WO1997012337A1 - Safe and low cost computer peripherals with force feedback for consumer applications - Google Patents

Safe and low cost computer peripherals with force feedback for consumer applications Download PDF

Info

Publication number
WO1997012337A1
WO1997012337A1 PCT/US1996/015340 US9615340W WO9712337A1 WO 1997012337 A1 WO1997012337 A1 WO 1997012337A1 US 9615340 W US9615340 W US 9615340W WO 9712337 A1 WO9712337 A1 WO 9712337A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
force
host computer
user
actuator
Prior art date
Application number
PCT/US1996/015340
Other languages
French (fr)
Other versions
WO1997012337B1 (en
Inventor
Louis B. Rosenberg
Adam C. Braun
Bruce M. Schena
Original Assignee
Immersion Human Interface Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/534,791 external-priority patent/US5739811A/en
Application filed by Immersion Human Interface Corporation filed Critical Immersion Human Interface Corporation
Priority to CA002233206A priority Critical patent/CA2233206C/en
Priority to EP96933888A priority patent/EP0852770B1/en
Priority to DE69607189T priority patent/DE69607189T2/en
Publication of WO1997012337A1 publication Critical patent/WO1997012337A1/en
Publication of WO1997012337B1 publication Critical patent/WO1997012337B1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/23Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/23Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • A63F13/235Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/28Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285Generating tactile feedback signals via the game input device, e.g. force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/803Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05GCONTROL DEVICES OR SYSTEMS INSOFAR AS CHARACTERISED BY MECHANICAL FEATURES ONLY
    • G05G9/00Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously
    • G05G9/02Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only
    • G05G9/04Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously
    • G05G9/047Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/266Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383Signal control means within the pointing device
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55Controlling game characters or game objects based on the game progress
    • A63F13/57Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1025Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1025Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
    • A63F2300/1031Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection using a wireless connection, e.g. Bluetooth, infrared connections
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/64Methods for processing data by generating or executing the game program for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8017Driving on land or water; Flying
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05GCONTROL DEVICES OR SYSTEMS INSOFAR AS CHARACTERISED BY MECHANICAL FEATURES ONLY
    • G05G9/00Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously
    • G05G9/02Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only
    • G05G9/04Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously
    • G05G9/047Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks
    • G05G2009/04766Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks providing feel, e.g. indexing means, means to create counterforce
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05GCONTROL DEVICES OR SYSTEMS INSOFAR AS CHARACTERISED BY MECHANICAL FEATURES ONLY
    • G05G9/00Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously
    • G05G9/02Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only
    • G05G9/04Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously
    • G05G9/047Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks
    • G05G2009/04777Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks with additional push or pull action on the handle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/014Force feedback applied to GUI
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/015Force feedback applied to a joystick
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H3/00Mechanisms for operating contacts
    • H01H2003/008Mechanisms for operating contacts with a haptic or a tactile feedback controlled by electrical means, e.g. a motor or magnetofriction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the present invention relates generally to interface devices between humans and computers, and more particularly to computer interface devices that provide force feedback to the user.
  • Computer systems are used extensively in many different industries to implement computer controlled simulations, games, and other application programs. More particularly, these types of games and simulations are very popular with the mass market of home consumers.
  • a computer system typically displays a visual environment to a user on a display screen or other visual output device. Users can interact with the displayed environment to play a game, experience a simulation or "virtual reality” environment, or otherwise influence events or images depicted on the screen. Such user interaction can be implemented through the use of a human- computer interface device, such as a joystick, "joypad” button controller, mouse, trackball, stylus and tablet, foot or hand pedals, or the like, that is connected to the computer system controlling the displayed environment.
  • the computer updates the game or simulation in response to the user's manipulation of a moved object such as a joystick handle or mouse, and provides feedback to the user utilizing the display screen and, typically, audio speakers.
  • haptic (e.g., tactile) feedback is also provided to the user, more generally known as "force feedback.”
  • force feedback e.g., tactile
  • These types of interface devices can provide physical sensations to the user manipulating the physical object of the interface device.
  • motors or other actuators are coupled to the interface object and are connected to the controlling computer system.
  • the computer system receives sensor signals from the interface device and sends appropriate force feedback control signals to the actuators of the interface device in conjunction with simulation/game events.
  • the actuators then provide forces on the interface object.
  • the computer system can thus convey physical sensations to the user in conjunction with other visual and auditory feedback as the user is grasping or contacting the object of the interface device.
  • Force feedback interface devices can provide a whole new modality for human-computer interaction.
  • Force feedback input output (I/O) devices of the prior art have concentrated on providing maximum haptic fidelity, i.e., the realism of the haptic feedback was desired to be optimized. This is because most of the force feedback devices have been targeted at the specific needs of highly industrial or scientific applications, and not a mass consumer market. To attain such realism, design concerns useful the mass market such as low size and weight, low complexity, programming compatibility, low cost, and safety have been sacrificed in the prior art. As a result, typical force feedback interface devices include complex robotic mechanisms which require precise, bulky, and expensive components that have significant power requirements and are difficult to program for applications.
  • FIGURE 1 illustrates a block diagram of a control system 2 having a typical host controlled loop.
  • a user manipulated object 3 such as a joystick or similar object, is moved by a user to interface with a host computer 4 with a display device 5.
  • Sensors 6 detect the position of the user object in provided degrees of freedom and may also include buttons or other controls that detect user actions such as the press of a button.
  • the sensor data including positional and button data is sent to host computer 4 over a bi-directional communication bus 7 that is typically connected to an interface card plugged into the host computer.
  • host computer 4 sends force commands over bus 7 to actuators 8, and the actuators output forces on the object 3 to the user.
  • the functions of reading sensor data and outputting force values to actuators 7 can be a burden on the host processor which detracts from the performance of the host in other host tasks and application execution.
  • a force feedback interface device An important concern for a force feedback interface device is communication bandwidth between the controlling computer and the interface device.
  • the complex devices of the prior art typically use high speed communication electronics that allow the controlling computer to quickly send and update force feedback signals to the interface device. The more quickly the controlling computer can send and receive signals to and from the interface device, the more accurately and realistically the desired forces can be applied on the interface object.
  • force feedback can be accurately coordinated with other supplied feedback, such as images on the video screen, and with user inputs such as movement of the object, activated buttons, etc.
  • Realistic and accurate force feedback thus becomes difficult to provide by a controlling computer system to a prior art interface device connected through such a serial interface in comparison with other interfaces such as a direct interface card (e.g., ISA or PCI card) connecting to the data bus of the host computer.
  • a direct interface card e.g., ISA or PCI card
  • the force feedback devices of the prior art typically include a safety or "deadman" switch which the user must activate to allow forces to be applied to the user manipulable object. If the user does not close the switch, no forces can be output.
  • the safety switches of the prior art are typically a button or a pedal which the user must continually press or hold down to allow power to be received by the actuators.
  • Such safety switches can be cumbersome and/or tiring for the user to close, since the user must constantly maintain a particular grip or position to feel forces.
  • these types of safety switches are easy to defeat by users; for example, an elastic band can be wrapped around a safety button to keep the button depressed, which defeats the entire safety purpose of the safety switch.
  • mass market force feedback interface devices must necessarily be low cost devices that are simple to manufacture so that the device is competitively priced in the high volume, aggressive home computer and home video game markets.
  • the present invention is directed to implementations of a human/computer interface device for controlling and providing force feedback to a user.
  • Several implementations are provided to decrease the cost in manufacturing an interface device and making the device safe for the high volume consumer market of computer and video game users.
  • an interface apparatus and method of the present invention for interfacing motion of a user manipulable object with a host computer includes a user object, such as a joystick, physically contacted by a user and having at least one degree of freedom of movement.
  • a device microprocessor local to the interface apparatus and separate from the host computer is coupled to the host by a first interface buses.
  • the microprocessor receives host commands from the host computer on the first interface bus.
  • An actuator applies a force along said degree of freedom to the user object in response to microprocessor force commands produced by the device microprocessor.
  • the sensor signals are received by the host computer on a second interface bus separate from the first interface bus.
  • the host computer updates a host application process, such as a simulation or video game, in response to the sensor signals.
  • the first interface bus is an RS-232 interface bus or similar serial standard.
  • the second interface bus is preferably a standard game port interface bus coupled to a game port of the host computer or the equivalent. Force feedback commands are sent by the host over the serial interface bus and the sensor signals are received by the host in the traditional way via the game port.
  • the interface device can thus be used as a standard joystick without force feedback by utilizing only the game port interface in communication with the host computer, and allows backward compatibility for non-force-feedback functionality via standard game port drivers.
  • the device microprocessor receives the sensor signals to compute force values to output to the actuators.
  • a second sensor can be used to detect the position of the joystick independently of the host sensor and output sensor signals to the microprocessor.
  • the local microprocessor receives high-level host commands and can implement independent force routines that receive sensor signals and compute forces.
  • the force routines can be stored in memory local to the interface apparatus.
  • a button device is coupled to the interface apparatus that provides a button input signal to the microprocessor when the user presses the button.
  • the microprocessor provides the button input signal to the host computer over the game port interface bus.
  • the microprocessor preferably deactivates the actuator when at least one of the multiple interface buses is disconnected from the host computer or disconnected from the interface apparatus.
  • the interface device includes an actuator that applies a force on the user object.
  • a user-selectable control such as a button provided on the joystick, sends an activation signal to the actuator when the user activates the button and thereby instructs the actuator to apply the force on said user object in a reflex process independent of the host computer.
  • This force for example, can be a recoil or jolt that is output whenever the user selects the button.
  • the actuator applies the force on the joystick only when the user activates the button.
  • the host computer is coupled to the actuator by a second interface and transmits an enable signal to the joystick.
  • the actuator applies the force only when the user activates the button and when the enable signal is provided.
  • the host computer may additionally send a simple activation signal to the actuator to command the actuator to apply the force to the user object regardless of whether the button is pressed by the user.
  • the host can control the actuator using only a very small amount of information, and can use a parallel interface or a serial port used as a parallel interface.
  • a user enable switch on said interface device can, when selected or deselected by the user, enable or disable the recoil reflex process.
  • the host computer can send a greater amount of control signals and/or other information to the actuators than in other recoil embodiments of the interface device by providing the control signals serially.
  • One or more shift registers covert the serial data to parallel information that is provided to programmable logic.
  • the logic sends the control signals, such as enable and activation signals, to the actuator and other components as necessary.
  • a sensor outputs sensor signals to the host computer via a second interface bus as described above.
  • a force feedback interface device of the present invention for safe use by a user includes a sensor for sensing a joystick's position and an actuator for applying a force to the joystick.
  • a safety switch is coupled to the joystick for disabling the actuator when the user is not using the interface device.
  • One safety switch of the present invention enables the actuator when an amount of weight over a predetermined amount is placed on the joystick, such as the amount of weight created by a user grasping the joystick.
  • the joystick includes a handle portion translatably coupled to a base portion.
  • the safety switch includes a contact on the handle portion and a contact on the base portion such that when the predetermined amount of weight is applied to the joystick, the contacts engage to allow electrical current to flow.
  • a spring member forces the portions apart from each other when less than the predetermined amount of weight is applied to the joystick.
  • a different touch plate safety switch feature similarly allows the actuators to be powered only when the user is touching the provided touch plates.
  • a separate break-away joystick safety feature can also be included which comprises a safety break handle that breaks off from the interface apparatus when a force over a predetermined threshold is applied to the joystick. The safety break-away handle can be attached to the interface apparatus, for example, by magnets.
  • a circuit of the present invention for storing power in a force feedback interface device that interfaces a user with a host computer system includes a capacitor for storing power provided by a signal input to the circuit.
  • a sensing device coupled to the capacitor senses when the capacitor is fully charged by monitoring the input signal to determine when the capacitor is fully charged.
  • a control device provides a control signal to a driver and actuator so that the actuator can apply force to a user object of the interface device.
  • the stored power from the capacitor is supplied to the actuator when applying the force.
  • a current limiter limits the current of the input signal and provides the limited current to the capacitor.
  • the input voltage signal can be received from a game port interface bus coupled to the host computer system or from a power supply included in the interface device.
  • the interface apparatus of the present invention includes several low cost components that are suitable for providing accurate force feedback for the high volume home consumer market and similar markets.
  • the use of the parallel combination of a serial bus and a game port bus, coupled to two ports of the host computer system, allows one bus to be used to send signals to the host and the other bus to receive force commands from the host, thus providing a very low cost system having realistic force feedback.
  • the local device microprocessor processes commands independently of the host computer, thus saving significant processing time on the host computer.
  • Other low cost embodiments require no or minimal force commands from the host, allowing simple force feedback to be provided to users.
  • the power circuit of the present invention allows smaller power supplies to be used or eliminates the need for a power supply.
  • the safety features of the present invention herein also are important when supplying force feedback devices to the home consumer market.
  • the hand-weighted safety switch allows a user to conveniently operate the interface device and provides necessary safety shut-down features.
  • the communication line safety feature allows the actuators to be deactivated in the event of a disconnection between interface device and host computer.
  • Figure 1 is a block diagram of a prior art control system for a force feedback interface device
  • FIG. 2 is a block diagram of a control system in accordance with the present invention for controlling a force feedback interface device from a host computer;
  • Figures 3 and 3a-b are schematic diagrams of a low-cost embodiment of the force feedback interface device of Figure 2;
  • FIGs 4a-4f are block diagrams of an altemative low-cost "recoil" embodiments of the interface device of Figure 2;
  • FIGS 5 and 5a-c are schematic diagrams of an alternative low-cost embodiment of the interface device of Figure 2 having no local microprocessor;
  • Figure 6 is a block diagram of a power circuit of the present invention for use with a force feedback interface device
  • Figure 7 is a flow diagram illustrating an embodiment of a method of the present invention for controlling a force feedback interface device
  • Figure 8 is a schematic diagram of a five bar linkage mechanism for providing multiple degrees of freedom to the user object of the interface device
  • Figure 9 is a schematic diagram of a circuit for a touch plate safety switch of the present invention.
  • Figure 9a is a perspective view of an example of a joystick including the touch plate safety switch of Figure 9;
  • Figure 10 is a diagrammatic illustration of a hand weight safety switch of the present invention.
  • Figure 1 1 is a diagrammatic illustration of a break away joystick safety feature of the present invention.
  • FIGS 1 la-1 Id are diagrammatic illustrations of the operation of the joystick of Figure 9.
  • FIGURE 2 is a block diagram illustrating a generic control system 10 of the present invention for a force feedback interface device controlled by a host computer system.
  • Control system 10 includes a host computer system 12 and an interface device 14 (or "force feedback peripheral").
  • Host computer system 12 is preferably a personal computer, such as an IBM- compatible or Macintosh personal computer, or a workstation, such as a SUN or Silicon Graphics workstation.
  • the host computer system can a personal computer which operates under the MS-DOS or Windows operating systems in conformance with an IBM PC AT standard.
  • host computer system 12 can be one of a variety of home video game systems commonly connected to a television set, such as systems available from Nintendo, Sega, or Sony.
  • home computer system 12 can be a more application specific "set top box” or "internet computer” which can be used, for example, to provide interactive television or information functions to users.
  • host computer system 12 implements a host application program with which a user 22 is interacting via peripherals and interface device 14.
  • the host application program can be a video game, medical simulation, scientific analysis program, or even an operating system or other application program that utilizes force feedback.
  • the host application provides images to be displayed on a display output device, as described below, and/or other feedback, such as auditory signals.
  • Host computer system 12 preferably includes a host microprocessor 16, random access memory (RAM) 17, read-only memory (ROM) 19, input/output (I/O) electronics 21, a clock 18, a display screen 20, and an audio output device 21.
  • Host microprocessor 16 can include a variety of available microprocessors from Intel, Motorola, Advanced Micro Devices, or other manufacturers. Microprocessor 16 can be single microprocessor chip, or can include multiple primary and/or co-processors. Microprocessor preferably retrieves and stores instructions and other necessary data from RAM 17 and ROM 19, as is well known to those skilled in the art.
  • host computer system 12 can receive sensor data or a sensor signal via a bus 24 from sensors of interface device 14 and other information.
  • Host microprocessor 16 can receive or transmit data on bus 24 using I/O electronics 21, and can use I/O electronics to control other peripheral devices.
  • Host computer system 12 can also output a "force command" to interface device 14 via bus 24 to cause force feedback by the interface device.
  • Clock 18 is a standard clock crystal or equivalent component used by host computer system 12 to provide timing to electrical signals used by microprocessor 16 and other components of the computer system. Clock 18 is accessed by host computer system 12 in the control process of the present invention, as described subsequently.
  • Display screen 20 is coupled to host microprocessor 16 by suitable display drivers and can be used to display images generated by host computer system 12 or other computer systems.
  • Display screen 20 can be a standard display screen or CRT, 3-D goggles, or any other visual interface.
  • display screen 20 displays images of a simulation or game environment. In other embodiments, other images can be displayed. For example, images describing a point of view from a first-person perspective can be displayed, as in a virtual reality simulation or game. Or, images describing a third-person perspective of objects, backgrounds, etc. can be displayed.
  • a user 22 of the host computer 12 and interface device 14 can receive visual feedback by viewing display screen 20.
  • computer 12 may be referred as displaying computer "objects” or "entities.”
  • objects are not physical objects, but are logical software unit collections of data and/or procedures that may be displayed as images by computer 12 on display screen 20, as is well known to those skilled in the art.
  • a cursor or a third-person view of a car might be considered player-controlled computer objects that can be moved across the screen.
  • a displayed, simulated cockpit of an aircraft might also be considered an "object", or the simulated aircraft can be considered a computer controlled "entity.”
  • Audio output device 21, such as speakers, is preferably coupled to host microprocessor 16 via amplifiers, filters, and other circuitry well known to those skilled in the art.
  • Host processor 16 outputs signals to speakers 21 to provide sound output to user 22 when an "audio event" occurs during the implementation of the host application program.
  • Other types of peripherals can also be coupled to host processor 16, such as storage devices (hard disk drive, CD ROM drive, floppy disk drive, etc.), printers, and other input and output devices.
  • Bus 24 sends signals in one or both directions between host computer system 12 and the interface device.
  • bus is intended to generically refer to any interface, connection, or communication link such as between host computer 12 and a peripheral such as interface device 14 which typically includes one or more connecting wires, lines, cables, or other connections and that can be implemented in a variety of ways.
  • bus 24 is a serial interface bus providing data according to a serial communication protocol.
  • An interface port of host computer system 12, such as an RS-232 serial interface port connects bus 24 to host computer system 12.
  • serial interface and bus 24 can also be used for the serial interface and bus 24, such as RS-422, Universal Serial Bus (USB), MIDI, system-specific ports on a Sega, Sony, etc. game system, or other protocols or standards well known to those skilled in the art.
  • USB Universal Serial Bus
  • MIDI system-specific ports on a Sega, Sony, etc. game system
  • the USB standard provides a relatively high speed serial interface that can provide force feedback signals in the present invention with a high degree of realism. USB can also source more power to drive peripheral devices. Since each device that accesses the USB is assigned a unique USB address by the host computer, this allows multiple devices to share the same bus.
  • the USB standard includes timing data that is encoded along with differential data. The USB has several useful features for the present invention, as described throughout this specification.
  • An advantage of the present invention is that low-bandwidth serial communication signals can be used to interface with interface device 14, thus allowing a standard built-in serial interface of many computers to be used directly.
  • a parallel port of host computer system 12 can be coupled to a parallel bus 24 and communicate with interface device using a parallel protocol, such as SCSI or PC Parallel Printer Bus.
  • bus 24 can be connected directly to a data bus of host computer system 12 using, for example, a plug-in interface card and slot or other access of computer system 12.
  • the interface card can be implemented as an ISA, EISA, VESA local bus, PCI, or other well-known standard interface card which plugs into the motherboard of the computer and provides input and output ports for connecting the main data bus of the computer to bus 24.
  • an additional bus 25 can be included to communicate between host computer system 12 and interface device 14. Since the speed requirement for communication signals is relatively high for outputting force feedback signals, the single serial interface used with bus 24 may not provide signals to and from the interface device at a high enough rate to achieve realistic force feedback.
  • bus 24 can be coupled to the standard serial port of host computer 12, while an additional bus 25 can be coupled to a second port of the host computer system.
  • many computer systems include a "game port" in addition to a serial RS-232 port to connect a joystick or similar game controller to the computer.
  • the two buses 24 and 25 can be used simultaneously to provide an increased data bandwidth.
  • microprocessor 26 can send sensor signals to host computer 12 via a game port bus 25, while host computer 12 can output force feedback signals from a serial port to microprocessor 26 via a uni-directional bus 24.
  • game port bus 25 can be directly connected from the sensors 28 (shown as bus 25a) or from the sensor interface 36 (shown as bus 25b) to the game port of the host computer 12 in some embodiments (as in Figure 3).
  • Another important feature that is desirable in the force feedback control system 10 is a communication line between the host computer 12 and the interface device 14 that incorporates user safety. Since forces are being generated on user object 34 by actuators 30 (as explained below), the interface device can potentially present some danger to a user if the buses 24 and/or 25 become disconnected during operation. Once the control of the force feedback from the host computer is disabled, the forces generated can become unpredictable. Thus, it is desirable for the actuators 30 to become deactivated if buses 24 and/or 25 are disconnected during operation. In the present invention, this feature can be implemented by designating one of the lines of bus 24 and/or one of the lines of bus 25 as a "life line.” The microprocessor periodically reads the life line signals to check if the buses are still connected.
  • the microprocessor will not detect the signal and will consider the state to be "disconnected.” If no signal is detected, then the microprocessor automatically sends a deactivation signal to the actuators. Likewise, in some embodiments, the host computer can periodically check a life line signal output from the microprocessor on one of the buses 24 or 25. If no such signal is detected, the host computer can output a deactivate actuators command on the other bus 24 or 25 (if still connected). In embodiments having no microprocessor 26 (see below), the life line can be coupled to a safety switch 41. For an RS-232, RS-422, or game port interface, one of the control lines in the interface bus can be used as the life line. When using a USB interface, the "Attach-Detach" feature inherent to the USB standard can conveniently be used for the life line.
  • bus 24 and bus 25 can be provided as either a uni-directional bus or a bi-directional bus. In the embodiment having both buses 24 and 25, they can both be uni ⁇ directional buses, which have several advantages for the described embodiments. This allows the full bandwidth of each bus to be used for one direction of data transfer, causing data communication rates to double compared to normal bi-directional use of each bus. Also, the communication protocol for each bus can be simplified in uni-directional operation. In addition, uni-directional driver software on the host computer can be simpler and require less processor time than software for bi-directional communication.
  • signals traveling between the host computer system 12 and the interface device 14 can be sent and received using wireless transmission.
  • an antenna can be included in both interface device 14 and in host computer 12 to send and receive electromagnetic signals, such as radio signals, infrared signals, or microwave signals.
  • a "bus" 24 or 25 can conceptually include a medium or channel of transmission reception, such as the air.
  • Interface device 14 is a peripheral for host 12 that includes a local microprocessor 26, sensors 28, actuators 30, a user object 34, optional sensor interface 36, an optional actuator interface 38, and other optional input devices 39.
  • Interface device 14 may also include additional electronic components for communicating via standard protocols on bus 24.
  • a separate Universal Asynchronous Receiver/Transmitter (UART) or level shifter might be included to receive/convert signals on bus 24; or, such components can be included on microprocessor 26.
  • UART Universal Asynchronous Receiver/Transmitter
  • the embodiment of Figure 2 provides a control loop between microprocessor 26, actuators 30, user object 34, and sensors 28 (which are connected back to microprocessor 26).
  • the host computer 12 is not included in the control loop, thus freeing the host of many routine tasks and allowing it to allocate host processor time to other tasks.
  • the microprocessor 26 can receive high level commands from the host and handle the routine tasks of the control loop in reflex processes, as discussed below.
  • multiple interface devices 14 can be coupled to a single host computer system 12 through bus 24 (or multiple buses 24) so that multiple users can simultaneously interface with the host application program (in a multi-player game or simulation, for example).
  • multiple players can interact in the host application program with multiple interface devices 14 using networked host computers 12, as is well known to those skilled in the art.
  • Local microprocessor 26 (or “device microprocessor”) is coupled to bus 24 and is preferably included within the housing of interface device 14 to allow quick communication with other components of the interface device.
  • Processor 26 is considered “local” to interface device 14, and is a separate microprocessor from any microprocessors in host computer system 12. For example, the local processor 26 does not share a data bus, address bus, and/or memory with the host processor(s) 16.
  • “Local” also preferably refers to processor 26 being dedicated to force feedback and sensor I/O of interface device 14, and being closely coupled to sensors 28 and actuators 30, such as within the housing for interface device or in a housing coupled closely to interface device 14.
  • Microprocessor 26 is provided with software instructions to instruct the processor to wait for commands or requests from computer host 16, decode and/or parse the commands or requests, manipulate data and select routines, and handle/control input and output signals according to the commands or requests.
  • processor 26 preferably operates independently of host computer 16 by reading sensor signals and calculating appropriate forces from those sensor signals, time signals, and a "force routine" selected in accordance with a host command, as described with reference to Figure 7.
  • Suitable microprocessors for use as local microprocessor 26 include the MC68HC71 1E9 by Motorola and the PIC16C74 by Microchip, for example; other well-known types of microprocessors can also be used.
  • Microprocessor 26 can include one microprocessor chip, or multiple processors and/or co-processor chips.
  • microprocessor 26 can includes a digital signal processor (DSP) chip.
  • DSP digital signal processor
  • Local memory 27 such as RAM and/or ROM (EPROM, EEPROM, etc.), is preferably coupled to microprocessor 26 in interface device 14 to store instructions for microprocessor 26 and store temporary and other data.
  • Microprocessor 26 can receive signals from sensors 28 and provide signals to actuators 30 of the interface device 14 in accordance with instructions provided by host computer 12 over bus 24.
  • a local clock 29 can be coupled to the microprocessor 26 to provide timing data, similar to system clock 18 of host computer 12; the timing data might be required, for example, to compute forces output by actuators 30 (e.g., forces dependent on calculated velocities or other time dependent factors).
  • timing data for microprocessor 26 can be retrieved from the USB signal.
  • the USB has a clock signal encoded with the data stream which can be used.
  • the Isochronous (stream) mode of USB can be used to derive timing information from the standard data transfer rate.
  • the USB also has a Sample Clock, Bus Clock, and Service Clock that also may be used.
  • host computer system 12 provides high level supervisory commands to microprocessor 26 over bus 24, and microprocessor 26 manages low level force control ("reflex") loops to sensors 28 and actuators 30 in accordance with force routines selected by the high level commands.
  • host computer 12 can provide low-level force commands over bus 24, which microprocessor 26 directly transfers to actuators 30.
  • Microprocessor 26 preferably also has access to an electrically erasable programmable ROM (EEPROM) or other memory storage device 27 for storing calibration parameters.
  • the calibration parameters can compensate for slight manufacturing variations in different physical properties of the components of different interface devices made from the same manufacturing process, such as physical dimensions.
  • the calibration parameters can be determined and stored by the manufacturer before the interface device 14 is sold, or optionally, the parameters can be determined by a user of the interface device.
  • the calibration parameters are used by processor 26 to modify the input sensor signals and/or output force values to actuators 30 to provide approximately the same range of forces on object 34 in a large number of manufactured interface devices 14.
  • the implementation of calibration parameters is well-known to those skilled in the art.
  • Microprocessor 26 can also receive commands from any other input devices included on interface apparatus 14 and provides appropriate signals to host computer 12 to indicate that the input information has been received and can send any information included in the input information.
  • buttons, switches, dials, or other input controls on interface device 14 or user object 34 can provide signals to microprocessor 26.
  • Input information might be directly sent to the host computer from the microprocessor, or it may be processed or combined with other data that is sent to the host.
  • sensors 28, actuators 30, and microprocessor 26, and other related electronic components are included in a housing for interface device 14, to which user object 34 is directly or indirectly coupled.
  • microprocessor 26 and or other electronic components of interface device 14 can be provided in a separate housing from user object 34, sensors 28, and actuators 30.
  • additional mechanical structures may be included in interface device 14 to provide object 34 with desired degrees of freedom. An example of such a mechanism is described with reference to Figure 8.
  • Sensors 28 sense the position, motion, and or other characteristics of a user object 34 of the interface device 14 along one or more degrees of freedom and provide signals to microprocessor 26 including information representative of those characteristics.
  • An example of an embodiment of a user object and movement within provided degrees of freedom is described subsequently with respect to Figure 8.
  • a sensor 28 is provided for each degree of freedom along which object 34 can be moved.
  • a single compound sensor can be used to sense position or movement in multiple degrees of freedom.
  • sensors suitable for several embodiments described herein are digital optical encoders, which sense the change in position of an object about a rotational axis and provide digital signals indicative of the change in position.
  • the encoder responds to a shaft's rotation by producing two phase-related signals in the rotary degree of freedom.
  • Linear optical encoders similarly sense the change in position of object 34 along a linear degree of freedom, and can produces the two phase- related signals in response to movement of a linear shaft in the linear degree of freedom.
  • Either relative or absolute sensors can be used.
  • relative sensors only provide relative angle information, and thus usually require some form of calibration step which provide a reference position for the relative angle information.
  • the sensors described herein are primarily relative sensors. In consequence, there is an implied calibration step after system power-up wherein a sensor's shaft is placed in a known position within interface device and a calibration signal is provided to the system to provide the reference position mentioned above.
  • Sensors 28 provide an electrical signal to an optional sensor interface 36, which can be used to convert sensor signals to signals that can be inte ⁇ reted by the microprocessor 26 and/or host computer system 12.
  • sensor interface 36 receives the two phase-related signals from a sensor 28 and converts the two signals into another pair of clock signals, which drive a bi ⁇ directional binary counter.
  • the output of the binary counter is received by microprocessor 26 as a binary number representing the angular position of the encoded shaft.
  • Such circuits, or equivalent circuits are well known to those skilled in the art; for example, the Quadrature Chip LS7166 from Hewlett Packard, California performs the functions described above.
  • Each sensor 28 can be provided with its own sensor interface, or one sensor interface may handle data from multiple sensors.
  • microprocessor 26 can perform these interface functions without the need for a separate sensor interface 36.
  • the position value signals can be used by microprocessor 26 and are also sent to host computer system 12 which updates the host application program and sends force control signals as appropriate. For example, if the user moves a steering wheel object 34, the computer system 12 receives position and/or other signals indicating this movement and can move a displayed point of view of the user as if looking out a vehicle and turning the vehicle.
  • Other interface mechanisms can also be used to provide an appropriate signal to host computer system 12.
  • sensor signals from sensors 28 can be provided directly to host computer system 12, bypassing microprocessor 26.
  • sensor interface 36 can be included within host computer system 12, such as on an interface board or card.
  • an analog sensor such as a potentiometer can be used instead of digital sensor for all or some of the sensors 28.
  • a strain gauge can be connected to measure forces on object 34 rather than positions of the object.
  • velocity sensors and/or accelerometers can be used to directly measure velocities and accelerations on object 34.
  • Analog sensors can provide an analog signal representative of the position/velocity/acceleration of the user object in a particular degree of freedom.
  • An analog to digital converter (ADC) can convert the analog signal to a digital signal that is received and inte ⁇ reted by microprocessor 26 and/or host computer system 12, as is well known to those skilled in the art. The resolution of the detected motion of object 34 would be limited by the resolution of the ADC.
  • interface circuitry 36 can also be used.
  • the interface allows the position of the mouse or stylus to be tracked and provides force feedback to the stylus using sensors and actuators.
  • Sensor interface 36 can include angle determining chips to pre-process angle signals reads from sensors 28 before sending them to the microprocessor 26.
  • a data bus plus chip-enable lines allow any of the angle determining chips to communicate with the microprocessor.
  • a configuration without angle-determining chips is most applicable in an embodiment having absolute sensors, which have output signals directly indicating the angles without any further processing, thereby requiring less computation for the microprocessor 26 and thus little if any pre-processing. If the sensors 28 are relative sensors, which indicate only the change in an angle and which require further processing for complete determination of the angle, then angle-determining chips are more appropriate.
  • Actuators 30 transmit forces to user object 34 of the interface device 14 in one or more directions along one or more degrees of freedom in response to signals received from microprocessor 26.
  • an actuator 30 is provided for each degree of freedom along which forces are desired to be transmitted.
  • Actuators 30 can include two types: active actuators and passive actuators.
  • Active actuators include linear current control motors, stepper motors, pneumatic/hydraulic active actuators, voice coils, and other types of actuators that transmit a force to move an object.
  • active actuators can drive a rotational shaft about an axis in a rotary degree of freedom, or drive a linear shaft along a linear degree of freedom.
  • Active transducers of the present invention are preferably bi-directional, meaning they can selectively transmit force along either direction of a degree of freedom.
  • DC servo motors can receive force control signals to control the direction and torque (force output) that is produced on a shaft.
  • the motors may also include brakes which allow the rotation of the shaft to be halted in a short span of time.
  • active motors can also be used, such as a stepper motor controlled with pulse width modulation of an applied voltage, pneumatic/hydraulic actuators, a torquer (motor with limited angular range), or a voice coil actuator, which are well known to those skilled in the art.
  • Passive actuators can also be used for actuators 30.
  • Magnetic particle brakes, friction brakes, or pneumatic hydraulic passive actuators can be used in addition to or instead of a motor to generate a damping resistance or friction in a degree of motion.
  • An altemate preferred embodiment only including passive actuators may not be as realistic as an embodiment including motors; however, the passive actuators are typically safer for a user since the user does not have to fight generated forces.
  • Passive actuators typically can only provide bi-directional resistance to a degree of motion.
  • a suitable magnetic particle brake for interface device 14 is available from Force Limited, Inc. of Santa Monica, California.
  • sensors 28 and actuators 30 can be included together as a sensor/actuator pair transducer.
  • a suitable transducer for the present invention including both an optical encoder and current controlled motor is a 20 W basket wound servo motor manufactured by Maxon.
  • Actuator interface 38 can be optionally connected between actuators 30 and microprocessor 26.
  • Interface 38 converts signals from microprocessor 26 into signals appropriate to drive actuators 30.
  • Interface 38 can include power amplifiers, switches, digital to analog controllers (DACs), and other components.
  • interface 38 circuitry can be provided within microprocessor 26 or in actuators 30.
  • Other input devices 39 can optionally be included in interface device 14 and send input signals to microprocessor 26.
  • Such input devices can include buttons, dials, switches, or other mechanisms.
  • user object 34 is a joystick
  • other input devices can include one or more buttons provided, for example, on the joystick handle or base and used to supplement the input from the user to a game or simulation. The operation of such input devices is well known to those skilled in the art.
  • Power supply 40 can optionally be coupled to actuator interface 38 and/or actuators 30 to provide electrical power. Active actuators typically require a separate power source to be driven. Power supply 40 can be included within the housing of interface device 14, or can be provided as a separate component, for example, connected by an electrical power cord.
  • interface device 14 can draw power from the bus 24 and/or 25 and thus have no need for power supply 40.
  • This embodiment is most applicable to a device 14 having passive actuators 30, since passive actuators require little power to operate.
  • passive actuators tend to require more power than can be drawn from USB, but this restriction can be overcome in a number of ways.
  • One way is to configure interface 14 to appear as more than one peripheral to host computer 12; for example, each provided degree of freedom of user object 34 can be configured as a different peripheral and receive its own allocation of power. This would allow host 12 to allocate more power to interface device 14.
  • power from the bus 24 and/or 25 can be stored and regulated by interface device 14 and thus used when needed to drive actuators 30.
  • power can be stored over time and then immediately dissipated to provide a jolt force to the user object 34.
  • a capacitor circuit for example, can store the energy and dissipate the energy when enough power has been stored.
  • Microprocessor may have to regulate the output of forces to assure that time is allowed for power to be stored.
  • This power storage embodiment can also be used in non-USB embodiments of interface device 14 to allow a smaller power supply 40 to be used.
  • a power storage circuit embodiment is described in greater detail with respect to Figure 6.
  • Safety switch 41 is preferably included in interface device to provide a mechanism to allow a user to override and deactivate actuators 30, or require a user to activate actuators 30, for safety reasons. Certain types of actuators, especially active actuators such as motors, can pose a safety issue for the user if the actuators unexpectedly move user object 34 against the user with a strong force. In addition, if a failure in the control system 10 occurs, the user may desire to quickly deactivate the actuators to avoid any injury. To provide this option, safety switch 41 is coupled to actuators 30. In the preferred embodiment, the user must continually activate or close safety switch 41 during operation of interface device 14 to activate the actuators 30.
  • safety switch is deactivated (opened), power from power supply 40 is cut to actuators 30 (or the actuators are otherwise deactivated) as long as the safety switch is open.
  • a preferred embodiment of safety switch is an optical switch located on user object 34 (such as a joystick) or on a convenient surface of a housing enclosing interface device 14. When the user covers the optical switch with a hand or finger, the sensor of the switch is blocked from sensing light, and the switch is closed. The actuators 30 thus will function as long as the user covers the switch.
  • Such an optical switch can comprise an ambient light detector, which simply senses when detected ambient light has been blocked by the user when the user covers the detector with a hand.
  • an emitter/detector pair can be provided in a small recess on the interface device 14.
  • the emitter emits a particular type of electromagnetic radiation, such as infrared light, out away from the interface device into exterior space.
  • the emitted radiation reflects from the user's hand or finger so that the detector detects the radiation and activates the motors.
  • optical switches are well known to those skilled in the art.
  • Other types of safety switches 41 can be provided in other embodiments.
  • an electrostatic contact switch can be used to sense contact with the user, a button or trigger can be pressed, or a different type of sensor or switch can be used. Further embodiments of safety switches of the present invention are described with reference to Figures 9 and 10.
  • a "safety ramping routine" which the microprocessor 26 implements when the safety switch 41 is opened and closed.
  • the microprocessor When the safety switch 41 is opened, the forces ou ⁇ ut by actuators 30 are dropped to zero instantly. However, when the safety-switch is then closed by the user, the output forces jump back up to the same magnitude that these forces were at before the safety switch was opened. This instant increase in the magnitude of forces creates a hazardous condition for the user.
  • the microprocessor preferably accesses a safety ramping routine in memory 27 that instructs the microprocessor to slowly ramp up the magnitude of the forces over a predefined time interval after the safety switch is closed. After the predefined time interval (e.g., 3 seconds), the forces are output at the full magnitude provided before the switch was opened.
  • User object 34 is preferably a device or article that may be grasped or otherwise contacted or controlled by a user and which is coupled to interface device 14.
  • grasp it is meant that users may releasably engage a grip portion of the object in some fashion, such as by hand, with their fingertips, or even orally in the case of handicapped persons.
  • the user 22 can manipulate and move the object along provided degrees of freedom to interface with the host application program the user is viewing on display screen 20.
  • Object 34 can be a joystick, mouse, trackball, stylus, steering wheel, hand/foot pedal, medical instrument (laparoscope, catheter, etc.), pool cue, hand grip, knob, button, or other article.
  • FIGURE 3 is a schematic diagram of an example of a specific embodiment 50 of the interface device 14.
  • Local microprocessor 26 in this example, is a PIC16C74 available from Microchip and having 14 address lines and 8 data lines.
  • This microprocessor includes an intemal architecture that splits memory into two partitions and allows fast program executions, and is thus well-suited for high speed force feedback processing.
  • This embodiment preferably includes local memory 27, such as ROM, as well as local clock 29 on board the microprocessor.
  • Interface device 50 is intended to communicate with host computer 12, as explained with reference to Figure 2, using both a serial interface such as an RS-232 interface as well as a second interface 25, which, in the described embodiment, a game port interface as typically found on an IBM-compatible personal computer (PC).
  • a serial interface such as an RS-232 interface
  • a second interface 25 which, in the described embodiment, a game port interface as typically found on an IBM-compatible personal computer (PC).
  • Sensors 28 are used to sense the position of user object 34 in provided degrees of freedom.
  • sensors 28 are potentiometers 52, each potentiometer being coupled to a shaft which rotates in a degree of freedom as the user object 34 is rotated.
  • Each potentiometer outputs an analog voltage signal ("sensor signal") in proportion to the position of the user object in the measured degree of freedom.
  • the potentiometers 52 are powered by a five-volt signal provided on a power line 53 of the game port interface (with reference to a ground line 53a of the game port interface, and where capacitors Cl and C2 are used for filtering the signal, as is well known to those skilled in the art).
  • the potentiometers output their sensor signals on the game port interface bus 25.
  • Each potentiometer can include a trimmer mechanism to allow reorientation with respect to the user object 34 and allows the user object to be recalibrated when in use, as is well known to those skilled in the art.
  • Analog potentiometers are used in this embodiment since the standard game port interface requires this type of sensor.
  • Other types of sensors, such as digital rotary encoders, can be used for sensors 28 in other embodiments using a different type of interface bus 25.
  • digital switches or contacts can be used in place of analog potentiometers 52.
  • some types of joysticks used by video game systems or computers are "digital joysticks" that provide digital signals corresponding to a position or direction of the joystick. Such digital signals do not typically describe a position of the joystick within a rotary or linear degree of freedom as do “analog joysticks”, but instead describe simple directions such as “up”, “left”, or “diagonal up-left”.
  • Contact switches for example, can be placed at four positions (up, down, left, right) around a joystick to detect eight possible directions
  • Such a digital joystick can be included to send digital representations of the joystick's direction to host computer 12, while actuators 30 can provide forces on the joystick in provided degrees of freedom.
  • the game port interface bus 25 is used to send sensor data describing the position of the user object 34 in provided degrees of freedom to the host computer.
  • the potentiometers 52 can detect the position of a joystick within the left/right degree of freedom and within the forward/back degree of freedom.
  • interface device 50 operates as a typical prior art joystick in reporting the position of the joystick directly to the host computer.
  • the host computer can then update a process such as a game in response to the received position information.
  • the interface device 50 can thus advantageously be used with any available software and hardware that is compatible with a standard joystick.
  • the sensor data is preferably sent directly to the host computer 12 over game port interface bus 25 without being sent to microprocessor 26. This is because the game port interface processes the analog signals into digital signals using the RC circuit, which prevents other components such as microprocessor 26 from also reading the potentiometer data.
  • the microprocessor may need sensor reading information to provide force commands to the actuators; in such an embodiment, a second set of sensors can be used, as described below.
  • the present embodiment also includes a second interface bus 24 coupled between the host computer 12 and interface device 50 which is preferably implemented as a serial RS-232, RS-442, or similar interface.
  • this interface bus is used exclusively for providing force feedback commands from the host computer to the interface device 50.
  • An RS- 232 level shifter 54 converts signals to the appropriate voltage levels for transmission and reception.
  • the host computer 12 sends serial commands out from its standard serial port on line RxD of the RS-232 interface.
  • Shifter 54 receives and converts these commands to the necessary logic level (e.g., 5 volts) and provides the commands to microprocessor 26.
  • Microprocessor controls motors 66 in response to the received commands.
  • the TxD line of the RS-232 interface of the level shifter need not be connected to the host.
  • the TxD line can be connected between interface device 50 and host computer 12 in some embodiments to provide interface device product information and other required information from the interface device to the host.
  • product information can include the serial number, version number of the device 50, version number of firmware of the microprocessor/local memory, release date of the firmware and/or device 50, model number, host commands that are compatible with device 50, the number of axes or degrees of freedom of user object 34 that are available and their description, the resolution of sensors or actuators, and/or copyright information.
  • This information can be stored in ROM or other memory 27 on the interface device 50.
  • status information and sensor data from sensors 28 can be provided on this TxD line if, for example, game port bus 25 becomes disconnected or unused.
  • the interface device 50 can thus be connected to any computer with a game port and can function as a non-force-feedback joystick with any software that is compatible with non-force-feedback joysticks. If software is available on host computer 12 to implement force feedback commands, the interface device 50 can also take advantage of that functionality.
  • the interface device is compatible with the presently available software applications and is compatible with new force feedback software as that software is introduced.
  • the present embodiment also preferably includes a communication line safety feature as described with reference to Figure 2.
  • a communication line safety feature As described with reference to Figure 2.
  • the microprocessor 26 To allow the microprocessor 26 to easily monitor the status of the connection of the serial bus 24, one of the lines of bus 24 is coupled to the microprocessor.
  • the DTR line 51 of the RS-232 interface is coupled (through level shifter 54) to a digital input (B6) of the microprocessor.
  • the PIC microprocessor of the described embodiment includes a universal asynchronous receiver/transmitter (UART) on the chip itself. The microprocessor checks for a logical low state on the DTR line to confirm that the serial bus 24 is connected.
  • UART universal asynchronous receiver/transmitter
  • the serial bus/cable When the DTR line carries a logical high state, the serial bus/cable is assumed to not be connected, and the microprocessor sends a disable signal to the motors 68 on line 60.
  • the host computer 12 can also control the state of the signal on the DTR line to disable the motors in like manner when desired.
  • a UART could be provided as a separate component.
  • the host computer can send a signal out to the microprocessor periodically and the microprocessor can check for this signal to ensure die connection of the bus is still intact.
  • the bus 25 is not checked in the described embodiment, but can be monitored in altemate embodiments.
  • serial interfaces can be implemented as serial interfaces to be used as buses 24 and/or 25.
  • video game consoles such as the Sega Saturn or the Sony PlayStation do not have a serial port or a game port as described above, but instead have a control port having a parallel interface.
  • a serial interface can be emulated by using the input and ou ⁇ ut lines of the parallel port.
  • the "up”, “down”, “left” and “right” control signal lines of the Sega Saturn can be used as lines which encode the sensor data (such as from a digital encoder or potentiometer) and button data and send that data to the host, and the ou ⁇ ut lines TH, TR, and TL from the Sega Saturn can be used to encode the host commands to the microprocessor 26, thus providing two way communication between host computer 12 and interface device.
  • a serial protocol can be used, where one output line (e.g., TH) is used in place of the TxD line described above.
  • Another line e.g., TR
  • the potentiometer data would be read by the microprocessor 26, processed, and sent to the host in such an embodiment.
  • the power and ground lines can be used from a video game console port similarly to power line 53 of an RS-232 interface.
  • Handle buttons 56 are included as other input devices 39 as shown in Figure 2.
  • the buttons 56 include switches and a 5-volt input from the game port interface, as is well known to those skilled in the art. Fourteen buttons are indicated as available in embodiment 50, but a different number of buttons or other types of switches, knobs, or controls can be included in other embodiments.
  • the button input signals are input to data ports D0-D7 of microprocessor 26 on bus 57.
  • Microprocessor 26 outputs the digital button signals on lines 55 of game port interface bus 25.
  • Thermistors 58 are coupled to the microprocessor 26 and sense the temperature of motors 68.
  • the thermistors convert a sensed temperature into an electrical signal as is well known to those skilled in the art.
  • thermistors such as RL2006- 1600-103 -Dl available from Keystone Thermometrics can be used.
  • the microprocessor 26 reads the temperature signals on buses 59 to determine if the motors are overheating.
  • the microprocessor can deactivate the motors using the EN signal 60 when an overheating condition is sensed (and can activate overtemp LED 62 to inform the user of the overheated condition).
  • Other types of temperature- sensing components can be used in other embodiments.
  • a temperature sensing integrated circuit can be used.
  • the temperature of the motors can be sensed or determined using other components or steps.
  • the voltage drop across the motor windings can be measured by an analog to digital converter (ADC) that, for example, can be included on the microprocessor 26.
  • ADC analog to digital converter
  • the voltage drop across the motor windings is typically a reliable indicator of the temperature of the windings material so that the temperature can be determined by the amount of the voltage drop.
  • a software estimation of the motor temperature can be performed by the microprocessor 26.
  • the microprocessor can keep a running average over time of the amount of current sent to the motors 68.
  • the thermal characteristics of the motors are provided to the microprocessor from memory or in software, and the software on the microprocessor can thus estimate the temperature of the motors at any desired time. This is a low cost solution for providing overheat protection since no extra hardware components are needed, but it may not be reliable in some situations due to variations in ambient air temperature and other factors that can change the thermal response of the motors 68 without the knowledge of the microprocessor.
  • Secondary potentiometers 62 are optional extra sensors included to provide sensor data to microprocessor 26 describing the position of the user object 34. As explained above, the standard game port interface requires that sensor data be directly sent to host computer 12 from potentiometers 52 and that microprocessor 26 cannot read the sensor signals.
  • Secondary potentiometers 62 can provide sensor data to the microprocessor independently of potentiometers 52 so that the microprocessor receives the needed data.
  • the secondary potentiometers can be analog potentiometers, rotary encoders, or other types of sensors similar to sensors 28. These potentiometers can be coupled to the same rotational shaft (not shown) as potentiometers 52, for example.
  • Microprocessor 26 receives the sensor signals from secondary potentiometers 62 on buses 63.
  • the 5 volt signal from line 53 of the game port interface is used to power handle buttons 56, LED's on device 50, potentiometers 52 and 62, and other logic components of the interface device 50.
  • the game port power line 53 is preferably used instead of a power signal from interface 24, since the game port interface is always used when the interface device 14 is connected, while the interface 24 may be disconnected for non-force-feedback uses of the interface device 50.
  • the other components, such as motors 68, are powered by the power supply partition, as explained below. In alternate embodiments, power lines from other interfaces can be used.
  • Power supply partition 64 is preferably a separate power section of interface device 50 that drives the actuators 30 of the interface device.
  • Power supply partition 64 includes actuators 30 and power circuit 66.
  • Actuators 30 preferably are two motors 68, such as 24 V motors available from Mabuchi, Japan in the described embodiment, where each motor is used to provide forces along one degree of freedom of the user object 34.
  • a joystick typically has two degrees of freedom, forward/back and left/right. If additional degrees of freedom are included in interface device 50, then additional motors can be added as appropriate.
  • Microprocessor 16 provides two signals to each motor: a direction (DIR) signal 70 and a pulse width modulation (PWM) signal
  • the direction signal instructs the motor 68 to provide force along one of the two directions within its degree of freedom.
  • the PWM signal controls the magnitude of the force by providing a signal having a constant frequency (e.g., 10 kHz) and a varying duty cycle. A high duty cycle provides high magnitude forces, and vice versa.
  • the DIR and PWM signals from microprocessor 26 are input to driver amplifiers 74 which can be considered as part of actuator interface 38. Amplifiers 74 have 24-volt inputs from a 24-volt power supply 40 and provide the control signals from microprocessor to drive motors 68 at the proper high current level.
  • Microprocessor outputs an enable signal on line 60 which permits the motors 68 to be activated and to output forces on user object 34.
  • a safety or "deadman" switch 41 is also included in embodiment 50 to allow the user to control when the motors can ou ⁇ ut forces. Switch 41 , as described with reference to Figure 2, must be closed by the user in order for the motors 68 to be activated.
  • a 5-volt signal from the game port interface is input on line 78 to an NOR gate 70 when the safety switch 41 is open. When the safety switch is closed, the 5-volt signal runs to ground, and a low enable signal is provided to NOR gate 70.
  • the ou ⁇ ut of the NOR gate is provided to driver amplifiers 74 as an enable input.
  • Safety switch 41 can be a device as described with reference to Figure 2, or can be a safety switch of the present invention described with reference to Figures 9 and 10.
  • "Active" LED 76 is illuminated when the motors are activated so that the user knows when the motors are exerting force.
  • Power circuit 66 is also preferably included in power supply partition 60 and is used to convert the 24 volt output from power supply 40 to a 5-volt signal used in various components of power supply partition 64, such as the driver amplifiers 74.
  • the power supply 40 is preferably connected to a standard AC wall socket.
  • the power supply partition 60 allows the force feedback portion of interface device 50 to be separated and used independently from the other components in the device. Thus, if interface device 50 is being used as a standard joystick and is only connected to the game port interface of host computer 12, then the 5-volt signal from the game port is used while the power supply partition is unused and the 12- volt power supply 40 need not be plugged into an AC wall socket. The 12- volt power supply 40 is plugged into a wall socket if force feedback is to be implemented on device 50.
  • microprocessor 26 need not be included and can be replaced by hard-wired logic.
  • the motors 68 can be controlled directly by host computer 12 using low or high level commands as described below with reference to Figure 7.
  • game port interface bus 25 sends only sensor signals to the host computer, and the serial interface bus 24 only sends host commands to the interface device.
  • the host computer can calculate force values and send the low level commands to the interface device.
  • a level shifter and shift register for example, can be used to read in the serial commands and provide the commands to logic provided on a field programmable gate array
  • the interface device 50 (or other interface device embodiments disclosed herein) can be made expandable to be controlled in other ways.
  • the interface device 50 can be provided with a separate "access port" which is connected to both sensors 28 and actuators 30.
  • a parallel bus can be connected between the access port and the host computer (e.g., an interface card can be plugged into the host) so that the host directly receives sensors signals and so that host commands are directly provided to the actuators 30 or the actuator interface 38.
  • the user can select a switch on the interface device to switch the communication lines from normal microprocessor control to direct host control through the access port (the microprocessor can be disabled when using direct host control). This would allow the host to provide realistic, direct force feedback to the user, but would put a greater processing burden on the host.
  • FIGURE 4a is a block diagram of an altemate "recoil" embodiment 80 of the force feedback control system 10 of Figure 2.
  • recoil control system 80 a local device microprocessor 26 is not necessary to provide force feedback and the host computer sends no signals, or only minimal signals, to the interface device 14.
  • the recoil embodiment is thus a "reflex" interface device, in that forces are ou ⁇ ut on user object 34 independently of host computer 12, and these forces depend only on local control events (e.g. a press of a button by the user).
  • the reflex process includes outputting a force when a button is pressed with no communication from the host.
  • the position of user object 34 is sensed by sensors 28, and the sensors send position or other related signals to the host computer 12.
  • the control loop includes buttons or other input devices 39, which sense actions of the user such as when the user pushes one of the buttons.
  • the buttons 39 provide input signals to a recoil reflex control block 82, which is "hard wired" logic or other components instead of a microprocessor.
  • the control block 82 sends activation signals to motor (or other type of actuator) 30, which ou ⁇ uts forces on user object 34 to complete the loop.
  • the host computer 12 can additionally provide simple enable signals on line 81 to the control block 82 or activation signals on line 83 to actuator 30 to provide more realistic force feedback.
  • FIGURE 4b is a schematic diagram of a first "recoil" embodiment 80 of Figure 4a.
  • Interface device 80 includes a joystick 84 or similar user object 34 that is coupled to (or otherwise sensed by) sensors 28. Sensors 28 provide signals indicating the position of the joystick in the provided degrees of freedom.
  • the sensors 28 preferably are analog potentiometers 86 similar to those described with reference to Figure 3.
  • Joystick 84 also preferably includes one or more buttons 88 positioned thereon similar to buttons 56 described with reference to Figure 3. Buttons or other controls can also be provided on a housing or base of the interface device 14 in addition to or in place of buttons on the joystick.
  • the sensor data from sensors 28 is preferably output on game port interface bus 25 to host computer 12.
  • analog potentiometers are preferably used, and the sensor data is converted to digital form in conformance with the game port interface standard.
  • force feedback is provided when the user activates input devices such as buttons 88.
  • buttons 88 For example, when button #1 on interface device 80 is pressed by the user, the signal from button #1 is sent over game port interface 25 with the other button data to host computer 12.
  • the button #1 data is also sent to a timer/pulse generator 90 included in interface device 80.
  • timer/pulse generator 90 receives the button #1 signal, it outputs a motor control signal on line 92.
  • Line 92 is coupled to actuator interface 38, which in the present embodiment includes a transistor 94 used for amplifying the motor control signal.
  • Actuator interface 38 is coupled to motor 96 to provide an appropriate signal to drive the motor.
  • Motor 96 provides a force in a particular degree of freedom to user object 34.
  • a set of motor 96 and actuator interface 38 can be provided for each degree of freedom in which the user object is capable of moving. Altematively, fewer motors 96 can be included if force is desired to be provided in only selected degrees of freedom.
  • Power supply 92 powers motor 96 and can be connected to a standard AC wall outlet, for example.
  • Two switches 41 and 98 either activate or deactivate the motor 96 by connecting or disconnecting the power to the motor.
  • Safety switch 41 is similar to the safety switch described with respect to Figure 3, and is closed when the user is pressing or otherwise closing a switch on the interface device 80.
  • Switch 98 is a "recoil active" switch that is positioned on the exterior of the interface device and can be closed or opened by the user. When closed, the force feedback provided by motor 96 is operational, and when open, the force feedback is tumed off. This allows the user to turn on force feedback when the user deems is appropriate to ou ⁇ ut forces to the joystick in response to a button press.
  • the user can turn off the force feedback when desired and/or when it is inappropriate to cause forces to be output when a button is pressed.
  • the present embodiment is intended for use as a low-cost "recoil" force feedback interface device which does not require a local microprocessor 26 and does not require the host computer 12 to send force feedback signals to provide forces on user object 34. Rather, the force feedback is initiated whenever the user activates an appropriate control, such as a fire button 88 on a joystick.
  • the "recoil” force feedback is an independent "reflex process.”
  • the host computer does not send any signals or commands to initiate force feedback, the forces in this embodiment can still realistically portray force events. For example, the host computer can run a simulation or video game in which the user controls a gun.
  • the force output by motor 96 can be initiated when the user presses a button to fire the gun, and can provide a jolt or similar force to simulate the recoil of the shooting gun.
  • a button press will always fire the controlled gun in the game.
  • the forces thus accurately simulate a recoil force when firing a gun during a game, a centrifugal force when activating thrusters on a simulated plane or spacecraft, a vibration force for a certain action, or other force when performing some other action during a simulation or game.
  • the forces can be provided in a predetermined or random direction(s).
  • This embodiment allows force feedback to be provided to a user in all software that is compatible with a standard joystick or other peripheral connected to a standard game port. No special force-control software is required for the host computer, since the host issues no force commands to the interface device in this embodiment.
  • Button #1 for example, is wired directly to timer/pulse generator 90, which activates the motor 96 when the button #1 is pressed.
  • the timer/pulse generator can produce a single force jolt while a button is pressed.
  • the pulse generator 90 can cause motor 96 to ou ⁇ ut a series of force jolts at a predetermined frequency for the length of time that the user continuously presses the button.
  • buttons on the interface device 80 can also be connected to individual motors and timer/generators in a similar fashion, or multiple buttons can be connected to one motor and timer/generator.
  • FIGURE 4c is a schematic diagram of a second embodiment 100 of the "recoil" interface device of Figure 4a.
  • Interface device 100 is more functional than interface device 80, since simple logic states can be sent by the host computer 12 as a control signal to enable or disable the force feedback on the interface device 100 to help correlate force feedback with game or simulation events implemented by the host.
  • Potentiometers 86, buttons 88, motor 96, motor interface 94, and switches 41 and 98 are similar to the equivalent components described with reference to Figure 4b.
  • the terms “activate” and “deactivate”, as applied to actuators or reflex processes, refers to directly causing the actuators to output or remove a force.
  • an activation signal will cause the actuator to ou ⁇ ut force when the actuator receives the activation signal, and a deactivation signal will turn the actuator off and/or remove output forces (assuming that no other disabling signals are in force).
  • the terms “enable” and “disable” refer to either allowing or not allowing the motors to be controlled by other activation or deactivation signals.
  • a disable signal has been sent to the actuator interface, or if the actuators are disabled by opening recoil switch 98 and cutting power, the actuator will not ou ⁇ ut forces when an activation signal is received (or at any other time).
  • an enable signal is sent, the actuators are able to output forces when an activation signal is received and will remove all forces when a deactivation signal is received.
  • An actuator can output forces when all enable signals are set to "enable” and when an activation signal is received.
  • reflex processes are also referred to herein as being “enabled” or “disabled”, where it is meant that the process of ou ⁇ utting forces in response to local events is either operation (enabled) or not operational (disabled).
  • a recoil reflex process that is disabled means that the process of ou ⁇ utting forces in response to the user pressing a button is not functional.
  • Interface device 100 includes a selection block 102 which is coupled to a control signal line 104 from a button on the interface device.
  • a host line 106 (or multiple host lines in altemative embodiments) is coupled to the selection block 102 from a parallel bus 105 connected to host computer 12.
  • Host line 106 is used by the host computer to enable or disable motor 96.
  • line 106 is connected to a serial port of host computer 12 that is used as a parallel port in the present embodiment.
  • an RS-232 port of the host computer can be coupled to parallel bus 105.
  • the DTR line of the RS-232 interface can be used as a parallel line carrying a low or a high signal. This DTR line would be host line 106 that is used to enable or disable the actuators.
  • Other lines of the RS-232 interface could also be used.
  • serial RS-232 interface as a parallel interface and does not require a UART or other serial support chips, thus reducing the cost of the device 100 significantly.
  • other interfaces can be used.
  • parallel bus
  • Selection block 102 can be coupled to a standard parallel port of host computer 12.
  • Selection block 102 ou ⁇ uts a pulse signal on control line 108 to activate motor 96 when the button sends an activation signal on line 104 and when the host computer sends an enable signal on line 106. If either of these signals is not in a high state (or equivalent), the motor cannot be activated.
  • the selection block 102 can be implemented in a number of possible ways. For example, FIGURE 4d illustrates a functional schematic in which button line 104, host line 106, and a line from timing/pulse generator 90 are inputs to an AND gate 1 10, and the output of AND gate 1 10 is provided as a control signal on line 108 to motor interface 94.
  • FIGURE 4e illustrates an altemate schematic in which button line 104 is input to triggered pulse generator 90 that outputs a pulse (or pulses) when a signal is received indicating that a button has been pressed by the user.
  • the output of the triggered pulse generator 90 and the enable line 106 from host computer 12 are input to AND gate 1 10 which outputs the control signal on line 108 to the motor 94 when both inputs are high.
  • the enable line 106 from the host computer can be implemented as a direct line from a serial or other port of the host or as a multi-line bus 105 with more information.
  • bus 105 can include separate lines for a clock, data, and clear signal that are input to a latch from the host computer 12, and the output of the latch can be coupled to the selection block as line 106.
  • the latch would provide the enable signal when the clock signal changes to a high state, thus allowing the host to control when the enable signal is sent using synchronous communication.
  • the interface device 100 is similar to the recoil interface device of Figure 4b in that when a user presses a designated button, force feedback is applied to the user object 34 by motor 96.
  • device 100 also includes enable line 106 from the host computer, which allows the host computer to determine when the motor can be activated.
  • the enable line 106 does not allow the host computer to command desired forces, but only allows the host to select when the user will be able to activate the force by pressing a button (thus enabling/disabling the reflex process).
  • the enable line 106 allows the software process running on the host computer to be better coordinated with the force feedback. For example, when the user's player in a video game runs out of ammunition for a controlled gun, the host computer can send a disable signal to selection block 102, which will immediately deactivate the motor 96 regardless of the state of button 88. Likewise, when the user's player is in a situation in which force feedback can be applied, e.g., if the user picks up more ammunition in a game, the host computer can send an enable signal on line 106, which will allow the motor to ou ⁇ ut a force when the user selects the button 88.
  • FIGURE 4f is a third embodiment 1 14 of the recoil interface device of Figure 4a in which either a button press or a control signal from the host computer can cause force feedback to be ou ⁇ ut on the user object 34.
  • the interface device 1 14 includes joystick 84, potentiometers 86, buttons 88, motor 96, motor interface 94, and switches 41 and 98 which are similar to the equivalent components described with reference to Figure 4b.
  • Device 1 14 also includes a selection block 102 to which lines 104 and 106 are input and which is substantially similar to the selection block 102 described in Figure 4c.
  • the interface device 1 14 additionally includes an OR gate 116 or the functional equivalent.
  • the OR gate 1 16 has two input lines, one line 1 18 from selection block 102 and a separate activation line 120 from the parallel bus 105 coupled to the host computer.
  • the output of the OR gate 1 16 is coupled to motor interface 94.
  • the OR gate allows the host computer to activate the motor 96 using an activation signal on activation line 120 regardless of whether a user is pressing any buttons. This activation of motor 96 is simply turning the motor on or off using pulse generator 90, i.e., the pulse generator will send out a predetermined PWM signal or other command to the actuator to implement a predetermined force sensation, such as a vibration, jolt, etc.
  • Bus 105 can be a standard parallel port interface from the host computer, or the bus can be a serial port that is used to carry serial signals, as explained above.
  • the host sends the activation signal to coordinate force feedback with events that occur within a computer-implemented process or application program. For example, if an explosion rocks a vehicle the user is controlling in a video game or simulation, the host computer can signal interface device 1 14 to output force feedback to the user object 34 without regard to the buttons the user is pressing.
  • the interface device 1 14 thus provides yet greater realism in force feedback than the embodiments of Figures 4b and 4c and coordination with the process implemented on host computer 12 since the host can control the actuators in two ways: either enabling or disabling the actuators using control line 104, but letting the user initiate force feedback with a button; or by independently initiating the force feedback regardless of the state of the button.
  • interface device 1 10 remains low cost and simple, with only a small number of lines from the host needed to control the force feedback and no local microprocessor 26 required.
  • the disadvantage of embodiments 100 and 1 14 is that specific software is required for host computer 12 to issue enabling and activation commands to the interface device 14.
  • additional lines of bus 105 can be used for additional functionality.
  • another line such as the CTS line of an RS-232 interface (normally used for handshaking signals in a serial interface, but used herein as a line in a parallel interface), can be used as the "axis select line" to select particular axes or degrees of freedom in which the force is to be applied.
  • a high signal on the axis select line might indicate that forces are to be applied in both forward/back and left right axes of a joystick (i.e. two motors), while a low signal might indicate only activate one motor for the left/right axis.
  • an additional line (or lines) in the bus 105 can be used to allow the host computer to command a direction of the forces in a particular degree of freedom. Additional lines can also be used to select other motor ou ⁇ ut configurations.
  • the device 1 14 can include an additional line in parallel bus 105 to be used as the enable line 104 of Figure 4c.
  • the DTR line can be used as the enable line 104
  • the TxD line of the RS-232 interface can be used as activation line 120.
  • the RxD line can be used as the "life line" to allow the microprocessor or host to monitor whether the bus has been disconnected, as described above.
  • the RS-232 interface has three lines that are output from the host computer and thus a maximum of three lines can be used as parallel signal lines in bus 105 to interface device 1 14. If additional control signal lines are needed, the embodiment of Figure 5, below, can be implemented.
  • a TxD line can also be used to send more complex host signals that provide a desired force sensation to the user.
  • a baud rate can be set by a UART on the host computer 12 to establish a rate of transmission of data.
  • Data can be sent as high or low bits on the TxD line at the specified baud rate to turn motors 96 on and off at the desired rate.
  • the frequency of vibration can be adjusted by changing the values or pattem of bits sent and or by changing the baud rate.
  • a pulse width modulation (PWM) signal can be sent on the TxD line to control the actuators 30 similarly as described above.
  • PWM pulse width modulation
  • FIGURE 5 is a schematic diagram of an altemate embodiment 130 of interface device 14 in which microprocessor 26 is not used in the interface device and where the host computer 12 can more effectively control forces ou ⁇ ut by actuators 30.
  • This embodiment does not use high level host commands that can be used with the embodiment 80 of Figure 3, yet this embodiment provides more control signals to the interface device 14 than the embodiments of Figures 4a-4f.
  • Interface device 130 includes a serial interface bus 24 and a game port interface bus 25 (not shown).
  • the game port interface bus (or equivalent) is similar to bus 25 of Figure 3 and is coupled to potentiometers or similar sensors as described above to provide position data in provided degrees of freedom of user object 34 to the host computer via a game port.
  • the interface bus 24 is coupled to a serial port on host computer 12, such as an RS-232 port or similar interface.
  • RS-232 port or similar interface.
  • other interfaces such as the control port interface of a video game console, can be used.
  • the interface bus 24 is preferably used to serially transmit host control signals and/or host commands to the interface device 130.
  • the standard RS-232 signal lines used for serial transmission are preferably changed in functionality.
  • Signal line TxD is typically used in the RS- 232 interface to transmit data in serial fashion, and lines DTR, DSR, and RTS are typically used to send and receive handshaking signals to and from a peripheral.
  • line DTR is instead used to serially transmit data
  • lines TxD and RTS are used as parallel ou ⁇ ut control lines having high and low states to allow the host computer to enable and disable functions of the interface device and control forces.
  • the DSR line is used to provide information back to the host.
  • serial interface bus 24 is used both as a serial bus when transmitting commands over line DTR, and as a parallel bus when utilizing control lines TxD, RTS, and DSR.
  • DTR line 132 transmits low level host commands serially from the host computer to the interface device 130.
  • DTR line 132 is input to level shifter 134 which converts the RS-232 signal voltage to appropriate logic voltage and outputs the serial data to a first shift register 136.
  • Shift register 136 receives the serial signal at a DSA port and converts the serial information to parallel bits on 8-bit parallel bus 138.
  • the parallel bus 138 is coupled to input ports P0-P7 of an address comparator 140.
  • a bus 139 is coupled to the six bit lines of parallel bus 138 between the most and least significant bit lines.
  • Bus 139 is coupled to input ports of a programmable array logic (PAL) chip 142.
  • PAL programmable array logic
  • the most significant bit (MSB) line 141 of the parallel bus 138 is coupled to the input DSA port of a second shift register 144.
  • the second shift register 144 converts the input information on line 141 to parallel bits which are ou ⁇ ut on 8-bit parallel bus 146.
  • Bus 146 is coupled to logic comparator 140 at input ports Q0-Q7.
  • the shift registers 136 and 144 and comparator 140 provide a circuit for determining when a new byte (actually six bits) of data has been received and is ready to be processed by PAL 142.
  • the shift registers 136 and 144 are cascaded such that shift register 144 receives the bits shifted out of shift register 136.
  • the output bytes on parallel buses 138 and 146 are compared by comparator 140. When the two bytes are identical, a new byte has been fully shifted in and is ready to be processed by PAL 142.
  • the most significant bit and the least significant bit of an input byte are provided as "matching bits.”
  • the matching bits are used to check when the new byte has been shifted into shift registers 136 and 144, and can be either a 1 (high) value or a 0 (low) value.
  • the host computer 12 preferably inserts a pair matching bits around each 6 bits of data that it transmits serially on DTR line 132. The process of shifting serial data in the two shift registers is described with respect to Table 1, below.
  • Table 1 shows the outputs Q0-Q7 of the shift registers 136 and 144 at various stages (a)-
  • the next bit from the serial data stream is shifted into QO of register 136 at stage (b). This is a matching bit since it is the beginning of a new byte of data. This matching bit is intentionally set to zero, the opposite of the matching bits of stage (a), so that a match will not be found with the previous bytes.
  • the other values in the shift registers have all been shifted one ou ⁇ ut to the right, and the MSB ( 1 ) that was at Q7 of the second shift register in stage (a) is discarded.
  • stage (c) three more bits Y5, Y4, and Y3 have been shifted in from the serial data stream and the previous bits have been shifted three places to the right. Each of these bits can have either a low or a high value depending on which commands the host computer has sent and how the bits are inte ⁇ reted.
  • stage (d) three more bits Y2, Yl and YO have been shifted into the first shift register and the other bits have been correspondingly shifted.
  • stage (e) the final matching bit of the new byte of data is shifted in. This match bit is intentionally made to be "0" so that no match will occur with the matching bits of the byte in the second shift register.
  • stage (e) Although a full new byte has been shifted into the first register at stage (e), there is no match of bits between the first and second registers. Therefore, to recreate a match condition, the host computer 12 shifts the same data byte Y5- YO and matching bits (0) into the first register in stages (f) - (h). Until stage (h), the bits of the two registers will not exactly correspond. At stage (h), the bits exactly correspond to indicate a match condition, and comparator 140 outputs a signal on line 148 to indicate to PAL 142 that a new byte has been fully shifted in and validated.
  • PAL 142 then processes the current bits on bus 139 (i.e., bits Y5-Y0) as the new input "byte.” Note that PAL 142 continually receives bits on bus 139 throughout the shifting process but only actually processes the incoming data that is present when the validating signal on line 148 is received. New bytes in the data stream are similarly compared and processed by PAL 142 when they have been verified. Note that the host computer should altemate the matching bit of the next byte after stage (h) to a value of " 1 " so that no match will occur with the present matching bits of "0.”
  • the PAL 142 can process the six bits of information in a variety of ways.
  • logic is provided in PAL 142 to process each incoming bit as a control signal or "control bit", so that, effectively, six control signals are received over the serial bus.
  • the six control lines are an improvement over the embodiment of Figure 4f, which allows only three parallel control signals to be sent over an RS-232 line as explained above.
  • the host can thus control a greater variety of parameters and characteristics of forces using the greater number of control lines.
  • each control bit can control a separate parameter such as an enable signal for actuators 30, a selection bit determining which degrees of freedom are to be provided with forces, or an enable signal to allow buttons 39 to activate forces.
  • Buttons 39 preferably input a signal on line 145 to PAL 142 so that the PAL can directly determine when any of the buttons have been pressed by the user. For example, if a button has been pressed, a validating signal has been received on line 148, and all of the appropriate enable signals from the host have been provided, then the PAL can cause the actuators to output forces on user object 34. If any of these conditions are false, preferably no forces are output.
  • the PAL includes the appropriate logic to send the control bits to the appropriate components in the interface device 130 using output lines 143, such as actuators 30 and interface 36 or other logic.
  • output lines 143 such as actuators 30 and interface 36 or other logic.
  • an enable signal can be sent directly from PAL 142 to actuator interface 36.
  • low level host commands such as actual force values
  • the PAL can include logic to convert the low-level commands to force values and send the force values to the appropriate components in the interface device 130 using output lines 143, such as actuators 30 and interface 36 or other logic.
  • Some of the lines of parallel bus 139 can be utilized as control bits, while other lines can be used to provide a force value or other low level command.
  • Such logic for PAL 142 can be implemented using techniques well-known to those skilled in the art.
  • additional lines can be included in bus 139 to provide additional control bits to PAL 142.
  • additional shift registers can be added in altemate embodiments, such as shift register 150.
  • Register 150 is cascaded with second shift register 144 and receives the most significant bit from the second shift register.
  • additional shift registers such as register 150 can ou ⁇ ut bits directly to PAL 142; for example, shift register 150 outputs bits to PAL 142 on bus 151 similarly to the bits on parallel bus 139. Since the first and second shift registers 136 and 144 can check when new bytes have shifted in, the additional shift registers do not need to compare their bytes to the bytes of the odier shift registers.
  • latching shift registers can be used.
  • the latches on the outputs of such shift registers can hold the values until all the values have shifted in, and then send out the parallel data. Only one such shift register need be provided to send the six control bits to PAL 142.
  • latching shift registers also require an additional latch clock signal to latch the data.
  • One of the lines of the RS-232 interface can be used as a latch clock signal, such as the TxD signal.
  • the TxD signal is preferably used for other functionality in the present embodiment (as described below), there is not a convenient line available to use as a latch clock line in an RS-232 interface.
  • the matching shift register embodiment described above is therefore more appropriate to the described embodiment and is less expensive than a latching shift register embodiment as well. In other embodiments using a different, non-RS-232 interface bus 24, latching shift registers may be more appropriate.
  • Host computer 12 also sends signals on TxD line 155 to the interface device 130.
  • Level shifter 154 receives the TxD line 155 from the RS-232 interface bus 24.
  • the TxD line 155 is input to PAL 142 and is used to enable or activate the motors similarly to the embodiment of Figure 4c and 3c.
  • the TxD line 155 can also be used to send more complex host signals that provide a desired force sensation to the user.
  • a baud rate can be set by a UART on the host computer 12 to establish a rate of transmission of data. Data can be sent as high or low bits on the TxD line at the specified baud rate to turn actuators 30 on and off at the desired rate, as described above with reference to Figure 4f.
  • a pulse width modulation (PWM) signal can be sent on TxD line 155 to control the actuators 30 as described above.
  • PWM pulse width modulation
  • the RTS line 152 is input to level shifter 134 and is provided as a clock signal for the shift registers 136 and 144 (and 150, if present) to set the rate of shifting the input bits and providing them to the PAL 142.
  • the clock signal on the RTS line is provided by the host computer at a predetermined frequency.
  • the RS-232 interface in the current embodiment is used for synchronous serial communication instead of the asynchronous serial communication for which it is normally used.
  • DSR line 156 is used in the described embodiment as a parallel communication line to provide information to host computer 12.
  • the host computer can use DSR line 156 to verify that the interface device 130 exists and is connected to the serial interface bus 24, for safety and other reasons as described above.
  • DSR line 156 is coupled to output Q0 of first shift register 136 and is connected to level shifter 154 to convert the logic level signal to an RS-232 voltage level.
  • the data on DSR line 156 is output from level shifter 154 to host computer 12.
  • the bit on line 156 changes as serial data is clocked into the shift registers on DTR line 132 as described above. The state of the DSR line can thus be clocked back to the host over the interface bus 24.
  • the host can read the DSR line 156 and set the data DTR line to a bit of the opposite state. At this point, the DSR line should still be in its original state. The host would then provide a clock pulse on the RTS line and check to see that the DSR line changes to the same state as the DTR line. If so, the connection between the host and interface device has been verified. If the DTR line does not change states, the interface device may be disconnected. This test can be provided for both states of the DTR data to verify a consistent response. Control "loop back" lines of a serial or parallel port can be used by the host computer to verify the identity of the interface device 130, especially when non microprocessor 26 is present to provide an identification signal for the interface device.
  • non-standard ou ⁇ ut and input lines of the interface bus are used so that the interface device will not be confused with other types of devices that can be connected to the host computer.
  • the host can send out a signal on an output line and check the non-standard input line; if the sent signal is detected, then the host knows that the interface device 14 or 130 is connected.
  • This feature can also be used in the embodiments of Figures 4a-4f and in other embodiments that do not include a microprocessor 26.
  • the embodiment 130 of the interface device has several advantages. Since no local microprocessor 26 or UART are needed in interface device 130, the cost of the interface device is reduced greatly.
  • the implementation of a serial data stream allows the host to send a greater number of control signals and have much greater control than in the embodiments of Figures 4a- 4f. Many more types of commands can be sent by the host using the serial interface than the three maximum commands allowed in the parallel bus implementation of an RS-232 interface in the above "recoil" embodiments. Also, force values or other commands can be sent by the host to better control the actuators.
  • the logic components of interface device 130 shown in Figure 5 can be readily provided on a single chip implemented as an ASIC or FPGA. This allows the circuitry for interface device 130 to be manufactured in high volume at a very low cost.
  • FIGURE 6 is a schematic diagram illustrating a low-cost and compact power circuit 158 of the present invention used for implementing force feedback in interface device 14.
  • Power circuit 158 includes a current limiter 160, a capacitor 162, and an optional analog-to-digital converter 164.
  • Motor 96 (or other type of active actuator) and motor interface 94 are substantially similar to the equivalent components described in the embodiments of Figures 2-5.
  • a voltage V is provided on a line 159.
  • Line 159 can be a line connected to a power supply such as power supply 41 , or to the power signal of a game port interface 25.
  • Line 159 can also be connected to a peripheral interface port of video game consoles such as the Sega Saturn or the Sony PlayStation.
  • Line 159 is input to current limiter 160, which can be implemented with several components well known to those skilled in the art.
  • Current limiter 160 limits the current of the input voltage signal on line 159 to a maximum current of I L1M . This current has been previously determined to be the desired current to charge the capacitor 162, as shown in Table 2 below.
  • Capacitor 162 is coupled between an ou ⁇ ut of current limiter 160 and ground.
  • Capacitor 162 stores energy from the current-limited signal on line 161 until it is fully charged.
  • the line 161 also is coupled to a voltage bias input of an amplifier 166 included in an actuator interface 94.
  • the capacitor 162 and amplifier (“driver") circuit 166 are configured in such a way so as to allow capacitor C to supply power to the amplifier to amplify a control signal input to the amplifier.
  • Resistors Rl and R2 are coupled between the ou ⁇ ut of current limiter 160 and ground.
  • Optional A/D converter 164 has an input coupled to the node between resistors Rl and R2 and has an output coupled to microprocessor 26.
  • Microprocessor 26 receives the digital signal from the A/D converter at an analog input pin.
  • Microprocessor 26 also sends out a motor control signal on line 163 to activate motor 96, similarly to the above-described embodiments.
  • the power circuit 158 operates as follows.
  • the voltage V from power supply is limited as described above by current limiter 160.
  • the limited voltage signal is output on line 161 and charges capacitor C.
  • the current-limited voltage signal is also provided to the A/D converter 144 which provides a digital representation of the signal to the microprocessor 26.
  • the microprocessor monitors this signal to determine the current charging state of the capacitor 162; the voltage magnitude is indicative of the amount of charge stored in the capacitor. When enough power has been charged in the capacitor to drive motor 96, and if the microprocessor has determined that it is an appropriate time to output forces on user object 34, then the microprocessor signals the motor to be activated on line 163.
  • the activation signal from the microprocessor 26 can be, for example, an analog signal from a D/A converter on the microprocessor, or could be a pulse width modulation (PWM) signal.
  • PWM pulse width modulation
  • the power in the capacitor is provided to amplifier 166 and is used to amplify the signal from the microprocessor and drive the motor 96.
  • the present power circuit configuration offers several advantages over standard prior art power supplies used for force feedback. It has been found that human perception of force sensations is highly focused on transient forces rather than constant forces. For example, a human will easily perceive a change in force but will not as easily sense a steady-state, continuous force. In terms of a force feedback interface device, if an intense force is desired to be ou ⁇ ut to the user operating the device, then only a short jolt or pulse of force (i.e., change in force) is actually necessary for the user to detect that force; maintaining a continuous magnitude of force over time is not as critical, since the user will not as readily detect that constant force after the change in force has occurred. This human perceptual condition is highly relevant to the present power circuit.
  • a change in force can be created for a short period of time as the capacitor discharges its energy.
  • the motor 96 can output a stronger force than when using the power supply 41 or other source alone.
  • strong jolts or other force sensations can be provided above the power supply's maximum force level of the interface device. These sensations do not have to be maintained for very long, since the user will more readily sense the change in force rather than any continuous stronger force output, so diat the user can be fooled into thinking a stronger force has been and continues to be output.
  • This operation can be advantageous in that a smaller power supply can be used to power the motors.
  • the capacitor power can be provided to achieve, for a short period of time, levels of force as great as a larger power supply would provide.
  • a smaller power supply would allow the interface device to be much smaller, less expensive, and lightweight, which are ideal characteristics for force feedback devices intended for the mass market.
  • the force feedback device would be safer for the user to operate.
  • a power supply 41 would not be required at all when using the power circuit 158.
  • Power can be drawn directly from the host computer 12 over the game port interface 25 or other interface that supplies power from the host computer, such as a USB interface. This power can be supplemented by using the capacitor 162 when high-magnitude forces are required to be output by motor 96.
  • the elimination of a separate power supply 41 allows the interface device to a great deal smaller and less expensive to manufacture, as well as being more convenient for a typical user to operate.
  • the capacitor 162 discharges its energy when the motor is activated, it must be charged again before it is again operative to power the motor 96.
  • the charging time is significant to the design since the microprocessor is limited in the frequency and control of forces according to when the capacitor is ready to provide power.
  • Several different capacitances C of capacitor 162 and other parameters in the circuit have been varied to determine efficient configurations of the circuit.
  • Table 2 shows sample pulse durations and recharge times for various configurations of supply voltages, currents, and storage capacitances (C).
  • Input Current Limit I LIM (mA)300 300 500 200 Storage Capacitance C ( ⁇ F) 4700 10000 4700 2000 Steady-State Current I ss (mA) 200 200 250 100 Pulse Current (mA) 2000 2000 2000 2000 2000 2000
  • Table 3 shows sample storage capacitances and recharge times for various supply voltages, currents, and a pulse duration.
  • a storage capacitor can supply enough power to provide a significant increase in output force magnitude.
  • a 2000 uF capacitor 162 can provide 2000 mA of pulse current to create a jolt force with motor 96 for 21 milliseconds when using a 24 V, 200 A (Iss) power supply. This allows a jolt force of 10 times the magnitude the power supply alone could output. A charge time of 380 milliseconds does not delay the force jolts significantly for many applications. Note that many different configurations and/or values of the parameters shown in Tables 2 and 3 can be used, and other parameters not shown in the tables can be varied in other embodiments.
  • microprocessor 26 can be eliminated from me interface device 14.
  • the "recoil" interface devices of Figures 4a-4f provide force feedback without the use of microprocessor 26.
  • A/D converter 164 does not need to be used.
  • the recharge time can be estimated and the motor can be deactivated using a timing circuit, for example, until the capacitor is fully charged.
  • the microprocessor 26 can be omitted and the A D converter 164 can send the converted digital signals to the host computer 12, which determines when the capacitor is fully charged and sends an output activation or enable signal to motor 96 when appropriate.
  • FIGURE 7 is a flow diagram illustrating a method 200 for controlling a force feedback interface device of the present invention using microprocessor 26.
  • this method can be adapted for some embodiments not including microprocessor 26, such as the recoil embodiments of Figures 4a-4f or embodiment 130 of Figure 5.
  • the microprocessor steps of the process can be implemented by logic or other components, such as in PAL 142 or control block 102.
  • the process of Figure 7 is suitable for low speed communication interfaces, such as a standard RS-232 serial interface.
  • the embodiment of Figure 7 is also suitable for high speed communication interfaces such as USB, since the local microprocessor relieves computational burden from host processor 16.
  • the slower "interrupt data transfers" mode of USB can be used.
  • step 204 host computer system 12 and interface device 14 are powered up, for example, by a user activating power switches.
  • step 204 the process 200 branches into two parallel (simultaneous) processes.
  • One process is implemented on host computer system 12, and the other process is implemented on local microprocessor 26. These two processes branch out of step 204 in different directions to indicate this simultaneity.
  • step 206 is first implemented, in which an application program is processed or updated.
  • This application can be a simulation, video game, scientific program, operating system, or other software program. Images can be displayed for a user on output display screen 20 and other feedback can be presented, such as audio feedback.
  • step 208 is implemented, where sensor data describing the user object is received by the host computer from local microprocessor 26.
  • the local processor 26 continually receives raw data from sensors 28, processes the raw data, and sends processed sensor data to host computer 12. Altematively, local processor 26 sends raw data directly to host computer system 12.
  • Sensor data can include position values, velocity values, and/or acceleration values derived from the sensors 28 which describe motion of object 34 in one or more degrees of freedom.
  • any other data received from other input devices 39 can also be considered “sensor data” in step 208, such as signals indicating a button on interface device 14 has been pressed by the user.
  • the term “sensor data” also can include a history of values, such as position values recorded previously and stored in order to calculate a velocity.
  • Host computer system 12 receives either raw data (e.g., position data and no velocity or acceleration data) or processed sensor data (position, velocity and/or acceleration data) from microprocessor 26 in step 208.
  • any other sensor data received from other input devices 39 can also be received by host computer system 12 from microprocessor 26 in step 208, such as signals indicating a button on interface device 14 has been pressed by the user.
  • the host computer does not need to calculate force values from the received sensor data in step 208. Rather, host computer 12 monitors the sensor data to determine when a change in the type of force is required. This is described in greater detail below.
  • host computer 12 also uses the sensor data as input for the host application to update the host application accordingly.
  • Step 208 is implemented in a continual loop of receiving sets of sensor data from local processor 26. Since the host computer does not need to directly control actuators based on sensor data, the sensor data can be provided to die host at a low speed.
  • the host computer updates the host application and images on display screen 20 in response to sensor data
  • the sensor data need only be read at 60-80 Hz (the refresh cycle of a typical display screen) compared to the much higher rate of about 500-1000 Hz (or greater) that would be required to realistically control force feedback signals directly from the host.
  • the second branch from step 206 is concemed with me process of the host computer determining high-level or supervisory force commands ("host commands") to provide force feedback to the user manipulated object 34.
  • host commands high-level or supervisory force commands
  • the second branch starts with step 210, in which the host computer system checks if a change in the type of force applied to user object 34 is required.
  • the "type" of force is intended to generically refer to different force sensations, durations, directions, or other high-level characteristics of forces, or changes in these characteristics, which are controlled by the host computer.
  • a force sensation or profile are types of forces produced by a particular force routine which the local microprocessor 26 can implement independently of the host computer.
  • the host computer 12 determines whether a change in the type of force is required according to several criteria, the most important of which are the sensor data read by the host computer 12 in step 208, timing data, and the implementation or "events" of the application program updated in step 206.
  • the sensor data read in step 208 informs the host computer how ⁇ e user is interacting with the application program and when new types of forces should be applied to the object based on the object's current position, velocity, and/or acceleration.
  • the user's manipulations of object 34 may have caused a new type of force to required.
  • a damping type of force should be applied to the object 34 as long as the race car moves within me mud.
  • damping forces need to be continually applied to the object, but no change in the type of force is required.
  • a new type of force i.e. a removal of the damping force in this case
  • the velocity and/or acceleration of the user object can also influence whether a change in force on the object is required. If the user is controlling a tennis racket in a game, the velocity of a user object joystick may determine if a tennis ball is hit and thus if an appropriate force should be applied to the joystick.
  • Other criteria for determining if a change in the type of force is required includes events in the application program. For example, a game application program may (perhaps randomly) determine mat another object in the game is going to collide with a computer object controlled by the user, regardless of the position of the user object 34. Forces should thus be applied to the user object in accordance with this collision event to simulate an impact. A type of force can be required on the user object depending on a combination of such events and the sensor data read in step 208. Other parameters and inputs to the application program can determine if a change in force to the user object is necessary, such as other input devices or user interface devices connected to host computer system 12 which input data to the application program (other interface devices can be directly connected, connected remotely through a network, etc.).
  • step 212 is implemented, in which host computer 12 determines an appropriate high-level host command to send to microprocessor 26.
  • the available host commands for host computer 12 may each correspond to an associated force routine implemented by microprocessor 26. For example, different host commands to provide a damping force, a spring force, a gravitational pull, a bumpy surface force, a virtual obstruction force, and other forces can be available to host computer 12.
  • These host commands can also include a designation of the particular actuators 30 and/or degrees of freedom which are to apply this desired force on object 34.
  • the host commands can also include other command parameter information which might vary the force produced by a particular force routine. For example, a damping constant can be included in a host command to designate a desired amount of damping force, or a direction of force can be provided.
  • the host command may also preferably override the reflex operation of the processor 26 and include "low-level" force commands, such as direct force values, that can be sent directly to the actuators 30 (described below with respect to step 226).
  • the commands include direct host commands, "reflex" commands, and custom effects.
  • Some desirable direct host commands include JOLT (a short force pulse), WOBBLE (random force), SPRING (a virtual spring), DAMPER (a damping force), and so on.
  • Each command preferably includes parameters which help the host specify the characteristics of the desired output force. These commands would cause the microprocessor to instantly ou ⁇ ut the commanded force according to the appropriately-selected force routine.
  • "Reflex" commands in contrast, provide conditions to the microprocessor so that the desired force is output when the conditions are met.
  • a reflex command of Joit_Button_Reflex can instruct the microprocessor to select a force routine that outputs a JOLT force only when a specified button is pressed by the user (or, when the user object is moved in a particular direction).
  • custom effects can be provided to the microprocessor by the host and then commanded to be output.
  • the host computer can download to the microprocessor a set of force values (a force profile) as a "force profile file" or other collection of data using a host command LOAD_PROFILE, and which can be stored in local memory 27.
  • a separate host command PLAY_PROFILE could then be sent to instruct the microprocessor to ou ⁇ ut the downloaded force profile as forces on user object 34.
  • Reflex commands can also be used to cause ⁇ e downloaded profile to be output only when a condition, such as a button press, occurs.
  • a force profile file includes an array of force values, size information about the size of the data, and timing information for when to output the various force values (preferably, the force values have "+" or "-" signs to indicate the direction of forces; altematively, directions can be separately indicated).
  • Numerous force profile files can be downloaded to the microprocessor, and the microprocessor can send back an index or other information to inform the host how to select a particular force profile file.
  • Custom effects can also be downloaded over a computer network, such as the World Wide Web, as described below.
  • step 214 the host computer sends me host command to the microprocessor 26 over bus 24 (or bus 25, if appropriate). The process then returns to step 206 to update die host application and to retum to step 210 to check if anodier change in force is required.
  • the host computer 12 preferably synchronizes any appropriate visual feedback, auditory feedback, or other feedback related to the host application with the issuance of host commands and the application of forces on user object 34.
  • the onset or start of visual events such as an object colliding with die user on display screen 20
  • the onsets visual events and force events are preferably occur within about 30 milliseconds (ms) of each other. This span of time is the typical limit of human perceptual ability to perceive the events as simultaneous. If die visual and force events occur outside this range, then a time lag between the events can usually be perceived.
  • the ou ⁇ ut of auditory signals are preferably ou ⁇ ut synchronized with die onset of ou ⁇ ut forces that correspond to/complement those auditory events.
  • die onsets of these events occur preferably within about 30 ms of each other.
  • host computer system 12 can output sounds of an explosion from speakers 21 as close in time as possible to die forces felt by the user from that explosion in a simulation.
  • the magnitude of the sound is in direct (as opposed to inverse) proportion to the magnitude of the forces applied to user object 34.
  • a low sound of an explosion in die far (virtual) distance can cause a small force on user object 34, while a large, "nearby" explosion might cause a loud sound to be output by die speakers and a correspondingly large force to be output on object 34.
  • step 216 The second process branching from step 204 is implemented by die local microprocessor 26.
  • This process starts with step 216 and is implemented in parallel with the host computer process of steps 206-214 described above.
  • step 216 the interface device 14 is activated. For example, signals can be sent between host computer 12 and interface device 14 to acknowledge that the interface device is now active and can be commanded by host computer 12.
  • two processes branch to indicate diat there are two processes running simultaneously (e.g., multi-tasking) on local microprocessor 26.
  • step 218 is implemented, in which die processor 26 reads raw data (sensor readings) from sensors 28.
  • raw data preferably includes position values describing the position of the user object along provided degrees of freedom.
  • sensors 28 are relative sensors that provide position values describing die change in position since the last position read.
  • Processor 26 can determine the absolute position by measuring the relative position from a designated reference position. Altematively, absolute sensors can be used.
  • sensors 28 can include velocity sensors and accelerometers for providing raw velocity and acceleration values of object 34.
  • the raw data read in step 218 can also include other input, such as from an activated button or odier control 39 of interface device 14.
  • either raw data or processed sensor data from sensors 28 can be sent directly to host computer 12 without being received by microprocessor 26.
  • the host can perform any processing that is necessary to inte ⁇ ret the sensor data in these embodiments, such diat any or all of steps 218-221 may not be necessary.
  • microprocessor 26 processes the received raw data into sensor data, if applicable.
  • this processing includes two steps: computing velocity and/or acceleration values from raw position data (if velocity and/or acceleration are needed to compute forces), and filtering the computed velocity and acceleration data.
  • the velocity and acceleration values are computed from raw position data received in step 218 and a history of stored position and time values (and other types of values, if appropriate).
  • processor 26 stores a number of position values and time values corresponding to when die position values were received.
  • Processor 26 can use, for example, local clock 21 to determine the timing data.
  • the velocity and acceleration can be computed using the stored position data and timing data, as is well known to those skilled in the art.
  • the calculated velocity and/or acceleration values can dien be filtered to remove noise from the data, such as large spikes that may result in velocity calculations from quick changes in position of object 34.
  • the sensor data in the described embodiment includes position, velocity, acceleration, and other input data.
  • circuitry that is electrically coupled to but separate from processor 26 can receive die raw data and determine velocity and acceleration.
  • ASIC application-specific integrated circuit
  • discrete logic circuitry can use counters or the like to determine velocity and acceleration to save processing time on microprocessor 26.
  • velocity and/or acceleration sensors are used, the calculation of velocity and/or acceleration is omitted.
  • step 221 die processor 26 sends the processed sensor data to host computer 12 and also stores histories of the sensor data in storage devices such as memory 27 for computing forces. The process then returns to step 218 to read raw data. Steps 218, 220 and 221 are thus continuously implemented to provide current sensor data to processor 26 and host computer 12.
  • the second branch from step 216 is concemed widi a "reflex process” or “reflex” in which microprocessor 26 controls the actuators 30 to provide forces to object 34.
  • a “reflex process” is a force process iat outputs forces on user object 34 and is implemented locally to interface device 14, is independent of host computer 12, and depends only on local control events, such as buttons being pressed or user object 34 being moved by die user.
  • reflex The most simple form of reflex is used in the "recoil" embodiments of Figures 4a-4f, in which a simple control event, such as the push of a button by the user, causes a force to be ou ⁇ ut on die user object by actuators 30.
  • a simple control event such as the push of a button by the user
  • causes a force to be ou ⁇ ut on die user object by actuators 30 The more complex form of reflex process, described in die current method, can calculate and output forces depending on a variety of local control events, such as button presses and the position, velocity, and/or acceleration of user object 34 in provided degrees of freedom.
  • step 222 in which processor 26 checks if a host command has been received from host computer 12 over bus 24.
  • Host commands are high-level commands that command changes in forces to the user object, as described with reference to step 214. If a host command has been received, the process continues to step 224, where a "force routine" indicated by or associated with the host command is selected if appropriate.
  • a "force routine”, as referred to herein, is a set of steps or instructions for microprocessor 26 to provide low-level force commands to actuators 30. These "low-level” force commands (or “processor force commands”) are to be distinguished from the "high-level” host commands issued from the host computer 12.
  • a low level force command instructs an actuator to output a force of a particular magnitude.
  • the low level command typically includes a "force value" or magnitude e.g., equivalent signal(s) to instruct the actuator to apply a force of a desired magnitude value.
  • Low level force commands may also designate a direction of force if an actuator can apply force in a selected direction, and/or other low-level information as required by an actuator.
  • Force routines determine low level force commands from other parameters, such as sensor data read in step 218 (button press data, position data, etc.) and timing data from clock 18.
  • the force routines can be stored local to microprocessor 26 in, for example, memory 27 such as RAM or ROM (or EPROM, EEPROM, etc.).
  • memory 27 such as RAM or ROM (or EPROM, EEPROM, etc.).
  • the microprocessor might select a particular damping force routine if die host command indicated diat the damping force from that particular damping process should be applied to object 34.
  • Other damping force routines might also be available.
  • the available force routines are described in greater detail below and may include algorithms, stored force profiles or values, conditions, etc.
  • die host command received from the host in step 222 may in some instances simply be a low-level force command, or even a single force value, diat is to be sent to an actuator 30, in which case a force routine need not be selected.
  • step 226 is implemented, in which processor 26 determines a processor low-level force command.
  • the low-level force command is derived from either a selected force routine, a resident force routine, any odier data required by d e force routine, and/or command parameters and/or values included in relevant host commands.
  • the required data can include sensor data and/or timing data from local clock 29.
  • the microprocessor 26 can determine a force command according to one or more "resident" force routines, i.e., the same force routines that it selected and used in previous iterations of step 226. This is the "reflex" process operation of the interface device that does not require any new input from host computer 12.
  • force routines can include several different types of steps and/or instructions which are followed to determine a low-level force command.
  • One type of instruction in a force routine is a force algorithm, which includes an equation that host computer 12 can use to calculate or model a force value based on sensor and timing data.
  • a force algorithm which includes an equation that host computer 12 can use to calculate or model a force value based on sensor and timing data.
  • algorithms in which force varies linearly (or nonlinearly) with the position of object 34 can be used to provide a simulated force like a spring.
  • Algorithms in which force varies linearly (or nonlinearly) with the velocity of object 34 can be also used to provide a simulated damping force or other forces on user object 34.
  • Algorithms in which force varies linearly (or nonlinearly) with the acceleration of object 34 can also be used to provide, for example, a simulated inertial force on a mass (for linear variation) or a simulated gravitational pull (for nonlinear variation).
  • a simulated inertial force on a mass for linear variation
  • a simulated gravitational pull for nonlinear variation.
  • a kinematic equation which calculates a force value based on the velocity of the user object multiplied by a damping constant can be used to determine a damping force on the user object.
  • This type of equation can simulate motion of object 34 along one degree of freedom through a fluid or similar material.
  • a damping constant can first be selected which indicates the degree of resistance that object 34 experiences when moving through a simulated material, such as a liquid, where a greater number indicates greater resistance. Water would have a lower damping constant man oil or syrup.
  • the microprocessor 26 recalls the previous position of user object 34 (along a particular degree of freedom) from memory 27, examines d e current position of the user object, and calculates the difference in position. From the sign (negative or positive) of the difference, the direction of the movement of object 34 can also be determined.
  • the force value is then set equal to the damping constant multiplied by the change in position.
  • Low-level commands that control an actuator based on this algoridim produce a force proportional to the user object's motion to simulate movement through a fluid. Movement in other mediums, such as on a bumpy surface, on an inclined plane, etc., can be simulated in a similar fashion using different methods of calculating the low-level force commands.
  • the determination of low-level commands from force routines can also be influenced by timing data accessed from system clock 18.
  • die velocity of the user object 34 is determined by calculating the different of positions of the user object and multiplying by the damping constant. This calculation assumes a fixed time interval between data points, i.e., it is assumed that the position data of the object 34 is received by host computer 12 in regular, predetermined time intervals. However, this may not actually occur due to different processing speeds of different computer platforms or due to processing variations on a single host microprocessor 16, such as due to multitasking. Therefore, in the present invention, the host computer preferably accesses clock 12 to determine how much time has actually elapsed since the last position data was received.
  • the host computer could take the difference in position and divide it by a time measure to account for differences in timing.
  • the host computer can thus use the clock's timing data in die modulation of forces and force sensations to the user.
  • Timing data can be used in other algorithms and force sensation processes of the present invention to provide repeatable and consistent force feedback regardless of type of platform or available processing time on host computer 12.
  • the velocity and acceleration required for particular force routines can be provided in a number of different ways.
  • the sensor data provided by steps 218-221 can include position data, velocity data, and/or acceleration data.
  • the microprocessor can use me velocity and acceleration data directly in an algorithm to calculate a low-level force command.
  • position data might be received from sensors 28, and me microprocessor can calculate the velocity and or acceleration values using stored histories of values.
  • the microprocessor only calculates the velocity and/or acceleration values when the values are needed by a force routine. Altematively, the processor can always calculate the velocity and acceleration values regardless of whether the values are used in a force routine.
  • conditional steps can be included to provide forces under specified circumstances.
  • a force routine might instruct the processor 26 to output a low-level force command only when the user object is moved to a particular position in provided degrees of freedom.
  • forces should be applied in only one direction (uni-directional).
  • conditional instructions can be included in a virtual obstruction force routine to output a low-level force command only when the user object is moved in a particular direction at a particular position.
  • a "null" force routine can be available iat instructs microprocessor 26 to issue low-level commands to provide zero force (i.e. remove all forces) on user object 34.
  • Another type of force routine does not use algorithms to model a force, but instead uses force values that have been previously calculated or sampled and stored as a digitized "force profile" in memory or other storage device. These force values may have been previously generated using an equation or algorithm as described above, or provided by sampling and digitizing forces. For example, to provide a particular force sensation to the user, host computer 12 can be instructed by die steps of a force routine to retrieve successive force values of a force profile from a certain storage device, such as memory 27, RAM, hard disk, etc. These force values can be included in low-level commands sent directly to an actuator to provide particular forces without requiring host computer 12 to calculate the force values.
  • previously- stored force values can be output with respect to other parameters to provide different types of forces and force sensations from one set of stored force values.
  • one set of stored force values can be output in sequence according to different time intervals that can vary depending on the desired force, thus producing different types of forces on d e user.
  • different retrieved force values can be output depending on the current position, velocity, etc. of user object 34.
  • the low level force command determined in step 226 can also depend on instructions that check for other parameters. These instructions can be included within or extemal to the above- described force routines.
  • One such parameter can includes values provided by the implemented host application program.
  • the application program may determine mat a particular low-level force command should be output or force routine selected based on events occurring within the application program or o er instructions.
  • Host commands can be provided by die host application program to output forces independently of sensor data. Also, in a host command, die host can provide its own particular position, velocity, and/or acceleration data to a designated force routine to calculate or provide a force that is not based on the manipulation of user object 34, but is provided to simulate an event in the application program.
  • Such events may include collision events, such as occur when a user-controlled computer image impacts a virtual surface or structure.
  • other input devices connected to host computer 12 can influence events and, therefore, the forces applied to user object 34.
  • the sensor data from multiple interface devices 14 connected to a single host computer can influence the forces felt on odier connected interface devices by influencing events and computer-controlled images/objects of the host application program.
  • the low-level force commands determined in step 226 can be based on other inputs to host computer 12, such as activations of buttons or other input devices in (or extemal to) interface device 14.
  • a particular force routine might instruct the microprocessor to ou ⁇ ut a force to a joystick whenever a user presses a button on the joystick.
  • steps 218, 220, and 221 for reading sensor data can be inco ⁇ orated in one or more force routines for the microprocessor, so that sensor data is only read once a force routine has been selected and executed.
  • the host command can include other command parameter information needed to determine a low-level force command.
  • the host command can indicate the direction of a force along a degree of freedom.
  • Microprocessor 26 can determine a low-level force command in step 226 according to a newly-selected force routine, or to a previously selected force routine. For example, if this is a second or later iteration of step 226, the same force routine as in the previous iteration can be again implemented if a new host command has not been received.
  • the microprocessor 26 can continually output forces on user object 34 using sensor data and timing data according to force routines, independently of any commands from the host.
  • a "virtual wall" force routine would allow the microprocessor to command forces simulating the wall whenever the user's joystick was moved in the appropriate position or direction.
  • the host computer need only command diat the virtual wall exists and provide die location of die wall, and die microprocessor 26 will independently implement the wall and die required forces when necessary.
  • typical haptic sensations may include a virtual damping (described above), a virtual obstruction, and a virtual texture.
  • Virtual obstructions are provided to simulate walls, obstructions, and other uni-directional forces in a simulation, game, etc.
  • a user moves a computer image into a virtual obstruction with a joystick, the user then feels a physical resistance as he or she continues to move the joystick in that direction. If the user moves die object away from the obstruction, the uni-directional force is removed.
  • the user is given a convincing sensation that the virtual obstruction displayed on the screen has physical properties.
  • virtual textures can be used to simulate a surface condition or similar texture.
  • the host computer sends a rapid sequence of commands to repetitively 1 ) apply resistance along that axis, and 2) to dien immediately apply no resistance along diat axis, e.g., as according to a force routine.
  • This frequency is based upon the travel of the joystick handle and is thus correlated with spatial position.
  • the user feels a physical sensation of texture, which can be described as the feeling of dragging a stick over a grating.
  • processor 26 outputs the determined processor force command to actuators 30 to set the output force to the desired level.
  • processor 26 can optionally convert the low-level force command to an appropriate form usable by actuator 30, and/or actuator interface 38 can perform such conversion. The process then returns to step 222 to check if another host command has been received from the host computer 12.
  • the reflex process of microprocessor 26 (steps 218, 220, 222, 224, 226, and 228) tiius operates to provide forces on object 34 independently of host computer 12 according to a selected force routine and other parameters.
  • the force routine instructs how the processor force command is to be determined based on the most recent sensor data read by microprocessor 26. Since a reflex process independently outputs forces depending on the local control events of interface device 14, die host computer is freed to process the host application and determine only when a new type of force needs to be output. This greatly improves communication rates between host computer 12 and interface device 14.
  • the host computer 12 preferably has the ability to override die reflex operation of microprocessor 26 and directly provide force values or low level commands.
  • me host command can simply indicate a force value to be sent to an actuator 30.
  • This override mode can also be implemented as a force routine.
  • the microprocessor 26 can select a force routine from memory that instructs it to relay low-level force commands received from host computer 12 to an actuator 30.
  • FIG. 7 Another advantage of the reflex embodiment of Figure 7, as well as the hardware embodiments of Figures 2, 3, 4a-f, and 5, is mat the low communication needs between die host computer and the interface device allows force feedback to be easily implemented over computer networks.
  • host computer 12 can be connected to the Internet and the World Wide Web networks as is well known to those skilled in the art.
  • a "web page" or other network site or node can store force feedback information for a user to download and implement using interface device 14.
  • a web page might store a sequence of force values so mat die user can interact with a game or simulation implemented on the web page.
  • the host computer 12 can receive the force commands or other force information over the network using, for example, a web browser or software utility such as Netscape from Netscape Communications.
  • the host can transmit the force information to the microprocessor 26 to control the actuators as described above. Since only high level force commands are needed in the reflex embodiment, the web page need store only a small amount of information to be downloaded to the host computer ratiier than all the actual force values necessary to control actuators.
  • a high level command protocol allows more realistic force feedback interaction over a global network.
  • a "host-controlled" method can be used, in which host computer system 12 provides direct, low-level force commands to microprocessor 26, and the microprocessor directly provides these force commands to actuators 30 to control forces ou ⁇ ut by the actuators.
  • this type of embodiment is not a reflex embodiment since forces ou ⁇ ut on user object 34 are dependent on active and continuous control from the host computer, which increases the computational burden on the host.
  • Processor 26 continually receives signals from sensors 28, processes the raw data, and sends processed sensor data to host computer 12. Altematively, the processor 26 can provide raw position data and odier input data to host computer 12, and the host computer 12 filters and computes velocity and acceleration from the raw position data. In other embodiments, me filtering can be performed on host computer 12 while the other processing can be performed on the processor 26.
  • the host computer determines the low-level force commands to provide force feedback to die user manipulating object 34.
  • force routines are used by the host which are provided local to the host and which are similar to the force routines used by microprocessor 26 as described above.
  • the host computer checks d e sensor data to determine if a change in low-level force applied to user object 34 is required. For example, if the user is controlling a simulated race car in a video game, die position of a joystick determines if the race car is moving into a wall and thus if a collision force should be generated on the joystick.
  • host computer 12 When a change in force is required, host computer 12 outputs appropriate low-level force commands to microprocessor 26 over bus 24.
  • These low-level force commands may include one or more force values and/or directions diat were determined in accordance with die parameters described above.
  • the force command can be ou ⁇ ut as an actual force signal diat is merely relayed to an actuator 30 by microprocessor 26; or, the force command can be converted to an appropriate form by microprocessor 26 before being sent to actuator 30.
  • the low-level force command preferably includes information indicating to microprocessor 26 which actuators are to receive this force value. The host application program is then processed/updated.
  • host computer 12 need not issue another command, since microprocessor 26 can continue to output the previous low-level force command to actuators 30. Altematively, host computer 12 can continuously output low-level commands, even if no change of force is required.
  • FIGURE 8 is a schematic diagram of an example of a user object 34 that is coupled to a gimbal mechanism 240 for providing two or more rotary degrees of freedom to object 34.
  • Gimbal mechanism 240 can be coupled to interface device 14 or be provided widi sensors 28 and actuators 30 separately from the other components of interface device 14.
  • Gimbal mechanism 38 in the described embodiment, provides support for apparatus 25 on a grounded surface 56 (schematically shown as part of member 46).
  • Gimbal mechanism 38 is preferably a five-member linkage that includes a ground member 46, extension members 48a and
  • Ground member 46 is preferably coupled to a base or surface which provides stability for apparatus 25.
  • Gimbal mechanism 240 can be supported by a grounded surface 242, which can be, for example, a surface of the housing of interface device 14 (schematically shown as part of member 244), a base, tabletop, or other surface that is fixed in position with reference to the user.
  • Gimbal mechanism 240 is preferably a five-member linkage that includes a ground member 244, extension members 246a and 246b, and central members 248a and 248b.
  • Ground member 244 is coupled to ground surface 242 which provides stability for mechanism 240.
  • Ground member 244 is shown in Figure 8 as two separate members coupled together through grounded surface 242, but is considered one "member" of the five member linkage.
  • the members of gimbal mechanism 240 are rotatably coupled to one another through the use of bearings or pivots, wherein extension member 246a is rotatably coupled to ground member 244 by bearing 243a and can rotate about an axis A, central member 248a is rotatably coupled to extension member 246a by bearing 245a and can rotate about a floating axis D, extension member 246b is rotatably coupled to ground member 244 by bearing 243b and can rotate about axis B, central member 248b is rotatably coupled to extension member 246b by bearing 245b and can rotate about floating axis E, and central member 248a is rotatably coupled to central member 248b by bearing 247 at a center point P at the intersection of axes D and E.
  • central member 248a is coupled to one rotatable portion 247a of bearing 47
  • central member 248b is coupled to the other rotatable portion 247b of bearing 247.
  • the axes D and E are "floating" in the sense that they are not fixed in one position as are axes A and B.
  • Axes A and B are substantially mutually pe ⁇ endicular.
  • substantially pe ⁇ endicular will mean that two objects or axis are exactly or almost perpendicular, i.e. at least within five degrees or ten degrees of perpendicular, or more preferably within less than one degree of pe ⁇ endicular.
  • Gimbal mechanism 240 is formed as a five member closed chain or loop, such diat a first member of the chain is coupled to the last member in the chain. Each end of one member is coupled to the end of another member.
  • the five-member linkage is arranged such that extension member 246a, central member 248a, and central member 248b can be rotated about axis A in a first degree of freedom.
  • the linkage is also arranged such that extension member 246b, central member 248b, and central member 248a can be rotated about axis B in a second degree of freedom.
  • an angle ⁇ between the central members 248a and 248b is about 90 degrees.
  • central members move in two fashions: rotation about axis D or E by bearing 245b and or 245a, and rotation about axis C by bearing 247 such d at angle ⁇ changes. For example, if the object 34 is moved into the page of Figure 3 away from the viewer, or out of the plane of the page toward the viewer, then the angle ⁇ will decrease. If the object is moved to the left or right as shown in Figure 3, the angle ⁇ will increase.
  • Linear axis member 250 is preferably an elongated rod-like member which is coupled to central member 248a and central member 248b at the point of intersection P of axes A and B.
  • Linear axis member 250 can be used as a shaft of user object 34, or, in other embodiments, linear axis member 250 can be coupled to a different object.
  • Linear axis member 250 is coupled to gimbal mechanism 240 such that it extends out of the plane defined by axis D and axis E.
  • Linear axis member 250 can be rotated about axis A (and E) by rotating extension member 246a, central member 248a, and central member 248b in a first revolute degree of freedom, shown as arrow line 251.
  • Member 250 can also be rotated about axis B (and D) by rotating extension member 250b and the two central members about axis B in a second revolute degree of freedom, shown by arrow line 252.
  • Linear axis member can also be translatably coupled to the ends of central members 248a and 248b, and thus can be linearly moved, independently with respect to the gimbal mechanism 240, along floating axis C, providing a third degree of freedom as shown by arrows 253.
  • Axis C can, of course, be rotated about one or both axes A and B as member 250 is rotated about these axes.
  • linear axis member 250 in some embodiments can rotated about axis C, as indicated by arrow 255, to provide an additional degree of freedom.
  • additional degrees of freedom can also be associated with additional sensors and actuators to allow processor 26/host computer 12 to read the position/motion of object 34 and apply forces in those degrees of freedom.
  • transducers such as the sensors 28 and actuators 30 of Figure 2.
  • Such transducers are preferably coupled at the link or bearing points between members of the apparatus and provide input to and output from microprocessor 26 and/or host computer system 12.
  • a sensors/actuator transducer 256 can be coupled to extension member 246b by a gear drive 258.
  • Gear drive 258 can include a drive wheel 255 and a rotatable cam 257 that interlock using gear teeth 253.
  • Cam 257 is rigidly coupled to extension member 246b and is rotatable with the member 246b with respect to ground 242.
  • Drive wheel is rigidly coupled to a rotating shaft of transducer 256 such that transducer 256 can rotate drive wheel 255, cam 257, and member 246b to ou ⁇ ut forces on user object 34 about axis B/D.
  • transducer 256 can sense rotation about axis B/D when member 246b, cam 257, and drive wheel 255 rotate.
  • a similar gear drive system can be provided at bearing 243a to sense and actuate movement about axis A/E.
  • different drive systems and transducers, sensors, and actuators can be used, as described above with reference to Figure 2.
  • a capstan drive or friction drive can be provided, and actuators and sensors can be provided for rotary or linear degrees of freedom of user object 34.
  • User object 34 is coupled to mechanism 240 and is preferably an interface object for a user to grasp or otherwise manipulate in three dimensional (3D) space.
  • User object 34 may be moved in both (or all three or four) degrees of freedom provided by gimbal mechanism 240 and linear axis member 250. As object 34 is moved about axis A, floating axis D varies its position, and as object 34 is moved about axis B, floating axis E varies its position.
  • the preferred embodiment for gimbal mechanism 240 is for a joystick user object that can be moved in two rotary degrees of freedom about axes A E and B/D.
  • linear axis member 250 can be replaced by a joystick handle diat is rigidly coupled to central member 248b.
  • Another preferred embodiment includes a third degree of freedom in which the joystick handle can rotate or "spin" about axis C.
  • These embodiments are most appropriate for video games and certain virtual reality type applications such as controlling a vehicle, first person point of view, etc.
  • Other embodiments include medical simulation and operation, for which the four degrees of freedom described above are more appropriate.
  • FIGURE 9 is a schematic diagram of circuit 260 for a touch plate safety switch 262 of the present invention. Like the optical and contact safety switches described with reference to Figure
  • the touch plate safety switch is designed to be contacted by a user while the interface device is in use.
  • the actuators 30 of the interface device are deactivated and pose no hazard to the user.
  • Touch plate safety switch 262 is designed so that the user does not have to press a button or otherwise actively control a switch, which can be awkward and tiresome during operation of the joystick or other user object 34.
  • Two touch plates 264 are provided on die exterior of die interface device 14, preferably in a position which is naturally underneath the grip of a user who is grasping the user object 34.
  • the two plates can be provided on a joystick handle, as shown in FIGURE 9a, near the midsection of the handle where users typically contact it.
  • the contacts might be additionally or alternately provided on the top portion of the joystick 34.
  • Touch plates 264 are preferably made of a metal or other conductive material. When the user touches both plates with skin, a circuit is closed through the user, providing a deadman signal to the microprocessor, host computer, and/or actuators 30 that the safety switch is closed and that the actuators can be enabled. Then the user does not contact both plates 264, no current can flow and the safety switch is open, disabling the actuators 30 from functioning.
  • Touch plate 264a is coupled to a circuit 266 which outputs a "deadman" signal 270 as a high (5 V) signal when the user contacts both plates.
  • Circuit 266 includes two capacitors, diree resistors, 4 inverters, and a diode.
  • Touch plate 26b is coupled to a circuit 268 which allows die current to flow to ground.
  • Circuit 268 includes three resistors, two capacitors, and two inverters. The function and implementation of these components are well known to those skilled in d e art. Other equivalent circuits can also be used to perform substantially the same functions, and are well known to those skilled in the art.
  • FIGURE 10 is a diagrammatic illustration of a joystick 280 including a hand-weight safety switch of the present invention.
  • the safety switch 41 as described in Figures 2 and 9, is included in joystick 260 so that die user must activate the switch before actuators 30 are able to output forces. This is a safety feature that prevents the user object from unexpectedly moving and impacting the user when the user is not controlling the user object.
  • Safety switches such as contact switches, light detectors, and other types of switches were described above which die user contacts or covers during operation of the joystick and are located on the user object or housing of die interface device 14. This can be awkward during operation of die stick since the user must constantly contact or cover a specific area of the user object or device housing.
  • Joystick 260 includes a hand-weight safety switch 262 which can be used to replace or supplement safety switch 41 and is more convenient for the user.
  • Joystick 260 includes a translatable handle 264, a base 266, a spring 268, and switch contacts 270.
  • Handle 264 is a standard joystick handle, but can also be replaced with other user objects 34 as described above. Handle 264 can be moved along axis C within a range distance d of the base 266 preferably on an extension member 272 or other similar guide. Distance d is preferably relatively small, such as 1 millimeter, and is exaggerated in Figure 8 for clarity.
  • Pre-loaded spring 268 preferably forces me handle 264 up away from base 266 in a direction indicated by arrow 274 to an "open" position when no weight is placed on handle 264.
  • a stop (not shown) coupled to the top of member 272 or to the bottom of handle 264 prevents the handle from being detached from me base 266.
  • a similar limit to movement of handle 264 in the direction of base 266 is provided by die physical engagement of the handle and base.
  • Switch contacts 270 are provided between the base 266 and handle 264 of joystick 260. Contacts 270 are connected by lines 276 to microprocessor 26, which can monitor when die contacts are touching. When the handle 264 is in the open position, contacts 270 are separated and no electrical current can flow between them, and thus no electrical current or power can flow to the motors from me power supply. Altematively, contacts 270 can be connected to microprocessor 26 or another selecting component which can detect the open state of the contacts and can deactivate actuators 30 with a safety disable signal when the open state is detected. The actuators 30 are thus prevented from outputting forces when d e user does not have control of the joystick handle 264 and the interface device 14.
  • the hand-weight safety switch has several advantages over other types of safety switches.
  • the user can simply grasp or hold the handle in a normal, comfortable fashion and still activate the safety switch due to the weight of the user's hand.
  • the user need not cover or press an awkwardly-located switch in a particular location of the handle or housing.
  • Another advantage is concerned with the transportability of the interface device 14.
  • users can pick up the interface device easily and move it to desired locations.
  • a natural way for a user to pick up a joystick is to hold and pull on the handle 264.
  • a standard force feedback joystick may present some danger to a user when picked up by the handle, since die actuators 30 will cause the base of the joystick to move and flail about.
  • die actuators 30 will cause the base of the joystick to move and flail about.
  • this danger does not exist: the actuators are activated only if the user provides weight on the handle, and the pulling and carrying of the handle will not provide this weight and will not activate the actuators.
  • FIGURE 1 1 is a diagrammatic illustration of a break-away joystick 280 of the present invention. Since forces are exerted on the user object 34 and the user from actuators 30, mere is a potential for too strong a force to be output and to injure a user. As a safety measure, a break ⁇ away joystick 280 or other break-away user object 34 can be implemented.
  • Break-away joystick 280 includes a handle 282, a base 284, and a securing device 286. In normal operation, handle 282 is secured to base 284 through securing device 286. Securing device 286 can be, for example, magnets that hold the base and handle together by magnetic fields. Oppositely-polarized magnets can be provided in the contacting portions of the base and handle.
  • the magnets can be particularly chosen to provide a predetermined attachment strength.
  • a user applies force to handle 282 during operation of the interface device, and the actuators 30 apply forces to base 284 to provide force feedback to the user.
  • a total force on die handle and base is thus equal to the sum of the force on the handle from the user and the force in the opposite direction on the base from the actuators.
  • a total force greater than a predetermined magnitude is applied to die break ⁇ away joystick, then d e handle detaches from the base.
  • other securing devices or materials can be used, such as velcro, mechanical or electro-mechanical fastening devices, etc.
  • FIGURES 1 la-1 1 c show the break-away joystick in operation.
  • a user grasps handle 282 and forces the handle in direction of arrow 290.
  • an actuator 30 provides force in a direction of arrow 292 to base 284. Combined, these forces add up to a total force greater than the predetermined force which the securing device can withstand.
  • the handle breaks away from the base in the direction die user was forcing the handle while the base moves in the direction forced by the actuators 30.
  • stops may be provided in the degrees of freedom of the joystick to provide limits to the movement of the joystick.
  • the handle may detach if the force from the user on d e handle is over the predetermined limit when the base is positioned against a stop such that the stop provides a force in the opposite direction to the user's force.
  • Figure 1 Id shows an alternate embodiment 280' of the break-away joystick 280.
  • Joystick 280' includes one or more controls 294 on the handle 282 that are available for the user to manipulate to provide other input 39, such as buttons, switches, or other input devices. Since input signals from control 294 are provided to die microprocessor and/or host computer 12, me signals are routed from the control 294 on the handle through a wire bundle 296. Wire bundle 296 is provided with extra length so that when handle 282 breaks from base 284, the wire bundle will not break. The wire bundle is routed through base 284 through an aperture 298 and is coupled to the microprocessor or is directly routed to host computer 12 as explained in die above described embodiments.
  • handle 282 and base 284 can be provided with mating conductive pads that are in contact when the handle 282 is mated with die base 284 and allow button signals to be transmitted to base 284 only when the handle and base are engaged.
  • the handle conductive pad is coupled to die button 294 and die base conductive pad is coupled to a wire diat runs to die microprocessor or other control components of the interface device. Signals from button 294 can thus be transmitted through joystick 280 when the handle and base are engaged and the conductive pads are in contact.
  • die joystick handle 282 breaks away from base 284, the conductive pads are no longer in contact and no signals from button 294 are transmitted to base 284.

Abstract

A method and apparatus for providing safe and low-cost force feedback peripherals for consumer applications. A device microprocessor (26) local to an interface device (14) is coupled to the host (12) by a first interface bus (24). The microprocessor receives host commands from the host computer on the first interface bus, such as an RS-232 interface, and commands an actuator (30) to apply a force to a user object (22), such as a joystick, in response to host commands. A sensor (28) detects positions of the user object and outputs signals to the host on a second interface bus (25), such as a PC game port bus, separate from the firt bus. A safety switch (41) of the present invention disables the actuator when the interface device is not in use and enables the actuator when an amount of weight over a predetermined amount is placed on the joystick created by a user grasping the joystick.

Description

SAFE AND LOW COST COMPUTER PERIPHERALS WITH FORCE FEEDBACK FOR CONSUMER APPLICATIONS
BACKGROUND OF THE INVENTION
The present invention relates generally to interface devices between humans and computers, and more particularly to computer interface devices that provide force feedback to the user.
Computer systems are used extensively in many different industries to implement computer controlled simulations, games, and other application programs. More particularly, these types of games and simulations are very popular with the mass market of home consumers. A computer system typically displays a visual environment to a user on a display screen or other visual output device. Users can interact with the displayed environment to play a game, experience a simulation or "virtual reality" environment, or otherwise influence events or images depicted on the screen. Such user interaction can be implemented through the use of a human- computer interface device, such as a joystick, "joypad" button controller, mouse, trackball, stylus and tablet, foot or hand pedals, or the like, that is connected to the computer system controlling the displayed environment. The computer updates the game or simulation in response to the user's manipulation of a moved object such as a joystick handle or mouse, and provides feedback to the user utilizing the display screen and, typically, audio speakers.
In some interface devices, haptic (e.g., tactile) feedback is also provided to the user, more generally known as "force feedback." These types of interface devices can provide physical sensations to the user manipulating the physical object of the interface device. Typically, motors or other actuators are coupled to the interface object and are connected to the controlling computer system. The computer system receives sensor signals from the interface device and sends appropriate force feedback control signals to the actuators of the interface device in conjunction with simulation/game events. The actuators then provide forces on the interface object. The computer system can thus convey physical sensations to the user in conjunction with other visual and auditory feedback as the user is grasping or contacting the object of the interface device. Force feedback interface devices can provide a whole new modality for human-computer interaction.
Force feedback input output (I/O) devices of the prior art have concentrated on providing maximum haptic fidelity, i.e., the realism of the haptic feedback was desired to be optimized. This is because most of the force feedback devices have been targeted at the specific needs of highly industrial or scientific applications, and not a mass consumer market. To attain such realism, design concerns useful the mass market such as low size and weight, low complexity, programming compatibility, low cost, and safety have been sacrificed in the prior art. As a result, typical force feedback interface devices include complex robotic mechanisms which require precise, bulky, and expensive components that have significant power requirements and are difficult to program for applications.
In addition, the prior art force feedback devices typically use a host computer to close a control loop around the system to generate sensations and maintain safety and stability through direct host control. FIGURE 1 illustrates a block diagram of a control system 2 having a typical host controlled loop. A user manipulated object 3, such as a joystick or similar object, is moved by a user to interface with a host computer 4 with a display device 5. Sensors 6 detect the position of the user object in provided degrees of freedom and may also include buttons or other controls that detect user actions such as the press of a button. The sensor data including positional and button data is sent to host computer 4 over a bi-directional communication bus 7 that is typically connected to an interface card plugged into the host computer. To complete the control loop, host computer 4 sends force commands over bus 7 to actuators 8, and the actuators output forces on the object 3 to the user. The functions of reading sensor data and outputting force values to actuators 7 can be a burden on the host processor which detracts from the performance of the host in other host tasks and application execution.
An important concern for a force feedback interface device is communication bandwidth between the controlling computer and the interface device. To provide realistic force feedback, the complex devices of the prior art typically use high speed communication electronics that allow the controlling computer to quickly send and update force feedback signals to the interface device. The more quickly the controlling computer can send and receive signals to and from the interface device, the more accurately and realistically the desired forces can be applied on the interface object. In addition, using a high bandwidth communication interface, force feedback can be accurately coordinated with other supplied feedback, such as images on the video screen, and with user inputs such as movement of the object, activated buttons, etc.
A problem is evident when prior art force feedback interface devices are provided to the mass consumer market. Most home computers have a built-in standard serial communication interfaces, such as an RS-232 interface, RS-422 interface, "game port", Universal Serial Bus interface, or Ethernet interface that may conveniently be used to connect peripherals like a force feedback interface device to the host computer. In addition, manufacturers prefer to provide peripheral devices that use these serial interfaces, since no additional hardware, such as interface cards, needs to be provided with such peripherals. The manufacturing cost of the peripheral device can thus be significantly reduced. However, these standard serial communication interfaces are typically quite slow (i.e. have low bandwidth) compared to other communication interfaces. Realistic and accurate force feedback thus becomes difficult to provide by a controlling computer system to a prior art interface device connected through such a serial interface in comparison with other interfaces such as a direct interface card (e.g., ISA or PCI card) connecting to the data bus of the host computer.
Another important concern in the mass market industry is the issue of user safety. Because a force feedback device can impart physical forces upon the user, the potential for injury must be carefully addressed. To provide a safety measure for the user, the force feedback devices of the prior art typically include a safety or "deadman" switch which the user must activate to allow forces to be applied to the user manipulable object. If the user does not close the switch, no forces can be output. The safety switches of the prior art are typically a button or a pedal which the user must continually press or hold down to allow power to be received by the actuators. However, such safety switches can be cumbersome and/or tiring for the user to close, since the user must constantly maintain a particular grip or position to feel forces. In addition, these types of safety switches are easy to defeat by users; for example, an elastic band can be wrapped around a safety button to keep the button depressed, which defeats the entire safety purpose of the safety switch.
Finally, mass market force feedback interface devices must necessarily be low cost devices that are simple to manufacture so that the device is competitively priced in the high volume, aggressive home computer and home video game markets.
SUMMARY OF THE INVENTION
The present invention is directed to implementations of a human/computer interface device for controlling and providing force feedback to a user. Several implementations are provided to decrease the cost in manufacturing an interface device and making the device safe for the high volume consumer market of computer and video game users.
More particularly, one embodiment of an interface apparatus and method of the present invention for interfacing motion of a user manipulable object with a host computer includes a user object, such as a joystick, physically contacted by a user and having at least one degree of freedom of movement. A device microprocessor local to the interface apparatus and separate from the host computer is coupled to the host by a first interface buses. The microprocessor receives host commands from the host computer on the first interface bus. An actuator applies a force along said degree of freedom to the user object in response to microprocessor force commands produced by the device microprocessor. A sensor for detecting a position of the user object along the degree of freedom and outputs sensor signals. The sensor signals are received by the host computer on a second interface bus separate from the first interface bus. The host computer updates a host application process, such as a simulation or video game, in response to the sensor signals.
Preferably, the first interface bus is an RS-232 interface bus or similar serial standard. The second interface bus is preferably a standard game port interface bus coupled to a game port of the host computer or the equivalent. Force feedback commands are sent by the host over the serial interface bus and the sensor signals are received by the host in the traditional way via the game port. The interface device can thus be used as a standard joystick without force feedback by utilizing only the game port interface in communication with the host computer, and allows backward compatibility for non-force-feedback functionality via standard game port drivers.
In some embodiments, the device microprocessor receives the sensor signals to compute force values to output to the actuators. A second sensor can be used to detect the position of the joystick independently of the host sensor and output sensor signals to the microprocessor. The local microprocessor receives high-level host commands and can implement independent force routines that receive sensor signals and compute forces. The force routines can be stored in memory local to the interface apparatus. Preferably, a button device is coupled to the interface apparatus that provides a button input signal to the microprocessor when the user presses the button. The microprocessor provides the button input signal to the host computer over the game port interface bus. In addition, the microprocessor preferably deactivates the actuator when at least one of the multiple interface buses is disconnected from the host computer or disconnected from the interface apparatus.
In a different "recoil" embodiment of the interface apparatus, the interface device includes an actuator that applies a force on the user object. A user-selectable control, such as a button provided on the joystick, sends an activation signal to the actuator when the user activates the button and thereby instructs the actuator to apply the force on said user object in a reflex process independent of the host computer. This force, for example, can be a recoil or jolt that is output whenever the user selects the button. In one embodiment, the actuator applies the force on the joystick only when the user activates the button. In a different embodiment, the host computer is coupled to the actuator by a second interface and transmits an enable signal to the joystick. The actuator applies the force only when the user activates the button and when the enable signal is provided. In a yet another embodiment, the host computer may additionally send a simple activation signal to the actuator to command the actuator to apply the force to the user object regardless of whether the button is pressed by the user. The host can control the actuator using only a very small amount of information, and can use a parallel interface or a serial port used as a parallel interface. A user enable switch on said interface device can, when selected or deselected by the user, enable or disable the recoil reflex process.
In a different, more complex "recoil" embodiment, the host computer can send a greater amount of control signals and/or other information to the actuators than in other recoil embodiments of the interface device by providing the control signals serially. One or more shift registers covert the serial data to parallel information that is provided to programmable logic. The logic sends the control signals, such as enable and activation signals, to the actuator and other components as necessary. A sensor outputs sensor signals to the host computer via a second interface bus as described above.
A force feedback interface device of the present invention for safe use by a user includes a sensor for sensing a joystick's position and an actuator for applying a force to the joystick. A safety switch is coupled to the joystick for disabling the actuator when the user is not using the interface device. One safety switch of the present invention enables the actuator when an amount of weight over a predetermined amount is placed on the joystick, such as the amount of weight created by a user grasping the joystick. The joystick includes a handle portion translatably coupled to a base portion. The safety switch includes a contact on the handle portion and a contact on the base portion such that when the predetermined amount of weight is applied to the joystick, the contacts engage to allow electrical current to flow. A spring member forces the portions apart from each other when less than the predetermined amount of weight is applied to the joystick. A different touch plate safety switch feature similarly allows the actuators to be powered only when the user is touching the provided touch plates. A separate break-away joystick safety feature can also be included which comprises a safety break handle that breaks off from the interface apparatus when a force over a predetermined threshold is applied to the joystick. The safety break-away handle can be attached to the interface apparatus, for example, by magnets.
A circuit of the present invention for storing power in a force feedback interface device that interfaces a user with a host computer system includes a capacitor for storing power provided by a signal input to the circuit. A sensing device coupled to the capacitor senses when the capacitor is fully charged by monitoring the input signal to determine when the capacitor is fully charged. A control device provides a control signal to a driver and actuator so that the actuator can apply force to a user object of the interface device. The stored power from the capacitor is supplied to the actuator when applying the force. A current limiter limits the current of the input signal and provides the limited current to the capacitor. The input voltage signal can be received from a game port interface bus coupled to the host computer system or from a power supply included in the interface device.
The interface apparatus of the present invention includes several low cost components that are suitable for providing accurate force feedback for the high volume home consumer market and similar markets. The use of the parallel combination of a serial bus and a game port bus, coupled to two ports of the host computer system, allows one bus to be used to send signals to the host and the other bus to receive force commands from the host, thus providing a very low cost system having realistic force feedback. The local device microprocessor processes commands independently of the host computer, thus saving significant processing time on the host computer. Other low cost embodiments require no or minimal force commands from the host, allowing simple force feedback to be provided to users. The power circuit of the present invention allows smaller power supplies to be used or eliminates the need for a power supply.
The safety features of the present invention herein also are important when supplying force feedback devices to the home consumer market. The hand-weighted safety switch allows a user to conveniently operate the interface device and provides necessary safety shut-down features. The communication line safety feature allows the actuators to be deactivated in the event of a disconnection between interface device and host computer. These improvements allow a computer system to provide accurate and realistic force feedback in a safe, low-cost low bandwidth communication interface and is thus ideal for the mass market of computer and game systems.
These and other advantages of the present invention will become apparent to those skilled in the art upon a reading of the following specification of the invention and a study of the several figures of the drawing. BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is a block diagram of a prior art control system for a force feedback interface device;
Figure 2 is a block diagram of a control system in accordance with the present invention for controlling a force feedback interface device from a host computer;
Figures 3 and 3a-b are schematic diagrams of a low-cost embodiment of the force feedback interface device of Figure 2;
Figures 4a-4f are block diagrams of an altemative low-cost "recoil" embodiments of the interface device of Figure 2;
Figures 5 and 5a-c are schematic diagrams of an alternative low-cost embodiment of the interface device of Figure 2 having no local microprocessor;
Figure 6 is a block diagram of a power circuit of the present invention for use with a force feedback interface device;
Figure 7 is a flow diagram illustrating an embodiment of a method of the present invention for controlling a force feedback interface device;
Figure 8 is a schematic diagram of a five bar linkage mechanism for providing multiple degrees of freedom to the user object of the interface device;
Figure 9 is a schematic diagram of a circuit for a touch plate safety switch of the present invention;
Figure 9a is a perspective view of an example of a joystick including the touch plate safety switch of Figure 9;
Figure 10 is a diagrammatic illustration of a hand weight safety switch of the present invention;
Figure 1 1 is a diagrammatic illustration of a break away joystick safety feature of the present invention; and
Figures 1 la-1 Id are diagrammatic illustrations of the operation of the joystick of Figure 9. DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
FIGURE 2 is a block diagram illustrating a generic control system 10 of the present invention for a force feedback interface device controlled by a host computer system. Control system 10 includes a host computer system 12 and an interface device 14 (or "force feedback peripheral").
Host computer system 12 ("host") is preferably a personal computer, such as an IBM- compatible or Macintosh personal computer, or a workstation, such as a SUN or Silicon Graphics workstation. For example, the host computer system can a personal computer which operates under the MS-DOS or Windows operating systems in conformance with an IBM PC AT standard. Altematively, host computer system 12 can be one of a variety of home video game systems commonly connected to a television set, such as systems available from Nintendo, Sega, or Sony. In other embodiments, home computer system 12 can be a more application specific "set top box" or "internet computer" which can be used, for example, to provide interactive television or information functions to users.
In the described embodiment, host computer system 12 implements a host application program with which a user 22 is interacting via peripherals and interface device 14. For example, the host application program can be a video game, medical simulation, scientific analysis program, or even an operating system or other application program that utilizes force feedback. Typically, the host application provides images to be displayed on a display output device, as described below, and/or other feedback, such as auditory signals.
Host computer system 12 preferably includes a host microprocessor 16, random access memory (RAM) 17, read-only memory (ROM) 19, input/output (I/O) electronics 21, a clock 18, a display screen 20, and an audio output device 21. Host microprocessor 16 can include a variety of available microprocessors from Intel, Motorola, Advanced Micro Devices, or other manufacturers. Microprocessor 16 can be single microprocessor chip, or can include multiple primary and/or co-processors. Microprocessor preferably retrieves and stores instructions and other necessary data from RAM 17 and ROM 19, as is well known to those skilled in the art. In the described embodiment, host computer system 12 can receive sensor data or a sensor signal via a bus 24 from sensors of interface device 14 and other information. Host microprocessor 16 can receive or transmit data on bus 24 using I/O electronics 21, and can use I/O electronics to control other peripheral devices. Host computer system 12 can also output a "force command" to interface device 14 via bus 24 to cause force feedback by the interface device. Clock 18 is a standard clock crystal or equivalent component used by host computer system 12 to provide timing to electrical signals used by microprocessor 16 and other components of the computer system. Clock 18 is accessed by host computer system 12 in the control process of the present invention, as described subsequently.
Display screen 20 is coupled to host microprocessor 16 by suitable display drivers and can be used to display images generated by host computer system 12 or other computer systems. Display screen 20 can be a standard display screen or CRT, 3-D goggles, or any other visual interface. In a described embodiment, display screen 20 displays images of a simulation or game environment. In other embodiments, other images can be displayed. For example, images describing a point of view from a first-person perspective can be displayed, as in a virtual reality simulation or game. Or, images describing a third-person perspective of objects, backgrounds, etc. can be displayed. A user 22 of the host computer 12 and interface device 14 can receive visual feedback by viewing display screen 20.
Herein, computer 12 may be referred as displaying computer "objects" or "entities." These computer objects are not physical objects, but are logical software unit collections of data and/or procedures that may be displayed as images by computer 12 on display screen 20, as is well known to those skilled in the art. For example, a cursor or a third-person view of a car might be considered player-controlled computer objects that can be moved across the screen. A displayed, simulated cockpit of an aircraft might also be considered an "object", or the simulated aircraft can be considered a computer controlled "entity."
Audio output device 21, such as speakers, is preferably coupled to host microprocessor 16 via amplifiers, filters, and other circuitry well known to those skilled in the art. Host processor 16 outputs signals to speakers 21 to provide sound output to user 22 when an "audio event" occurs during the implementation of the host application program. Other types of peripherals can also be coupled to host processor 16, such as storage devices (hard disk drive, CD ROM drive, floppy disk drive, etc.), printers, and other input and output devices.
An interface device 14 is coupled to host computer system 12 by an interface bus 24. Bus 24 sends signals in one or both directions between host computer system 12 and the interface device. Herein, the term "bus" is intended to generically refer to any interface, connection, or communication link such as between host computer 12 and a peripheral such as interface device 14 which typically includes one or more connecting wires, lines, cables, or other connections and that can be implemented in a variety of ways. In the preferred embodiment, bus 24 is a serial interface bus providing data according to a serial communication protocol. An interface port of host computer system 12, such as an RS-232 serial interface port, connects bus 24 to host computer system 12. Other standard serial communication protocols can also be used for the serial interface and bus 24, such as RS-422, Universal Serial Bus (USB), MIDI, system-specific ports on a Sega, Sony, etc. game system, or other protocols or standards well known to those skilled in the art.
For example, the USB standard provides a relatively high speed serial interface that can provide force feedback signals in the present invention with a high degree of realism. USB can also source more power to drive peripheral devices. Since each device that accesses the USB is assigned a unique USB address by the host computer, this allows multiple devices to share the same bus. In addition, the USB standard includes timing data that is encoded along with differential data. The USB has several useful features for the present invention, as described throughout this specification.
An advantage of the present invention is that low-bandwidth serial communication signals can be used to interface with interface device 14, thus allowing a standard built-in serial interface of many computers to be used directly. Alternatively, a parallel port of host computer system 12 can be coupled to a parallel bus 24 and communicate with interface device using a parallel protocol, such as SCSI or PC Parallel Printer Bus. In a different embodiment, bus 24 can be connected directly to a data bus of host computer system 12 using, for example, a plug-in interface card and slot or other access of computer system 12. For example, on an IBM AT compatible computer, the interface card can be implemented as an ISA, EISA, VESA local bus, PCI, or other well-known standard interface card which plugs into the motherboard of the computer and provides input and output ports for connecting the main data bus of the computer to bus 24.
In another embodiment, an additional bus 25 can be included to communicate between host computer system 12 and interface device 14. Since the speed requirement for communication signals is relatively high for outputting force feedback signals, the single serial interface used with bus 24 may not provide signals to and from the interface device at a high enough rate to achieve realistic force feedback. In such an embodiment, bus 24 can be coupled to the standard serial port of host computer 12, while an additional bus 25 can be coupled to a second port of the host computer system. For example, many computer systems include a "game port" in addition to a serial RS-232 port to connect a joystick or similar game controller to the computer. The two buses 24 and 25 can be used simultaneously to provide an increased data bandwidth. For example, microprocessor 26 can send sensor signals to host computer 12 via a game port bus 25, while host computer 12 can output force feedback signals from a serial port to microprocessor 26 via a uni-directional bus 24. Such an embodiment is described in greater detail below with respect to Figure 3. Other combinations of data flow configurations and buses can be implemented in other embodiments. For example, game port bus 25 can be directly connected from the sensors 28 (shown as bus 25a) or from the sensor interface 36 (shown as bus 25b) to the game port of the host computer 12 in some embodiments (as in Figure 3).
Another important feature that is desirable in the force feedback control system 10 is a communication line between the host computer 12 and the interface device 14 that incorporates user safety. Since forces are being generated on user object 34 by actuators 30 (as explained below), the interface device can potentially present some danger to a user if the buses 24 and/or 25 become disconnected during operation. Once the control of the force feedback from the host computer is disabled, the forces generated can become unpredictable. Thus, it is desirable for the actuators 30 to become deactivated if buses 24 and/or 25 are disconnected during operation. In the present invention, this feature can be implemented by designating one of the lines of bus 24 and/or one of the lines of bus 25 as a "life line." The microprocessor periodically reads the life line signals to check if the buses are still connected. If the device is unplugged, the microprocessor will not detect the signal and will consider the state to be "disconnected." If no signal is detected, then the microprocessor automatically sends a deactivation signal to the actuators. Likewise, in some embodiments, the host computer can periodically check a life line signal output from the microprocessor on one of the buses 24 or 25. If no such signal is detected, the host computer can output a deactivate actuators command on the other bus 24 or 25 (if still connected). In embodiments having no microprocessor 26 (see below), the life line can be coupled to a safety switch 41. For an RS-232, RS-422, or game port interface, one of the control lines in the interface bus can be used as the life line. When using a USB interface, the "Attach-Detach" feature inherent to the USB standard can conveniently be used for the life line.
It should be noted that bus 24 and bus 25 can be provided as either a uni-directional bus or a bi-directional bus. In the embodiment having both buses 24 and 25, they can both be uni¬ directional buses, which have several advantages for the described embodiments. This allows the full bandwidth of each bus to be used for one direction of data transfer, causing data communication rates to double compared to normal bi-directional use of each bus. Also, the communication protocol for each bus can be simplified in uni-directional operation. In addition, uni-directional driver software on the host computer can be simpler and require less processor time than software for bi-directional communication.
In yet anodier embodiment, signals traveling between the host computer system 12 and the interface device 14 can be sent and received using wireless transmission. For example, an antenna can be included in both interface device 14 and in host computer 12 to send and receive electromagnetic signals, such as radio signals, infrared signals, or microwave signals. In such an embodiment, a "bus" 24 or 25 can conceptually include a medium or channel of transmission reception, such as the air. Interface device 14 is a peripheral for host 12 that includes a local microprocessor 26, sensors 28, actuators 30, a user object 34, optional sensor interface 36, an optional actuator interface 38, and other optional input devices 39. Interface device 14 may also include additional electronic components for communicating via standard protocols on bus 24. For example, a separate Universal Asynchronous Receiver/Transmitter (UART) or level shifter might be included to receive/convert signals on bus 24; or, such components can be included on microprocessor 26. The embodiment of Figure 2 provides a control loop between microprocessor 26, actuators 30, user object 34, and sensors 28 (which are connected back to microprocessor 26). Unlike the prior art embodiment shown in Figure 1 , the host computer 12 is not included in the control loop, thus freeing the host of many routine tasks and allowing it to allocate host processor time to other tasks. The microprocessor 26 can receive high level commands from the host and handle the routine tasks of the control loop in reflex processes, as discussed below.
In the preferred embodiment, multiple interface devices 14 can be coupled to a single host computer system 12 through bus 24 (or multiple buses 24) so that multiple users can simultaneously interface with the host application program (in a multi-player game or simulation, for example). In addition, multiple players can interact in the host application program with multiple interface devices 14 using networked host computers 12, as is well known to those skilled in the art.
Local microprocessor 26 (or "device microprocessor") is coupled to bus 24 and is preferably included within the housing of interface device 14 to allow quick communication with other components of the interface device. Processor 26 is considered "local" to interface device 14, and is a separate microprocessor from any microprocessors in host computer system 12. For example, the local processor 26 does not share a data bus, address bus, and/or memory with the host processor(s) 16. "Local" also preferably refers to processor 26 being dedicated to force feedback and sensor I/O of interface device 14, and being closely coupled to sensors 28 and actuators 30, such as within the housing for interface device or in a housing coupled closely to interface device 14. Microprocessor 26 is provided with software instructions to instruct the processor to wait for commands or requests from computer host 16, decode and/or parse the commands or requests, manipulate data and select routines, and handle/control input and output signals according to the commands or requests. In addition, processor 26 preferably operates independently of host computer 16 by reading sensor signals and calculating appropriate forces from those sensor signals, time signals, and a "force routine" selected in accordance with a host command, as described with reference to Figure 7. Suitable microprocessors for use as local microprocessor 26 include the MC68HC71 1E9 by Motorola and the PIC16C74 by Microchip, for example; other well-known types of microprocessors can also be used. Microprocessor 26 can include one microprocessor chip, or multiple processors and/or co-processor chips. In other embodiments, microprocessor 26 can includes a digital signal processor (DSP) chip. Local memory 27, such as RAM and/or ROM (EPROM, EEPROM, etc.), is preferably coupled to microprocessor 26 in interface device 14 to store instructions for microprocessor 26 and store temporary and other data. Microprocessor 26 can receive signals from sensors 28 and provide signals to actuators 30 of the interface device 14 in accordance with instructions provided by host computer 12 over bus 24.
In addition, a local clock 29 can be coupled to the microprocessor 26 to provide timing data, similar to system clock 18 of host computer 12; the timing data might be required, for example, to compute forces output by actuators 30 (e.g., forces dependent on calculated velocities or other time dependent factors). In altemate embodiments using the USB communication interface, timing data for microprocessor 26 can be retrieved from the USB signal. The USB has a clock signal encoded with the data stream which can be used. Alternatively, the Isochronous (stream) mode of USB can be used to derive timing information from the standard data transfer rate. The USB also has a Sample Clock, Bus Clock, and Service Clock that also may be used.
For example, in the preferred "reflex" embodiment, host computer system 12 provides high level supervisory commands to microprocessor 26 over bus 24, and microprocessor 26 manages low level force control ("reflex") loops to sensors 28 and actuators 30 in accordance with force routines selected by the high level commands. In a different embodiment, host computer 12 can provide low-level force commands over bus 24, which microprocessor 26 directly transfers to actuators 30. These embodiments are described in greater detail with respect to the method of Figure 7.
Microprocessor 26 preferably also has access to an electrically erasable programmable ROM (EEPROM) or other memory storage device 27 for storing calibration parameters. The calibration parameters can compensate for slight manufacturing variations in different physical properties of the components of different interface devices made from the same manufacturing process, such as physical dimensions. The calibration parameters can be determined and stored by the manufacturer before the interface device 14 is sold, or optionally, the parameters can be determined by a user of the interface device. The calibration parameters are used by processor 26 to modify the input sensor signals and/or output force values to actuators 30 to provide approximately the same range of forces on object 34 in a large number of manufactured interface devices 14. The implementation of calibration parameters is well-known to those skilled in the art.
Microprocessor 26 can also receive commands from any other input devices included on interface apparatus 14 and provides appropriate signals to host computer 12 to indicate that the input information has been received and can send any information included in the input information. For example, buttons, switches, dials, or other input controls on interface device 14 or user object 34 can provide signals to microprocessor 26. Input information might be directly sent to the host computer from the microprocessor, or it may be processed or combined with other data that is sent to the host.
In the preferred embodiment, sensors 28, actuators 30, and microprocessor 26, and other related electronic components are included in a housing for interface device 14, to which user object 34 is directly or indirectly coupled. Altematively, microprocessor 26 and or other electronic components of interface device 14 can be provided in a separate housing from user object 34, sensors 28, and actuators 30. Also, additional mechanical structures may be included in interface device 14 to provide object 34 with desired degrees of freedom. An example of such a mechanism is described with reference to Figure 8.
Sensors 28 sense the position, motion, and or other characteristics of a user object 34 of the interface device 14 along one or more degrees of freedom and provide signals to microprocessor 26 including information representative of those characteristics. An example of an embodiment of a user object and movement within provided degrees of freedom is described subsequently with respect to Figure 8. Typically, a sensor 28 is provided for each degree of freedom along which object 34 can be moved. Altematively, a single compound sensor can be used to sense position or movement in multiple degrees of freedom. An example of sensors suitable for several embodiments described herein are digital optical encoders, which sense the change in position of an object about a rotational axis and provide digital signals indicative of the change in position. The encoder, for example, responds to a shaft's rotation by producing two phase-related signals in the rotary degree of freedom. Linear optical encoders similarly sense the change in position of object 34 along a linear degree of freedom, and can produces the two phase- related signals in response to movement of a linear shaft in the linear degree of freedom. Either relative or absolute sensors can be used. For example, relative sensors only provide relative angle information, and thus usually require some form of calibration step which provide a reference position for the relative angle information. The sensors described herein are primarily relative sensors. In consequence, there is an implied calibration step after system power-up wherein a sensor's shaft is placed in a known position within interface device and a calibration signal is provided to the system to provide the reference position mentioned above. All angles provided by the sensors are thereafter relative to that reference position. Altematively, a known index pulse can be provided in the relative sensor which can provide a reference position. Such calibration methods are well known to those skilled in the art and, therefore, will not be discussed in any great detail herein. A suitable optical encoder is the "Softpot" from U.S. Digital of Vancouver, Washington.
Sensors 28 provide an electrical signal to an optional sensor interface 36, which can be used to convert sensor signals to signals that can be inteφreted by the microprocessor 26 and/or host computer system 12. For example, sensor interface 36 receives the two phase-related signals from a sensor 28 and converts the two signals into another pair of clock signals, which drive a bi¬ directional binary counter. The output of the binary counter is received by microprocessor 26 as a binary number representing the angular position of the encoded shaft. Such circuits, or equivalent circuits, are well known to those skilled in the art; for example, the Quadrature Chip LS7166 from Hewlett Packard, California performs the functions described above. Each sensor 28 can be provided with its own sensor interface, or one sensor interface may handle data from multiple sensors. Alternately, microprocessor 26 can perform these interface functions without the need for a separate sensor interface 36. The position value signals can be used by microprocessor 26 and are also sent to host computer system 12 which updates the host application program and sends force control signals as appropriate. For example, if the user moves a steering wheel object 34, the computer system 12 receives position and/or other signals indicating this movement and can move a displayed point of view of the user as if looking out a vehicle and turning the vehicle. Other interface mechanisms can also be used to provide an appropriate signal to host computer system 12. In alternate embodiments, sensor signals from sensors 28 can be provided directly to host computer system 12, bypassing microprocessor 26. Also, sensor interface 36 can be included within host computer system 12, such as on an interface board or card.
Alternatively, an analog sensor such as a potentiometer can be used instead of digital sensor for all or some of the sensors 28. For example, a strain gauge can be connected to measure forces on object 34 rather than positions of the object. Also, velocity sensors and/or accelerometers can be used to directly measure velocities and accelerations on object 34. Analog sensors can provide an analog signal representative of the position/velocity/acceleration of the user object in a particular degree of freedom. An analog to digital converter (ADC) can convert the analog signal to a digital signal that is received and inteφreted by microprocessor 26 and/or host computer system 12, as is well known to those skilled in the art. The resolution of the detected motion of object 34 would be limited by the resolution of the ADC.
Other types of interface circuitry 36 can also be used. The interface allows the position of the mouse or stylus to be tracked and provides force feedback to the stylus using sensors and actuators. Sensor interface 36 can include angle determining chips to pre-process angle signals reads from sensors 28 before sending them to the microprocessor 26. For example, a data bus plus chip-enable lines allow any of the angle determining chips to communicate with the microprocessor. A configuration without angle-determining chips is most applicable in an embodiment having absolute sensors, which have output signals directly indicating the angles without any further processing, thereby requiring less computation for the microprocessor 26 and thus little if any pre-processing. If the sensors 28 are relative sensors, which indicate only the change in an angle and which require further processing for complete determination of the angle, then angle-determining chips are more appropriate. Actuators 30 transmit forces to user object 34 of the interface device 14 in one or more directions along one or more degrees of freedom in response to signals received from microprocessor 26. Typically, an actuator 30 is provided for each degree of freedom along which forces are desired to be transmitted. Actuators 30 can include two types: active actuators and passive actuators.
Active actuators include linear current control motors, stepper motors, pneumatic/hydraulic active actuators, voice coils, and other types of actuators that transmit a force to move an object. For example, active actuators can drive a rotational shaft about an axis in a rotary degree of freedom, or drive a linear shaft along a linear degree of freedom. Active transducers of the present invention are preferably bi-directional, meaning they can selectively transmit force along either direction of a degree of freedom. For example, DC servo motors can receive force control signals to control the direction and torque (force output) that is produced on a shaft. The motors may also include brakes which allow the rotation of the shaft to be halted in a short span of time. Other types of active motors can also be used, such as a stepper motor controlled with pulse width modulation of an applied voltage, pneumatic/hydraulic actuators, a torquer (motor with limited angular range), or a voice coil actuator, which are well known to those skilled in the art.
Passive actuators can also be used for actuators 30. Magnetic particle brakes, friction brakes, or pneumatic hydraulic passive actuators can be used in addition to or instead of a motor to generate a damping resistance or friction in a degree of motion. An altemate preferred embodiment only including passive actuators may not be as realistic as an embodiment including motors; however, the passive actuators are typically safer for a user since the user does not have to fight generated forces. Passive actuators typically can only provide bi-directional resistance to a degree of motion. A suitable magnetic particle brake for interface device 14 is available from Force Limited, Inc. of Santa Monica, California.
In altemate embodiments, all or some of sensors 28 and actuators 30 can be included together as a sensor/actuator pair transducer. A suitable transducer for the present invention including both an optical encoder and current controlled motor is a 20 W basket wound servo motor manufactured by Maxon.
Actuator interface 38 can be optionally connected between actuators 30 and microprocessor 26. Interface 38 converts signals from microprocessor 26 into signals appropriate to drive actuators 30. Interface 38 can include power amplifiers, switches, digital to analog controllers (DACs), and other components. In altemate embodiments, interface 38 circuitry can be provided within microprocessor 26 or in actuators 30. Other input devices 39 can optionally be included in interface device 14 and send input signals to microprocessor 26. Such input devices can include buttons, dials, switches, or other mechanisms. For example, in embodiments where user object 34 is a joystick, other input devices can include one or more buttons provided, for example, on the joystick handle or base and used to supplement the input from the user to a game or simulation. The operation of such input devices is well known to those skilled in the art.
Power supply 40 can optionally be coupled to actuator interface 38 and/or actuators 30 to provide electrical power. Active actuators typically require a separate power source to be driven. Power supply 40 can be included within the housing of interface device 14, or can be provided as a separate component, for example, connected by an electrical power cord.
Alternatively, if the USB interface, game port, or similar communication interface is used, interface device 14 can draw power from the bus 24 and/or 25 and thus have no need for power supply 40. This embodiment is most applicable to a device 14 having passive actuators 30, since passive actuators require little power to operate. For example, active actuators tend to require more power than can be drawn from USB, but this restriction can be overcome in a number of ways. One way is to configure interface 14 to appear as more than one peripheral to host computer 12; for example, each provided degree of freedom of user object 34 can be configured as a different peripheral and receive its own allocation of power. This would allow host 12 to allocate more power to interface device 14. Altematively, power from the bus 24 and/or 25 can be stored and regulated by interface device 14 and thus used when needed to drive actuators 30. For example, power can be stored over time and then immediately dissipated to provide a jolt force to the user object 34. A capacitor circuit, for example, can store the energy and dissipate the energy when enough power has been stored. Microprocessor may have to regulate the output of forces to assure that time is allowed for power to be stored. This power storage embodiment can also be used in non-USB embodiments of interface device 14 to allow a smaller power supply 40 to be used. A power storage circuit embodiment is described in greater detail with respect to Figure 6.
Safety switch 41 is preferably included in interface device to provide a mechanism to allow a user to override and deactivate actuators 30, or require a user to activate actuators 30, for safety reasons. Certain types of actuators, especially active actuators such as motors, can pose a safety issue for the user if the actuators unexpectedly move user object 34 against the user with a strong force. In addition, if a failure in the control system 10 occurs, the user may desire to quickly deactivate the actuators to avoid any injury. To provide this option, safety switch 41 is coupled to actuators 30. In the preferred embodiment, the user must continually activate or close safety switch 41 during operation of interface device 14 to activate the actuators 30. If, at any time, the safety switch is deactivated (opened), power from power supply 40 is cut to actuators 30 (or the actuators are otherwise deactivated) as long as the safety switch is open. For example, a preferred embodiment of safety switch is an optical switch located on user object 34 (such as a joystick) or on a convenient surface of a housing enclosing interface device 14. When the user covers the optical switch with a hand or finger, the sensor of the switch is blocked from sensing light, and the switch is closed. The actuators 30 thus will function as long as the user covers the switch. Such an optical switch can comprise an ambient light detector, which simply senses when detected ambient light has been blocked by the user when the user covers the detector with a hand. Alternatively, an emitter/detector pair can be provided in a small recess on the interface device 14. The emitter emits a particular type of electromagnetic radiation, such as infrared light, out away from the interface device into exterior space. When the user covers the recessed emitter/detector, the emitted radiation reflects from the user's hand or finger so that the detector detects the radiation and activates the motors. Such optical switches are well known to those skilled in the art. Other types of safety switches 41 can be provided in other embodiments. For example, an electrostatic contact switch can be used to sense contact with the user, a button or trigger can be pressed, or a different type of sensor or switch can be used. Further embodiments of safety switches of the present invention are described with reference to Figures 9 and 10.
In the preferred embodiment, there is additionally included a "safety ramping routine" which the microprocessor 26 implements when the safety switch 41 is opened and closed. When the safety switch 41 is opened, the forces ouφut by actuators 30 are dropped to zero instantly. However, when the safety-switch is then closed by the user, the output forces jump back up to the same magnitude that these forces were at before the safety switch was opened. This instant increase in the magnitude of forces creates a hazardous condition for the user. To counter this effect, the microprocessor preferably accesses a safety ramping routine in memory 27 that instructs the microprocessor to slowly ramp up the magnitude of the forces over a predefined time interval after the safety switch is closed. After the predefined time interval (e.g., 3 seconds), the forces are output at the full magnitude provided before the switch was opened.
User object 34 is preferably a device or article that may be grasped or otherwise contacted or controlled by a user and which is coupled to interface device 14. By "grasp", it is meant that users may releasably engage a grip portion of the object in some fashion, such as by hand, with their fingertips, or even orally in the case of handicapped persons. The user 22 can manipulate and move the object along provided degrees of freedom to interface with the host application program the user is viewing on display screen 20. Object 34 can be a joystick, mouse, trackball, stylus, steering wheel, hand/foot pedal, medical instrument (laparoscope, catheter, etc.), pool cue, hand grip, knob, button, or other article.
FIGURE 3, as detailed by FIGURES 3a and 3b, is a schematic diagram of an example of a specific embodiment 50 of the interface device 14. Local microprocessor 26, in this example, is a PIC16C74 available from Microchip and having 14 address lines and 8 data lines. This microprocessor includes an intemal architecture that splits memory into two partitions and allows fast program executions, and is thus well-suited for high speed force feedback processing. This embodiment preferably includes local memory 27, such as ROM, as well as local clock 29 on board the microprocessor.
Interface device 50 is intended to communicate with host computer 12, as explained with reference to Figure 2, using both a serial interface such as an RS-232 interface as well as a second interface 25, which, in the described embodiment, a game port interface as typically found on an IBM-compatible personal computer (PC).
Sensors 28 are used to sense the position of user object 34 in provided degrees of freedom. In the described embodiment, sensors 28 are potentiometers 52, each potentiometer being coupled to a shaft which rotates in a degree of freedom as the user object 34 is rotated. Each potentiometer outputs an analog voltage signal ("sensor signal") in proportion to the position of the user object in the measured degree of freedom. The potentiometers 52 are powered by a five-volt signal provided on a power line 53 of the game port interface (with reference to a ground line 53a of the game port interface, and where capacitors Cl and C2 are used for filtering the signal, as is well known to those skilled in the art). The potentiometers output their sensor signals on the game port interface bus 25. Each potentiometer can include a trimmer mechanism to allow reorientation with respect to the user object 34 and allows the user object to be recalibrated when in use, as is well known to those skilled in the art. Analog potentiometers are used in this embodiment since the standard game port interface requires this type of sensor. Other types of sensors, such as digital rotary encoders, can be used for sensors 28 in other embodiments using a different type of interface bus 25.
In altemate embodiments, digital switches or contacts can be used in place of analog potentiometers 52. For example, some types of joysticks used by video game systems or computers are "digital joysticks" that provide digital signals corresponding to a position or direction of the joystick. Such digital signals do not typically describe a position of the joystick within a rotary or linear degree of freedom as do "analog joysticks", but instead describe simple directions such as "up", "left", or "diagonal up-left". Contact switches, for example, can be placed at four positions (up, down, left, right) around a joystick to detect eight possible directions
(those four directions and the four intermediary diagonal directions). When the joystick is moved in one of these directions, the appropriate contact switch(es) are closed and a corresponding signal is output. "Joypads" and like controllers for video games typically use this arrangement. For the described and other embodiments of the present invention, such a digital joystick can be included to send digital representations of the joystick's direction to host computer 12, while actuators 30 can provide forces on the joystick in provided degrees of freedom. The game port interface bus 25 is used to send sensor data describing the position of the user object 34 in provided degrees of freedom to the host computer. For example, the potentiometers 52 can detect the position of a joystick within the left/right degree of freedom and within the forward/back degree of freedom. This information is presented to the game port interface and converted to digital signals by RC circuitry typically located in host computer system 12 and used with the game port, as is well known to those skilled in the art. The digital signals are serially transmitted over bus 25 that is connected to the standard game port of host computer 12. In this respect, interface device 50 operates as a typical prior art joystick in reporting the position of the joystick directly to the host computer. The host computer can then update a process such as a game in response to the received position information. The interface device 50 can thus advantageously be used with any available software and hardware that is compatible with a standard joystick.
In the present embodiment, the sensor data is preferably sent directly to the host computer 12 over game port interface bus 25 without being sent to microprocessor 26. This is because the game port interface processes the analog signals into digital signals using the RC circuit, which prevents other components such as microprocessor 26 from also reading the potentiometer data. In some embodiments, the microprocessor may need sensor reading information to provide force commands to the actuators; in such an embodiment, a second set of sensors can be used, as described below.
The present embodiment also includes a second interface bus 24 coupled between the host computer 12 and interface device 50 which is preferably implemented as a serial RS-232, RS-442, or similar interface. In the described embodiment, this interface bus is used exclusively for providing force feedback commands from the host computer to the interface device 50. An RS- 232 level shifter 54 converts signals to the appropriate voltage levels for transmission and reception. The host computer 12 sends serial commands out from its standard serial port on line RxD of the RS-232 interface. Shifter 54 receives and converts these commands to the necessary logic level (e.g., 5 volts) and provides the commands to microprocessor 26. Microprocessor controls motors 66 in response to the received commands. The TxD line of the RS-232 interface of the level shifter need not be connected to the host.
Altematively, the TxD line can be connected between interface device 50 and host computer 12 in some embodiments to provide interface device product information and other required information from the interface device to the host. Such product information can include the serial number, version number of the device 50, version number of firmware of the microprocessor/local memory, release date of the firmware and/or device 50, model number, host commands that are compatible with device 50, the number of axes or degrees of freedom of user object 34 that are available and their description, the resolution of sensors or actuators, and/or copyright information. This information can be stored in ROM or other memory 27 on the interface device 50. Also, status information and sensor data from sensors 28 can be provided on this TxD line if, for example, game port bus 25 becomes disconnected or unused.
Since the entire bandwidth of the serial RS-232 interface is used for receiving force feedback commands from the host computer, a greater transmission rate for force signals can be implemented and a greater degree of realism and control can be provided in the forces ouφut on the user object. In addition, the game port is implemented as in standard joysticks that do not provide force feedback. The interface device 50 can thus be connected to any computer with a game port and can function as a non-force-feedback joystick with any software that is compatible with non-force-feedback joysticks. If software is available on host computer 12 to implement force feedback commands, the interface device 50 can also take advantage of that functionality.
This is important in that the interface device is compatible with the presently available software applications and is compatible with new force feedback software as that software is introduced.
This provides a more marketable interface device than a pure force feedback joystick until force feedback software is more widely available.
The present embodiment also preferably includes a communication line safety feature as described with reference to Figure 2. To allow the microprocessor 26 to easily monitor the status of the connection of the serial bus 24, one of the lines of bus 24 is coupled to the microprocessor. In the described embodiment, the DTR line 51 of the RS-232 interface is coupled (through level shifter 54) to a digital input (B6) of the microprocessor. The PIC microprocessor of the described embodiment includes a universal asynchronous receiver/transmitter (UART) on the chip itself. The microprocessor checks for a logical low state on the DTR line to confirm that the serial bus 24 is connected. When the DTR line carries a logical high state, the serial bus/cable is assumed to not be connected, and the microprocessor sends a disable signal to the motors 68 on line 60. The host computer 12 can also control the state of the signal on the DTR line to disable the motors in like manner when desired. In other similar embodiments, a UART could be provided as a separate component. In other embodiments, the host computer can send a signal out to the microprocessor periodically and the microprocessor can check for this signal to ensure die connection of the bus is still intact. The bus 25 is not checked in the described embodiment, but can be monitored in altemate embodiments.
In other embodiments, other types of interfaces can be implemented as serial interfaces to be used as buses 24 and/or 25. For example, video game consoles such as the Sega Saturn or the Sony PlayStation do not have a serial port or a game port as described above, but instead have a control port having a parallel interface. However, a serial interface can be emulated by using the input and ouφut lines of the parallel port. For example, the "up", "down", "left" and "right" control signal lines of the Sega Saturn can be used as lines which encode the sensor data (such as from a digital encoder or potentiometer) and button data and send that data to the host, and the ouφut lines TH, TR, and TL from the Sega Saturn can be used to encode the host commands to the microprocessor 26, thus providing two way communication between host computer 12 and interface device. A serial protocol can be used, where one output line (e.g., TH) is used in place of the TxD line described above. Another line (e.g., TR) can be used in place of the DTR line. Note that the potentiometer data would be read by the microprocessor 26, processed, and sent to the host in such an embodiment. In addition, the power and ground lines can be used from a video game console port similarly to power line 53 of an RS-232 interface.
Handle buttons 56 are included as other input devices 39 as shown in Figure 2. The buttons 56 include switches and a 5-volt input from the game port interface, as is well known to those skilled in the art. Fourteen buttons are indicated as available in embodiment 50, but a different number of buttons or other types of switches, knobs, or controls can be included in other embodiments. The button input signals are input to data ports D0-D7 of microprocessor 26 on bus 57. Microprocessor 26 outputs the digital button signals on lines 55 of game port interface bus 25.
Thermistors 58 are coupled to the microprocessor 26 and sense the temperature of motors 68. The thermistors convert a sensed temperature into an electrical signal as is well known to those skilled in the art. For example, thermistors such as RL2006- 1600-103 -Dl available from Keystone Thermometrics can be used. The microprocessor 26 reads the temperature signals on buses 59 to determine if the motors are overheating. The microprocessor can deactivate the motors using the EN signal 60 when an overheating condition is sensed (and can activate overtemp LED 62 to inform the user of the overheated condition). Other types of temperature- sensing components can be used in other embodiments. For example, a temperature sensing integrated circuit can be used. In yet other embodiments, the temperature of the motors can be sensed or determined using other components or steps. For example, the voltage drop across the motor windings can be measured by an analog to digital converter (ADC) that, for example, can be included on the microprocessor 26. The voltage drop across the motor windings is typically a reliable indicator of the temperature of the windings material so that the temperature can be determined by the amount of the voltage drop. Altematively, a software estimation of the motor temperature can be performed by the microprocessor 26. The microprocessor can keep a running average over time of the amount of current sent to the motors 68. The thermal characteristics of the motors are provided to the microprocessor from memory or in software, and the software on the microprocessor can thus estimate the temperature of the motors at any desired time. This is a low cost solution for providing overheat protection since no extra hardware components are needed, but it may not be reliable in some situations due to variations in ambient air temperature and other factors that can change the thermal response of the motors 68 without the knowledge of the microprocessor. Secondary potentiometers 62 are optional extra sensors included to provide sensor data to microprocessor 26 describing the position of the user object 34. As explained above, the standard game port interface requires that sensor data be directly sent to host computer 12 from potentiometers 52 and that microprocessor 26 cannot read the sensor signals. However, the microprocessor 26 may still need the sensor data to calculate force values or otherwise determine the control signals sent to actuators 30. Secondary potentiometers 62 can provide sensor data to the microprocessor independently of potentiometers 52 so that the microprocessor receives the needed data. The secondary potentiometers can be analog potentiometers, rotary encoders, or other types of sensors similar to sensors 28. These potentiometers can be coupled to the same rotational shaft (not shown) as potentiometers 52, for example. Microprocessor 26 receives the sensor signals from secondary potentiometers 62 on buses 63.
The 5 volt signal from line 53 of the game port interface is used to power handle buttons 56, LED's on device 50, potentiometers 52 and 62, and other logic components of the interface device 50. The game port power line 53 is preferably used instead of a power signal from interface 24, since the game port interface is always used when the interface device 14 is connected, while the interface 24 may be disconnected for non-force-feedback uses of the interface device 50. The other components, such as motors 68, are powered by the power supply partition, as explained below. In alternate embodiments, power lines from other interfaces can be used.
Power supply partition 64 is preferably a separate power section of interface device 50 that drives the actuators 30 of the interface device. Power supply partition 64 includes actuators 30 and power circuit 66. Actuators 30 preferably are two motors 68, such as 24 V motors available from Mabuchi, Japan in the described embodiment, where each motor is used to provide forces along one degree of freedom of the user object 34. A joystick typically has two degrees of freedom, forward/back and left/right. If additional degrees of freedom are included in interface device 50, then additional motors can be added as appropriate. Microprocessor 16 provides two signals to each motor: a direction (DIR) signal 70 and a pulse width modulation (PWM) signal
72. The direction signal instructs the motor 68 to provide force along one of the two directions within its degree of freedom. The PWM signal controls the magnitude of the force by providing a signal having a constant frequency (e.g., 10 kHz) and a varying duty cycle. A high duty cycle provides high magnitude forces, and vice versa. The DIR and PWM signals from microprocessor 26 are input to driver amplifiers 74 which can be considered as part of actuator interface 38. Amplifiers 74 have 24-volt inputs from a 24-volt power supply 40 and provide the control signals from microprocessor to drive motors 68 at the proper high current level.
Microprocessor outputs an enable signal on line 60 which permits the motors 68 to be activated and to output forces on user object 34. A safety or "deadman" switch 41 is also included in embodiment 50 to allow the user to control when the motors can ouφut forces. Switch 41 , as described with reference to Figure 2, must be closed by the user in order for the motors 68 to be activated. A 5-volt signal from the game port interface is input on line 78 to an NOR gate 70 when the safety switch 41 is open. When the safety switch is closed, the 5-volt signal runs to ground, and a low enable signal is provided to NOR gate 70. The ouφut of the NOR gate is provided to driver amplifiers 74 as an enable input. Thus, if either the safety switch 41 is closed, or if an enable signal is sent by microprocessor 26 on line 60, motors 68 are activated and will output forces according to the control signals on lines 70 and 72. The 5-volt signal on line 78 is also preferably input to microprocessor 26 so the microprocessor can monitor the state of the safety switch. Safety switch 41 can be a device as described with reference to Figure 2, or can be a safety switch of the present invention described with reference to Figures 9 and 10. Preferably, "Active" LED 76 is illuminated when the motors are activated so that the user knows when the motors are exerting force.
Power circuit 66 is also preferably included in power supply partition 60 and is used to convert the 24 volt output from power supply 40 to a 5-volt signal used in various components of power supply partition 64, such as the driver amplifiers 74. The power supply 40 is preferably connected to a standard AC wall socket.
The power supply partition 60 allows the force feedback portion of interface device 50 to be separated and used independently from the other components in the device. Thus, if interface device 50 is being used as a standard joystick and is only connected to the game port interface of host computer 12, then the 5-volt signal from the game port is used while the power supply partition is unused and the 12- volt power supply 40 need not be plugged into an AC wall socket. The 12- volt power supply 40 is plugged into a wall socket if force feedback is to be implemented on device 50.
In an altemate embodiment of interface device 50, microprocessor 26 need not be included and can be replaced by hard-wired logic. The motors 68 can be controlled directly by host computer 12 using low or high level commands as described below with reference to Figure 7.
As in the embodiment described above, game port interface bus 25 sends only sensor signals to the host computer, and the serial interface bus 24 only sends host commands to the interface device. The host computer can calculate force values and send the low level commands to the interface device. A level shifter and shift register, for example, can be used to read in the serial commands and provide the commands to logic provided on a field programmable gate array
(FPGA), which can be used to issue force values to the actuators as instructed by the low level commands from the host (as described with reference to Figure 7). Since serial port interface bus
24 is used exclusively to send low level host commands to the actuators, a greater bandwidth and more realistic force feedback can be provided. In an even simpler embodiment, the logic and shift register need not be used, and the serial interface can be used as simple parallel bit Iines to provide high and low logic signals to control the actuators 30. This embodiment is described in greater detail with respect to Figures 4a-4f .
In a different embodiment, the interface device 50 (or other interface device embodiments disclosed herein) can be made expandable to be controlled in other ways. For example, the interface device 50 can be provided with a separate "access port" which is connected to both sensors 28 and actuators 30. If the user desires that the host computer 12 directly control the interface device, a parallel bus can be connected between the access port and the host computer (e.g., an interface card can be plugged into the host) so that the host directly receives sensors signals and so that host commands are directly provided to the actuators 30 or the actuator interface 38. Preferably, the user can select a switch on the interface device to switch the communication lines from normal microprocessor control to direct host control through the access port (the microprocessor can be disabled when using direct host control). This would allow the host to provide realistic, direct force feedback to the user, but would put a greater processing burden on the host.
FIGURE 4a is a block diagram of an altemate "recoil" embodiment 80 of the force feedback control system 10 of Figure 2. In recoil control system 80, a local device microprocessor 26 is not necessary to provide force feedback and the host computer sends no signals, or only minimal signals, to the interface device 14. The recoil embodiment is thus a "reflex" interface device, in that forces are ouφut on user object 34 independently of host computer 12, and these forces depend only on local control events (e.g. a press of a button by the user). The reflex process includes outputting a force when a button is pressed with no communication from the host.
The position of user object 34 is sensed by sensors 28, and the sensors send position or other related signals to the host computer 12. The control loop includes buttons or other input devices 39, which sense actions of the user such as when the user pushes one of the buttons. The buttons 39 provide input signals to a recoil reflex control block 82, which is "hard wired" logic or other components instead of a microprocessor. The control block 82 sends activation signals to motor (or other type of actuator) 30, which ouφuts forces on user object 34 to complete the loop. In altemate embodiments as disclosed with respect to Figures 4c-4f, the host computer 12 can additionally provide simple enable signals on line 81 to the control block 82 or activation signals on line 83 to actuator 30 to provide more realistic force feedback. Since the host computer is not included in the main control loop, the host can devote minimal processing time to the control of force feedback and can process other tasks more efficiently, such as displaying images on display device 20 and other processes. In addition, the lack of a microprocessor 26 simplifies and reduces the cost of the interface device 14, as discussed below. FIGURE 4b is a schematic diagram of a first "recoil" embodiment 80 of Figure 4a. Interface device 80 includes a joystick 84 or similar user object 34 that is coupled to (or otherwise sensed by) sensors 28. Sensors 28 provide signals indicating the position of the joystick in the provided degrees of freedom. For example, the sensors 28 preferably are analog potentiometers 86 similar to those described with reference to Figure 3. Joystick 84 also preferably includes one or more buttons 88 positioned thereon similar to buttons 56 described with reference to Figure 3. Buttons or other controls can also be provided on a housing or base of the interface device 14 in addition to or in place of buttons on the joystick.
The sensor data from sensors 28 is preferably output on game port interface bus 25 to host computer 12. For example, analog potentiometers are preferably used, and the sensor data is converted to digital form in conformance with the game port interface standard.
In the described embodiment, force feedback is provided when the user activates input devices such as buttons 88. For example, when button #1 on interface device 80 is pressed by the user, the signal from button #1 is sent over game port interface 25 with the other button data to host computer 12. The button #1 data is also sent to a timer/pulse generator 90 included in interface device 80. When timer/pulse generator 90 receives the button #1 signal, it outputs a motor control signal on line 92.
Line 92 is coupled to actuator interface 38, which in the present embodiment includes a transistor 94 used for amplifying the motor control signal. Actuator interface 38 is coupled to motor 96 to provide an appropriate signal to drive the motor. Motor 96 provides a force in a particular degree of freedom to user object 34. A set of motor 96 and actuator interface 38 can be provided for each degree of freedom in which the user object is capable of moving. Altematively, fewer motors 96 can be included if force is desired to be provided in only selected degrees of freedom.
Power supply 92 powers motor 96 and can be connected to a standard AC wall outlet, for example. Two switches 41 and 98 either activate or deactivate the motor 96 by connecting or disconnecting the power to the motor. Safety switch 41 is similar to the safety switch described with respect to Figure 3, and is closed when the user is pressing or otherwise closing a switch on the interface device 80. Switch 98 is a "recoil active" switch that is positioned on the exterior of the interface device and can be closed or opened by the user. When closed, the force feedback provided by motor 96 is operational, and when open, the force feedback is tumed off. This allows the user to turn on force feedback when the user deems is appropriate to ouφut forces to the joystick in response to a button press. The user can turn off the force feedback when desired and/or when it is inappropriate to cause forces to be output when a button is pressed. The present embodiment is intended for use as a low-cost "recoil" force feedback interface device which does not require a local microprocessor 26 and does not require the host computer 12 to send force feedback signals to provide forces on user object 34. Rather, the force feedback is initiated whenever the user activates an appropriate control, such as a fire button 88 on a joystick. Thus, the "recoil" force feedback is an independent "reflex process." Although the host computer does not send any signals or commands to initiate force feedback, the forces in this embodiment can still realistically portray force events. For example, the host computer can run a simulation or video game in which the user controls a gun. The force output by motor 96 can be initiated when the user presses a button to fire the gun, and can provide a jolt or similar force to simulate the recoil of the shooting gun. In many such games, a button press will always fire the controlled gun in the game. The forces thus accurately simulate a recoil force when firing a gun during a game, a centrifugal force when activating thrusters on a simulated plane or spacecraft, a vibration force for a certain action, or other force when performing some other action during a simulation or game. The forces can be provided in a predetermined or random direction(s).
This embodiment allows force feedback to be provided to a user in all software that is compatible with a standard joystick or other peripheral connected to a standard game port. No special force-control software is required for the host computer, since the host issues no force commands to the interface device in this embodiment. Button #1, for example, is wired directly to timer/pulse generator 90, which activates the motor 96 when the button #1 is pressed. In one embodiment, the timer/pulse generator can produce a single force jolt while a button is pressed. Altematively, the pulse generator 90 can cause motor 96 to ouφut a series of force jolts at a predetermined frequency for the length of time that the user continuously presses the button.
When the user runs out of ammunition during a game or is otherwise unable to perform a force feedback related action, then the user can open the recoil switch 98 to deactivate the motor. This allows the force feedback to be conveniently disabled when it is not appropriate to the game or simulation. In addition, the user can open recoil switch 98 when the user does not desire to feel forces in response to button presses. The user also can open the safety switch 41 to disable force feedback (unless the hand-weight safety switch of Figure 9 is being used, in which it would not be possible for the user to operate the joystick without closing the safety switch). Other buttons on the interface device 80 can also be connected to individual motors and timer/generators in a similar fashion, or multiple buttons can be connected to one motor and timer/generator. Different motors can be set up to provide different force sensations depending on the particular button that the user presses, e.g., one motor can provide a gun recoil force on the user object, a different motor can provide a vibration force of a vehicle, etc. Many combinations of button or other control activations and different motor forces can be provided. FIGURE 4c is a schematic diagram of a second embodiment 100 of the "recoil" interface device of Figure 4a. Interface device 100 is more functional than interface device 80, since simple logic states can be sent by the host computer 12 as a control signal to enable or disable the force feedback on the interface device 100 to help correlate force feedback with game or simulation events implemented by the host. Potentiometers 86, buttons 88, motor 96, motor interface 94, and switches 41 and 98 are similar to the equivalent components described with reference to Figure 4b.
As referred to herein, the terms "activate" and "deactivate", as applied to actuators or reflex processes, refers to directly causing the actuators to output or remove a force. For example, an activation signal will cause the actuator to ouφut force when the actuator receives the activation signal, and a deactivation signal will turn the actuator off and/or remove output forces (assuming that no other disabling signals are in force). In contrast, the terms "enable" and "disable" refer to either allowing or not allowing the motors to be controlled by other activation or deactivation signals. For example, if a disable signal has been sent to the actuator interface, or if the actuators are disabled by opening recoil switch 98 and cutting power, the actuator will not ouφut forces when an activation signal is received (or at any other time). If an enable signal is sent, the actuators are able to output forces when an activation signal is received and will remove all forces when a deactivation signal is received. An actuator can output forces when all enable signals are set to "enable" and when an activation signal is received. In addition, reflex processes are also referred to herein as being "enabled" or "disabled", where it is meant that the process of ouφutting forces in response to local events is either operation (enabled) or not operational (disabled). For example, a recoil reflex process that is disabled means that the process of ouφutting forces in response to the user pressing a button is not functional.
Interface device 100 includes a selection block 102 which is coupled to a control signal line 104 from a button on the interface device. In addition, a host line 106 (or multiple host lines in altemative embodiments) is coupled to the selection block 102 from a parallel bus 105 connected to host computer 12. Host line 106 is used by the host computer to enable or disable motor 96.
In the described embodiment, line 106 is connected to a serial port of host computer 12 that is used as a parallel port in the present embodiment. For example, an RS-232 port of the host computer can be coupled to parallel bus 105. The DTR line of the RS-232 interface can be used as a parallel line carrying a low or a high signal. This DTR line would be host line 106 that is used to enable or disable the actuators. Other lines of the RS-232 interface could also be used.
The present embodiment thus treats the serial RS-232 interface as a parallel interface and does not require a UART or other serial support chips, thus reducing the cost of the device 100 significantly. In altemate embodiments, other interfaces can be used. For example, parallel bus
105 can be coupled to a standard parallel port of host computer 12. Selection block 102 ouφuts a pulse signal on control line 108 to activate motor 96 when the button sends an activation signal on line 104 and when the host computer sends an enable signal on line 106. If either of these signals is not in a high state (or equivalent), the motor cannot be activated. The selection block 102 can be implemented in a number of possible ways. For example, FIGURE 4d illustrates a functional schematic in which button line 104, host line 106, and a line from timing/pulse generator 90 are inputs to an AND gate 1 10, and the output of AND gate 1 10 is provided as a control signal on line 108 to motor interface 94. FIGURE 4e illustrates an altemate schematic in which button line 104 is input to triggered pulse generator 90 that outputs a pulse (or pulses) when a signal is received indicating that a button has been pressed by the user. The output of the triggered pulse generator 90 and the enable line 106 from host computer 12 are input to AND gate 1 10 which outputs the control signal on line 108 to the motor 94 when both inputs are high.
The enable line 106 from the host computer can be implemented as a direct line from a serial or other port of the host or as a multi-line bus 105 with more information. For example, bus 105 can include separate lines for a clock, data, and clear signal that are input to a latch from the host computer 12, and the output of the latch can be coupled to the selection block as line 106. The latch would provide the enable signal when the clock signal changes to a high state, thus allowing the host to control when the enable signal is sent using synchronous communication.
The interface device 100 is similar to the recoil interface device of Figure 4b in that when a user presses a designated button, force feedback is applied to the user object 34 by motor 96. However, device 100 also includes enable line 106 from the host computer, which allows the host computer to determine when the motor can be activated. The enable line 106 does not allow the host computer to command desired forces, but only allows the host to select when the user will be able to activate the force by pressing a button (thus enabling/disabling the reflex process).
The enable line 106 allows the software process running on the host computer to be better coordinated with the force feedback. For example, when the user's player in a video game runs out of ammunition for a controlled gun, the host computer can send a disable signal to selection block 102, which will immediately deactivate the motor 96 regardless of the state of button 88. Likewise, when the user's player is in a situation in which force feedback can be applied, e.g., if the user picks up more ammunition in a game, the host computer can send an enable signal on line 106, which will allow the motor to ouφut a force when the user selects the button 88. This is an improvement in coordinating forces with a host application over the embodiment of Figure 4b, since, in that embodiment, a user had to manually disable the actuators with recoil switch 98. This configuration is almost as low-cost and simple as the embodiment of Figure 4b while allowing a greater degree of realism and coordination of force feedback with other visual and auditory feedback on the host computer 12. Only a single line 106 is required for the host computer to be able to deactivate force feedback in accordance with game or simulation events. The user can also open or close recoil active switch 94 similarly to the embodiment of Figure 4b to enable or disable the motor.
FIGURE 4f is a third embodiment 1 14 of the recoil interface device of Figure 4a in which either a button press or a control signal from the host computer can cause force feedback to be ouφut on the user object 34. The interface device 1 14 includes joystick 84, potentiometers 86, buttons 88, motor 96, motor interface 94, and switches 41 and 98 which are similar to the equivalent components described with reference to Figure 4b. Device 1 14 also includes a selection block 102 to which lines 104 and 106 are input and which is substantially similar to the selection block 102 described in Figure 4c.
The interface device 1 14 additionally includes an OR gate 116 or the functional equivalent. The OR gate 1 16 has two input lines, one line 1 18 from selection block 102 and a separate activation line 120 from the parallel bus 105 coupled to the host computer. The output of the OR gate 1 16 is coupled to motor interface 94. The OR gate allows the host computer to activate the motor 96 using an activation signal on activation line 120 regardless of whether a user is pressing any buttons. This activation of motor 96 is simply turning the motor on or off using pulse generator 90, i.e., the pulse generator will send out a predetermined PWM signal or other command to the actuator to implement a predetermined force sensation, such as a vibration, jolt, etc. The host preferably does not send actual force values or directly control the forces of motor 96, and thus cannot alter the magnitude of output forces. Bus 105 can be a standard parallel port interface from the host computer, or the bus can be a serial port that is used to carry serial signals, as explained above.
The host sends the activation signal to coordinate force feedback with events that occur within a computer-implemented process or application program. For example, if an explosion rocks a vehicle the user is controlling in a video game or simulation, the host computer can signal interface device 1 14 to output force feedback to the user object 34 without regard to the buttons the user is pressing. This adds further functionality over embodiment 100 of Figure 4c, in which the host could only enable or disable force feedback, and could not activate it; in that embodiment, forces triggered from explosions or other events that happen to the user could not be provided. The interface device 1 14 thus provides yet greater realism in force feedback than the embodiments of Figures 4b and 4c and coordination with the process implemented on host computer 12 since the host can control the actuators in two ways: either enabling or disabling the actuators using control line 104, but letting the user initiate force feedback with a button; or by independently initiating the force feedback regardless of the state of the button. Despite the added functionality, interface device 1 10 remains low cost and simple, with only a small number of lines from the host needed to control the force feedback and no local microprocessor 26 required. The disadvantage of embodiments 100 and 1 14 is that specific software is required for host computer 12 to issue enabling and activation commands to the interface device 14.
In altemate embodiments, additional lines of bus 105 can be used for additional functionality. For example, another line, such as the CTS line of an RS-232 interface (normally used for handshaking signals in a serial interface, but used herein as a line in a parallel interface), can be used as the "axis select line" to select particular axes or degrees of freedom in which the force is to be applied. A high signal on the axis select line might indicate that forces are to be applied in both forward/back and left right axes of a joystick (i.e. two motors), while a low signal might indicate only activate one motor for the left/right axis. Similarly, an additional line (or lines) in the bus 105 can be used to allow the host computer to command a direction of the forces in a particular degree of freedom. Additional lines can also be used to select other motor ouφut configurations. Also, the device 1 14 can include an additional line in parallel bus 105 to be used as the enable line 104 of Figure 4c. For example, in the RS-232 interface, the DTR line can be used as the enable line 104, and the TxD line of the RS-232 interface can be used as activation line 120. The RxD line can be used as the "life line" to allow the microprocessor or host to monitor whether the bus has been disconnected, as described above. It should be noted that the RS-232 interface has three lines that are output from the host computer and thus a maximum of three lines can be used as parallel signal lines in bus 105 to interface device 1 14. If additional control signal lines are needed, the embodiment of Figure 5, below, can be implemented.
A TxD line can also be used to send more complex host signals that provide a desired force sensation to the user. For example, in the RS-232 interface, a baud rate can be set by a UART on the host computer 12 to establish a rate of transmission of data. Data can be sent as high or low bits on the TxD line at the specified baud rate to turn motors 96 on and off at the desired rate. For example, a byte specified as 01010101 can be provided on line TxD at a baud rate of 9600 bps, so that each bit lasts for 1/9600 = 10 ms. Since each "1" bit activates the actuator and each "0" bit deactivates the actuator, a force sensation of vibration results. The frequency of vibration can be adjusted by changing the values or pattem of bits sent and or by changing the baud rate. In other embodiments, a pulse width modulation (PWM) signal can be sent on the TxD line to control the actuators 30 similarly as described above.
Other interfaces, such as the standard parallel port of host computer 12, can altematively be used to provide several parallel control signals from the host to the interface device. Altematively, if a video game console were used as host computer 12, the parallel lines of the control port of the game console can be used, such as the TL, TR, and TL lines of the Sega Saturn control port. It should be noted that these parallel lines require very little processing by the host computer and require very little communication bandwidth, yet add considerable functionality in correlating force feedback of interface device 14 to application events implemented by the host computer. In addition, all of the embodiments of Figures 4b-4f can be used as standard non- force-feedback joysticks or other peripherals that use a standard game port on computers or equivalent ports on other computers or video game consoles.
FIGURE 5, as detailed by FIGURES 5a, 5b, and 5c, is a schematic diagram of an altemate embodiment 130 of interface device 14 in which microprocessor 26 is not used in the interface device and where the host computer 12 can more effectively control forces ouφut by actuators 30. This embodiment does not use high level host commands that can be used with the embodiment 80 of Figure 3, yet this embodiment provides more control signals to the interface device 14 than the embodiments of Figures 4a-4f.
Interface device 130 includes a serial interface bus 24 and a game port interface bus 25 (not shown). The game port interface bus (or equivalent) is similar to bus 25 of Figure 3 and is coupled to potentiometers or similar sensors as described above to provide position data in provided degrees of freedom of user object 34 to the host computer via a game port. In the described embodiment, the interface bus 24 is coupled to a serial port on host computer 12, such as an RS-232 port or similar interface. Altematively, other interfaces, such as the control port interface of a video game console, can be used.
The interface bus 24 is preferably used to serially transmit host control signals and/or host commands to the interface device 130. However, the standard RS-232 signal lines used for serial transmission are preferably changed in functionality. Signal line TxD is typically used in the RS- 232 interface to transmit data in serial fashion, and lines DTR, DSR, and RTS are typically used to send and receive handshaking signals to and from a peripheral. In the present embodiment, line DTR is instead used to serially transmit data, and lines TxD and RTS are used as parallel ouφut control lines having high and low states to allow the host computer to enable and disable functions of the interface device and control forces. The DSR line is used to provide information back to the host. Thus, serial interface bus 24 is used both as a serial bus when transmitting commands over line DTR, and as a parallel bus when utilizing control lines TxD, RTS, and DSR.
DTR line 132 transmits low level host commands serially from the host computer to the interface device 130. DTR line 132 is input to level shifter 134 which converts the RS-232 signal voltage to appropriate logic voltage and outputs the serial data to a first shift register 136. Shift register 136 receives the serial signal at a DSA port and converts the serial information to parallel bits on 8-bit parallel bus 138. The parallel bus 138 is coupled to input ports P0-P7 of an address comparator 140. Also, a bus 139 is coupled to the six bit lines of parallel bus 138 between the most and least significant bit lines. Bus 139 is coupled to input ports of a programmable array logic (PAL) chip 142. In addition, the most significant bit (MSB) line 141 of the parallel bus 138 is coupled to the input DSA port of a second shift register 144. The second shift register 144 converts the input information on line 141 to parallel bits which are ouφut on 8-bit parallel bus 146. Bus 146 is coupled to logic comparator 140 at input ports Q0-Q7.
The shift registers 136 and 144 and comparator 140 provide a circuit for determining when a new byte (actually six bits) of data has been received and is ready to be processed by PAL 142. The shift registers 136 and 144 are cascaded such that shift register 144 receives the bits shifted out of shift register 136. The output bytes on parallel buses 138 and 146 are compared by comparator 140. When the two bytes are identical, a new byte has been fully shifted in and is ready to be processed by PAL 142.
To determine when a full new byte has been input, the most significant bit and the least significant bit of an input byte are provided as "matching bits." The matching bits are used to check when the new byte has been shifted into shift registers 136 and 144, and can be either a 1 (high) value or a 0 (low) value. The host computer 12 preferably inserts a pair matching bits around each 6 bits of data that it transmits serially on DTR line 132. The process of shifting serial data in the two shift registers is described with respect to Table 1, below.
First Shift Register Second Shift Register Q0 Qi Q2 O_3 Ci4 Ci5 Q_6 Q7 ΩΩ 01 Ω2 Q3 Q4 Q5 Q6 O_7
(a) 1 X0 XI X2 X3 X4 X5 1 1 X0 XI X2 X3 X4 X5 1
(b) 0 1 X0 XI X2 X3 X4 X5 1 1 X0 XI X2 X3 X4 X5
(c) Y3 Y4Y5 0 1 X0 XI X2 X3 X4 X5 1 1 X0 XI X2
(d) Y0 Yl Y2 Y3 Y4 Y5 0 1 X0 XI X2 X3 X4 X5 1 1 (e) 0 Y0 Yl Y2 Y3 Y4 Y5 0 1 X0 XI X2 X3 X4 X5 1
(f) Y2 Y4 Y5 0 0 Y0 Yl Y2 Y3 Y4 Y5 0 1 X0 XI X2
(g) Y0 Yl Y2 Y3 Y4 Y5 0 0 Y0 Yl Y2 Y3 Y4 Y5 0 1 (h) 0 Y0 Yl Y2 Y3 Y4 Y5 0 0 Y0 Yl Y2 Y3 Y4 Y5 0
TABLE 1
Table 1 shows the outputs Q0-Q7 of the shift registers 136 and 144 at various stages (a)-
(h) when bits of data are being input from the serial data stream on the DTR line 132. The system begins at initial stage (a), in which the outputs Q0-Q7 of register 136 exactly match the ouφuts Q0-Q7 of register 144. When such an exact match occurs and is read by comparator 140 on buses 138 and 146, the comparator outputs a low signal on line 148 to PAL 142 that indicates a valid, full new byte has been shifted in.
The next bit from the serial data stream is shifted into QO of register 136 at stage (b). This is a matching bit since it is the beginning of a new byte of data. This matching bit is intentionally set to zero, the opposite of the matching bits of stage (a), so that a match will not be found with the previous bytes. The other values in the shift registers have all been shifted one ouφut to the right, and the MSB ( 1 ) that was at Q7 of the second shift register in stage (a) is discarded.
At stage (c), three more bits Y5, Y4, and Y3 have been shifted in from the serial data stream and the previous bits have been shifted three places to the right. Each of these bits can have either a low or a high value depending on which commands the host computer has sent and how the bits are inteφreted. At stage (d) three more bits Y2, Yl and YO have been shifted into the first shift register and the other bits have been correspondingly shifted. At stage (e), the final matching bit of the new byte of data is shifted in. This match bit is intentionally made to be "0" so that no match will occur with the matching bits of the byte in the second shift register.
Although a full new byte has been shifted into the first register at stage (e), there is no match of bits between the first and second registers. Therefore, to recreate a match condition, the host computer 12 shifts the same data byte Y5- YO and matching bits (0) into the first register in stages (f) - (h). Until stage (h), the bits of the two registers will not exactly correspond. At stage (h), the bits exactly correspond to indicate a match condition, and comparator 140 outputs a signal on line 148 to indicate to PAL 142 that a new byte has been fully shifted in and validated. PAL 142 then processes the current bits on bus 139 (i.e., bits Y5-Y0) as the new input "byte." Note that PAL 142 continually receives bits on bus 139 throughout the shifting process but only actually processes the incoming data that is present when the validating signal on line 148 is received. New bytes in the data stream are similarly compared and processed by PAL 142 when they have been verified. Note that the host computer should altemate the matching bit of the next byte after stage (h) to a value of " 1 " so that no match will occur with the present matching bits of "0."
The PAL 142 can process the six bits of information in a variety of ways. Preferably, logic is provided in PAL 142 to process each incoming bit as a control signal or "control bit", so that, effectively, six control signals are received over the serial bus. The six control lines are an improvement over the embodiment of Figure 4f, which allows only three parallel control signals to be sent over an RS-232 line as explained above. The host can thus control a greater variety of parameters and characteristics of forces using the greater number of control lines. For example, each control bit can control a separate parameter such as an enable signal for actuators 30, a selection bit determining which degrees of freedom are to be provided with forces, or an enable signal to allow buttons 39 to activate forces. Buttons 39 preferably input a signal on line 145 to PAL 142 so that the PAL can directly determine when any of the buttons have been pressed by the user. For example, if a button has been pressed, a validating signal has been received on line 148, and all of the appropriate enable signals from the host have been provided, then the PAL can cause the actuators to output forces on user object 34. If any of these conditions are false, preferably no forces are output.
The PAL includes the appropriate logic to send the control bits to the appropriate components in the interface device 130 using output lines 143, such as actuators 30 and interface 36 or other logic. For example, an enable signal can be sent directly from PAL 142 to actuator interface 36.
Altematively, low level host commands, such as actual force values, can be sent by the host on serial DTR line 132 to converted to forces output by the actuators. The PAL can include logic to convert the low-level commands to force values and send the force values to the appropriate components in the interface device 130 using output lines 143, such as actuators 30 and interface 36 or other logic. Some of the lines of parallel bus 139 can be utilized as control bits, while other lines can be used to provide a force value or other low level command. Such logic for PAL 142 can be implemented using techniques well-known to those skilled in the art.
In other embodiments, additional lines can be included in bus 139 to provide additional control bits to PAL 142. Also, additional shift registers can be added in altemate embodiments, such as shift register 150. Register 150 is cascaded with second shift register 144 and receives the most significant bit from the second shift register. Using shift register 150 and/or additional shift registers, more incoming data bits can be sent to the PAL at one time, thus providing more control lines to the interface device 130 and/or increasing the speed of processing the input host commands. Additional shift registers such as register 150 can ouφut bits directly to PAL 142; for example, shift register 150 outputs bits to PAL 142 on bus 151 similarly to the bits on parallel bus 139. Since the first and second shift registers 136 and 144 can check when new bytes have shifted in, the additional shift registers do not need to compare their bytes to the bytes of the odier shift registers.
In an altemate embodiment, latching shift registers can be used. The latches on the outputs of such shift registers can hold the values until all the values have shifted in, and then send out the parallel data. Only one such shift register need be provided to send the six control bits to PAL 142. However, latching shift registers also require an additional latch clock signal to latch the data. One of the lines of the RS-232 interface can be used as a latch clock signal, such as the TxD signal. However, since the TxD signal is preferably used for other functionality in the present embodiment (as described below), there is not a convenient line available to use as a latch clock line in an RS-232 interface. The matching shift register embodiment described above is therefore more appropriate to the described embodiment and is less expensive than a latching shift register embodiment as well. In other embodiments using a different, non-RS-232 interface bus 24, latching shift registers may be more appropriate.
Host computer 12 also sends signals on TxD line 155 to the interface device 130. Level shifter 154 receives the TxD line 155 from the RS-232 interface bus 24. The TxD line 155 is input to PAL 142 and is used to enable or activate the motors similarly to the embodiment of Figure 4c and 3c. The TxD line 155 can also be used to send more complex host signals that provide a desired force sensation to the user. For example, a baud rate can be set by a UART on the host computer 12 to establish a rate of transmission of data. Data can be sent as high or low bits on the TxD line at the specified baud rate to turn actuators 30 on and off at the desired rate, as described above with reference to Figure 4f. Or, a pulse width modulation (PWM) signal can be sent on TxD line 155 to control the actuators 30 as described above.
The RTS line 152 is input to level shifter 134 and is provided as a clock signal for the shift registers 136 and 144 (and 150, if present) to set the rate of shifting the input bits and providing them to the PAL 142. The clock signal on the RTS line is provided by the host computer at a predetermined frequency. Thus, the RS-232 interface in the current embodiment is used for synchronous serial communication instead of the asynchronous serial communication for which it is normally used.
DSR line 156 is used in the described embodiment as a parallel communication line to provide information to host computer 12. Preferably, the host computer can use DSR line 156 to verify that the interface device 130 exists and is connected to the serial interface bus 24, for safety and other reasons as described above. DSR line 156 is coupled to output Q0 of first shift register 136 and is connected to level shifter 154 to convert the logic level signal to an RS-232 voltage level. The data on DSR line 156 is output from level shifter 154 to host computer 12. The bit on line 156 changes as serial data is clocked into the shift registers on DTR line 132 as described above. The state of the DSR line can thus be clocked back to the host over the interface bus 24. To check whether the interface device 130 is connected, the host can read the DSR line 156 and set the data DTR line to a bit of the opposite state. At this point, the DSR line should still be in its original state. The host would then provide a clock pulse on the RTS line and check to see that the DSR line changes to the same state as the DTR line. If so, the connection between the host and interface device has been verified. If the DTR line does not change states, the interface device may be disconnected. This test can be provided for both states of the DTR data to verify a consistent response. Control "loop back" lines of a serial or parallel port can be used by the host computer to verify the identity of the interface device 130, especially when non microprocessor 26 is present to provide an identification signal for the interface device. Preferably, non-standard ouφut and input lines of the interface bus are used so that the interface device will not be confused with other types of devices that can be connected to the host computer. For example, when the host wishes to determine what type of peripheral is connected to its serial port, the host can send out a signal on an output line and check the non-standard input line; if the sent signal is detected, then the host knows that the interface device 14 or 130 is connected. This feature can also be used in the embodiments of Figures 4a-4f and in other embodiments that do not include a microprocessor 26.
It should be noted that different and equivalent signals to the RS-232 signals described above can be used in altemate embodiments of interface device 130. For example, equivalent signals on RS-422 or video game interfaces can be used similarly.
The embodiment 130 of the interface device has several advantages. Since no local microprocessor 26 or UART are needed in interface device 130, the cost of the interface device is reduced greatly. The implementation of a serial data stream allows the host to send a greater number of control signals and have much greater control than in the embodiments of Figures 4a- 4f. Many more types of commands can be sent by the host using the serial interface than the three maximum commands allowed in the parallel bus implementation of an RS-232 interface in the above "recoil" embodiments. Also, force values or other commands can be sent by the host to better control the actuators. In addition, the logic components of interface device 130 shown in Figure 5 can be readily provided on a single chip implemented as an ASIC or FPGA. This allows the circuitry for interface device 130 to be manufactured in high volume at a very low cost.
FIGURE 6 is a schematic diagram illustrating a low-cost and compact power circuit 158 of the present invention used for implementing force feedback in interface device 14. Power circuit 158 includes a current limiter 160, a capacitor 162, and an optional analog-to-digital converter 164. Motor 96 (or other type of active actuator) and motor interface 94 are substantially similar to the equivalent components described in the embodiments of Figures 2-5.
A voltage V is provided on a line 159. Line 159 can be a line connected to a power supply such as power supply 41 , or to the power signal of a game port interface 25. Line 159 can also be connected to a peripheral interface port of video game consoles such as the Sega Saturn or the Sony PlayStation. Line 159 is input to current limiter 160, which can be implemented with several components well known to those skilled in the art. Current limiter 160 limits the current of the input voltage signal on line 159 to a maximum current of IL1M. This current has been previously determined to be the desired current to charge the capacitor 162, as shown in Table 2 below. Capacitor 162 is coupled between an ouφut of current limiter 160 and ground. The capacitor has a capacitance C that has been selected to provide the desired charging characteristics. For example, in the described embodiment, C can be 2,000 to 10,000 microfarads. The factors determining C and other component values are described in greater detail below. Capacitor 162 stores energy from the current-limited signal on line 161 until it is fully charged. The line 161 also is coupled to a voltage bias input of an amplifier 166 included in an actuator interface 94. The capacitor 162 and amplifier ("driver") circuit 166 are configured in such a way so as to allow capacitor C to supply power to the amplifier to amplify a control signal input to the amplifier.
Resistors Rl and R2 are coupled between the ouφut of current limiter 160 and ground. Optional A/D converter 164 has an input coupled to the node between resistors Rl and R2 and has an output coupled to microprocessor 26. Microprocessor 26 receives the digital signal from the A/D converter at an analog input pin. Microprocessor 26 also sends out a motor control signal on line 163 to activate motor 96, similarly to the above-described embodiments.
The power circuit 158 operates as follows. The voltage V from power supply is limited as described above by current limiter 160. The limited voltage signal is output on line 161 and charges capacitor C. The current-limited voltage signal is also provided to the A/D converter 144 which provides a digital representation of the signal to the microprocessor 26. The microprocessor monitors this signal to determine the current charging state of the capacitor 162; the voltage magnitude is indicative of the amount of charge stored in the capacitor. When enough power has been charged in the capacitor to drive motor 96, and if the microprocessor has determined that it is an appropriate time to output forces on user object 34, then the microprocessor signals the motor to be activated on line 163. The activation signal from the microprocessor 26 can be, for example, an analog signal from a D/A converter on the microprocessor, or could be a pulse width modulation (PWM) signal. The power in the capacitor is provided to amplifier 166 and is used to amplify the signal from the microprocessor and drive the motor 96.
The present power circuit configuration offers several advantages over standard prior art power supplies used for force feedback. It has been found that human perception of force sensations is highly focused on transient forces rather than constant forces. For example, a human will easily perceive a change in force but will not as easily sense a steady-state, continuous force. In terms of a force feedback interface device, if an intense force is desired to be ouφut to the user operating the device, then only a short jolt or pulse of force (i.e., change in force) is actually necessary for the user to detect that force; maintaining a continuous magnitude of force over time is not as critical, since the user will not as readily detect that constant force after the change in force has occurred. This human perceptual condition is highly relevant to the present power circuit. Using the energy stored in capacitor 162 to power amplifier 166, a change in force can be created for a short period of time as the capacitor discharges its energy. Using the added power from the capacitor, the motor 96 can output a stronger force than when using the power supply 41 or other source alone. Thus, strong jolts or other force sensations can be provided above the power supply's maximum force level of the interface device. These sensations do not have to be maintained for very long, since the user will more readily sense the change in force rather than any continuous stronger force output, so diat the user can be fooled into thinking a stronger force has been and continues to be output.
This operation can be advantageous in that a smaller power supply can be used to power the motors. The capacitor power can be provided to achieve, for a short period of time, levels of force as great as a larger power supply would provide. A smaller power supply would allow the interface device to be much smaller, less expensive, and lightweight, which are ideal characteristics for force feedback devices intended for the mass market. In addition, since such a smaller power supply would only output the larger magnitude forces for short periods of time instead of continuously, the force feedback device would be safer for the user to operate.
In an ideal embodiment, a power supply 41 would not be required at all when using the power circuit 158. Power can be drawn directly from the host computer 12 over the game port interface 25 or other interface that supplies power from the host computer, such as a USB interface. This power can be supplemented by using the capacitor 162 when high-magnitude forces are required to be output by motor 96. The elimination of a separate power supply 41 allows the interface device to a great deal smaller and less expensive to manufacture, as well as being more convenient for a typical user to operate.
Since the capacitor 162 discharges its energy when the motor is activated, it must be charged again before it is again operative to power the motor 96. The charging time is significant to the design since the microprocessor is limited in the frequency and control of forces according to when the capacitor is ready to provide power. Several different capacitances C of capacitor 162 and other parameters in the circuit have been varied to determine efficient configurations of the circuit.
Table 2 shows sample pulse durations and recharge times for various configurations of supply voltages, currents, and storage capacitances (C). Configurations
1 2
Input Supply Voltage V 12 5 12 24
Minimum Driver Vcc 5 3 5 5
Input Current Limit ILIM (mA)300 300 500 200 Storage Capacitance C (μF) 4700 10000 4700 2000 Steady-State Current Iss (mA) 200 200 250 100 Pulse Current (mA) 2000 2000 2000 2000
Max Pulse Time (ms) 19 12 22 21
Recharge Time (ms) 329 200 132 380
TABLE 2
Table 3 shows sample storage capacitances and recharge times for various supply voltages, currents, and a pulse duration.
Configurations
1 2
Input P. Supply Voltage (V) 12 5 12 24 Minimum Driver Vcc 5 3 5 5
Input Current Limit IUM (mA)300 300 500 200 Storage Capacitance C (uF) 2429 8500 2143 947 Steady-State Current Iss (mA) 200 200 250 100 Pulse Current (mA) 2000 2000 2000 2000
Max Pulse Time (ms) 10 10 10 10
Recharge Time (ms) 170 170 60 180
TABLE 3
As shown from Tables 2 and 3, a storage capacitor can supply enough power to provide a significant increase in output force magnitude. For example, as shown in Configuration 4 of Table 1, a 2000 uF capacitor 162 can provide 2000 mA of pulse current to create a jolt force with motor 96 for 21 milliseconds when using a 24 V, 200 A (Iss) power supply. This allows a jolt force of 10 times the magnitude the power supply alone could output. A charge time of 380 milliseconds does not delay the force jolts significantly for many applications. Note that many different configurations and/or values of the parameters shown in Tables 2 and 3 can be used, and other parameters not shown in the tables can be varied in other embodiments.
Using additional and/or different capacitors 162, as well as additional and/or different power supplies 41 , a variety of durations and magnitudes of forces can be created using a combination of capacitor storage abilities and power supply outputs. In addition, multiple motors of interface device 14 can each be provided with its own capacitor circuit to provide power for a dedicated motor.
In an altemative embodiment, microprocessor 26 can be eliminated from me interface device 14. For example, the "recoil" interface devices of Figures 4a-4f provide force feedback without the use of microprocessor 26. In such an embodiment, A/D converter 164 does not need to be used. The recharge time can be estimated and the motor can be deactivated using a timing circuit, for example, until the capacitor is fully charged. In yet other embodiments, the microprocessor 26 can be omitted and the A D converter 164 can send the converted digital signals to the host computer 12, which determines when the capacitor is fully charged and sends an output activation or enable signal to motor 96 when appropriate.
FIGURE 7 is a flow diagram illustrating a method 200 for controlling a force feedback interface device of the present invention using microprocessor 26. such as in the interface devices as described with respect to Figure 2 and Figure 3. In addition, this method can be adapted for some embodiments not including microprocessor 26, such as the recoil embodiments of Figures 4a-4f or embodiment 130 of Figure 5. In such an embodiment, the microprocessor steps of the process can be implemented by logic or other components, such as in PAL 142 or control block 102.
The process of Figure 7 is suitable for low speed communication interfaces, such as a standard RS-232 serial interface. However, the embodiment of Figure 7 is also suitable for high speed communication interfaces such as USB, since the local microprocessor relieves computational burden from host processor 16. In this reflex embodiment, for example, the slower "interrupt data transfers" mode of USB can be used.
The process of Figure 7 begins at 202. In step 204, host computer system 12 and interface device 14 are powered up, for example, by a user activating power switches. After step
204, the process 200 branches into two parallel (simultaneous) processes. One process is implemented on host computer system 12, and the other process is implemented on local microprocessor 26. These two processes branch out of step 204 in different directions to indicate this simultaneity. In the host computer system process, step 206 is first implemented, in which an application program is processed or updated. This application can be a simulation, video game, scientific program, operating system, or other software program. Images can be displayed for a user on output display screen 20 and other feedback can be presented, such as audio feedback.
Two branches exit step 206 to indicate that there are two processes running simultaneously
(e.g., multi-tasking, etc.) on host computer system 12. In one of the processes, step 208 is implemented, where sensor data describing the user object is received by the host computer from local microprocessor 26. The local processor 26 continually receives raw data from sensors 28, processes the raw data, and sends processed sensor data to host computer 12. Altematively, local processor 26 sends raw data directly to host computer system 12. "Sensor data," as referred to herein, can include position values, velocity values, and/or acceleration values derived from the sensors 28 which describe motion of object 34 in one or more degrees of freedom. In addition, any other data received from other input devices 39 can also be considered "sensor data" in step 208, such as signals indicating a button on interface device 14 has been pressed by the user. Finally, the term "sensor data" also can include a history of values, such as position values recorded previously and stored in order to calculate a velocity.
Host computer system 12 receives either raw data (e.g., position data and no velocity or acceleration data) or processed sensor data (position, velocity and/or acceleration data) from microprocessor 26 in step 208. In addition, any other sensor data received from other input devices 39 can also be received by host computer system 12 from microprocessor 26 in step 208, such as signals indicating a button on interface device 14 has been pressed by the user. The host computer does not need to calculate force values from the received sensor data in step 208. Rather, host computer 12 monitors the sensor data to determine when a change in the type of force is required. This is described in greater detail below. Of course, host computer 12 also uses the sensor data as input for the host application to update the host application accordingly.
After sensor data is received in step 208, the process returns to step 206, where the host computer system 12 can update the application program in response to the user's manipulations of object 34 and any other user input received as sensor data in step 208 as well as determine if one or more force commands need to be output to object 34 in the parallel process (step 210). Step 208 is implemented in a continual loop of receiving sets of sensor data from local processor 26. Since the host computer does not need to directly control actuators based on sensor data, the sensor data can be provided to die host at a low speed. For example, since the host computer updates the host application and images on display screen 20 in response to sensor data, the sensor data need only be read at 60-80 Hz (the refresh cycle of a typical display screen) compared to the much higher rate of about 500-1000 Hz (or greater) that would be required to realistically control force feedback signals directly from the host. The second branch from step 206 is concemed with me process of the host computer determining high-level or supervisory force commands ("host commands") to provide force feedback to the user manipulated object 34.
The second branch starts with step 210, in which the host computer system checks if a change in the type of force applied to user object 34 is required. The "type" of force is intended to generically refer to different force sensations, durations, directions, or other high-level characteristics of forces, or changes in these characteristics, which are controlled by the host computer. For example, a force sensation or profile are types of forces produced by a particular force routine which the local microprocessor 26 can implement independently of the host computer.
The host computer 12 determines whether a change in the type of force is required according to several criteria, the most important of which are the sensor data read by the host computer 12 in step 208, timing data, and the implementation or "events" of the application program updated in step 206. The sensor data read in step 208 informs the host computer how ώe user is interacting with the application program and when new types of forces should be applied to the object based on the object's current position, velocity, and/or acceleration. The user's manipulations of object 34 may have caused a new type of force to required. For example, if the user is moving a virtual race car within a virtual pool of mud in a video game, a damping type of force should be applied to the object 34 as long as the race car moves within me mud. Thus, damping forces need to be continually applied to the object, but no change in the type of force is required. When the race car moves out of the pool of mud, a new type of force (i.e. a removal of the damping force in this case) is required. The velocity and/or acceleration of the user object can also influence whether a change in force on the object is required. If the user is controlling a tennis racket in a game, the velocity of a user object joystick may determine if a tennis ball is hit and thus if an appropriate force should be applied to the joystick.
Other criteria for determining if a change in the type of force is required includes events in the application program. For example, a game application program may (perhaps randomly) determine mat another object in the game is going to collide with a computer object controlled by the user, regardless of the position of the user object 34. Forces should thus be applied to the user object in accordance with this collision event to simulate an impact. A type of force can be required on the user object depending on a combination of such events and the sensor data read in step 208. Other parameters and inputs to the application program can determine if a change in force to the user object is necessary, such as other input devices or user interface devices connected to host computer system 12 which input data to the application program (other interface devices can be directly connected, connected remotely through a network, etc.). If no change in the type of force is currently required in step 210, then the process returns to step 206 to update die host application and retum to step 210 to again check until such a change the type of force is required. When such a change is required, step 212 is implemented, in which host computer 12 determines an appropriate high-level host command to send to microprocessor 26. The available host commands for host computer 12 may each correspond to an associated force routine implemented by microprocessor 26. For example, different host commands to provide a damping force, a spring force, a gravitational pull, a bumpy surface force, a virtual obstruction force, and other forces can be available to host computer 12. These host commands can also include a designation of the particular actuators 30 and/or degrees of freedom which are to apply this desired force on object 34. The host commands can also include other command parameter information which might vary the force produced by a particular force routine. For example, a damping constant can be included in a host command to designate a desired amount of damping force, or a direction of force can be provided. The host command may also preferably override the reflex operation of the processor 26 and include "low-level" force commands, such as direct force values, that can be sent directly to the actuators 30 (described below with respect to step 226).
Preferably, the commands include direct host commands, "reflex" commands, and custom effects. Some desirable direct host commands include JOLT (a short force pulse), WOBBLE (random force), SPRING (a virtual spring), DAMPER (a damping force), and so on. Each command preferably includes parameters which help the host specify the characteristics of the desired output force. These commands would cause the microprocessor to instantly ouφut the commanded force according to the appropriately-selected force routine. "Reflex" commands, in contrast, provide conditions to the microprocessor so that the desired force is output when the conditions are met. For example, a reflex command of Joit_Button_Reflex can instruct the microprocessor to select a force routine that outputs a JOLT force only when a specified button is pressed by the user (or, when the user object is moved in a particular direction). Finally, custom effects can be provided to the microprocessor by the host and then commanded to be output. For example, the host computer can download to the microprocessor a set of force values (a force profile) as a "force profile file" or other collection of data using a host command LOAD_PROFILE, and which can be stored in local memory 27. A separate host command PLAY_PROFILE could then be sent to instruct the microprocessor to ouφut the downloaded force profile as forces on user object 34. Reflex commands can also be used to cause ώe downloaded profile to be output only when a condition, such as a button press, occurs. Preferably, a force profile file includes an array of force values, size information about the size of the data, and timing information for when to output the various force values (preferably, the force values have "+" or "-" signs to indicate the direction of forces; altematively, directions can be separately indicated). Numerous force profile files can be downloaded to the microprocessor, and the microprocessor can send back an index or other information to inform the host how to select a particular force profile file. Custom effects can also be downloaded over a computer network, such as the World Wide Web, as described below.
In next step 214, the host computer sends me host command to the microprocessor 26 over bus 24 (or bus 25, if appropriate). The process then returns to step 206 to update die host application and to retum to step 210 to check if anodier change in force is required.
In addition, the host computer 12 preferably synchronizes any appropriate visual feedback, auditory feedback, or other feedback related to the host application with the issuance of host commands and the application of forces on user object 34. For example, in a video game application, the onset or start of visual events, such as an object colliding with die user on display screen 20, should be synchronized with the onset or start of forces felt by the user which correspond to or complement those visual events. The onsets visual events and force events are preferably occur within about 30 milliseconds (ms) of each other. This span of time is the typical limit of human perceptual ability to perceive the events as simultaneous. If die visual and force events occur outside this range, then a time lag between the events can usually be perceived. Similarly, the ouφut of auditory signals, corresponding to the onset of auditory events in the host application, are preferably ouφut synchronized with die onset of ouφut forces that correspond to/complement those auditory events. Again, die onsets of these events occur preferably within about 30 ms of each other. For example, host computer system 12 can output sounds of an explosion from speakers 21 as close in time as possible to die forces felt by the user from that explosion in a simulation. Preferably, the magnitude of the sound is in direct (as opposed to inverse) proportion to the magnitude of the forces applied to user object 34. For example, during a simulation, a low sound of an explosion in die far (virtual) distance can cause a small force on user object 34, while a large, "nearby" explosion might cause a loud sound to be output by die speakers and a correspondingly large force to be output on object 34.
The second process branching from step 204 is implemented by die local microprocessor 26. This process starts with step 216 and is implemented in parallel with the host computer process of steps 206-214 described above. In step 216, the interface device 14 is activated. For example, signals can be sent between host computer 12 and interface device 14 to acknowledge that the interface device is now active and can be commanded by host computer 12. From step 216, two processes branch to indicate diat there are two processes running simultaneously (e.g., multi-tasking) on local microprocessor 26.
In the first process branch, step 218 is implemented, in which die processor 26 reads raw data (sensor readings) from sensors 28. Such raw data preferably includes position values describing the position of the user object along provided degrees of freedom. In the preferred embodiment, sensors 28 are relative sensors that provide position values describing die change in position since the last position read. Processor 26 can determine the absolute position by measuring the relative position from a designated reference position. Altematively, absolute sensors can be used. In odier embodiments, sensors 28 can include velocity sensors and accelerometers for providing raw velocity and acceleration values of object 34. The raw data read in step 218 can also include other input, such as from an activated button or odier control 39 of interface device 14.
In other embodiments such as die interface device 50 of Figure 3 and the embodiments of
Figures 4a-f and 5, either raw data or processed sensor data from sensors 28 can be sent directly to host computer 12 without being received by microprocessor 26. The host can perform any processing that is necessary to inteφret the sensor data in these embodiments, such diat any or all of steps 218-221 may not be necessary.
In next step 220, microprocessor 26 processes the received raw data into sensor data, if applicable. In the preferred embodiment, this processing includes two steps: computing velocity and/or acceleration values from raw position data (if velocity and/or acceleration are needed to compute forces), and filtering the computed velocity and acceleration data. The velocity and acceleration values are computed from raw position data received in step 218 and a history of stored position and time values (and other types of values, if appropriate). Preferably, processor 26 stores a number of position values and time values corresponding to when die position values were received. Processor 26 can use, for example, local clock 21 to determine the timing data. The velocity and acceleration can be computed using the stored position data and timing data, as is well known to those skilled in the art. The calculated velocity and/or acceleration values can dien be filtered to remove noise from the data, such as large spikes that may result in velocity calculations from quick changes in position of object 34. Thus, the sensor data in the described embodiment includes position, velocity, acceleration, and other input data. In an altemate embodiment, circuitry that is electrically coupled to but separate from processor 26 can receive die raw data and determine velocity and acceleration. For example, an application-specific integrated circuit (ASIC) or discrete logic circuitry can use counters or the like to determine velocity and acceleration to save processing time on microprocessor 26. In embodiments where velocity and/or acceleration sensors are used, the calculation of velocity and/or acceleration is omitted.
In next step 221, die processor 26 sends the processed sensor data to host computer 12 and also stores histories of the sensor data in storage devices such as memory 27 for computing forces. The process then returns to step 218 to read raw data. Steps 218, 220 and 221 are thus continuously implemented to provide current sensor data to processor 26 and host computer 12. The second branch from step 216 is concemed widi a "reflex process" or "reflex" in which microprocessor 26 controls the actuators 30 to provide forces to object 34. As mentioned above, a "reflex process" is a force process iat outputs forces on user object 34 and is implemented locally to interface device 14, is independent of host computer 12, and depends only on local control events, such as buttons being pressed or user object 34 being moved by die user. The most simple form of reflex is used in the "recoil" embodiments of Figures 4a-4f, in which a simple control event, such as the push of a button by the user, causes a force to be ouφut on die user object by actuators 30. The more complex form of reflex process, described in die current method, can calculate and output forces depending on a variety of local control events, such as button presses and the position, velocity, and/or acceleration of user object 34 in provided degrees of freedom.
The second branch starts with step 222, in which processor 26 checks if a host command has been received from host computer 12 over bus 24. Host commands are high-level commands that command changes in forces to the user object, as described with reference to step 214. If a host command has been received, the process continues to step 224, where a "force routine" indicated by or associated with the host command is selected if appropriate. A "force routine", as referred to herein, is a set of steps or instructions for microprocessor 26 to provide low-level force commands to actuators 30. These "low-level" force commands (or "processor force commands") are to be distinguished from the "high-level" host commands issued from the host computer 12. A low level force command instructs an actuator to output a force of a particular magnitude. For example, the low level command typically includes a "force value" or magnitude e.g., equivalent signal(s) to instruct the actuator to apply a force of a desired magnitude value. Low level force commands may also designate a direction of force if an actuator can apply force in a selected direction, and/or other low-level information as required by an actuator.
Force routines determine low level force commands from other parameters, such as sensor data read in step 218 (button press data, position data, etc.) and timing data from clock 18. The force routines can be stored local to microprocessor 26 in, for example, memory 27 such as RAM or ROM (or EPROM, EEPROM, etc.). Thus, the microprocessor might select a particular damping force routine if die host command indicated diat the damping force from that particular damping process should be applied to object 34. Other damping force routines might also be available. The available force routines are described in greater detail below and may include algorithms, stored force profiles or values, conditions, etc. Also, die host command received from the host in step 222 may in some instances simply be a low-level force command, or even a single force value, diat is to be sent to an actuator 30, in which case a force routine need not be selected. After a force routine has been selected in step 224, or if a new host command has not been received in step 222, then step 226 is implemented, in which processor 26 determines a processor low-level force command. The low-level force command is derived from either a selected force routine, a resident force routine, any odier data required by d e force routine, and/or command parameters and/or values included in relevant host commands. As explained above, the required data can include sensor data and/or timing data from local clock 29. If no new high level command was received in step 222, then the microprocessor 26 can determine a force command according to one or more "resident" force routines, i.e., the same force routines that it selected and used in previous iterations of step 226. This is the "reflex" process operation of the interface device that does not require any new input from host computer 12.
In the described embodiment, force routines can include several different types of steps and/or instructions which are followed to determine a low-level force command. One type of instruction in a force routine is a force algorithm, which includes an equation that host computer 12 can use to calculate or model a force value based on sensor and timing data. Several types of algorithms can be used. For example, algorithms in which force varies linearly (or nonlinearly) with the position of object 34 can be used to provide a simulated force like a spring. Algorithms in which force varies linearly (or nonlinearly) with the velocity of object 34 can be also used to provide a simulated damping force or other forces on user object 34. Algorithms in which force varies linearly (or nonlinearly) with the acceleration of object 34 can also be used to provide, for example, a simulated inertial force on a mass (for linear variation) or a simulated gravitational pull (for nonlinear variation). Several types of simulated forces and the algorithms used to calculate such forces are described in "Perceptual Design of a Virtual Rigid Surface Contact," by Louis B. Rosenberg, Center for Design Research, Stanford University, Report number AL/CF-TR-1995- 0029, April 1993, which is incoφorated by reference herein.
For example, a kinematic equation which calculates a force value based on the velocity of the user object multiplied by a damping constant can be used to determine a damping force on the user object. This type of equation can simulate motion of object 34 along one degree of freedom through a fluid or similar material. For example, a damping constant can first be selected which indicates the degree of resistance that object 34 experiences when moving through a simulated material, such as a liquid, where a greater number indicates greater resistance. Water would have a lower damping constant man oil or syrup. The microprocessor 26 recalls the previous position of user object 34 (along a particular degree of freedom) from memory 27, examines d e current position of the user object, and calculates the difference in position. From the sign (negative or positive) of the difference, the direction of the movement of object 34 can also be determined. The force value is then set equal to the damping constant multiplied by the change in position.
Low-level commands that control an actuator based on this algoridim produce a force proportional to the user object's motion to simulate movement through a fluid. Movement in other mediums, such as on a bumpy surface, on an inclined plane, etc., can be simulated in a similar fashion using different methods of calculating the low-level force commands.
The determination of low-level commands from force routines can also be influenced by timing data accessed from system clock 18. For example, in me damping force example described above, die velocity of the user object 34 is determined by calculating the different of positions of the user object and multiplying by the damping constant. This calculation assumes a fixed time interval between data points, i.e., it is assumed that the position data of the object 34 is received by host computer 12 in regular, predetermined time intervals. However, this may not actually occur due to different processing speeds of different computer platforms or due to processing variations on a single host microprocessor 16, such as due to multitasking. Therefore, in the present invention, the host computer preferably accesses clock 12 to determine how much time has actually elapsed since the last position data was received. In die damping force example, the host computer could take the difference in position and divide it by a time measure to account for differences in timing. The host computer can thus use the clock's timing data in die modulation of forces and force sensations to the user. Timing data can be used in other algorithms and force sensation processes of the present invention to provide repeatable and consistent force feedback regardless of type of platform or available processing time on host computer 12.
The velocity and acceleration required for particular force routines can be provided in a number of different ways. The sensor data provided by steps 218-221 can include position data, velocity data, and/or acceleration data. For example, the microprocessor can use me velocity and acceleration data directly in an algorithm to calculate a low-level force command. In an altemate embodiment, only position data might be received from sensors 28, and me microprocessor can calculate the velocity and or acceleration values using stored histories of values. The microprocessor only calculates the velocity and/or acceleration values when the values are needed by a force routine. Altematively, the processor can always calculate the velocity and acceleration values regardless of whether the values are used in a force routine.
Other instructions can also be included in a force routine. For example, conditional steps can be included to provide forces under specified circumstances. For example, a force routine might instruct the processor 26 to output a low-level force command only when the user object is moved to a particular position in provided degrees of freedom. Or, to simulate a virtual obstruction such as a wall, forces should be applied in only one direction (uni-directional). For many passive actuators, only bi-directional resistance forces can be applied. To simulate uni¬ directional resistance using a passive actuator, conditional instructions can be included in a virtual obstruction force routine to output a low-level force command only when the user object is moved in a particular direction at a particular position. Also, a "null" force routine can be available iat instructs microprocessor 26 to issue low-level commands to provide zero force (i.e. remove all forces) on user object 34.
Another type of force routine does not use algorithms to model a force, but instead uses force values that have been previously calculated or sampled and stored as a digitized "force profile" in memory or other storage device. These force values may have been previously generated using an equation or algorithm as described above, or provided by sampling and digitizing forces. For example, to provide a particular force sensation to the user, host computer 12 can be instructed by die steps of a force routine to retrieve successive force values of a force profile from a certain storage device, such as memory 27, RAM, hard disk, etc. These force values can be included in low-level commands sent directly to an actuator to provide particular forces without requiring host computer 12 to calculate the force values. In addition, previously- stored force values can be output with respect to other parameters to provide different types of forces and force sensations from one set of stored force values. For example, using system clock 18, one set of stored force values can be output in sequence according to different time intervals that can vary depending on the desired force, thus producing different types of forces on d e user. Or, different retrieved force values can be output depending on the current position, velocity, etc. of user object 34.
The low level force command determined in step 226 can also depend on instructions that check for other parameters. These instructions can be included within or extemal to the above- described force routines. One such parameter can includes values provided by the implemented host application program. The application program may determine mat a particular low-level force command should be output or force routine selected based on events occurring within the application program or o er instructions. Host commands can be provided by die host application program to output forces independently of sensor data. Also, in a host command, die host can provide its own particular position, velocity, and/or acceleration data to a designated force routine to calculate or provide a force that is not based on the manipulation of user object 34, but is provided to simulate an event in the application program. Such events may include collision events, such as occur when a user-controlled computer image impacts a virtual surface or structure. Also, other input devices connected to host computer 12 can influence events and, therefore, the forces applied to user object 34. For example, the sensor data from multiple interface devices 14 connected to a single host computer can influence the forces felt on odier connected interface devices by influencing events and computer-controlled images/objects of the host application program.
Also, the low-level force commands determined in step 226 can be based on other inputs to host computer 12, such as activations of buttons or other input devices in (or extemal to) interface device 14. For example, a particular force routine might instruct the microprocessor to ouφut a force to a joystick whenever a user presses a button on the joystick. In some embodiments, steps 218, 220, and 221 for reading sensor data can be incoφorated in one or more force routines for the microprocessor, so that sensor data is only read once a force routine has been selected and executed. In addition, the host command can include other command parameter information needed to determine a low-level force command. For example, the host command can indicate the direction of a force along a degree of freedom.
Microprocessor 26 can determine a low-level force command in step 226 according to a newly-selected force routine, or to a previously selected force routine. For example, if this is a second or later iteration of step 226, the same force routine as in the previous iteration can be again implemented if a new host command has not been received. This is, in fact, die advantage of an independent reflex process: the microprocessor 26 can continually output forces on user object 34 using sensor data and timing data according to force routines, independently of any commands from the host. Thus, a "virtual wall" force routine would allow the microprocessor to command forces simulating the wall whenever the user's joystick was moved in the appropriate position or direction. The host computer need only command diat the virtual wall exists and provide die location of die wall, and die microprocessor 26 will independently implement the wall and die required forces when necessary.
The above-described force routines and other parameters can be used to provide a variety of haptic sensations to the user through the user object 34 to simulate many different types of tactile events. For example, typical haptic sensations may include a virtual damping (described above), a virtual obstruction, and a virtual texture. Virtual obstructions are provided to simulate walls, obstructions, and other uni-directional forces in a simulation, game, etc. When a user moves a computer image into a virtual obstruction with a joystick, the user then feels a physical resistance as he or she continues to move the joystick in that direction. If the user moves die object away from the obstruction, the uni-directional force is removed. Thus the user is given a convincing sensation that the virtual obstruction displayed on the screen has physical properties. Similarly, virtual textures can be used to simulate a surface condition or similar texture. For example, as the user moves a joystick or other user object along an axis, the host computer sends a rapid sequence of commands to repetitively 1 ) apply resistance along that axis, and 2) to dien immediately apply no resistance along diat axis, e.g., as according to a force routine. This frequency is based upon the travel of the joystick handle and is thus correlated with spatial position. Thus, the user feels a physical sensation of texture, which can be described as the feeling of dragging a stick over a grating.
In step 228, processor 26 outputs the determined processor force command to actuators 30 to set the output force to the desired level. Before sending out the low-level force command, processor 26 can optionally convert the low-level force command to an appropriate form usable by actuator 30, and/or actuator interface 38 can perform such conversion. The process then returns to step 222 to check if another host command has been received from the host computer 12.
The reflex process of microprocessor 26 (steps 218, 220, 222, 224, 226, and 228) tiius operates to provide forces on object 34 independently of host computer 12 according to a selected force routine and other parameters. The force routine instructs how the processor force command is to be determined based on the most recent sensor data read by microprocessor 26. Since a reflex process independently outputs forces depending on the local control events of interface device 14, die host computer is freed to process the host application and determine only when a new type of force needs to be output. This greatly improves communication rates between host computer 12 and interface device 14.
In addition, the host computer 12 preferably has the ability to override die reflex operation of microprocessor 26 and directly provide force values or low level commands. For example, me host command can simply indicate a force value to be sent to an actuator 30. This override mode can also be implemented as a force routine. For example, the microprocessor 26 can select a force routine from memory that instructs it to relay low-level force commands received from host computer 12 to an actuator 30.
Another advantage of the reflex embodiment of Figure 7, as well as the hardware embodiments of Figures 2, 3, 4a-f, and 5, is mat the low communication needs between die host computer and the interface device allows force feedback to be easily implemented over computer networks. For example, host computer 12 can be connected to the Internet and the World Wide Web networks as is well known to those skilled in the art. A "web page" or other network site or node can store force feedback information for a user to download and implement using interface device 14. For example, a web page might store a sequence of force values so mat die user can interact with a game or simulation implemented on the web page. The host computer 12 can receive the force commands or other force information over the network using, for example, a web browser or software utility such as Netscape from Netscape Communications. As me force information is received by the host, the host can transmit the force information to the microprocessor 26 to control the actuators as described above. Since only high level force commands are needed in the reflex embodiment, the web page need store only a small amount of information to be downloaded to the host computer ratiier than all the actual force values necessary to control actuators. A high level command protocol allows more realistic force feedback interaction over a global network.
In other embodiments, a "host-controlled" method can be used, in which host computer system 12 provides direct, low-level force commands to microprocessor 26, and the microprocessor directly provides these force commands to actuators 30 to control forces ouφut by the actuators. However, this type of embodiment is not a reflex embodiment since forces ouφut on user object 34 are dependent on active and continuous control from the host computer, which increases the computational burden on the host.
The control process for a host controlled embodiment would be similar to the process of
Figure 7, except the host computer 12 would determine all forces to be output on user object 34. Sensor data is received by die host computer from local microprocessor 26. Processor 26 continually receives signals from sensors 28, processes the raw data, and sends processed sensor data to host computer 12. Altematively, the processor 26 can provide raw position data and odier input data to host computer 12, and the host computer 12 filters and computes velocity and acceleration from the raw position data. In other embodiments, me filtering can be performed on host computer 12 while the other processing can be performed on the processor 26.
In the host-controlled embodiment, the host computer determines the low-level force commands to provide force feedback to die user manipulating object 34. Preferably, force routines are used by the host which are provided local to the host and which are similar to the force routines used by microprocessor 26 as described above. The host computer checks d e sensor data to determine if a change in low-level force applied to user object 34 is required. For example, if the user is controlling a simulated race car in a video game, die position of a joystick determines if the race car is moving into a wall and thus if a collision force should be generated on the joystick.
When a change in force is required, host computer 12 outputs appropriate low-level force commands to microprocessor 26 over bus 24. These low-level force commands may include one or more force values and/or directions diat were determined in accordance with die parameters described above. The force command can be ouφut as an actual force signal diat is merely relayed to an actuator 30 by microprocessor 26; or, the force command can be converted to an appropriate form by microprocessor 26 before being sent to actuator 30. In addition, the low-level force command preferably includes information indicating to microprocessor 26 which actuators are to receive this force value. The host application program is then processed/updated. If no change of force is required, host computer 12 need not issue another command, since microprocessor 26 can continue to output the previous low-level force command to actuators 30. Altematively, host computer 12 can continuously output low-level commands, even if no change of force is required.
FIGURE 8 is a schematic diagram of an example of a user object 34 that is coupled to a gimbal mechanism 240 for providing two or more rotary degrees of freedom to object 34. Gimbal mechanism 240 can be coupled to interface device 14 or be provided widi sensors 28 and actuators 30 separately from the other components of interface device 14.
Gimbal mechanism 38, in the described embodiment, provides support for apparatus 25 on a grounded surface 56 (schematically shown as part of member 46). Gimbal mechanism 38 is preferably a five-member linkage that includes a ground member 46, extension members 48a and
48b, and central members 50a and 50b. Ground member 46 is preferably coupled to a base or surface which provides stability for apparatus 25.
Gimbal mechanism 240 can be supported by a grounded surface 242, which can be, for example, a surface of the housing of interface device 14 (schematically shown as part of member 244), a base, tabletop, or other surface that is fixed in position with reference to the user. Gimbal mechanism 240 is preferably a five-member linkage that includes a ground member 244, extension members 246a and 246b, and central members 248a and 248b. Ground member 244 is coupled to ground surface 242 which provides stability for mechanism 240. Ground member 244 is shown in Figure 8 as two separate members coupled together through grounded surface 242, but is considered one "member" of the five member linkage.
The members of gimbal mechanism 240 are rotatably coupled to one another through the use of bearings or pivots, wherein extension member 246a is rotatably coupled to ground member 244 by bearing 243a and can rotate about an axis A, central member 248a is rotatably coupled to extension member 246a by bearing 245a and can rotate about a floating axis D, extension member 246b is rotatably coupled to ground member 244 by bearing 243b and can rotate about axis B, central member 248b is rotatably coupled to extension member 246b by bearing 245b and can rotate about floating axis E, and central member 248a is rotatably coupled to central member 248b by bearing 247 at a center point P at the intersection of axes D and E. Preferably, central member 248a is coupled to one rotatable portion 247a of bearing 47, and central member 248b is coupled to the other rotatable portion 247b of bearing 247. The axes D and E are "floating" in the sense that they are not fixed in one position as are axes A and B. Axes A and B are substantially mutually peφendicular. As used herein, "substantially peφendicular" will mean that two objects or axis are exactly or almost perpendicular, i.e. at least within five degrees or ten degrees of perpendicular, or more preferably within less than one degree of peφendicular.
Gimbal mechanism 240 is formed as a five member closed chain or loop, such diat a first member of the chain is coupled to the last member in the chain. Each end of one member is coupled to the end of another member. The five-member linkage is arranged such that extension member 246a, central member 248a, and central member 248b can be rotated about axis A in a first degree of freedom. The linkage is also arranged such that extension member 246b, central member 248b, and central member 248a can be rotated about axis B in a second degree of freedom. When object 34 is positioned at the "origin" as shown in Figure 3, an angle θ between the central members 248a and 248b is about 90 degrees. When object 34 is rotated about one or both axes A and B, central members move in two fashions: rotation about axis D or E by bearing 245b and or 245a, and rotation about axis C by bearing 247 such d at angle θ changes. For example, if the object 34 is moved into the page of Figure 3 away from the viewer, or out of the plane of the page toward the viewer, then the angle θ will decrease. If the object is moved to the left or right as shown in Figure 3, the angle θ will increase.
Linear axis member 250 is preferably an elongated rod-like member which is coupled to central member 248a and central member 248b at the point of intersection P of axes A and B. Linear axis member 250 can be used as a shaft of user object 34, or, in other embodiments, linear axis member 250 can be coupled to a different object. Linear axis member 250 is coupled to gimbal mechanism 240 such that it extends out of the plane defined by axis D and axis E. Linear axis member 250 can be rotated about axis A (and E) by rotating extension member 246a, central member 248a, and central member 248b in a first revolute degree of freedom, shown as arrow line 251. Member 250 can also be rotated about axis B (and D) by rotating extension member 250b and the two central members about axis B in a second revolute degree of freedom, shown by arrow line 252. Linear axis member can also be translatably coupled to the ends of central members 248a and 248b, and thus can be linearly moved, independently with respect to the gimbal mechanism 240, along floating axis C, providing a third degree of freedom as shown by arrows 253. Axis C can, of course, be rotated about one or both axes A and B as member 250 is rotated about these axes. In addition, linear axis member 250 in some embodiments can rotated about axis C, as indicated by arrow 255, to provide an additional degree of freedom. These additional degrees of freedom can also be associated with additional sensors and actuators to allow processor 26/host computer 12 to read the position/motion of object 34 and apply forces in those degrees of freedom.
Also preferably coupled to gimbal mechanism 240 and/or linear axis member 250 are transducers, such as the sensors 28 and actuators 30 of Figure 2. Such transducers are preferably coupled at the link or bearing points between members of the apparatus and provide input to and output from microprocessor 26 and/or host computer system 12. For example, a sensors/actuator transducer 256 can be coupled to extension member 246b by a gear drive 258. Gear drive 258 can include a drive wheel 255 and a rotatable cam 257 that interlock using gear teeth 253. Cam 257 is rigidly coupled to extension member 246b and is rotatable with the member 246b with respect to ground 242. Drive wheel is rigidly coupled to a rotating shaft of transducer 256 such that transducer 256 can rotate drive wheel 255, cam 257, and member 246b to ouφut forces on user object 34 about axis B/D. Likewise, transducer 256 can sense rotation about axis B/D when member 246b, cam 257, and drive wheel 255 rotate. A similar gear drive system can be provided at bearing 243a to sense and actuate movement about axis A/E. In altemate embodiments, different drive systems and transducers, sensors, and actuators can be used, as described above with reference to Figure 2. For example, a capstan drive or friction drive can be provided, and actuators and sensors can be provided for rotary or linear degrees of freedom of user object 34.
User object 34 is coupled to mechanism 240 and is preferably an interface object for a user to grasp or otherwise manipulate in three dimensional (3D) space. User object 34 may be moved in both (or all three or four) degrees of freedom provided by gimbal mechanism 240 and linear axis member 250. As object 34 is moved about axis A, floating axis D varies its position, and as object 34 is moved about axis B, floating axis E varies its position.
The preferred embodiment for gimbal mechanism 240 is for a joystick user object that can be moved in two rotary degrees of freedom about axes A E and B/D. For example, linear axis member 250 can be replaced by a joystick handle diat is rigidly coupled to central member 248b. Another preferred embodiment includes a third degree of freedom in which the joystick handle can rotate or "spin" about axis C. These embodiments are most appropriate for video games and certain virtual reality type applications such as controlling a vehicle, first person point of view, etc. Other embodiments include medical simulation and operation, for which the four degrees of freedom described above are more appropriate.
FIGURE 9 is a schematic diagram of circuit 260 for a touch plate safety switch 262 of the present invention. Like the optical and contact safety switches described with reference to Figure
2, the touch plate safety switch is designed to be contacted by a user while the interface device is in use. When the user does not contact the safety switch, the actuators 30 of the interface device are deactivated and pose no hazard to the user.
Touch plate safety switch 262 is designed so that the user does not have to press a button or otherwise actively control a switch, which can be awkward and tiresome during operation of the joystick or other user object 34. Two touch plates 264 are provided on die exterior of die interface device 14, preferably in a position which is naturally underneath the grip of a user who is grasping the user object 34. For example, the two plates can be provided on a joystick handle, as shown in FIGURE 9a, near the midsection of the handle where users typically contact it. Or, the contacts might be additionally or alternately provided on the top portion of the joystick 34.
Touch plates 264 are preferably made of a metal or other conductive material. When the user touches both plates with skin, a circuit is closed through the user, providing a deadman signal to the microprocessor, host computer, and/or actuators 30 that the safety switch is closed and that the actuators can be enabled. Then the user does not contact both plates 264, no current can flow and the safety switch is open, disabling the actuators 30 from functioning. Touch plate 264a is coupled to a circuit 266 which outputs a "deadman" signal 270 as a high (5 V) signal when the user contacts both plates. Circuit 266 includes two capacitors, diree resistors, 4 inverters, and a diode. Touch plate 26b is coupled to a circuit 268 which allows die current to flow to ground. Circuit 268 includes three resistors, two capacitors, and two inverters. The function and implementation of these components are well known to those skilled in d e art. Other equivalent circuits can also be used to perform substantially the same functions, and are well known to those skilled in the art.
FIGURE 10 is a diagrammatic illustration of a joystick 280 including a hand-weight safety switch of the present invention. The safety switch 41 , as described in Figures 2 and 9, is included in joystick 260 so that die user must activate the switch before actuators 30 are able to output forces. This is a safety feature that prevents the user object from unexpectedly moving and impacting the user when the user is not controlling the user object. Safety switches such as contact switches, light detectors, and other types of switches were described above which die user contacts or covers during operation of the joystick and are located on the user object or housing of die interface device 14. This can be awkward during operation of die stick since the user must constantly contact or cover a specific area of the user object or device housing.
Joystick 260 includes a hand-weight safety switch 262 which can be used to replace or supplement safety switch 41 and is more convenient for the user. Joystick 260 includes a translatable handle 264, a base 266, a spring 268, and switch contacts 270. Handle 264 is a standard joystick handle, but can also be replaced with other user objects 34 as described above. Handle 264 can be moved along axis C within a range distance d of the base 266 preferably on an extension member 272 or other similar guide. Distance d is preferably relatively small, such as 1 millimeter, and is exaggerated in Figure 8 for clarity. Pre-loaded spring 268 preferably forces me handle 264 up away from base 266 in a direction indicated by arrow 274 to an "open" position when no weight is placed on handle 264. Preferably, a stop (not shown) coupled to the top of member 272 or to the bottom of handle 264 prevents the handle from being detached from me base 266. A similar limit to movement of handle 264 in the direction of base 266 is provided by die physical engagement of the handle and base.
Switch contacts 270 are provided between the base 266 and handle 264 of joystick 260. Contacts 270 are connected by lines 276 to microprocessor 26, which can monitor when die contacts are touching. When the handle 264 is in the open position, contacts 270 are separated and no electrical current can flow between them, and thus no electrical current or power can flow to the motors from me power supply. Altematively, contacts 270 can be connected to microprocessor 26 or another selecting component which can detect the open state of the contacts and can deactivate actuators 30 with a safety disable signal when the open state is detected. The actuators 30 are thus prevented from outputting forces when d e user does not have control of the joystick handle 264 and the interface device 14.
When a user grasps handle 264, the weight of the user's hand forces the handle 264 down to engage the base 266. Switch contacts 270 connect from this engagement and allow current to flow between them. Since the contacts 270 complete the circuit from the actuators to the power supply, power is thus allowed to flow from the power supply to the actuators. Alternatively, microprocessor 26 detects die closed contact condition and discontinues sending a safety disable signal to actuators 30. This allows the actuators 30 to be controlled and activated by host computer 12 and microprocessor 26 normally. When the user releases the handle 264 from his or her grasp, the spring 268 forces the handle 264 away from base 266, which separates contacts 270 and deactivates the actuators 30.
The hand-weight safety switch has several advantages over other types of safety switches. The user can simply grasp or hold the handle in a normal, comfortable fashion and still activate the safety switch due to the weight of the user's hand. Thus, the user need not cover or press an awkwardly-located switch in a particular location of the handle or housing. Another advantage is concerned with the transportability of the interface device 14. The use of smaller power supplies, especially with respect to the features of the power circuit of Figure 6 of the present invention and the use of interface device 14 for home applications, results in a more lightweight interface device. Thus, users can pick up the interface device easily and move it to desired locations. A natural way for a user to pick up a joystick is to hold and pull on the handle 264. A standard force feedback joystick may present some danger to a user when picked up by the handle, since die actuators 30 will cause the base of the joystick to move and flail about. When using the hand-weight safety switch 262 of the present invention, this danger does not exist: the actuators are activated only if the user provides weight on the handle, and the pulling and carrying of the handle will not provide this weight and will not activate the actuators.
FIGURE 1 1 is a diagrammatic illustration of a break-away joystick 280 of the present invention. Since forces are exerted on the user object 34 and the user from actuators 30, mere is a potential for too strong a force to be output and to injure a user. As a safety measure, a break¬ away joystick 280 or other break-away user object 34 can be implemented. Break-away joystick 280 includes a handle 282, a base 284, and a securing device 286. In normal operation, handle 282 is secured to base 284 through securing device 286. Securing device 286 can be, for example, magnets that hold the base and handle together by magnetic fields. Oppositely-polarized magnets can be provided in the contacting portions of the base and handle. The magnets can be particularly chosen to provide a predetermined attachment strength. A user applies force to handle 282 during operation of the interface device, and the actuators 30 apply forces to base 284 to provide force feedback to the user. A total force on die handle and base is thus equal to the sum of the force on the handle from the user and the force in the opposite direction on the base from the actuators. When a total force greater than a predetermined magnitude is applied to die break¬ away joystick, then d e handle detaches from the base. In other embodiments, other securing devices or materials can be used, such as velcro, mechanical or electro-mechanical fastening devices, etc.
FIGURES 1 la-1 1 c show the break-away joystick in operation. In Figure I la, a user grasps handle 282 and forces the handle in direction of arrow 290. At the same time, an actuator 30 provides force in a direction of arrow 292 to base 284. Combined, these forces add up to a total force greater than the predetermined force which the securing device can withstand. As shown in Figures 1 lb and 1 lc, the handle breaks away from the base in the direction die user was forcing the handle while the base moves in the direction forced by the actuators 30.
In addition, stops may be provided in the degrees of freedom of the joystick to provide limits to the movement of the joystick. The handle may detach if the force from the user on d e handle is over the predetermined limit when the base is positioned against a stop such that the stop provides a force in the opposite direction to the user's force.
Figure 1 Id shows an alternate embodiment 280' of the break-away joystick 280. Joystick 280' includes one or more controls 294 on the handle 282 that are available for the user to manipulate to provide other input 39, such as buttons, switches, or other input devices. Since input signals from control 294 are provided to die microprocessor and/or host computer 12, me signals are routed from the control 294 on the handle through a wire bundle 296. Wire bundle 296 is provided with extra length so that when handle 282 breaks from base 284, the wire bundle will not break. The wire bundle is routed through base 284 through an aperture 298 and is coupled to the microprocessor or is directly routed to host computer 12 as explained in die above described embodiments.
In an altemative embodiment to the embodiment 280' of Figure I Id, wire bundle 296 need not be used. Instead, handle 282 and base 284 can be provided with mating conductive pads that are in contact when the handle 282 is mated with die base 284 and allow button signals to be transmitted to base 284 only when the handle and base are engaged. The handle conductive pad is coupled to die button 294 and die base conductive pad is coupled to a wire diat runs to die microprocessor or other control components of the interface device. Signals from button 294 can thus be transmitted through joystick 280 when the handle and base are engaged and the conductive pads are in contact. When die joystick handle 282 breaks away from base 284, the conductive pads are no longer in contact and no signals from button 294 are transmitted to base 284.
While this invention has been described in terms of several preferred embodiments, it is contemplated at alterations, modifications and permutations thereof will become apparent to those skilled in die art upon a reading of die specification and study of the drawings. For example, many different types and standards of communication interfaces can be used with the interface device closed herein. Various signal lines can be used to provide communication between host computer and interface device depending on die desired control that die host computer has over output forces. In addition, many different types of gimbal mechanisms or other mechanisms can be provided to allow movement of me user object in desired degrees of freedom. A variety of different types of actuators, sensors, and other devices, as well as die necessary power supplies, can also be used to sense the position of an object and apply forces to die object along degrees of freedom. The different low-cost and safety embodiments disclosed herein can be combined in multiple configurations for various applications.
Furthermore, certain terminology has been used for the puφoses of descriptive clarity, and not to limit the present invention. It is therefore intended that the following appended claims include all such alterations, modifications and permutations as fall within the true spirit and scope of die present invention.

Claims

C L A I M S
1. An interface apparatus for interfacing motion of a user manipulable object with a host computer and enabling said host computer to track motion of said user manipulable object and to command feedback forces to said user manipulable object, said interface apparatus comprising:
a user object being physically contacted and manipulable by a user and having at least one degree of freedom of movement with respect to a ground surface;
a device microprocessor provided local to said interface apparatus and separate from said host computer and being controlled by software instructions stored in a memory device separate from said host computer, said microprocessor being coupled to said host computer by a first interface bus and receiving host commands from said host computer on said first interface bus;
an actuator coupled to said user object for applying a force along said degree of freedom to said user object, wherein said actuator applies said force in response to microprocessor force commands produced by said device microprocessor; and
a sensor coupled to said user object for detecting a position of said user object along said degree of freedom and for ouφutting a locative sensor signal which represents said position of said user manipulable object, said locative sensor signal being received by said host computer on a second interface bus that is coupled between said interface apparatus and said host computer and which is separate from said first interface bus, and wherein said host computer modifies a displayed process in response to said locative sensor signal.
2. An interface apparatus as recited in claim 1 wherein said first interface bus is a serial interface bus for transmitting and receiving data serially.
3. An interface apparatus as recited in claim 2 wherein said first interface bus is an RS- 232 interface bus coupled to an RS-232 interface port of said host computer.
4. An interface apparatus as recited in claim 3 wherein said second interface bus is a game port interface bus coupled to a personal computer game port of said host computer.
5. An interface apparatus as recited in claim 4 wherein said user object includes a joystick.
6. An interface apparatus as recited in claim 4 wherein said sensor is a first sensor and said locative sensor signal is a first locative sensor signal, and further comprising a second sensor coupled to said device microprocessor, wherein said first sensor outputs said first locative sensor signal to said host computer on said first interface bus, and wherein said second sensor detects said position of said joystick along said degree of freedom independently of said first sensor and outputs a second locative sensor signal to said microprocessor.
7. An interface apparatus as recited in claim 6 further comprising a button device coupled to said interface apparatus, said button device providing a button input signal to said microprocessor when said user activates said button, said microprocessor providing said button input signal to said host computer using said game port interface bus.
8. An interface apparatus as recited in claim 7 wherein said microprocessor, said first sensor, said second sensor, and said button are powered by said host computer using a power line of said game port interface bus.
9. An interface apparatus as recited in claim 7 wherein said microprocessor, said first sensor, said second sensor, and said button are powered by said host computer using a power line of said RS-232 interface bus.
10. An interface apparatus as recited in claim 8 wherein said actuator is powered by a power supply separate from said host computer and said game port interface bus.
1 1. A force feedback interface device as recited in claim 2 further comprising a power store circuit coupled to said actuator, said power store circuit storing power from a power source and providing said stored power to said actuator when said actuator applies said force to said user object, said power store circuit including a capacitor that charges to store said power and discharges said stored power for said actuator.
12. An interface apparatus as recited in claim 1 further comprising a thermal sensor for detecting a temperature of said actuator, said thermal sensor providing a temperature signal to said microprocessor such that said microprocessor can deactivate said actuator when said temperature of said actuator rises above a predetermined threshold.
13. An interface apparatus as recited in ciaim 5 wherein said microprocessor deactivates said actuator when at least one of said plurality of buses is disconnected from said host computer or disconnected from said interface apparatus.
14. An interface apparatus as recited in claim 5 further comprising a safety switch for said user, wherein said actuator is operative to output said force only when said safety switch is closed.
15. An interface apparatus as recited in claim 14 wherein said safety switch is a hand- weight safety switch coupled to said joystick, said hand weight safety switch being closed by said user when said user applies weight to said joystick by grasping said joystick.
16. An interface apparatus as recited in claim 5 wherein said joystick includes a safety break-away handle that breaks off from said interface apparatus when a force over a predetermined threshold is applied to said joystick.
17. An interface apparatus as recited in claim 16 wherein said safety break-away handle is attached to said interface apparatus by a magnet.
18. An interface apparatus as recited in claim 6 further comprising a local memory device separate from said host computer, said local memory device storing at least one force routine, wherein said microprocessor selects a force routine in accordance with said at least one of said host commands, said force routine determining said microprocessor force commands, at least in part, from said sensor signals of said microprocessor sensors.
19. An interface apparatus as recited in claim 1 wherein said selected force routine retrieves a plurality of digital force values stored in said local memory device and ouφuts said stored force values to said actuator.
20. An interface apparatus for interfacing motion of a user manipulable joystick with a host computer, said interface apparatus comprising:
a joystick being physically contacted by a user and having at least one degree of freedom of movement;
an actuator coupled to said joystick for applying a force along said degree of freedom to said joystick, wherein said actuator applies said force in response to force commands received from said host computer via a first interface bus coupling said interface apparatus to a first interface port of said host computer; and
a sensor for detecting a position of said joystick along said degree of freedom and outputting sensor signals, said sensor signals being received by said host computer via a second interface bus coupling said interface apparatus to a PC game port of said host computer, said PC game port being a separate port from said first interface port.
21. An interface apparatus as recited in claim 20 wherein said first interface port is an RS- 232 port.
22. An interface apparatus as recited in claim 20 wherein said force commands received by said actuator are host data sent by said host computer and which instruct said actuator to ouφut said force in accordance with a software process running on said host computer.
23. An interface apparatus as recited in claim 22 wherein said first interface bus transmits said host data serially to said interface apparatus from said host computer, and further comprising at least one shift register for providing said serial host data as control signals to said actuator.
24. An interface apparatus as recited in claim 23 further comprising a programmable logic device for receiving said control signals from said at least one shift register and controlling said force from said actuator using said control signals.
25. An interface apparatus as recited in claim 23 wherein said interface bus transmits at least a portion of said host data in parallel in conjunction with said serially transmitted host data.
26. An interface apparatus as recited in claim 23 wherein said interface bus is an RS-232 interface bus in which two lines are used to transmit data to said interface apparatus as parallel information and in which one line is used to transmit data to said interface apparatus as serial information.
27. An interface apparatus as recited in claim 23 wherein said interface bus is an RS-232 interface bus in which all lines included in said RS-232 bus are used to transmit data to said interface apparatus as parallel information.
28. An interface apparatus as recited in claim 25 wherein said actuator is a motor and said sensor is an analog potentiometer.
29. An interface apparatus as recited in claim 22 further comprising a button device coupled to said interface apparatus, said button device providing a button input signal to said host computer via said second serial interface bus when said user activates said button.
30. An interface apparatus as recited in claim 23 wherein said actuator is deactivated when at least one of said first and second interface buses is disconnected from said host computer or disconnected from said interface apparatus.
31. An interface device as recited in claim 20 further comprising a device microprocessor provided local to said interface apparatus and separate from said host computer, said microprocessor being coupled to said host computer by said first serial interface bus, wherein said microprocessor receives host commands from said host computer on said first serial interface bus and provides processor host commands to said actuator to command said actuator to apply said force to said joystick.
32. An interface apparatus as recited in claim 20 further comprising a hand-weight safety switch for said user and coupled to said joystick, wherein said actuator is operative to ouφut said force only when said safety switch is closed, said hand weight safety switch being closed by said user when said user applies weight to said joystick by grasping said joystick.
33. An interface apparatus as recited in claim 20 further comprising an optical safety switch for said user and coupled to said joystick, wherein said actuator is operative to output said force only when said safety switch is closed, said optical safety switch being closed by said user when said user blocks an optical sensor of said optical safety switch by contacting said joystick.
34. A force feedback interface device for use widi a host computer and for implementing a force reflex process independently of said host computer, the interface device comprising:
a sensor for determining the position of a user object in a degree of freedom and for providing sensor signals representing said position to said host computer via a first interface bus;
an actuator for applying a force on said user object when said actuator receives an activation signal; and
a user-selectable control coupled to said interface device, wherein when said user selects said user-selectable control, a reflex process is initiated in which said activation signal is sent to said actuator and commands said actuator to apply said force on said user object, thereby initiating force feedback on said interface device independently of said host computer.
35. A force feedback interface device as recited in claim 34 wherein said user object is a joystick, and wherein said first interface bus is a game port interface bus coupled to a game port of said host computer.
36. A force feedback interface device as recited in claim 34 wherein said actuator applies said force on said joystick only when said user selects said user-selectable device.
37. A force feedback interface device as recited in claim 34 wherein said user selectable control includes a button.
38. A force feedback interface device as recited in claim 37 wherein said host computer is coupled to said actuator by a second interface bus operative to transmit an enable signal from said host computer to said interface apparatus for enabling said reflex process, wherein when said enable signal is provided by said host computer, said selection of said user-selectable control causes said actuator to output said force, and wherein when said enable signal is not provided by said host computer, said selection of said user selectable control does not cause said actuator to output said force.
39. A force feedback interface device as recited in claim 38 wherein said activation signal is a first activation signal, and wherein said host computer is operative to provide a second activation signal to said actuator via said second interface bus to command said actuator to apply said force to said user object regardless of whedier said first activation signal from said user selectable control has been provided to said actuator.
40. A force feedback interface device as recited in claim 39 wherein said second activation signal is provided at a desired baud rate to said actuator such that said second activation signal activates and deactivates said actuator at said desired baud rate.
41. A force feedback interface device as recited in claim 39 further comprising a user enable switch on said interface device which, when selected, enables said reflex process to ouφut force in response to said user-selectable control and, when unselected, disables said reflex process from applying said force in response to said user-selectable control.
42. A force feedback interface device as recited in claim 37 further comprising a power store circuit coupled to said actuator, said power store circuit storing power from a power source and providing said stored power to said actuator when said actuator applies said force to said user object.
43. A force feedback interface device as recited in claim 42 wherein said power store circuit includes a capacitor that charges to store said power and discharges said stored power for said actuator.
44. A force feedback interface device as recited in claim 43 wherein said power store circuit stores power received from said host computer over a second interface bus coupled to said host computer.
45. A force feedback interface device as recited in claim 44 wherein said second interface bus is a serial interface bus.
46. A force feedback interface device as recited in claim 44 wherein said host computer is a video game console, and wherein said second interface bus is coupled to a control port of said video game console.
47. A force feedback interface device as recited in claim 37 further comprising a safety switch for said user, wherein said actuator is operative to output said force only when said user continually closes said safety switch during operation of said interface device.
48. A force feedback interface device as recited in claim 47 wherein said safety switch is a hand-weight safety switch coupled to said joystick, said hand weight safety switch being closed by said user when said user applies weight to said joystick by grasping said joystick.
49. A force feedback interface device as recited in claim 47 wherein said safety switch includes two touch plates coupled to said force feedback interface device, wherein said safety switch is closed when said user creates an electrical connection between said two touch plates by touching both of said touch plates.
50. A force feedback interface device as recited in claim 37 further comprising a timer/pulse generator and actuator drive electronics for driving said actuator.
51. A force feedback interface device as recited in claim 50 wherein when said button is continually depressed by said user, said timer/pulse generator causes said actuator to repeatedly output forces to said user object.
52. A force feedback interface device for safe use by a user, said interface device comprising:
a sensor for sensing the position of a user object along a degree of freedom and for providing a sensor signal indicating said position of said user object to a host computer coupled to said interface device;
an actuator for applying a force to said user object along said degree of freedom;
a safety switch coupled to said user object for disabling said actuator when said user is not using said interface device, said safety switch enabling said actuator when more than a predetermined amount of weight is placed on said user object.
53. An interface device as recited in claim 52 wherein said user object includes a joystick.
54. An interface device as recited in claim 53 wherein an amount of weight created by a user grasping said joystick is more than said predetermined amount of weight and enables said actuator.
55. An interface device as recited in claim 54 wherein said joystick includes a handle portion and a base portion, said handle portion being translatably coupled to said base portion.
56. An interface device as recited in claim 55 wherein said safety switch includes a contact on said handle portion and a contact on said base portion such that when said predetermined amount of weight is applied to said user object, said handle portion engages said base portion and said contacts engage to allow electrical current to flow therebetween.
57. An interface device as recited in claim 56 further comprising a spring member positioned between said handle portion and said base portion of said joystick, said spring member forcing said handle portion and said base portion apart from each other when less than said predetermined amount of weight is applied to said joystick.
58. An interface device as recited in claim 53 wherein said actuator is one of a plurality of actuators included in said interface device, wherein said safety switch is operative to enable and disable said plurality of actuators.
59. A circuit for storing power in a force feedback interface device that interfaces a user with a host computer system, said circuit comprising:
a capacitor for storing power provided by a signal input to said circuit;
a sensing device coupled to said capacitor for sensing when said capacitor is fully charged; and
a control device for providing a control signal to an actuator so that said actuator can apply force to a user object of said interface device, wherein said stored power is supplied to said actuator to apply said force.
60. A circuit as recited in claim 59 wherein said sensing device includes an analog to digital converter and a microprocessor operative to monitor said input signal to determine when said capacitor is fully charged.
61. A circuit as recited in claim 59 further comprising a driver circuit for receiving said control signal and for amplifying said control signal using said supplied stored power to drive said actuator.
62. A circuit as recited in claim 61 further comprising a current limiter coupled to said input signal for limiting a current of said input signal to a predetermined value and providing said limited current to said capacitor.
63. A circuit as recited in claim 61 wherein said input signal is received from a game port interface bus coupled to a game port of said host computer system.
64. A circuit as recited in claim 61 wherein said input signal is received from an interface bus coupled to a control port of said host computer system, wherein said host computer system is a video game console.
65. A circuit as recited in claim 61 wherein said input signal is received from a power supply included in said interface device.
66. A method for interfacing a force feedback interface device manipulated by a user with a host computer system, the method comprising the steps of:
providing a user manipulable joystick included in said force feedback interface device, said joystick having a degree of freedom;
sensing positions of said joystick along said degree of freedom with a sensor and producing electrical sensor signals therefrom, said sensor signals being sent to said host computer system over a first interface bus to a game port of said host computer system;
utilizing a microprocessor local to said joystick and separate from said host computer system to communicate with said host computer system to receive host commands from said host computer system on a second interface bus;
selecting a reflex process stored in a memory local to said microprocessor in accordance with said at least one of said host commands; and
outputting processor force commands from said microprocessor to an actuator utilizing said reflex process and said electrical sensor signals, said actuator being coupled to said joystick and being operative to apply a force to said joystick in accordance with said processor force commands.
67. A method as recited in claim 66 wherein said second bus is coupled to an RS-232 port of said host computer system.
68. A method as recited in claim 66 wherein said sensor is an analog potentiometer.
69. A method as recited in claim 66 further comprising a step of updating game software or simulation software implemented by said host computer system in accordance with said position signals.
70. A method as recited in claim 69 wherein said selected reflex process retrieves a plurality of stored digital force values and outputs said stored force values to said actuator.
71. An interface apparatus for interfacing motion of a user manipulable object with a host computer and enabling said host computer to track motion of said user manipulable object and to command feedback forces to said user manipulable object, said interface apparatus comprising:
a user object being physically contacted and manipulable by a user and having at least one degree of freedom of movement;
a device microprocessor provided local to said interface apparatus and separate from said host computer and being controlled by software instructions stored in a memory device separate from said host computer, said microprocessor being coupled to said host computer by a serial interface bus and receiving host commands from said host computer on said first interface bus;
an actuator coupled to said user object for applying a force along said degree of freedom to said user object, wherein said actuator applies said force in response to microprocessor force commands produced by said device microprocessor;
a thermal sensor for detecting a temperature of said actuator, said thermal sensor providing a temperature signal to said microprocessor such that said microprocessor can deactivate said actuator when said temperature of said actuator rises above a predetermined threshold; and
a sensor coupled to said user object for detecting a position of said user object along said degree of freedom and for ouφutting a locative sensor signal which represents said position of said user manipulable object, said locative sensor signal being received by said host computer, and wherein said host computer modifies a displayed process in response to said locative sensor signal.
72. An interface apparatus for interfacing motion of a joystick with a host computer and enabling said host computer to track motion of said user manipulable object and to command feedback forces to said user manipulable object, said interface apparatus comprising: a joystick being physically contacted and manipulable by a user and having at least one degree of freedom of movement with respect to a ground surface, wherein said joystick includes a safety break-away handle that breaks off from said interface apparatus when a force over a predetermined threshold is applied to said joystick;
a device microprocessor provided local to said interface apparatus and separate from said host computer and being controlled by software instructions stored in a memory device separate from said host computer, said microprocessor being coupled to said host computer by a serial interface bus and receiving host commands from said host computer on said first interface bus;
an actuator coupled to said user object for applying a force along said degree of freedom to said user object, wherein said actuator applies said force in response to microprocessor force commands produced by said device microprocessor; and
a sensor coupled to said user object for detecting a position of said user object along said degree of freedom and for outputting a locative sensor signal which represents said position of said user manipulable object, said locative sensor signal being received by said host computer, and wherein said host computer modifies a displayed process in response to said locative sensor signal.
73. An interface apparatus as recited in claim 72 wherein said safety break-away handle is attached to said interface apparatus by a magnet.
PCT/US1996/015340 1995-09-27 1996-09-25 Safe and low cost computer peripherals with force feedback for consumer applications WO1997012337A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA002233206A CA2233206C (en) 1995-09-27 1996-09-25 Safe and low cost computer peripherals with force feedback for consumer applications
EP96933888A EP0852770B1 (en) 1995-09-27 1996-09-25 Safe and low cost computer peripherals with force feedback for consumer applications
DE69607189T DE69607189T2 (en) 1995-09-27 1996-09-25 SAFE AND INEXPENSIVE COMPUTER PERIPHERAL DEVICES WITH POWER FEEDBACK FOR CONSUMPTION APPLICATIONS

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US08/534,791 US5739811A (en) 1993-07-16 1995-09-27 Method and apparatus for controlling human-computer interface systems providing force feedback
US08/534,791 1995-09-27
US08/623,660 US5691898A (en) 1995-09-27 1996-03-28 Safe and low cost computer peripherals with force feedback for consumer applications
US08/623,660 1996-03-28

Publications (2)

Publication Number Publication Date
WO1997012337A1 true WO1997012337A1 (en) 1997-04-03
WO1997012337B1 WO1997012337B1 (en) 1997-06-05

Family

ID=27064588

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/015340 WO1997012337A1 (en) 1995-09-27 1996-09-25 Safe and low cost computer peripherals with force feedback for consumer applications

Country Status (5)

Country Link
US (8) US5691898A (en)
EP (2) EP0852770B1 (en)
CA (1) CA2233206C (en)
DE (2) DE69607189T2 (en)
WO (1) WO1997012337A1 (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0875819A1 (en) * 1997-04-25 1998-11-04 Microsoft Corporation Offline force effect rendering
US5956484A (en) * 1995-12-13 1999-09-21 Immersion Corporation Method and apparatus for providing force feedback over a computer network
US6111577A (en) * 1996-04-04 2000-08-29 Massachusetts Institute Of Technology Method and apparatus for determining forces to be applied to a user through a haptic interface
US6191796B1 (en) 1998-01-21 2001-02-20 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with rigid and deformable surfaces in a haptic virtual reality environment
FR2803085A1 (en) * 1999-12-28 2001-06-29 Thomson Csf Sextant Dialogue equipment for aircraft pilot interrogating screen based indicators and measurements, comprises ministick with rotating button giving outputs to direct and validate screen displays
US6417638B1 (en) 1998-07-17 2002-07-09 Sensable Technologies, Inc. Force reflecting haptic interface
GB2418475B (en) * 2003-06-09 2007-10-24 Immersion Corp Interactive gaming systems with haptic feedback
US7815508B2 (en) 2006-09-13 2010-10-19 Nintendo Co., Ltd. Game device and storage medium storing game program
US8888576B2 (en) 1999-02-26 2014-11-18 Mq Gaming, Llc Multi-media interactive play system
US8907889B2 (en) 2005-01-12 2014-12-09 Thinkoptics, Inc. Handheld vision based absolute pointing system
US8913003B2 (en) 2006-07-17 2014-12-16 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer using a projection marker system
US8913011B2 (en) 2001-02-22 2014-12-16 Creative Kingdoms, Llc Wireless entertainment device, system, and method
US8961260B2 (en) 2000-10-20 2015-02-24 Mq Gaming, Llc Toy incorporating RFID tracking device
US8994643B2 (en) 2003-10-30 2015-03-31 3D Systems, Inc. Force reflecting haptic interface
US9011248B2 (en) 2005-08-22 2015-04-21 Nintendo Co., Ltd. Game operating device
US9039533B2 (en) 2003-03-25 2015-05-26 Creative Kingdoms, Llc Wireless interactive game having both physical and virtual elements
US9044671B2 (en) 2005-08-24 2015-06-02 Nintendo Co., Ltd. Game controller and game system
US9149717B2 (en) 2000-02-22 2015-10-06 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9176598B2 (en) 2007-05-08 2015-11-03 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer with improved performance
USRE45905E1 (en) 2005-09-15 2016-03-01 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
US9272206B2 (en) 2002-04-05 2016-03-01 Mq Gaming, Llc System and method for playing an interactive game
US9427659B2 (en) 2004-07-29 2016-08-30 Motiva Llc Human movement measurement system
US9616334B2 (en) 2002-04-05 2017-04-11 Mq Gaming, Llc Multi-platform gaming system using RFID-tagged toys
US9802364B2 (en) 2011-10-18 2017-10-31 3D Systems, Inc. Systems and methods for construction of an instruction set for three-dimensional printing of a user-customizableimage of a three-dimensional structure
US9993724B2 (en) 2003-03-25 2018-06-12 Mq Gaming, Llc Interactive gaming toy
FR3072942A1 (en) * 2017-10-31 2019-05-03 Safran Electronics & Defense DEVICE FOR CONTROLLING FLIGHT OF AN AIRCRAFT

Families Citing this family (556)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889670A (en) 1991-10-24 1999-03-30 Immersion Corporation Method and apparatus for tactilely responsive user interface
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US6433771B1 (en) 1992-12-02 2002-08-13 Cybernet Haptic Systems Corporation Haptic device attribute control
US6131097A (en) * 1992-12-02 2000-10-10 Immersion Corporation Haptic authoring
US5629594A (en) * 1992-12-02 1997-05-13 Cybernet Systems Corporation Force feedback system
US5805140A (en) 1993-07-16 1998-09-08 Immersion Corporation High bandwidth force feedback interface using voice coils and flexures
US6057828A (en) * 1993-07-16 2000-05-02 Immersion Corporation Method and apparatus for providing force sensations in virtual environments in accordance with host software
US6437771B1 (en) * 1995-01-18 2002-08-20 Immersion Corporation Force feedback device including flexure member between actuator and user object
CA2167304C (en) 1993-07-16 1998-04-21 Louis B. Rosenberg Multi degree of freedom human-computer interface with tracking and forcefeedback
US5625576A (en) * 1993-10-01 1997-04-29 Massachusetts Institute Of Technology Force reflecting haptic interface
US6004134A (en) * 1994-05-19 1999-12-21 Exos, Inc. Interactive simulation including force feedback
US20030040361A1 (en) 1994-09-21 2003-02-27 Craig Thorner Method and apparatus for generating tactile feedback via relatively low-burden and/or zero burden telemetry
US5666138A (en) 1994-11-22 1997-09-09 Culver; Craig F. Interface control
US6722888B1 (en) * 1995-01-20 2004-04-20 Vincent J. Macri Method and apparatus for tutorial, self and assisted instruction directed to simulated preparation, training and competitive play and entertainment
US6241611B1 (en) 1995-05-10 2001-06-05 Nintendo Co., Ltd. Function expansion device and operating device using the function expansion device
DE69625523T2 (en) 1995-05-10 2003-07-10 Nintendo Co Ltd Control unit with analog joystick
US20060206219A1 (en) * 1995-05-30 2006-09-14 Brown David W Motion control systems and methods
US7137107B1 (en) 2003-04-29 2006-11-14 Roy-G-Biv Corporation Motion control systems and methods
US7139843B1 (en) 1995-05-30 2006-11-21 Roy-G-Biv Corporation System and methods for generating and communicating motion data through a distributed network
US7024666B1 (en) 2002-01-28 2006-04-04 Roy-G-Biv Corporation Motion control systems and methods
US5691897A (en) 1995-05-30 1997-11-25 Roy-G-Biv Corporation Motion control systems
US6941543B1 (en) 1995-05-30 2005-09-06 Roy-G-Biv Corporation Motion control system and method
US6859671B1 (en) 1995-05-30 2005-02-22 Roy-G-Biv Corporation Application programs for motion control devices including access limitations
US5691898A (en) * 1995-09-27 1997-11-25 Immersion Human Interface Corp. Safe and low cost computer peripherals with force feedback for consumer applications
US6166723A (en) * 1995-11-17 2000-12-26 Immersion Corporation Mouse interface device providing force feedback
US5959613A (en) 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
JP3524247B2 (en) 1995-10-09 2004-05-10 任天堂株式会社 Game machine and game machine system using the same
JP3544268B2 (en) 1995-10-09 2004-07-21 任天堂株式会社 Three-dimensional image processing apparatus and image processing method using the same
US6239806B1 (en) 1995-10-09 2001-05-29 Nintendo Co., Ltd. User controlled graphics object movement based on amount of joystick angular rotation and point of view angle
US6007428A (en) 1995-10-09 1999-12-28 Nintendo Co., Ltd. Operation controlling device and video processing system used therewith
WO1997017651A1 (en) 1995-11-10 1997-05-15 Nintendo Co., Ltd. Joystick apparatus
US6100874A (en) 1995-11-17 2000-08-08 Immersion Corporation Force feedback mouse interface
US5825308A (en) 1996-11-26 1998-10-20 Immersion Human Interface Corporation Force feedback interface having isotonic and isometric functionality
US6639581B1 (en) 1995-11-17 2003-10-28 Immersion Corporation Flexure mechanism for interface device
US6022274A (en) 1995-11-22 2000-02-08 Nintendo Co., Ltd. Video game system using memory module
US6155926A (en) 1995-11-22 2000-12-05 Nintendo Co., Ltd. Video game system and method with enhanced three-dimensional character and background control
US6267673B1 (en) 1996-09-20 2001-07-31 Nintendo Co., Ltd. Video game system with state of next world dependent upon manner of entry from previous world via a portal
US6139433A (en) 1995-11-22 2000-10-31 Nintendo Co., Ltd. Video game system and method with enhanced three-dimensional character and background control due to environmental conditions
US6061004A (en) * 1995-11-26 2000-05-09 Immersion Corporation Providing force feedback using an interface device including an indexing function
JP2000501033A (en) 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド Human / machine interface with tactile feedback
US6219032B1 (en) * 1995-12-01 2001-04-17 Immersion Corporation Method for providing force feedback to a user of an interface device based on interactions of a controlled cursor with graphical elements in a graphical user interface
US8508469B1 (en) 1995-12-01 2013-08-13 Immersion Corporation Networked applications including haptic feedback
US6028593A (en) 1995-12-01 2000-02-22 Immersion Corporation Method and apparatus for providing simulated physical interactions within computer generated environments
US7027032B2 (en) 1995-12-01 2006-04-11 Immersion Corporation Designing force sensations for force feedback computer applications
US6169540B1 (en) 1995-12-01 2001-01-02 Immersion Corporation Method and apparatus for designing force sensations in force feedback applications
US6147674A (en) * 1995-12-01 2000-11-14 Immersion Corporation Method and apparatus for designing force sensations in force feedback computer applications
US6078308A (en) * 1995-12-13 2000-06-20 Immersion Corporation Graphical click surfaces for force feedback applications to provide user selection using cursor interaction with a trigger position within a boundary of a graphical object
US6161126A (en) * 1995-12-13 2000-12-12 Immersion Corporation Implementing force feedback over the World Wide Web and other computer networks
US6300936B1 (en) 1997-11-14 2001-10-09 Immersion Corporation Force feedback system including multi-tasking graphical host environment and interface device
SE519661C2 (en) 1996-02-23 2003-03-25 Immersion Corp Pointing devices and method for marking graphic details on a display with sensory feedback upon finding said detail
US6078311A (en) * 1996-03-26 2000-06-20 Pacific Digital Peripherals, Inc. Joystick game adapter card for a personal computer
US7225404B1 (en) 1996-04-04 2007-05-29 Massachusetts Institute Of Technology Method and apparatus for determining forces to be applied to a user through a haptic interface
US6374255B1 (en) 1996-05-21 2002-04-16 Immersion Corporation Haptic authoring
JP2828953B2 (en) * 1996-05-31 1998-11-25 コナミ株式会社 Gaming machine manual operation device
US8674932B2 (en) 1996-07-05 2014-03-18 Anascape, Ltd. Image controller
US6125385A (en) * 1996-08-01 2000-09-26 Immersion Corporation Force feedback implementation in web pages
US6084587A (en) 1996-08-02 2000-07-04 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with a haptic virtual reality environment
US7815436B2 (en) 1996-09-04 2010-10-19 Immersion Corporation Surgical simulation interface device and method
US6106301A (en) * 1996-09-04 2000-08-22 Ht Medical Systems, Inc. Interventional radiology interface apparatus and method
US6929481B1 (en) 1996-09-04 2005-08-16 Immersion Medical, Inc. Interface device and method for interfacing instruments to medical procedure simulation systems
US6024576A (en) 1996-09-06 2000-02-15 Immersion Corporation Hemispherical, high bandwidth mechanical interface for computer systems
US6139434A (en) 1996-09-24 2000-10-31 Nintendo Co., Ltd. Three-dimensional image processing apparatus with enhanced automatic and user point of view control
EP1452212A3 (en) 1996-10-11 2007-07-11 Sony Computer Entertainment Inc. Operating device for game machines
US6411276B1 (en) 1996-11-13 2002-06-25 Immersion Corporation Hybrid control of haptic feedback for host computer and interface device
US6758755B2 (en) 1996-11-14 2004-07-06 Arcade Planet, Inc. Prize redemption system for games executed over a wide area network
US20080227538A1 (en) * 1996-11-14 2008-09-18 Bally Gaming Inc. Game prize controller and system
US8235821B2 (en) 1996-11-14 2012-08-07 Bally Gaming, Inc. Progressive controller and TCP/IP in gaming system
US6128006A (en) * 1998-03-26 2000-10-03 Immersion Corporation Force feedback mouse wheel and other control wheels
US6636197B1 (en) 1996-11-26 2003-10-21 Immersion Corporation Haptic feedback effects for control, knobs and other interface devices
US6686911B1 (en) 1996-11-26 2004-02-03 Immersion Corporation Control knob with control modes and force feedback
US6154201A (en) * 1996-11-26 2000-11-28 Immersion Corporation Control knob with multiple degrees of freedom and force feedback
US6096096A (en) * 1996-12-13 2000-08-01 Silicon Graphics, Inc. Web-site delivery
CA2278726C (en) * 1997-01-27 2004-08-31 Immersion Corporation Method and apparatus for providing high bandwidth, realistic force feedback including an improved actuator
JPH1186038A (en) * 1997-03-03 1999-03-30 Sega Enterp Ltd Image processor, image processing method, medium and game machine
JPH10258181A (en) * 1997-03-18 1998-09-29 Alps Electric Co Ltd Operation device for game machine
US6954899B1 (en) 1997-04-14 2005-10-11 Novint Technologies, Inc. Human-computer interface including haptically controlled interactions
US20060053371A1 (en) * 1997-04-14 2006-03-09 Anderson Thomas G Navigation and viewing in a multidimensional space
US6020876A (en) * 1997-04-14 2000-02-01 Immersion Corporation Force feedback interface with selective disturbance filter
JPH10295937A (en) * 1997-04-24 1998-11-10 Sony Computer Entertainment:Kk Operation device for game machine
US6641479B1 (en) * 1997-04-24 2003-11-04 Sony Computer Entertainment, Inc. Control unit and system utilizing the control unit
US7091948B2 (en) * 1997-04-25 2006-08-15 Immersion Corporation Design of force sensations for haptic feedback computer interfaces
US6285351B1 (en) * 1997-04-25 2001-09-04 Immersion Corporation Designing force sensations for computer applications including sounds
US6292170B1 (en) * 1997-04-25 2001-09-18 Immersion Corporation Designing compound force sensations for computer applications
US7472047B2 (en) * 1997-05-12 2008-12-30 Immersion Corporation System and method for constraining a graphical hand from penetrating simulated graphical objects
AU8057198A (en) * 1997-06-03 1998-12-21 Alpha Technologies, Inc. Status monitoring system for communications systems
US6071194A (en) * 1997-06-19 2000-06-06 Act Labs Ltd Reconfigurable video game controller
JP3655438B2 (en) 1997-07-17 2005-06-02 任天堂株式会社 Video game system
US6270415B1 (en) * 1997-08-15 2001-08-07 Guillemot Corporation Method for bi-directional data communication in a digital game port
US6292174B1 (en) 1997-08-23 2001-09-18 Immersion Corporation Enhanced cursor control using limited-workspace force feedback devices
US6252579B1 (en) 1997-08-23 2001-06-26 Immersion Corporation Interface device and method for providing enhanced cursor control with force feedback
US6243075B1 (en) * 1997-08-29 2001-06-05 Xerox Corporation Graspable device manipulation for controlling a computer display
US5995034A (en) * 1997-09-09 1999-11-30 Primax Electronics Ltd. Computer joystick with a removable joystick handle
US20010032278A1 (en) * 1997-10-07 2001-10-18 Brown Stephen J. Remote generation and distribution of command programs for programmable devices
US6020875A (en) * 1997-10-31 2000-02-01 Immersion Corporation High fidelity mechanical transmission system and interface device
US6104382A (en) 1997-10-31 2000-08-15 Immersion Corporation Force feedback transmission mechanisms
US6125333A (en) * 1997-11-06 2000-09-26 Northrop Grumman Corporation Building block approach for fatigue spectra generation
US6252583B1 (en) 1997-11-14 2001-06-26 Immersion Corporation Memory and force output management for a force feedback system
US6088019A (en) * 1998-06-23 2000-07-11 Immersion Corporation Low cost force feedback device with actuator for non-primary axis
US6243078B1 (en) 1998-06-23 2001-06-05 Immersion Corporation Pointing device with forced feedback button
US6256011B1 (en) * 1997-12-03 2001-07-03 Immersion Corporation Multi-function control device with force feedback
IL123073A0 (en) 1998-01-26 1998-09-24 Simbionix Ltd Endoscopic tutorial system
WO1999039317A1 (en) 1998-01-28 1999-08-05 Ht Medical Systems, Inc. Interface device and method for interfacing instruments to medical procedure simulation system
WO1999039315A2 (en) 1998-01-28 1999-08-05 Ht Medical Systems, Inc. Interface device and method for interfacing instruments to vascular access simulation systems
CA2319586C (en) * 1998-02-03 2012-01-31 Immersion Corporation Implementing force feedback over the world wide web and other computer networks
US6878066B2 (en) * 1998-02-13 2005-04-12 Freedom Wave Llc Wireless game control units
US6391005B1 (en) 1998-03-30 2002-05-21 Agilent Technologies, Inc. Apparatus and method for penetration with shaft having a sensor for sensing penetration depth
US6067077A (en) * 1998-04-10 2000-05-23 Immersion Corporation Position sensing for force feedback devices
US6354945B1 (en) * 1998-05-20 2002-03-12 Alps Electric Co., Ltd. Controller
US6707443B2 (en) 1998-06-23 2004-03-16 Immersion Corporation Haptic trackball device
US6697043B1 (en) 1999-12-21 2004-02-24 Immersion Corporation Haptic interface device and actuator assembly providing linear haptic sensations
US6184868B1 (en) 1998-09-17 2001-02-06 Immersion Corp. Haptic feedback control devices
US6429846B2 (en) 1998-06-23 2002-08-06 Immersion Corporation Haptic feedback for touchpads and other touch controls
US6552722B1 (en) 1998-07-17 2003-04-22 Sensable Technologies, Inc. Systems and methods for sculpting virtual objects in a haptic virtual reality environment
US6985133B1 (en) 1998-07-17 2006-01-10 Sensable Technologies, Inc. Force reflecting haptic interface
US6421048B1 (en) 1998-07-17 2002-07-16 Sensable Technologies, Inc. Systems and methods for interacting with virtual objects in a haptic virtual reality environment
DE19850205C1 (en) * 1998-10-23 2000-03-09 Andreas Wenzel Simulation device triggered by electronic signals for creating the impression of movement in video action games fits into a flexible mat on seating to activate vibrations and shocks.
US7038667B1 (en) 1998-10-26 2006-05-02 Immersion Corporation Mechanisms for control knobs and other interface devices
US6339419B1 (en) * 1998-11-10 2002-01-15 Lord Corporation Magnetically-controllable, semi-active haptic interface system and apparatus
US6650338B1 (en) 1998-11-24 2003-11-18 Interval Research Corporation Haptic interaction with video and image data
US6452586B1 (en) 1998-11-30 2002-09-17 Microsoft Corporation Computer input device providing tactile feedback
US6402620B1 (en) 1998-12-02 2002-06-11 Technology Creations, Inc. Amplified stereo sound and force feed back accessory for video game devices
US6422944B1 (en) 1998-12-02 2002-07-23 Technology Creations, Inc. Plug-in amplified stereo sound and force feed back accessory for video game devices and method of using same
US6493608B1 (en) * 1999-04-07 2002-12-10 Intuitive Surgical, Inc. Aspects of a control system of a minimally invasive surgical apparatus
DE19856722A1 (en) * 1998-12-09 2000-06-15 Mannesmann Vdo Ag Operating device with a handle with at least two degrees of freedom of adjustment
US6664666B2 (en) * 1998-12-23 2003-12-16 Engineering Matters, Inc. Motor assembly allowing output in multiple degrees of freedom
US6320284B1 (en) 1998-12-23 2001-11-20 Engineering Matters, Inc. Motor assembly allowing output in multiple degrees of freedom
JP2000246674A (en) * 1999-02-26 2000-09-12 Sony Corp Inner force sense presenting device
US6404417B1 (en) * 1999-03-22 2002-06-11 Logitech Europe S.A. Direct drive rotational sensor adapted to withstand off-axis loading
US6424356B2 (en) 1999-05-05 2002-07-23 Immersion Corporation Command of force sensations in a forceback system using force effect suites
US6762745B1 (en) 1999-05-10 2004-07-13 Immersion Corporation Actuator control providing linear and continuous force output
WO2000068927A1 (en) * 1999-05-10 2000-11-16 Immersion Corporation Actuator control providing linear and continuous force output
US6903721B2 (en) * 1999-05-11 2005-06-07 Immersion Corporation Method and apparatus for compensating for position slip in interface devices
US6525711B1 (en) * 1999-06-24 2003-02-25 Interval Research Corp. Haptic interface including clutch control
US8169402B2 (en) 1999-07-01 2012-05-01 Immersion Corporation Vibrotactile haptic feedback devices
DE20022244U1 (en) 1999-07-01 2001-11-08 Immersion Corp Control of vibrotactile sensations for haptic feedback devices
US6982696B1 (en) 1999-07-01 2006-01-03 Immersion Corporation Moving magnet actuator for providing haptic feedback
US6337678B1 (en) 1999-07-21 2002-01-08 Tactiva Incorporated Force feedback computer input and output device with coordinated haptic elements
WO2001011474A1 (en) * 1999-08-04 2001-02-15 Fujitsu Limited Method and apparatus for information processing, and medium
JP2001056742A (en) * 1999-08-19 2001-02-27 Alps Electric Co Ltd Input device
DE20080209U1 (en) 1999-09-28 2001-08-09 Immersion Corp Control of haptic sensations for interface devices with vibrotactile feedback
US6885898B1 (en) 2001-05-18 2005-04-26 Roy-G-Biv Corporation Event driven motion systems
US8032605B2 (en) 1999-10-27 2011-10-04 Roy-G-Biv Corporation Generation and distribution of motion commands over a distributed network
US6743104B1 (en) 1999-11-18 2004-06-01 Nintendo Co., Ltd. Portable game machine
US6693626B1 (en) 1999-12-07 2004-02-17 Immersion Corporation Haptic feedback using a keyboard device
AU3495000A (en) * 1999-12-12 2001-06-18 Ralph Lander Open loop tactile feedback
US6552713B1 (en) * 1999-12-16 2003-04-22 Hewlett-Packard Company Optical pointing device
JP2001175347A (en) * 1999-12-20 2001-06-29 Mitsumi Electric Co Ltd Joy stick
US6822635B2 (en) 2000-01-19 2004-11-23 Immersion Corporation Haptic interface for laptop computers and other portable devices
AU2001232973A1 (en) * 2000-01-25 2001-08-07 Mythtree, Inc. An actuation device with actuator and brake
JP3897948B2 (en) * 2000-02-14 2007-03-28 富士通株式会社 Computer-readable recording medium recording support system and support program
US20080122799A1 (en) * 2001-02-22 2008-05-29 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US6531998B1 (en) * 2000-02-29 2003-03-11 Microsoft Corporation Haptic feedback gaming device with integral power supply
US6924787B2 (en) * 2000-04-17 2005-08-02 Immersion Corporation Interface for controlling a graphical image
US6710764B1 (en) 2000-05-09 2004-03-23 Logitech Europe S.A. Method and system for processing force feedback effects generated at a host for playback at a physical interaction device
US7418470B2 (en) * 2000-06-26 2008-08-26 Massively Parallel Technologies, Inc. Parallel processing systems and method
US7233476B2 (en) * 2000-08-11 2007-06-19 Immersion Corporation Actuator thermal protection in haptic feedback devices
US7084854B1 (en) 2000-09-28 2006-08-01 Immersion Corporation Actuator for providing tactile sensations and device for directional tactile sensations
US7182691B1 (en) * 2000-09-28 2007-02-27 Immersion Corporation Directional inertial tactile feedback using rotating masses
US6727924B1 (en) 2000-10-17 2004-04-27 Novint Technologies, Inc. Human-computer interface including efficient three-dimensional controls
US8160864B1 (en) 2000-10-26 2012-04-17 Cypress Semiconductor Corporation In-circuit emulator and pod synchronized boot
US7206733B1 (en) 2000-10-26 2007-04-17 Cypress Semiconductor Corporation Host to FPGA interface in an in-circuit emulation system
US8149048B1 (en) 2000-10-26 2012-04-03 Cypress Semiconductor Corporation Apparatus and method for programmable power management in a programmable analog circuit block
US8176296B2 (en) 2000-10-26 2012-05-08 Cypress Semiconductor Corporation Programmable microcontroller architecture
US6724220B1 (en) 2000-10-26 2004-04-20 Cyress Semiconductor Corporation Programmable microcontroller architecture (mixed analog/digital)
US8103496B1 (en) 2000-10-26 2012-01-24 Cypress Semicondutor Corporation Breakpoint control in an in-circuit emulation system
US7765095B1 (en) 2000-10-26 2010-07-27 Cypress Semiconductor Corporation Conditional branching in an in-circuit emulation system
US8641644B2 (en) 2000-11-21 2014-02-04 Sanofi-Aventis Deutschland Gmbh Blood testing apparatus having a rotatable cartridge with multiple lancing elements and testing means
US6867770B2 (en) * 2000-12-14 2005-03-15 Sensable Technologies, Inc. Systems and methods for voxel warping
EP1217495A3 (en) * 2000-12-22 2004-04-21 Alps Electric Co., Ltd. Force feedback functioning manual input device and onboard instrument control system having it
US6958752B2 (en) * 2001-01-08 2005-10-25 Sensable Technologies, Inc. Systems and methods for three-dimensional modeling
US6641480B2 (en) * 2001-01-29 2003-11-04 Microsoft Corporation Force feedback mechanism for gamepad device
US7904194B2 (en) 2001-02-09 2011-03-08 Roy-G-Biv Corporation Event management systems and methods for motion control systems
US7031798B2 (en) 2001-02-09 2006-04-18 Roy-G-Biv Corporation Event management systems and methods for the distribution of motion control commands
US6587091B2 (en) 2001-04-23 2003-07-01 Michael Lawrence Serpa Stabilized tactile output mechanism for computer interface devices
US7202851B2 (en) 2001-05-04 2007-04-10 Immersion Medical Inc. Haptic interface for palpation simulation
IL143255A (en) 2001-05-20 2015-09-24 Simbionix Ltd Endoscopic ultrasonography simulation
KR20020093516A (en) * 2001-06-09 2002-12-16 주식회사 엘지이아이 apparatus and method of home networking communication using internet
US7041068B2 (en) 2001-06-12 2006-05-09 Pelikan Technologies, Inc. Sampling module device and method
US9226699B2 (en) 2002-04-19 2016-01-05 Sanofi-Aventis Deutschland Gmbh Body fluid sampling module with a continuous compression tissue interface surface
CA2448902C (en) 2001-06-12 2010-09-07 Pelikan Technologies, Inc. Self optimizing lancing device with adaptation means to temporal variations in cutaneous properties
WO2002100254A2 (en) 2001-06-12 2002-12-19 Pelikan Technologies, Inc. Method and apparatus for lancet launching device integrated onto a blood-sampling cartridge
US8337419B2 (en) 2002-04-19 2012-12-25 Sanofi-Aventis Deutschland Gmbh Tissue penetration device
EP1395185B1 (en) 2001-06-12 2010-10-27 Pelikan Technologies Inc. Electric lancet actuator
US9427532B2 (en) 2001-06-12 2016-08-30 Sanofi-Aventis Deutschland Gmbh Tissue penetration device
US7981056B2 (en) 2002-04-19 2011-07-19 Pelikan Technologies, Inc. Methods and apparatus for lancet actuation
US7344507B2 (en) 2002-04-19 2008-03-18 Pelikan Technologies, Inc. Method and apparatus for lancet actuation
US9795747B2 (en) 2010-06-02 2017-10-24 Sanofi-Aventis Deutschland Gmbh Methods and apparatus for lancet actuation
JP2003000943A (en) * 2001-06-19 2003-01-07 Sony Corp Memory card, portable type information terminal and information processing method, recording medium and program
US6937033B2 (en) 2001-06-27 2005-08-30 Immersion Corporation Position sensor with resistive element
US7056123B2 (en) 2001-07-16 2006-06-06 Immersion Corporation Interface apparatus with cable-driven force feedback and grounded actuators
JP4216716B2 (en) * 2001-08-09 2009-01-28 ウォーターズ・インヴェストメンツ・リミテッド Porous organic / inorganic hybrid monolithic material for chromatographic separation and method for producing the same
JP3923774B2 (en) 2001-10-16 2007-06-06 アルプス電気株式会社 Input device with force sense
US7406674B1 (en) 2001-10-24 2008-07-29 Cypress Semiconductor Corporation Method and apparatus for generating microcontroller configuration information
JP3893940B2 (en) * 2001-10-26 2007-03-14 ミツミ電機株式会社 controller
US8078970B1 (en) 2001-11-09 2011-12-13 Cypress Semiconductor Corporation Graphical user interface with user-selectable list-box
US7526422B1 (en) 2001-11-13 2009-04-28 Cypress Semiconductor Corporation System and a method for checking lock-step consistency between an in circuit emulation and a microcontroller
US8042093B1 (en) 2001-11-15 2011-10-18 Cypress Semiconductor Corporation System providing automatic source code generation for personalization and parameterization of user modules
US7770113B1 (en) 2001-11-19 2010-08-03 Cypress Semiconductor Corporation System and method for dynamically generating a configuration datasheet
US8069405B1 (en) 2001-11-19 2011-11-29 Cypress Semiconductor Corporation User interface for efficiently browsing an electronic document using data-driven tabs
US7844437B1 (en) 2001-11-19 2010-11-30 Cypress Semiconductor Corporation System and method for performing next placements and pruning of disallowed placements for programming an integrated circuit
US7774190B1 (en) 2001-11-19 2010-08-10 Cypress Semiconductor Corporation Sleep and stall in an in-circuit emulation system
US6971004B1 (en) 2001-11-19 2005-11-29 Cypress Semiconductor Corp. System and method of dynamically reconfiguring a programmable integrated circuit
US20030101288A1 (en) * 2001-11-27 2003-05-29 Joel Tague Tracking features of devices
US6851929B2 (en) * 2002-03-19 2005-02-08 Hamilton Sundstrand System for powering and controlling a device associated with a rotating component on aircraft
US8103497B1 (en) 2002-03-28 2012-01-24 Cypress Semiconductor Corporation External interface for event architecture
US6904823B2 (en) * 2002-04-03 2005-06-14 Immersion Corporation Haptic shifting devices
US7892183B2 (en) 2002-04-19 2011-02-22 Pelikan Technologies, Inc. Method and apparatus for body fluid sampling and analyte sensing
US7901362B2 (en) 2002-04-19 2011-03-08 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US9314194B2 (en) 2002-04-19 2016-04-19 Sanofi-Aventis Deutschland Gmbh Tissue penetration device
US8702624B2 (en) 2006-09-29 2014-04-22 Sanofi-Aventis Deutschland Gmbh Analyte measurement device with a single shot actuator
US8372016B2 (en) 2002-04-19 2013-02-12 Sanofi-Aventis Deutschland Gmbh Method and apparatus for body fluid sampling and analyte sensing
US7976476B2 (en) 2002-04-19 2011-07-12 Pelikan Technologies, Inc. Device and method for variable speed lancet
US8360992B2 (en) 2002-04-19 2013-01-29 Sanofi-Aventis Deutschland Gmbh Method and apparatus for penetrating tissue
US8784335B2 (en) 2002-04-19 2014-07-22 Sanofi-Aventis Deutschland Gmbh Body fluid sampling device with a capacitive sensor
US7331931B2 (en) 2002-04-19 2008-02-19 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US9248267B2 (en) 2002-04-19 2016-02-02 Sanofi-Aventis Deustchland Gmbh Tissue penetration device
US7297122B2 (en) 2002-04-19 2007-11-20 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US7229458B2 (en) 2002-04-19 2007-06-12 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US7547287B2 (en) 2002-04-19 2009-06-16 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US7198606B2 (en) 2002-04-19 2007-04-03 Pelikan Technologies, Inc. Method and apparatus for a multi-use body fluid sampling device with analyte sensing
US8579831B2 (en) 2002-04-19 2013-11-12 Sanofi-Aventis Deutschland Gmbh Method and apparatus for penetrating tissue
US7909778B2 (en) 2002-04-19 2011-03-22 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US7232451B2 (en) 2002-04-19 2007-06-19 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US9795334B2 (en) 2002-04-19 2017-10-24 Sanofi-Aventis Deutschland Gmbh Method and apparatus for penetrating tissue
US7481776B2 (en) * 2002-04-19 2009-01-27 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US8221334B2 (en) 2002-04-19 2012-07-17 Sanofi-Aventis Deutschland Gmbh Method and apparatus for penetrating tissue
US7491178B2 (en) * 2002-04-19 2009-02-17 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US8267870B2 (en) 2002-04-19 2012-09-18 Sanofi-Aventis Deutschland Gmbh Method and apparatus for body fluid sampling with hybrid actuation
US7674232B2 (en) 2002-04-19 2010-03-09 Pelikan Technologies, Inc. Method and apparatus for penetrating tissue
US6671651B2 (en) 2002-04-26 2003-12-30 Sensable Technologies, Inc. 3-D selection and manipulation with a multiple dimension haptic interface
US7308608B1 (en) 2002-05-01 2007-12-11 Cypress Semiconductor Corporation Reconfigurable testing system and method
US6760649B2 (en) 2002-05-22 2004-07-06 International Business Machines Corporation Thermal management of a laptop computer
US6687134B2 (en) * 2002-06-13 2004-02-03 Hewlett-Packard Development Company, L.P. Card extraction and separation system
US8242344B2 (en) * 2002-06-26 2012-08-14 Fingersteps, Inc. Method and apparatus for composing and performing music
US7129405B2 (en) * 2002-06-26 2006-10-31 Fingersteps, Inc. Method and apparatus for composing and performing music
US7723603B2 (en) * 2002-06-26 2010-05-25 Fingersteps, Inc. Method and apparatus for composing and performing music
US7786366B2 (en) * 2004-07-06 2010-08-31 Daniel William Moffatt Method and apparatus for universal adaptive music system
US6948398B2 (en) * 2002-07-22 2005-09-27 Deere & Company Joystick with enabling sensors
US6948948B2 (en) * 2002-07-30 2005-09-27 D&C Technology Co., Ltd. PC cartridge having enhanced front connecting structure
WO2004014244A2 (en) 2002-08-13 2004-02-19 Microbotics Corporation Microsurgical robot system
US20050227763A1 (en) * 2004-03-31 2005-10-13 Microsoft Corporation Game controller power management
US7761845B1 (en) 2002-09-09 2010-07-20 Cypress Semiconductor Corporation Method for parameterizing a user module
GB2410995B (en) 2002-10-15 2007-05-09 Immersion Corp Products and processes for providing force sensations in a user interface
JP3895662B2 (en) * 2002-10-24 2007-03-22 本田技研工業株式会社 Steering device
US20040090418A1 (en) * 2002-11-12 2004-05-13 Bio-Rad Laboratories, Inc., A Corporation Of The State Of Delaware Joystick with axial disengagement switch
GB0227425D0 (en) * 2002-11-25 2002-12-31 Penny & Giles Controls Ltd Joystick controller
JP4200748B2 (en) * 2002-11-29 2008-12-24 富士ゼロックス株式会社 Tactile interface device
WO2004052193A1 (en) 2002-12-08 2004-06-24 Immersion Corporation Methods and systems for providing haptic messaging to handheld communication devices
US8830161B2 (en) 2002-12-08 2014-09-09 Immersion Corporation Methods and systems for providing a virtual touch haptic effect to handheld communication devices
US8059088B2 (en) 2002-12-08 2011-11-15 Immersion Corporation Methods and systems for providing haptic messaging to handheld communication devices
JP4057900B2 (en) * 2002-12-09 2008-03-05 アルプス電気株式会社 Haptic input device
US8574895B2 (en) 2002-12-30 2013-11-05 Sanofi-Aventis Deutschland Gmbh Method and apparatus using optical techniques to measure analyte levels
US7339574B2 (en) * 2003-01-16 2008-03-04 Korean Advanced Institute Of Science And Technology Haptic mouse interface system for providing force and tactile feedbacks to user's fingers and arm
KR100525470B1 (en) * 2003-02-14 2005-11-23 오의진 The inputting device which has keys within finger's movement and inputting method
JP4160843B2 (en) * 2003-02-24 2008-10-08 アルプス電気株式会社 Haptic input device
US7789741B1 (en) * 2003-02-28 2010-09-07 Microsoft Corporation Squad vs. squad video game
JP4268430B2 (en) * 2003-03-19 2009-05-27 アルプス電気株式会社 Haptic input device
US20050245789A1 (en) 2003-04-01 2005-11-03 Boston Scientific Scimed, Inc. Fluid manifold for endoscope system
US20040199052A1 (en) 2003-04-01 2004-10-07 Scimed Life Systems, Inc. Endoscopic imaging system
US7591783B2 (en) 2003-04-01 2009-09-22 Boston Scientific Scimed, Inc. Articulation joint for video endoscope
US7578786B2 (en) 2003-04-01 2009-08-25 Boston Scientific Scimed, Inc. Video endoscope
US8118732B2 (en) 2003-04-01 2012-02-21 Boston Scientific Scimed, Inc. Force feedback control system for video endoscope
JP2004326163A (en) * 2003-04-21 2004-11-18 Alps Electric Co Ltd Stoking switch
US20050003877A1 (en) * 2003-05-09 2005-01-06 Electronic Arts Inc. Systems and methods for playmaker control
US7385374B2 (en) * 2003-05-27 2008-06-10 William Marsh Rice University Adaptive power system
US20040242261A1 (en) * 2003-05-29 2004-12-02 General Dynamics Decision Systems, Inc. Software-defined radio
EP1628567B1 (en) 2003-05-30 2010-08-04 Pelikan Technologies Inc. Method and apparatus for fluid injection
WO2004109488A2 (en) 2003-05-30 2004-12-16 Immersion Corporation System and method for low power haptic feedback
ES2490740T3 (en) 2003-06-06 2014-09-04 Sanofi-Aventis Deutschland Gmbh Apparatus for blood fluid sampling and analyte detection
WO2006001797A1 (en) 2004-06-14 2006-01-05 Pelikan Technologies, Inc. Low pain penetrating
US9529762B2 (en) * 2003-06-30 2016-12-27 Becton, Dickinson And Company Self powered serial-to-serial or USB-to-serial cable with loopback and isolation
US7850456B2 (en) 2003-07-15 2010-12-14 Simbionix Ltd. Surgical simulation device, system and method
US20060063577A1 (en) * 2003-07-17 2006-03-23 Shuffle Master, Inc. System for monitoring the game of baccarat
US8027349B2 (en) 2003-09-25 2011-09-27 Roy-G-Biv Corporation Database event driven motion systems
US20060064503A1 (en) 2003-09-25 2006-03-23 Brown David W Data routing systems and methods
EP1671096A4 (en) 2003-09-29 2009-09-16 Pelikan Technologies Inc Method and apparatus for an improved sample capture device
US20050076161A1 (en) * 2003-10-03 2005-04-07 Amro Albanna Input system and method
EP1680014A4 (en) 2003-10-14 2009-01-21 Pelikan Technologies Inc Method and apparatus for a variable user interface
US7285932B2 (en) * 2003-10-28 2007-10-23 United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Method and apparatus for loss of control inhibitor systems
US7095418B2 (en) 2003-10-30 2006-08-22 Sensable Technologies, Inc. Apparatus and methods for texture mapping
US7382378B2 (en) 2003-10-30 2008-06-03 Sensable Technologies, Inc. Apparatus and methods for stenciling an image
US7096852B2 (en) 2003-10-30 2006-08-29 Immersion Corporation Haptic throttle devices and methods
US20050130604A1 (en) * 2003-11-26 2005-06-16 Nokia Corporation Electronic device having a physical configuration that is dependent upon its operational status
KR20050054731A (en) * 2003-12-05 2005-06-10 한국전자통신연구원 Haptic simulation system and method for providing real-time haptic interaction in virtual simulation
US7626589B2 (en) * 2003-12-10 2009-12-01 Sensable Technologies, Inc. Haptic graphical user interface for adjusting mapped texture
US7889209B2 (en) 2003-12-10 2011-02-15 Sensable Technologies, Inc. Apparatus and methods for wrapping texture onto the surface of a virtual object
US7510477B2 (en) * 2003-12-11 2009-03-31 Argentar Eric J Control apparatus for use with a computer or video game system
US7982711B2 (en) * 2003-12-19 2011-07-19 Immersion Corporation Haptic profiling system and method
US7742036B2 (en) 2003-12-22 2010-06-22 Immersion Corporation System and method for controlling haptic devices having multiple operational modes
US7791588B2 (en) * 2003-12-22 2010-09-07 Immersion Corporation System and method for mapping instructions associated with haptic feedback
US7667687B2 (en) * 2003-12-30 2010-02-23 Immersion Corporation Resistive and hybrid control schemes for haptic feedback interface devices
WO2005065414A2 (en) 2003-12-31 2005-07-21 Pelikan Technologies, Inc. Method and apparatus for improving fluidic flow and sample capture
US7822454B1 (en) 2005-01-03 2010-10-26 Pelikan Technologies, Inc. Fluid sampling device with improved analyte detecting member configuration
US7149596B2 (en) * 2004-01-13 2006-12-12 Sensable Technologies, Inc. Apparatus and methods for modifying a model of an object to enforce compliance with a manufacturing constraint
US20050174337A1 (en) * 2004-02-11 2005-08-11 Nielsen Paul S. Electronic handheld drawing and gaming system using television monitor
US7204168B2 (en) * 2004-02-25 2007-04-17 The University Of Manitoba Hand controller and wrist device
US7505030B2 (en) * 2004-03-18 2009-03-17 Immersion Medical, Inc. Medical device and procedure simulation
US7295049B1 (en) 2004-03-25 2007-11-13 Cypress Semiconductor Corporation Method and circuit for rapid alignment of signals
DE102004016121B4 (en) * 2004-04-01 2008-11-27 Siemens Ag Operating device for moving at least one machine axis of a tool or production machine
US20050237306A1 (en) * 2004-04-27 2005-10-27 Udo Klein Tactile feedback through a computer keyboard key
US20050237305A1 (en) * 2004-04-27 2005-10-27 Udo Klein Tactile feedback through a computer keyboard
US20060084504A1 (en) * 2004-04-30 2006-04-20 Chan Andy K Wireless communication systems
US7499290B1 (en) * 2004-05-19 2009-03-03 Mississippi State University Power conversion
US8828203B2 (en) 2004-05-20 2014-09-09 Sanofi-Aventis Deutschland Gmbh Printable hydrogels for biosensors
US20050264528A1 (en) * 2004-05-26 2005-12-01 Burry Stephen W Low profile pointing device with tactile feedback
US7522152B2 (en) * 2004-05-27 2009-04-21 Immersion Corporation Products and processes for providing haptic feedback in resistive interface devices
WO2005120365A1 (en) 2004-06-03 2005-12-22 Pelikan Technologies, Inc. Method and apparatus for a fluid sampling device
US9775553B2 (en) 2004-06-03 2017-10-03 Sanofi-Aventis Deutschland Gmbh Method and apparatus for a fluid sampling device
US7990374B2 (en) * 2004-06-29 2011-08-02 Sensable Technologies, Inc. Apparatus and methods for haptic rendering using data in a graphics pipeline
US7318130B2 (en) * 2004-06-29 2008-01-08 Intel Corporation System and method for thermal throttling of memory modules
US7198137B2 (en) * 2004-07-29 2007-04-03 Immersion Corporation Systems and methods for providing haptic feedback with position sensing
US8441433B2 (en) * 2004-08-11 2013-05-14 Immersion Corporation Systems and methods for providing friction in a haptic feedback device
US8286125B2 (en) * 2004-08-13 2012-10-09 Cypress Semiconductor Corporation Model for a hardware device-independent method of defining embedded firmware for programmable systems
US8069436B2 (en) 2004-08-13 2011-11-29 Cypress Semiconductor Corporation Providing hardware independence to automate code generation of processing device firmware
US9495009B2 (en) * 2004-08-20 2016-11-15 Immersion Corporation Systems and methods for providing haptic effects
US8013847B2 (en) * 2004-08-24 2011-09-06 Immersion Corporation Magnetic actuator for providing haptic feedback
US8803796B2 (en) 2004-08-26 2014-08-12 Immersion Corporation Products and processes for providing haptic feedback in a user interface
US8002089B2 (en) * 2004-09-10 2011-08-23 Immersion Corporation Systems and methods for providing a haptic device
US9046922B2 (en) * 2004-09-20 2015-06-02 Immersion Corporation Products and processes for providing multimodal feedback in a user interface device
US7764268B2 (en) * 2004-09-24 2010-07-27 Immersion Corporation Systems and methods for providing a haptic device
EP1799096A2 (en) 2004-09-30 2007-06-27 Boston Scientific Scimed, Inc. System and method of obstruction removal
CA2581079A1 (en) 2004-09-30 2006-04-13 Boston Scientific Scimed, Inc. Multi-functional endoscopic system for use in electrosurgical applications
US7241263B2 (en) 2004-09-30 2007-07-10 Scimed Life Systems, Inc. Selectively rotatable shaft coupler
EP1799095A2 (en) 2004-09-30 2007-06-27 Boston Scientific Scimed, Inc. Adapter for use with digital imaging medical device
US8083671B2 (en) 2004-09-30 2011-12-27 Boston Scientific Scimed, Inc. Fluid delivery system for use with an endoscope
US7479106B2 (en) 2004-09-30 2009-01-20 Boston Scientific Scimed, Inc. Automated control of irrigation and aspiration in a single-use endoscope
US8232969B2 (en) 2004-10-08 2012-07-31 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
US7159500B2 (en) * 2004-10-12 2007-01-09 The Telerobotics Corporation Public network weapon system and method
ITPI20040084A1 (en) * 2004-11-18 2005-02-18 Massimo Bergamasco PORTABLE APTIC INTERFACE
US8652831B2 (en) 2004-12-30 2014-02-18 Sanofi-Aventis Deutschland Gmbh Method and apparatus for analyte measurement test time
JP2008527962A (en) * 2005-01-04 2008-07-24 コアクティヴ・ドライヴ・コーポレイション Vibration device
US7699260B2 (en) * 2005-01-14 2010-04-20 Hughey Electricopter Corporation Vertical takeoff and landing aircraft using a redundant array of independent rotors
US7332976B1 (en) 2005-02-04 2008-02-19 Cypress Semiconductor Corporation Poly-phase frequency synthesis oscillator
US7400183B1 (en) 2005-05-05 2008-07-15 Cypress Semiconductor Corporation Voltage controlled oscillator delay cell and method
WO2006120666A1 (en) * 2005-05-10 2006-11-16 Navicath Ltd. User interface for remote control catheterization
US8097003B2 (en) 2005-05-13 2012-01-17 Boston Scientific Scimed, Inc. Endoscopic apparatus with integrated variceal ligation device
US7846107B2 (en) 2005-05-13 2010-12-07 Boston Scientific Scimed, Inc. Endoscopic apparatus with integrated multiple biopsy device
US8089461B2 (en) 2005-06-23 2012-01-03 Cypress Semiconductor Corporation Touch wake for electronic devices
US11203041B2 (en) 2005-06-27 2021-12-21 General Vibration Corporation Haptic game controller with dual linear vibration actuators
US9764357B2 (en) 2005-06-27 2017-09-19 General Vibration Corporation Synchronized array of vibration actuators in an integrated module
EP1907086B1 (en) * 2005-06-27 2011-07-20 Coactive Drive Corporation Synchronized vibration device for haptic feedback
US9459632B2 (en) 2005-06-27 2016-10-04 Coactive Drive Corporation Synchronized array of vibration actuators in a network topology
US8784336B2 (en) 2005-08-24 2014-07-22 C. R. Bard, Inc. Stylet apparatuses and methods of manufacture
US8870655B2 (en) 2005-08-24 2014-10-28 Nintendo Co., Ltd. Wireless game controllers
US8052597B2 (en) 2005-08-30 2011-11-08 Boston Scientific Scimed, Inc. Method for forming an endoscope articulation joint
US7518745B2 (en) * 2005-09-28 2009-04-14 Xerox Corporation Imaging system with haptic interface
WO2007057390A2 (en) * 2005-11-16 2007-05-24 Abb Ab Method and device for controlling motion of an industrial robot with a position switch
US7096731B1 (en) * 2005-11-29 2006-08-29 Mike Chien Ming Lee Finger gripping force measuring device
US20070122892A1 (en) * 2005-11-30 2007-05-31 Christian Andersson Process for producing succinic acid from sucrose
US7554027B2 (en) * 2005-12-05 2009-06-30 Daniel William Moffatt Method to playback multiple musical instrument digital interface (MIDI) and audio sound files
US8085067B1 (en) 2005-12-21 2011-12-27 Cypress Semiconductor Corporation Differential-to-single ended signal converter circuit and method
US7967759B2 (en) 2006-01-19 2011-06-28 Boston Scientific Scimed, Inc. Endoscopic system with integrated patient respiratory status indicator
US20070188453A1 (en) * 2006-02-15 2007-08-16 Logitech Europe S.A. Input device roller with hybrid magnetic ratchet system
US20070188454A1 (en) * 2006-02-15 2007-08-16 Logitech Europe S.A. Magnetic ratchet for input device roller
EP1984642A2 (en) * 2006-02-17 2008-10-29 Oceaneering International, Inc. Variable mode manipulator and drive system
US8888684B2 (en) 2006-03-27 2014-11-18 Boston Scientific Scimed, Inc. Medical devices with local drug delivery capabilities
US8067948B2 (en) 2006-03-27 2011-11-29 Cypress Semiconductor Corporation Input/output multiplexer bus
JP2007265238A (en) * 2006-03-29 2007-10-11 Fujitsu Ltd Simulation device and simulation method
US20070232397A1 (en) * 2006-04-03 2007-10-04 Arnon Katz Remote slot machine controller
US7955255B2 (en) 2006-04-20 2011-06-07 Boston Scientific Scimed, Inc. Imaging assembly with transparent distal cap
US8202265B2 (en) 2006-04-20 2012-06-19 Boston Scientific Scimed, Inc. Multiple lumen assembly for use in endoscopes or other medical devices
DE202006007164U1 (en) * 2006-05-03 2007-09-20 Mann+Hummel Gmbh Device for receiving and transporting chip-contaminated cooling lubricant
CA2651780C (en) * 2006-05-19 2015-03-10 Mako Surgical Corp. A method and apparatus for controlling a haptic device
WO2007138645A1 (en) * 2006-05-25 2007-12-06 Mitsubishi Electric Corporation Auxiliary power source device for vehicle
JP2009540773A (en) * 2006-06-13 2009-11-19 マグネットー・イナーシャル・センシング・テクノロジー・インコーポレイテッド Motion sensing in wireless RF networks
US8545323B2 (en) * 2006-06-30 2013-10-01 Logitech Europe S.A. Video game controller with compact and efficient force feedback mechanism
EP2052309A1 (en) * 2006-08-07 2009-04-29 Koninklijke Philips Electronics N.V. Method and apparatus for monitoring user activity at a computer screen to stimulate motility
DE102006041056C5 (en) * 2006-09-01 2015-02-19 Siemens Aktiengesellschaft Encoder for connecting additional sensors and electrical machine with such a rotary encoder
US20080062121A1 (en) * 2006-09-08 2008-03-13 Aten Interational Co., Ltd. Shuttle control system for controlling kvm switch and method thereof
US20080071424A1 (en) * 2006-09-18 2008-03-20 Protap Design, Llc Programmable positional liquid flow sensing device
US7794407B2 (en) 2006-10-23 2010-09-14 Bard Access Systems, Inc. Method of locating the tip of a central venous catheter
US8388546B2 (en) 2006-10-23 2013-03-05 Bard Access Systems, Inc. Method of locating the tip of a central venous catheter
US7759894B2 (en) * 2006-10-26 2010-07-20 Honeywell International Inc. Cogless motor driven active user interface haptic feedback system
US7750593B2 (en) * 2006-10-26 2010-07-06 Honeywell International Inc. Active human-machine interface system without a force sensor
US7843426B2 (en) * 2006-11-15 2010-11-30 Honeywell International Inc. Active human-machine interface system including interposed sector gears
CN101627411B (en) 2007-01-16 2014-03-19 西姆博尼克斯有限公司 Device and method for simulated image to guide medical procedure
US8543338B2 (en) 2007-01-16 2013-09-24 Simbionix Ltd. System and method for performing computerized simulations for image-guided procedures using a patient specific model
EP2117417B1 (en) 2007-02-27 2014-10-29 Carnegie Mellon University System for releasably attaching a disposable device to a durable device
US20080218338A1 (en) * 2007-03-07 2008-09-11 Optimal Licensing Corporating System and method for premises monitoring using weight detection
US20080218372A1 (en) * 2007-03-07 2008-09-11 Optimal Licensing Corporation Light switch used as a communication device
US20080218307A1 (en) * 2007-03-07 2008-09-11 Optimal Licensing Corporation Anticipatory utility control device
US20090027196A1 (en) * 2007-03-07 2009-01-29 Roland Schoettle System and method for premises monitoring and control using self-learning detection devices
US7497273B2 (en) * 2007-03-07 2009-03-03 Optimal Innovations, Inc. Plug and play utility control modules
US20080218319A1 (en) * 2007-03-07 2008-09-11 Optimal Licensing Corporation Systems and methods for linking utility control devices
US8040266B2 (en) 2007-04-17 2011-10-18 Cypress Semiconductor Corporation Programmable sigma-delta analog-to-digital converter
US8516025B2 (en) 2007-04-17 2013-08-20 Cypress Semiconductor Corporation Clock driven dynamic datapath chaining
US9564902B2 (en) 2007-04-17 2017-02-07 Cypress Semiconductor Corporation Dynamically configurable and re-configurable data path
US8026739B2 (en) 2007-04-17 2011-09-27 Cypress Semiconductor Corporation System level interconnect with programmable switching
US8130025B2 (en) 2007-04-17 2012-03-06 Cypress Semiconductor Corporation Numerical band gap
US7737724B2 (en) 2007-04-17 2010-06-15 Cypress Semiconductor Corporation Universal digital block interconnection and channel routing
US8092083B2 (en) 2007-04-17 2012-01-10 Cypress Semiconductor Corporation Temperature sensor with digital bandgap
US8266575B1 (en) 2007-04-25 2012-09-11 Cypress Semiconductor Corporation Systems and methods for dynamically reconfiguring a programmable system on a chip
US9720805B1 (en) 2007-04-25 2017-08-01 Cypress Semiconductor Corporation System and method for controlling a target device
US8065653B1 (en) 2007-04-25 2011-11-22 Cypress Semiconductor Corporation Configuration of programmable IC design elements
US8903577B2 (en) 2009-10-30 2014-12-02 Lsi Industries, Inc. Traction system for electrically powered vehicles
US8604709B2 (en) 2007-07-31 2013-12-10 Lsi Industries, Inc. Methods and systems for controlling electrical power to DC loads
US7598683B1 (en) 2007-07-31 2009-10-06 Lsi Industries, Inc. Control of light intensity using pulses of a fixed duration and frequency
US8049569B1 (en) 2007-09-05 2011-11-01 Cypress Semiconductor Corporation Circuit and method for improving the accuracy of a crystal-less oscillator having dual-frequency modes
US8108098B2 (en) * 2007-09-12 2012-01-31 International Business Machines Corporation Control appropriateness illumination for corrective response
US8084969B2 (en) * 2007-10-01 2011-12-27 Allegro Microsystems, Inc. Hall-effect based linear motor controller
US20090101386A1 (en) * 2007-10-19 2009-04-23 Optimal Innovations Inc. Size unconstrained faceplate display for use with infrastructure device
US20090102679A1 (en) * 2007-10-19 2009-04-23 Optimal Innovations Inc. Infrastructure device with removable face plate for remote operation
US8849382B2 (en) 2007-11-26 2014-09-30 C. R. Bard, Inc. Apparatus and display methods relating to intravascular placement of a catheter
ES2651898T3 (en) 2007-11-26 2018-01-30 C.R. Bard Inc. Integrated system for intravascular catheter placement
US9649048B2 (en) 2007-11-26 2017-05-16 C. R. Bard, Inc. Systems and methods for breaching a sterile field for intravascular placement of a catheter
US10449330B2 (en) 2007-11-26 2019-10-22 C. R. Bard, Inc. Magnetic element-equipped needle assemblies
US10751509B2 (en) 2007-11-26 2020-08-25 C. R. Bard, Inc. Iconic representations for guidance of an indwelling medical device
US9521961B2 (en) 2007-11-26 2016-12-20 C. R. Bard, Inc. Systems and methods for guiding a medical instrument
US9456766B2 (en) 2007-11-26 2016-10-04 C. R. Bard, Inc. Apparatus for use with needle insertion guidance system
US8781555B2 (en) 2007-11-26 2014-07-15 C. R. Bard, Inc. System for placement of a catheter including a signal-generating stylet
US10524691B2 (en) 2007-11-26 2020-01-07 C. R. Bard, Inc. Needle assembly including an aligned magnetic element
US8478382B2 (en) 2008-02-11 2013-07-02 C. R. Bard, Inc. Systems and methods for positioning a catheter
TW200941434A (en) * 2008-03-19 2009-10-01 Coretronic Corp Display apparatus and power control circuit thereof
US8317744B2 (en) 2008-03-27 2012-11-27 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter manipulator assembly
US8343096B2 (en) 2008-03-27 2013-01-01 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter system
US9161817B2 (en) * 2008-03-27 2015-10-20 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter system
US9241768B2 (en) * 2008-03-27 2016-01-26 St. Jude Medical, Atrial Fibrillation Division, Inc. Intelligent input device controller for a robotic catheter system
WO2009120982A2 (en) * 2008-03-27 2009-10-01 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter system with dynamic response
US8684962B2 (en) * 2008-03-27 2014-04-01 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter device cartridge
WO2009120992A2 (en) * 2008-03-27 2009-10-01 St. Jude Medical, Arrial Fibrillation Division Inc. Robotic castheter system input device
US20090248042A1 (en) * 2008-03-27 2009-10-01 Kirschenman Mark B Model catheter input device
US8317745B2 (en) * 2008-03-27 2012-11-27 St. Jude Medical, Atrial Fibrillation Division, Inc. Robotic catheter rotatable device cartridge
WO2009126900A1 (en) 2008-04-11 2009-10-15 Pelikan Technologies, Inc. Method and apparatus for analyte detecting device
US8593403B2 (en) * 2008-06-13 2013-11-26 Sprintek Corporation Pointing stick device
CN101620439A (en) * 2008-06-30 2010-01-06 鸿富锦精密工业(深圳)有限公司 Motor control system
US8288983B2 (en) * 2008-07-10 2012-10-16 Lockheed Martin Corporation Optical telemetry system and method for electro-mechanical switches
US8120228B2 (en) * 2008-07-15 2012-02-21 Hamilton Sundstrand Corporation Slip ring assembly
US9901714B2 (en) 2008-08-22 2018-02-27 C. R. Bard, Inc. Catheter assembly including ECG sensor and magnetic assemblies
EP3443911A1 (en) 2008-09-05 2019-02-20 Carnegie Mellon University Multi-linked endoscopic device with spherical distal assembly
US8437833B2 (en) 2008-10-07 2013-05-07 Bard Access Systems, Inc. Percutaneous magnetic gastrostomy
US8477103B2 (en) 2008-10-26 2013-07-02 Microsoft Corporation Multi-touch object inertia simulation
US8466879B2 (en) * 2008-10-26 2013-06-18 Microsoft Corporation Multi-touch manipulation of application objects
US8690575B1 (en) 2008-11-03 2014-04-08 ACME Worldwide Enterprises, Inc. Apparatus and method for a weapon simulator
US20100167820A1 (en) * 2008-12-29 2010-07-01 Houssam Barakat Human interface device
JP5773884B2 (en) * 2008-12-31 2015-09-02 セント・ジュード・メディカル・エイトリアル・フィブリレーション・ディヴィジョン・インコーポレーテッド Robot catheter system input device
WO2010080766A2 (en) * 2009-01-06 2010-07-15 Immersion Corporation Programmable game-based haptic enabled gun controller
US9375169B2 (en) 2009-01-30 2016-06-28 Sanofi-Aventis Deutschland Gmbh Cam drive for managing disposable penetrating member actions with a single motor and motor and control system
US10564721B2 (en) * 2009-03-12 2020-02-18 Immersion Corporation Systems and methods for using multiple actuators to realize textures
US9696803B2 (en) 2009-03-12 2017-07-04 Immersion Corporation Systems and methods for friction displays and additional haptic effects
US10007340B2 (en) 2009-03-12 2018-06-26 Immersion Corporation Systems and methods for interfaces featuring surface-based haptic effects
US9927873B2 (en) 2009-03-12 2018-03-27 Immersion Corporation Systems and methods for using textures in graphical user interface widgets
US9746923B2 (en) * 2009-03-12 2017-08-29 Immersion Corporation Systems and methods for providing features in a friction display wherein a haptic effect is configured to vary the coefficient of friction
US9874935B2 (en) * 2009-03-12 2018-01-23 Immersion Corporation Systems and methods for a texture engine
US9448964B2 (en) 2009-05-04 2016-09-20 Cypress Semiconductor Corporation Autonomous control in a programmable system
US9532724B2 (en) 2009-06-12 2017-01-03 Bard Access Systems, Inc. Apparatus and method for catheter navigation using endovascular energy mapping
US9125578B2 (en) 2009-06-12 2015-09-08 Bard Access Systems, Inc. Apparatus and method for catheter navigation and tip location
ES2745861T3 (en) 2009-06-12 2020-03-03 Bard Access Systems Inc Apparatus, computer-aided data-processing algorithm, and computer storage medium for positioning an endovascular device in or near the heart
US9737796B2 (en) 2009-07-08 2017-08-22 Steelseries Aps Apparatus and method for managing operations of accessories in multi-dimensions
US8719714B2 (en) 2009-07-08 2014-05-06 Steelseries Aps Apparatus and method for managing operations of accessories
WO2011123669A1 (en) 2010-03-31 2011-10-06 St. Jude Medical, Atrial Fibrillation Division, Inc. Intuitive user interface control for remote catheter navigation and 3d mapping and visualization systems
US9330497B2 (en) 2011-08-12 2016-05-03 St. Jude Medical, Atrial Fibrillation Division, Inc. User interface devices for electrophysiology lab diagnostic and therapeutic equipment
US9439736B2 (en) 2009-07-22 2016-09-13 St. Jude Medical, Atrial Fibrillation Division, Inc. System and method for controlling a remote medical device guidance system in three-dimensions using gestures
EP2464407A4 (en) 2009-08-10 2014-04-02 Bard Access Systems Inc Devices and methods for endovascular electrography
WO2011041450A1 (en) 2009-09-29 2011-04-07 C. R. Bard, Inc. Stylets for use with apparatus for intravascular placement of a catheter
US11103213B2 (en) 2009-10-08 2021-08-31 C. R. Bard, Inc. Spacers for use with an ultrasound probe
TWI363273B (en) * 2009-11-06 2012-05-01 Transcend Information Inc Portable device having plug detector and control method of detecting the portable device
CN102053941B (en) * 2009-11-06 2012-07-04 创见资讯股份有限公司 Portable device with reciprocating type detection terminal and detection and control method thereof
SI23206A (en) * 2009-11-06 2011-05-31 Univerza V Ljubljani Device for practicing the muscle-skeleton nervous system
JP2011170616A (en) * 2010-02-18 2011-09-01 On Semiconductor Trading Ltd Capacitance type touch sensor
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
US20120194553A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with sensor and user action based control of external devices with feedback
US10180572B2 (en) 2010-02-28 2019-01-15 Microsoft Technology Licensing, Llc AR glasses with event and user action control of external applications
EP2539759A1 (en) 2010-02-28 2013-01-02 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US20150309316A1 (en) 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
US8965476B2 (en) 2010-04-16 2015-02-24 Sanofi-Aventis Deutschland Gmbh Tissue penetration device
EP3662827B1 (en) 2010-05-28 2021-03-03 C.R. Bard, Inc. Apparatus for use with needle insertion guidance system
US9132352B1 (en) 2010-06-24 2015-09-15 Gregory S. Rabin Interactive system and method for rendering an object
TW201203026A (en) * 2010-07-13 2012-01-16 Weistech Technology Co Ltd Revolving control device with a displacement sensor without contact points
CN103228219B (en) 2010-08-09 2016-04-27 C·R·巴德股份有限公司 For support and the covered structure of ultrasound probe head
KR101856267B1 (en) 2010-08-20 2018-05-09 씨. 알. 바드, 인크. Reconfirmation of ecg-assisted catheter tip placement
WO2012058461A1 (en) 2010-10-29 2012-05-03 C.R.Bard, Inc. Bioimpedance-assisted placement of a medical device
US9119655B2 (en) 2012-08-03 2015-09-01 Stryker Corporation Surgical manipulator capable of controlling a surgical instrument in multiple modes
US9921712B2 (en) 2010-12-29 2018-03-20 Mako Surgical Corp. System and method for providing substantially stable control of a surgical tool
US8918215B2 (en) * 2011-01-19 2014-12-23 Harris Corporation Telematic interface with control signal scaling based on force sensor feedback
US8918214B2 (en) * 2011-01-19 2014-12-23 Harris Corporation Telematic interface with directional translation
CN103620928A (en) 2011-03-17 2014-03-05 联合活跃驱动公司 Asymmetric and general vibration waveforms from a plurality of synchronized vibration actuators
US9205555B2 (en) 2011-03-22 2015-12-08 Harris Corporation Manipulator joint-limit handling algorithm
US8694134B2 (en) 2011-05-05 2014-04-08 Harris Corporation Remote control interface
US8639386B2 (en) 2011-05-20 2014-01-28 Harris Corporation Haptic device for manipulator and vehicle control
KR101991034B1 (en) * 2011-05-31 2019-06-19 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Positive control of robotic surgical instrument end effector
CN103563238B (en) * 2011-06-03 2016-03-23 株式会社安川电机 Multiaxis electric motor drive system and multiaxis motor drive
RU2609203C2 (en) 2011-07-06 2017-01-30 Си.Ар. Бард, Инк. Determination and calibration of needle length for needle guidance system
USD699359S1 (en) 2011-08-09 2014-02-11 C. R. Bard, Inc. Ultrasound probe head
USD724745S1 (en) 2011-08-09 2015-03-17 C. R. Bard, Inc. Cap for an ultrasound probe
US9026250B2 (en) 2011-08-17 2015-05-05 Harris Corporation Haptic manipulation system for wheelchairs
US10368669B2 (en) 2011-09-30 2019-08-06 Verily Life Sciences Llc System and method for stabilizing unintentional muscle movements
US9925034B2 (en) * 2011-09-30 2018-03-27 Verily Life Sciences Llc Stabilizing unintentional muscle movements
US8996244B2 (en) 2011-10-06 2015-03-31 Harris Corporation Improvised explosive device defeat system
KR102067458B1 (en) 2011-10-21 2020-01-20 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Grip force control for robotic surgical instrument end effector
US9582178B2 (en) 2011-11-07 2017-02-28 Immersion Corporation Systems and methods for multi-pressure interaction on touch-sensitive surfaces
WO2013070775A1 (en) 2011-11-07 2013-05-16 C.R. Bard, Inc Ruggedized ultrasound hydrogel insert
WO2013158689A2 (en) * 2012-04-16 2013-10-24 Cornell University Digitally controlled musical instrument
US10820885B2 (en) 2012-06-15 2020-11-03 C. R. Bard, Inc. Apparatus and methods for detection of a removable cap on an ultrasound probe
EP4316409A2 (en) 2012-08-03 2024-02-07 Stryker Corporation Systems for robotic surgery
US9226796B2 (en) 2012-08-03 2016-01-05 Stryker Corporation Method for detecting a disturbance as an energy applicator of a surgical instrument traverses a cutting path
US9820818B2 (en) 2012-08-03 2017-11-21 Stryker Corporation System and method for controlling a surgical manipulator based on implant parameters
US9056244B2 (en) 2012-09-12 2015-06-16 Wms Gaming Inc. Gaming apparatus incorporating targeted haptic feedback
US20170277282A1 (en) * 2012-09-14 2017-09-28 Widevantage Inc. Input device for transmitting user input
US20150253908A1 (en) * 2012-09-14 2015-09-10 Widevantage Inc. Electrical device for determining user input by using a magnetometer
US8954195B2 (en) 2012-11-09 2015-02-10 Harris Corporation Hybrid gesture control haptic system
KR102079945B1 (en) * 2012-11-22 2020-02-21 삼성전자주식회사 Surgical robot and method for controlling the surgical robot
US8965620B2 (en) 2013-02-07 2015-02-24 Harris Corporation Systems and methods for controlling movement of unmanned vehicles
US9415299B2 (en) 2013-03-15 2016-08-16 Steelseries Aps Gaming device
US9604147B2 (en) * 2013-03-15 2017-03-28 Steelseries Aps Method and apparatus for managing use of an accessory
US9687730B2 (en) 2013-03-15 2017-06-27 Steelseries Aps Gaming device with independent gesture-sensitive areas
EP3211511A1 (en) * 2013-03-15 2017-08-30 Immersion Corporation Programmable haptic peripheral
US9409087B2 (en) 2013-03-15 2016-08-09 Steelseries Aps Method and apparatus for processing gestures
US9423874B2 (en) 2013-03-15 2016-08-23 Steelseries Aps Gaming accessory with sensory feedback device
US9542347B2 (en) 2013-03-16 2017-01-10 Intel Corporation Host interface crossbar for sensor hub
US9430414B2 (en) 2013-03-16 2016-08-30 Intel Corporation Bus independent platform for sensor hub peripherals to provide coalescing of multiple reports
DE102013219155A1 (en) * 2013-09-24 2015-03-26 Siemens Aktiengesellschaft Method for controlling movements of a medical device, control device therefor and medical device
US9498710B2 (en) * 2013-11-11 2016-11-22 Pixart Imaging Inc. 3D feedback mouse sensor
US9164587B2 (en) 2013-11-14 2015-10-20 Immersion Corporation Haptic spatialization system
US9619029B2 (en) 2013-11-14 2017-04-11 Immersion Corporation Haptic trigger control system
US9128507B2 (en) 2013-12-30 2015-09-08 Harris Corporation Compact haptic interface
ES2811323T3 (en) 2014-02-06 2021-03-11 Bard Inc C R Systems for the guidance and placement of an intravascular device
TWI548274B (en) * 2014-02-24 2016-09-01 緯創資通股份有限公司 Handheld electronic device and method for taking photo by handheld electronic device
US10600596B2 (en) 2014-04-21 2020-03-24 Verily Life Sciences Llc Adapter to attach implements to an actively controlled human tremor cancellation platform
JP2015231098A (en) * 2014-06-04 2015-12-21 ソニー株式会社 Vibration device and vibration method
US9588586B2 (en) * 2014-06-09 2017-03-07 Immersion Corporation Programmable haptic devices and methods for modifying haptic strength based on perspective and/or proximity
US9838009B2 (en) 2014-08-27 2017-12-05 Continental Automotive Systems, Inc. Switch with user feedback
US10185396B2 (en) 2014-11-12 2019-01-22 Immersion Corporation Haptic trigger modification system
US9174134B1 (en) 2014-11-12 2015-11-03 Immersion Corporation Peripheral device with haptic diminishment prevention component
US9592608B1 (en) * 2014-12-15 2017-03-14 X Development Llc Methods and systems for providing feedback during teach mode
US10973584B2 (en) 2015-01-19 2021-04-13 Bard Access Systems, Inc. Device and method for vascular access
US10271770B2 (en) 2015-02-20 2019-04-30 Verily Life Sciences Llc Measurement and collection of human tremors through a handheld tool
US9943430B2 (en) 2015-03-25 2018-04-17 Verily Life Sciences Llc Handheld tool for leveling uncoordinated motion
US10613629B2 (en) 2015-03-27 2020-04-07 Chad Laurendeau System and method for force feedback interface devices
WO2016210325A1 (en) 2015-06-26 2016-12-29 C.R. Bard, Inc. Connector interface for ecg-based catheter positioning system
US11191528B2 (en) * 2015-07-09 2021-12-07 DePuy Synthes Products, Inc. External hand control for surgical power tool
DE102015113110B4 (en) * 2015-08-10 2019-03-14 MAQUET GmbH Drive device at least one drive device of a surgical table and method for driving
EP3359042B1 (en) * 2015-10-06 2023-01-11 Ecential Robotics Method and device for controlling movement of a motorized c-arm
JP6577326B2 (en) * 2015-10-16 2019-09-18 ファナック株式会社 Robot control apparatus, robot system, and method for controlling robot that carries objects in cooperation with human
US10072997B2 (en) 2015-11-17 2018-09-11 Rockwell Automation Technologies, Inc. Safety switch with imbalance test
US9824841B2 (en) 2015-11-17 2017-11-21 Rockwell Automation Technologies, Inc. Safety switch and associated methods
JP6518793B2 (en) * 2016-01-04 2019-05-22 日立オートモティブシステムズ株式会社 POWER LINE COMMUNICATION DEVICE, AND ELECTRONIC CONTROL DEVICE PROVIDED WITH POWER LINE COMMUNICATION DEVICE
US9919422B1 (en) 2016-01-06 2018-03-20 X Development Llc Methods and systems to provide mechanical feedback during movement of a robotic system
US11000207B2 (en) 2016-01-29 2021-05-11 C. R. Bard, Inc. Multiple coil system for tracking a medical device
US10198074B2 (en) * 2016-02-18 2019-02-05 Immersion Corporation Haptically-enabled modular peripheral device assembly
US10245112B2 (en) * 2016-06-27 2019-04-02 Corindus, Inc. Interlocking system and method for joysticks in a catheter procedure system
US11202682B2 (en) 2016-12-16 2021-12-21 Mako Surgical Corp. Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site
EP3566157A4 (en) * 2017-01-27 2020-08-05 Ohuku LLC Method and system for simulating, predicting, interpreting, comparing, or visualizing complex data
JP2020507377A (en) * 2017-02-15 2020-03-12 コヴィディエン リミテッド パートナーシップ Systems and equipment for crush prevention in medical robot applications
US10420663B2 (en) 2017-05-01 2019-09-24 Verily Life Sciences Llc Handheld articulated user-assistive device with behavior control modes
CN107231144A (en) * 2017-05-08 2017-10-03 西门子公司 Servo-driver
CN108874243B (en) * 2017-05-11 2021-11-12 京东方科技集团股份有限公司 Touch panel, electronic device and driving method thereof
DE102017208833B4 (en) * 2017-05-24 2018-12-13 Wago Verwaltungsgesellschaft Mbh module unit
FR3085522B1 (en) * 2018-09-03 2020-08-14 Safran Electronics & Defense CONNECTED MEASURING DEVICE FOR AN AIRCRAFT
US10611391B1 (en) 2018-10-05 2020-04-07 Corindus, Inc. Mobile support and storage system for a medical device
WO2020081373A1 (en) 2018-10-16 2020-04-23 Bard Access Systems, Inc. Safety-equipped connection systems and methods thereof for establishing electrical connections
US11027194B2 (en) 2019-03-01 2021-06-08 Sony Interactive Entertainment Inc. Force feedback to improve gameplay
WO2021011571A1 (en) 2019-07-15 2021-01-21 Corindus, Inc. Systems and methods for a control station for robotic interventional procedures using a plurality of elongated medical devices
US11277084B2 (en) * 2020-07-14 2022-03-15 Qualcomm Incorporated Driver for haptics and camera voice coil motor applications
CN113181628B (en) * 2021-05-12 2023-03-28 歌尔科技有限公司 Handle, correction method of button feedback force of handle, control device and storage medium
CN113842634B (en) * 2021-09-27 2024-02-27 歌尔科技有限公司 Force feedback control method and device for trigger button, electronic product and medium
US20230218985A1 (en) * 2022-01-13 2023-07-13 Dell Products L.P. Contextual adjustment of input device resistance

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4125800A (en) * 1975-09-02 1978-11-14 Contraves Gorez Corporation Power controller with a modular power output
US5051094A (en) * 1987-10-16 1991-09-24 Environmental Tectonics Corporation G-force trainer
US5103404A (en) * 1985-12-06 1992-04-07 Tensor Development, Inc. Feedback for a manipulator
US5389865A (en) * 1992-12-02 1995-02-14 Cybernet Systems Corporation Method and system for providing a tactile virtual reality and manipulator defining an interface device therefor
US5396267A (en) * 1992-07-09 1995-03-07 Thrustmaster, Inc. Reconfigurable video game system
US5405152A (en) * 1993-06-08 1995-04-11 The Walt Disney Company Method and apparatus for an interactive video game with physical feedback

Family Cites Families (259)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2906179A (en) * 1957-01-28 1959-09-29 North American Aviation Inc Vector gage
US3157853A (en) 1957-12-06 1964-11-17 Hirsch Joseph Tactile communication system
US2972140A (en) 1958-09-23 1961-02-14 Hirsch Joseph Apparatus and method for communication through the sense of touch
GB958325A (en) 1962-07-08 1964-05-21 Communications Patents Ltd Improvements in or relating to ground-based flight training or simulating apparatus
US3490059A (en) * 1966-06-06 1970-01-13 Martin Marietta Corp Three axis mounting and torque sensing apparatus
US3497668A (en) 1966-08-25 1970-02-24 Joseph Hirsch Tactile control system
US3517446A (en) 1967-04-19 1970-06-30 Singer General Precision Vehicle trainer controls and control loading
US3531868A (en) * 1968-04-18 1970-10-06 Ford Motor Co Surface scanner for measuring the coordinates of points on a three-dimensional surface
US3623064A (en) 1968-10-11 1971-11-23 Bell & Howell Co Paging receiver having cycling eccentric mass
US3903614A (en) 1970-03-27 1975-09-09 Singer Co Apparatus for simulating aircraft control loading
US3919691A (en) * 1971-05-26 1975-11-11 Bell Telephone Labor Inc Tactile man-machine communication system
US3795150A (en) * 1972-12-13 1974-03-05 Us Air Force System for rapidly positioning gimbaled objects
US3875488A (en) * 1973-02-15 1975-04-01 Raytheon Co Inertially stabilized gimbal platform
US3902687A (en) 1973-06-25 1975-09-02 Robert E Hightower Aircraft indicator system
US3923166A (en) 1973-10-11 1975-12-02 Nasa Remote manipulator system
US3890958A (en) * 1974-04-08 1975-06-24 Moog Automotive Inc Physiological diagnostic apparatus
US3944798A (en) * 1974-04-18 1976-03-16 Eaton-Leonard Corporation Method and apparatus for measuring direction
US3911416A (en) 1974-08-05 1975-10-07 Motorola Inc Silent call pager
US3978392A (en) * 1975-05-08 1976-08-31 General Signal Corporation Energy transfer circuit
US4148014A (en) * 1977-04-06 1979-04-03 Texas Instruments Incorporated System with joystick to control velocity vector of a display cursor
US4160508A (en) 1977-08-19 1979-07-10 Nasa Controller arm for a remotely related slave arm
US4127752A (en) 1977-10-13 1978-11-28 Sheldahl, Inc. Tactile touch switch panel
US4216467A (en) * 1977-12-22 1980-08-05 Westinghouse Electric Corp. Hand controller
US4262549A (en) 1978-05-10 1981-04-21 Schwellenbach Donald D Variable mechanical vibrator
US4236325A (en) 1978-12-26 1980-12-02 The Singer Company Simulator control loading inertia compensator
US4464117A (en) 1980-08-27 1984-08-07 Dr. Ing. Reiner Foerst Gmbh Driving simulator apparatus
US4638798A (en) * 1980-09-10 1987-01-27 Shelden C Hunter Stereotactic method and apparatus for locating and treating or removing lesions
NL8006091A (en) * 1980-11-07 1982-06-01 Fokker Bv FLIGHTMATTER.
US4333070A (en) 1981-02-06 1982-06-01 Barnes Robert W Motor vehicle fuel-waste indicator
US4367373A (en) * 1981-04-07 1983-01-04 The United States Of America As Represented By The Secretary Of The Air Force Two-axis electromechanical controller
JPS57169643A (en) * 1981-04-13 1982-10-19 Yamato Scale Co Ltd Load cell for multiple components of force
US4382217A (en) * 1981-05-15 1983-05-03 Gould Inc. Starting control circuit for an A.C. motor
US4599070A (en) 1981-07-29 1986-07-08 Control Interface Company Limited Aircraft simulator and simulated control system therefor
US4436188A (en) * 1981-11-18 1984-03-13 Jones Cecil R Controlled motion apparatus
DE3380420D1 (en) 1982-01-22 1989-09-21 British Aerospace Control apparatus
US4484191A (en) 1982-06-14 1984-11-20 Vavra George S Tactile signaling systems for aircraft
US4477973A (en) * 1982-07-14 1984-10-23 Micro Control Systems, Inc. Three dimensional graphics tablet
US4593470A (en) * 1982-07-14 1986-06-10 Micro Control Systems, Inc. Portable three dimensional graphics tablet
US4560983A (en) 1982-09-17 1985-12-24 Ampex Corporation Dynamically interactive responsive control device and system
US4477043A (en) * 1982-12-15 1984-10-16 The United States Of America As Represented By The Secretary Of The Air Force Biodynamic resistant control stick
DE3366764D1 (en) * 1983-01-28 1986-11-13 Ibm A stylus or pen for interactive use with a graphics input tablet
FR2545606B1 (en) * 1983-05-06 1985-09-13 Hispano Suiza Sa FORCE TENSIONER SENSOR
US4604016A (en) 1983-08-03 1986-08-05 Joyce Stephen A Multi-dimensional force-torque hand controller having force feedback
GB2146776B (en) * 1983-09-16 1986-07-30 Ferranti Plc Accelerometer systems
US4550221A (en) * 1983-10-07 1985-10-29 Scott Mabusth Touch sensitive control device
US4670851A (en) 1984-01-09 1987-06-02 Mitsubishi Denki Kabushiki Kaisha Vector quantizer
JPS60170709A (en) * 1984-02-16 1985-09-04 Toshiba Corp Measuring insturment for shape
US4571834A (en) * 1984-02-17 1986-02-25 Orthotronics Limited Partnership Knee laxity evaluator and motion module/digitizer arrangement
US4581491A (en) 1984-05-04 1986-04-08 Research Corporation Wearable tactile sensory aid providing information on voice pitch and intonation patterns
US4688983A (en) * 1984-05-21 1987-08-25 Unimation Inc. Low cost robot
US4676002A (en) * 1984-06-25 1987-06-30 Slocum Alexander H Mechanisms to determine position and orientation in space
US4632241A (en) * 1984-10-04 1986-12-30 F. Schumacher & Co. Portable display bag with support means
JPS61105411A (en) * 1984-10-29 1986-05-23 Mitsutoyo Mfg Co Ltd Measuring method of multidimensional measuring machine
US4654648A (en) * 1984-12-17 1987-03-31 Herrington Richard A Wireless cursor control system
US4935728A (en) * 1985-01-02 1990-06-19 Altra Corporation Computer control
US4632341A (en) * 1985-02-06 1986-12-30 The United States Of America As Represented By The Secretary Of The Air Force Stabilizing force feedback in bio-actuated control systems
JPH0537531Y2 (en) 1985-06-11 1993-09-22
US5078152A (en) * 1985-06-23 1992-01-07 Loredan Biomedical, Inc. Method for diagnosis and/or training of proprioceptor feedback capabilities in a muscle and joint system of a human patient
DE3523188A1 (en) * 1985-06-28 1987-01-08 Zeiss Carl Fa CONTROL FOR COORDINATE MEASURING DEVICES
US4704909A (en) * 1985-07-22 1987-11-10 Grahn Allen R Multicomponent force-torque sensor
US4679331A (en) * 1985-08-26 1987-07-14 Ppg Industries, Inc. Apparatus and method for determining contour characteristics of a contoured article
US4713007A (en) 1985-10-11 1987-12-15 Alban Eugene P Aircraft controls simulator
US5275174B1 (en) * 1985-10-30 1998-08-04 Jonathan A Cook Repetitive strain injury assessment
NL8503096A (en) 1985-11-11 1987-06-01 Fokker Bv SIMULATOR OF MECHANICAL PROPERTIES OF OPERATING SYSTEM.
US4934694A (en) 1985-12-06 1990-06-19 Mcintosh James L Computer controlled exercise system
US4891764A (en) 1985-12-06 1990-01-02 Tensor Development Inc. Program controlled force measurement and control system
US4811608A (en) * 1985-12-18 1989-03-14 Spatial Systems Pty Limited Force and torque converter
US5591924A (en) 1985-12-18 1997-01-07 Spacetec Imc Corporation Force and torque converter
US5195179A (en) * 1986-01-29 1993-03-16 Hitachi, Ltd. Coordinate input apparatus
US4787051A (en) * 1986-05-16 1988-11-22 Tektronix, Inc. Inertial mouse system
US4803413A (en) * 1986-07-15 1989-02-07 Honeywell Inc. Magnetic isolating and pointing gimbal apparatus
US4791934A (en) * 1986-08-07 1988-12-20 Picker International, Inc. Computer tomography assisted stereotactic surgery system and method
US4945305A (en) * 1986-10-09 1990-07-31 Ascension Technology Corporation Device for quantitatively measuring the relative position and orientation of two bodies in the presence of metals utilizing direct current magnetic fields
US4849692A (en) * 1986-10-09 1989-07-18 Ascension Technology Corporation Device for quantitatively measuring the relative position and orientation of two bodies in the presence of metals utilizing direct current magnetic fields
NL8602697A (en) * 1986-10-27 1988-05-16 Huka Bv Developments JOYSTICK.
US4771344A (en) * 1986-11-13 1988-09-13 James Fallacaro System for enhancing audio and/or visual presentation
US4795296A (en) 1986-11-17 1989-01-03 California Institute Of Technology Hand-held robot end effector controller having movement and force control
US4750487A (en) * 1986-11-24 1988-06-14 Zanetti Paul H Stereotactic frame
CA1299362C (en) * 1986-12-10 1992-04-28 Gregory James Mcdonald Coordinate measuring system
US4819195A (en) * 1987-01-20 1989-04-04 The Warner & Swasey Company Method for calibrating a coordinate measuring machine and the like and system therefor
US4945501A (en) * 1987-01-20 1990-07-31 The Warner & Swasey Company Method for determining position within the measuring volume of a coordinate measuring machine and the like and system therefor
US4800721A (en) * 1987-02-13 1989-01-31 Caterpillar Inc. Force feedback lever
US4794392A (en) 1987-02-20 1988-12-27 Motorola, Inc. Vibrator alert device for a communication receiver
US4988981B1 (en) * 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US5986643A (en) 1987-03-24 1999-11-16 Sun Microsystems, Inc. Tactile feedback mechanism for a data processing system
US4839838A (en) * 1987-03-30 1989-06-13 Labiche Mitchell Spatial input apparatus
US4769517A (en) * 1987-04-13 1988-09-06 Swinney Carl M Joystick switch assembly
GB2204131B (en) * 1987-04-28 1991-04-17 Ibm Graphics input tablet
US4961138A (en) * 1987-05-01 1990-10-02 General Datacomm, Inc. System and apparatus for providing three dimensions of input into a host processor
IT1214292B (en) * 1987-05-05 1990-01-10 Garda Impianti Srl EQUIPMENT FOR MEASUREMENT AND / OR CONTROL OF THE POSITION AND ORIENTATION OF POINTS OR AREAS CHARACTERISTIC OF STRUCTURES, IN PARTICULAR OF VEHICLE BODIES.
US4868549A (en) * 1987-05-18 1989-09-19 International Business Machines Corporation Feedback mouse
DE3717459A1 (en) * 1987-05-23 1988-12-01 Zeiss Carl Fa HAND-HELD COORDINATE MEASURING DEVICE
US4811921A (en) * 1987-06-22 1989-03-14 Whitaker Charles N Cyclic control stick
US4823634A (en) 1987-11-03 1989-04-25 Culver Craig F Multifunction tactile manipulatable control
DE3740070A1 (en) * 1987-11-26 1989-06-08 Zeiss Carl Fa TURN SLEWING DEVICE FOR TEST COOKING OF COORDINATE MEASURING DEVICES
GB8729638D0 (en) * 1987-12-19 1988-02-03 Renishaw Plc Mounting for surface sensing device
US5251127A (en) * 1988-02-01 1993-10-05 Faro Medical Technologies Inc. Computer-aided surgery apparatus
SE461548B (en) * 1988-02-18 1990-02-26 Johansson Ab C E PROCEDURE AND DEVICE FOR DETERMINING AND CORRECTING IN CASE OF LOCATION ERROR IN SEATING A POINT OF A POINT OR POSITIONING TO A POINT WITH A PARTICULAR LOCATION
GB8803847D0 (en) * 1988-02-18 1988-03-16 Renishaw Plc Mounting for surface-sensing device
US4925312A (en) * 1988-03-21 1990-05-15 Staubli International Ag Robot control system having adaptive feedforward torque control for improved accuracy
US5038089A (en) 1988-03-23 1991-08-06 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Synchronized computational architecture for generalized bilateral control of robot arms
US4907970A (en) * 1988-03-30 1990-03-13 Grumman Aerospace Corporation Sidestick-type thrust control simulator
US4885565A (en) 1988-06-01 1989-12-05 General Motors Corporation Touchscreen CRT with tactile feedback
US4942545A (en) * 1988-06-06 1990-07-17 Combustion Engineering, Inc. Calibration of eddy current profilometry
US5050608A (en) * 1988-07-12 1991-09-24 Medirand, Inc. System for indicating a position to be operated in a patient's body
US5116180A (en) 1988-07-18 1992-05-26 Spar Aerospace Limited Human-in-the-loop machine control loop
US4962448A (en) 1988-09-30 1990-10-09 Demaio Joseph Virtual pivot handcontroller
DE58903515D1 (en) * 1988-10-03 1993-03-25 Zeiss Carl Fa TEST BODY FOR COORDINATE MEASURING DEVICES.
US5007085A (en) * 1988-10-28 1991-04-09 International Business Machines Corporation Remotely sensed personal stylus
US4907973A (en) * 1988-11-14 1990-03-13 Hon David C Expert system simulator for modeling realistic internal environments and performance
US4930770A (en) 1988-12-01 1990-06-05 Baker Norman A Eccentrically loaded computerized positive/negative exercise machine
US5189806A (en) * 1988-12-19 1993-03-02 Renishaw Plc Method of and apparatus for scanning the surface of a workpiece
US5044956A (en) * 1989-01-12 1991-09-03 Atari Games Corporation Control device such as a steering wheel for video vehicle simulator with realistic feedback forces
US5116051A (en) * 1989-01-12 1992-05-26 Atari Games Corporation Strain gauge pressure-sensitive video game control
US4949119A (en) 1989-01-12 1990-08-14 Atari Games Corporation Gearshift for a vehicle simulator using computer controlled realistic real world forces
US5186695A (en) * 1989-02-03 1993-02-16 Loredan Biomedical, Inc. Apparatus for controlled exercise and diagnosis of human performance
US5019761A (en) 1989-02-21 1991-05-28 Kraft Brett W Force feedback control for backhoe
JPH02220106A (en) * 1989-02-22 1990-09-03 Okuma Mach Works Ltd Digitization controller containing measuring function
GB8904955D0 (en) * 1989-03-03 1989-04-12 Atomic Energy Authority Uk Multi-axis hand controller
US4983901A (en) * 1989-04-21 1991-01-08 Allergan, Inc. Digital electronic foot control for medical apparatus and the like
JPH02290506A (en) * 1989-04-28 1990-11-30 Mitsutoyo Corp Three-dimensional measuring instrument
US5184306A (en) * 1989-06-09 1993-02-02 Regents Of The University Of Minnesota Automated high-precision fabrication of objects of complex and unique geometry
JPH0347414A (en) * 1989-07-13 1991-02-28 Isuzu Ceramics Kenkyusho:Kk Driver device for solenoid valve
US5076517A (en) 1989-08-14 1991-12-31 United Technologies Corporation Programmable, linear collective control system for a helicopter
JPH07104146B2 (en) * 1989-08-29 1995-11-13 株式会社ミツトヨ Rotation table scanning control method for coordinate measuring probe
US5139261A (en) * 1989-09-15 1992-08-18 Openiano Renato M Foot-actuated computer game controller serving as a joystick
US5182557A (en) * 1989-09-20 1993-01-26 Semborg Recrob, Corp. Motorized joystick
US5283862A (en) * 1989-10-11 1994-02-01 Lund Alan K Notebook computer with reversible cover for external use of membrane switch screen
US4961038A (en) * 1989-10-16 1990-10-02 General Electric Company Torque estimator for switched reluctance machines
US5209131A (en) * 1989-11-03 1993-05-11 Rank Taylor Hobson Metrology
US5126948A (en) * 1989-11-08 1992-06-30 Ltv Aerospace And Defense Company Digital position encoder and data optimizer
US5107080A (en) * 1989-12-01 1992-04-21 Massachusetts Institute Of Technology Multiple degree of freedom damped hand controls
US4983786A (en) * 1990-01-17 1991-01-08 The University Of British Columbia XY velocity controller
US5022407A (en) 1990-01-24 1991-06-11 Topical Testing, Inc. Apparatus for automated tactile testing
US5259894A (en) * 1990-01-26 1993-11-09 Sampson Richard K Method for solvent bonding non-porous materials to automatically create variable bond characteristics
US5072361A (en) * 1990-02-01 1991-12-10 Sarcos Group Force-reflective teleoperation control system
US5184319A (en) * 1990-02-02 1993-02-02 Kramer James F Force feedback and textures simulating interface device
US5095303A (en) * 1990-03-27 1992-03-10 Apple Computer, Inc. Six degree of freedom graphic object controller
US5132672A (en) * 1990-03-27 1992-07-21 Apple Computer, Inc. Three degree of freedom graphic object controller
JPH03292524A (en) * 1990-04-11 1991-12-24 Oki Electric Ind Co Ltd Cursor shift system
US5128671A (en) * 1990-04-12 1992-07-07 Ltv Aerospace And Defense Company Control device having multiple degrees of freedom
US5035242A (en) 1990-04-16 1991-07-30 David Franklin Method and apparatus for sound responsive tactile stimulation of deaf individuals
US5022384A (en) 1990-05-14 1991-06-11 Capitol Systems Vibrating/massage chair
US5197003A (en) 1990-08-01 1993-03-23 Atari Games Corporation Gearshift for a vehicle simulator having a solenoid for imposing a resistance force
US5298918A (en) * 1990-08-01 1994-03-29 Yen Chen Chiu Electric circuit for reducing the energy consumption of a pointing device used in combination with a data processing system
US5251156A (en) * 1990-08-25 1993-10-05 Carl-Zeiss-Stiftung, Heidenheim/Brenz Method and apparatus for non-contact measurement of object surfaces
US5181181A (en) * 1990-09-27 1993-01-19 Triton Technologies, Inc. Computer apparatus input device for three-dimensional information
WO1992007350A1 (en) * 1990-10-15 1992-04-30 National Biomedical Research Foundation Three-dimensional cursor control device
US5142506A (en) * 1990-10-22 1992-08-25 Logitech, Inc. Ultrasonic position locating method and apparatus therefor
US5209661A (en) 1990-10-29 1993-05-11 Systems Control Technology, Inc. Motor control desired dynamic load of a simulating system and method
US5193963A (en) 1990-10-31 1993-03-16 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Force reflecting hand controller
US5305449A (en) * 1990-11-16 1994-04-19 Vetra Systems Corporation Keycode/pointing device conversion adapter which converts mouse motion signals into cursor signals by activating keyboard cursor keys
US5200674A (en) * 1990-11-16 1993-04-06 Aichi Sharyo Co., Ltd. Electric power supply device for mobile vehicular apparatus with aerial cabin having force-feedback manipulator
NL194053C (en) 1990-12-05 2001-05-03 Koninkl Philips Electronics Nv Device with a rotationally symmetrical body.
US5223776A (en) * 1990-12-31 1993-06-29 Honeywell Inc. Six-degree virtual pivot controller
US5264836A (en) * 1991-01-15 1993-11-23 Apple Computer, Inc. Three dimensional cursor
US5098437A (en) 1991-02-13 1992-03-24 Pfizer Hospital Products Group, Inc. Acetabular cup positioning insert
US5142931A (en) * 1991-02-14 1992-09-01 Honeywell Inc. 3 degree of freedom hand controller
US5354162A (en) 1991-02-26 1994-10-11 Rutgers University Actuator system for providing force feedback to portable master support
US5143505A (en) * 1991-02-26 1992-09-01 Rutgers University Actuator system for providing force feedback to a dextrous master glove
US5194786A (en) * 1991-02-27 1993-03-16 Kollmorgen Corporation Linear current source amplifier for brushless dc motor
DE69212149D1 (en) * 1991-03-21 1996-08-14 Atari Games Corp DRIVING SIMULATOR WITH CROSS-CROSS NETWORK FEEDBACK
US5203563A (en) 1991-03-21 1993-04-20 Atari Games Corporation Shaker control device
US5131844A (en) * 1991-04-08 1992-07-21 Foster-Miller, Inc. Contact digitizer, particularly for dental applications
GB9108497D0 (en) 1991-04-20 1991-06-05 Ind Limited W Human/computer interface
JPH06508222A (en) * 1991-05-23 1994-09-14 アタリ ゲームズ コーポレーション modular display simulator
US5146566A (en) 1991-05-29 1992-09-08 Ibm Corporation Input/output system for computer user interface using magnetic levitation
US5178012A (en) * 1991-05-31 1993-01-12 Rockwell International Corporation Twisting actuator accelerometer
US5279309A (en) 1991-06-13 1994-01-18 International Business Machines Corporation Signaling device and method for monitoring positions in a surgical operation
JP2514490B2 (en) * 1991-07-05 1996-07-10 株式会社ダイヘン Teaching control method by interlocking manual operation of industrial robot
US5185561A (en) * 1991-07-23 1993-02-09 Digital Equipment Corporation Torque motor as a tactile feedback device in a computer system
DE69207983T2 (en) * 1991-07-27 1996-06-05 Renishaw Transducer Syst Calibration and measuring device
US5298919A (en) * 1991-08-02 1994-03-29 Multipoint Technology Corporation Multi-dimensional input device
US5186629A (en) * 1991-08-22 1993-02-16 International Business Machines Corporation Virtual graphics display capable of presenting icons and windows to the blind computer user and method
US5235868A (en) 1991-10-02 1993-08-17 Culver Craig F Mechanism for generating control signals
US5262777A (en) * 1991-11-16 1993-11-16 Sri International Device for generating multidimensional input signals to a computer
US5889670A (en) 1991-10-24 1999-03-30 Immersion Corporation Method and apparatus for tactilely responsive user interface
US5220260A (en) 1991-10-24 1993-06-15 Lex Computer And Management Corporation Actuator having electronically controllable tactile responsiveness
US5228356A (en) * 1991-11-25 1993-07-20 Chuang Keh Shih K Variable effort joystick
US5230623A (en) * 1991-12-10 1993-07-27 Radionics, Inc. Operating pointer with interactive computergraphics
US5471571A (en) * 1991-12-27 1995-11-28 Xerox Corporation Method and apparatus for setting a graphical object's position and orientation with viscous dragging
GB9201214D0 (en) 1992-01-21 1992-03-11 Mcmahon Michael J Surgical retractors
DE4205875A1 (en) 1992-02-26 1993-09-02 Vdo Schindling Rotary selector e.g. for manual input of data in to electronic equipment - has movement of rotary input knob controlled by motor and generator with positions defined by load data in memory
CA2062147C (en) 1992-03-02 1995-07-25 Kenji Hara Multi-axial joy stick device
US5589828A (en) 1992-03-05 1996-12-31 Armstrong; Brad A. 6 Degrees of freedom controller with capability of tactile feedback
JP3199130B2 (en) 1992-03-31 2001-08-13 パイオニア株式会社 3D coordinate input device
US5189355A (en) * 1992-04-10 1993-02-23 Ampex Corporation Interactive rotary controller system with tactile feedback
JP2677315B2 (en) 1992-04-27 1997-11-17 株式会社トミー Driving toys
US5368484A (en) 1992-05-22 1994-11-29 Atari Games Corp. Vehicle simulator with realistic operating feedback
US5327790A (en) * 1992-06-19 1994-07-12 Massachusetts Institute Of Technology Reaction sensing torque actuator
US5551701A (en) 1992-08-19 1996-09-03 Thrustmaster, Inc. Reconfigurable video game controller with graphical reconfiguration display
US5296871A (en) * 1992-07-27 1994-03-22 Paley W Bradford Three-dimensional mouse with tactile feedback
US5428748A (en) 1992-09-24 1995-06-27 National Semiconductor Corporation Method and apparatus for automatically configuring a computer peripheral
US5283970A (en) * 1992-09-25 1994-02-08 Strombecker Corporation Toy guns
US5264768A (en) * 1992-10-06 1993-11-23 Honeywell, Inc. Active hand controller feedback loop
US5286203A (en) 1992-10-07 1994-02-15 Aai Microflite Simulation International Simulating horizontal stabilizer trimming in an aircraft
US5790108A (en) 1992-10-23 1998-08-04 University Of British Columbia Controller
US5397323A (en) 1992-10-30 1995-03-14 International Business Machines Corporation Remote center-of-motion robot for surgery
US5629594A (en) 1992-12-02 1997-05-13 Cybernet Systems Corporation Force feedback system
US5769640A (en) 1992-12-02 1998-06-23 Cybernet Systems Corporation Method and system for simulating medical procedures including virtual reality and control method and system for use therein
US5550562A (en) 1993-01-12 1996-08-27 Fujitsu Limited Data processing device that enables mouse-operated application programs to be operated from an operation pad, and an operation pad for use with the same
US5451924A (en) 1993-01-14 1995-09-19 Massachusetts Institute Of Technology Apparatus for providing sensory substitution of force feedback
US5389849A (en) * 1993-01-20 1995-02-14 Olympus Optical Co., Ltd. Tactility providing apparatus and manipulating device using the same
US5374942A (en) * 1993-02-05 1994-12-20 Gilligan; Federico G. Mouse and method for concurrent cursor position and scrolling control
US5412880A (en) 1993-02-23 1995-05-09 Faro Technologies Inc. Method of constructing a 3-dimensional map of a measurable quantity using three dimensional coordinate measuring apparatus
US5402582A (en) 1993-02-23 1995-04-04 Faro Technologies Inc. Three dimensional coordinate measuring apparatus
US5456341A (en) * 1993-04-23 1995-10-10 Moog Inc. Method and apparatus for actively adjusting and controlling a resonant mass-spring system
JP3686686B2 (en) * 1993-05-11 2005-08-24 松下電器産業株式会社 Haptic device, data input device, and data input device device
US5429140A (en) 1993-06-04 1995-07-04 Greenleaf Medical Systems, Inc. Integrated virtual reality rehabilitation system
US5396266A (en) * 1993-06-08 1995-03-07 Technical Research Associates, Inc. Kinesthetic feedback apparatus and method
US5351692A (en) * 1993-06-09 1994-10-04 Capistrano Labs Inc. Laparoscopic ultrasonic probe
US5513100A (en) 1993-06-10 1996-04-30 The University Of British Columbia Velocity controller with force feedback stiffness control
US5466213A (en) * 1993-07-06 1995-11-14 Massachusetts Institute Of Technology Interactive robotic therapist
US5805140A (en) 1993-07-16 1998-09-08 Immersion Corporation High bandwidth force feedback interface using voice coils and flexures
CA2167304C (en) 1993-07-16 1998-04-21 Louis B. Rosenberg Multi degree of freedom human-computer interface with tracking and forcefeedback
US5721566A (en) * 1995-01-18 1998-02-24 Immersion Human Interface Corp. Method and apparatus for providing damping force feedback
US5739811A (en) * 1993-07-16 1998-04-14 Immersion Human Interface Corporation Method and apparatus for controlling human-computer interface systems providing force feedback
US5734373A (en) * 1993-07-16 1998-03-31 Immersion Human Interface Corporation Method and apparatus for controlling force feedback interface systems utilizing a host computer
US5767839A (en) * 1995-01-18 1998-06-16 Immersion Human Interface Corporation Method and apparatus for providing passive force feedback to human-computer interface systems
US5625576A (en) 1993-10-01 1997-04-29 Massachusetts Institute Of Technology Force reflecting haptic interface
US5436640A (en) 1993-10-29 1995-07-25 Thrustmaster, Inc. Video game and simulator joystick controller with geared potentiometer actuation
US5384460A (en) 1993-11-03 1995-01-24 Silitek Corporation Encoder with a light emitting editing wheel
US5473235A (en) 1993-12-21 1995-12-05 Honeywell Inc. Moment cell counterbalance for active hand controller
US5461711A (en) * 1993-12-22 1995-10-24 Interval Research Corporation Method and system for spatial accessing of time-based information
US5438529A (en) * 1994-01-26 1995-08-01 Immersion Human Interface Corporation Percussion input device for personal computer systems
WO1995020787A1 (en) * 1994-01-27 1995-08-03 Exos, Inc. Multimode feedback display technology
WO1995020788A1 (en) 1994-01-27 1995-08-03 Exos, Inc. Intelligent remote multimode sense and display system utilizing haptic information compression
US5436542A (en) 1994-01-28 1995-07-25 Surgix, Inc. Telescopic camera mount with remotely controlled positioning
US5482051A (en) 1994-03-10 1996-01-09 The University Of Akron Electromyographic virtual reality system
JP2665313B2 (en) * 1994-04-22 1997-10-22 国際電業株式会社 Reaction force generator
US6004134A (en) 1994-05-19 1999-12-21 Exos, Inc. Interactive simulation including force feedback
US5623582A (en) 1994-07-14 1997-04-22 Immersion Human Interface Corporation Computer interface or control input device for laparoscopic surgical instrument and other elongated mechanical objects
US5684722A (en) 1994-09-21 1997-11-04 Thorner; Craig Apparatus and method for generating a control signal for a tactile sensation generator
US6422941B1 (en) * 1994-09-21 2002-07-23 Craig Thorner Universal tactile feedback system for computer video games and simulations
US5546039A (en) * 1994-11-02 1996-08-13 Advanced Micro Devices, Inc. Charge dissipation in capacitively loaded ports
US5642469A (en) * 1994-11-03 1997-06-24 University Of Washington Direct-drive manipulator for pen-based force display
US5666138A (en) 1994-11-22 1997-09-09 Culver; Craig F. Interface control
GB2295662A (en) * 1994-11-28 1996-06-05 Wah Leung Chan Joystick eg for video games
US5596403A (en) * 1994-12-02 1997-01-21 Tma Technologies, Inc. System and method for measuring angular position
JP3236180B2 (en) 1994-12-05 2001-12-10 日本電気株式会社 Coordinate pointing device
US5591082A (en) 1995-01-05 1997-01-07 Thrustmaster, Inc. Side-mounted throttle and weapons controller for computer video games and flight simulation
KR100430507B1 (en) 1995-03-13 2004-07-23 코닌클리케 필립스 일렉트로닉스 엔.브이. Vertical translation of the mouse or trackball to enable true three-dimensional (3D) input
US5749577A (en) 1995-03-15 1998-05-12 Sega Enterprises, Ltd. Perpheral input device with six-axis capability
US5882206A (en) 1995-03-29 1999-03-16 Gillio; Robert G. Virtual surgery system
US5714981A (en) * 1995-04-21 1998-02-03 Advanced Gravis Computer Technology, Ltd. Gameport communication apparatus and method
US5691898A (en) 1995-09-27 1997-11-25 Immersion Human Interface Corp. Safe and low cost computer peripherals with force feedback for consumer applications
US5589854A (en) * 1995-06-22 1996-12-31 Tsai; Ming-Chang Touching feedback device
US5628686A (en) * 1995-07-31 1997-05-13 Microsoft Corporation Apparatus and method for bidirectional data communication in a game port
US5611731A (en) 1995-09-08 1997-03-18 Thrustmaster, Inc. Video pinball machine controller having an optical accelerometer for detecting slide and tilt
US5959613A (en) 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
US6239806B1 (en) 1995-10-09 2001-05-29 Nintendo Co., Ltd. User controlled graphics object movement based on amount of joystick angular rotation and point of view angle
US5754023A (en) 1995-10-26 1998-05-19 Cybernet Systems Corporation Gyro-stabilized platforms for force-feedback applications
US5825308A (en) 1996-11-26 1998-10-20 Immersion Human Interface Corporation Force feedback interface having isotonic and isometric functionality
JP2000501033A (en) 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド Human / machine interface with tactile feedback
US6050718A (en) 1996-03-28 2000-04-18 Immersion Corporation Method and apparatus for providing high bandwidth force feedback with improved actuator feel
US5990869A (en) 1996-08-20 1999-11-23 Alliance Technologies Corp. Force feedback mouse
US5694013A (en) 1996-09-06 1997-12-02 Ford Global Technologies, Inc. Force feedback haptic interface for a three-dimensional CAD surface
US6020876A (en) 1997-04-14 2000-02-01 Immersion Corporation Force feedback interface with selective disturbance filter
US6005551A (en) 1997-04-25 1999-12-21 Microsoft Corporation Offline force effect rendering

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4125800A (en) * 1975-09-02 1978-11-14 Contraves Gorez Corporation Power controller with a modular power output
US5103404A (en) * 1985-12-06 1992-04-07 Tensor Development, Inc. Feedback for a manipulator
US5051094A (en) * 1987-10-16 1991-09-24 Environmental Tectonics Corporation G-force trainer
US5396267A (en) * 1992-07-09 1995-03-07 Thrustmaster, Inc. Reconfigurable video game system
US5389865A (en) * 1992-12-02 1995-02-14 Cybernet Systems Corporation Method and system for providing a tactile virtual reality and manipulator defining an interface device therefor
US5405152A (en) * 1993-06-08 1995-04-11 The Walt Disney Company Method and apparatus for an interactive video game with physical feedback

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0852770A4 *

Cited By (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5956484A (en) * 1995-12-13 1999-09-21 Immersion Corporation Method and apparatus for providing force feedback over a computer network
US6101530A (en) * 1995-12-13 2000-08-08 Immersion Corporation Force feedback provided over a computer network
US6369834B1 (en) 1996-04-04 2002-04-09 Massachusetts Institute Of Technology Method and apparatus for determining forces to be applied to a user through a haptic interface
US6111577A (en) * 1996-04-04 2000-08-29 Massachusetts Institute Of Technology Method and apparatus for determining forces to be applied to a user through a haptic interface
US6005551A (en) * 1997-04-25 1999-12-21 Microsoft Corporation Offline force effect rendering
EP0875819A1 (en) * 1997-04-25 1998-11-04 Microsoft Corporation Offline force effect rendering
US6191796B1 (en) 1998-01-21 2001-02-20 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with rigid and deformable surfaces in a haptic virtual reality environment
US6879315B2 (en) 1998-07-17 2005-04-12 Sensable Technologies, Inc. Force reflecting haptic interface
US6417638B1 (en) 1998-07-17 2002-07-09 Sensable Technologies, Inc. Force reflecting haptic interface
US9731194B2 (en) 1999-02-26 2017-08-15 Mq Gaming, Llc Multi-platform gaming systems and methods
US9468854B2 (en) 1999-02-26 2016-10-18 Mq Gaming, Llc Multi-platform gaming systems and methods
US10300374B2 (en) 1999-02-26 2019-05-28 Mq Gaming, Llc Multi-platform gaming systems and methods
US8888576B2 (en) 1999-02-26 2014-11-18 Mq Gaming, Llc Multi-media interactive play system
US9861887B1 (en) 1999-02-26 2018-01-09 Mq Gaming, Llc Multi-platform gaming systems and methods
FR2803085A1 (en) * 1999-12-28 2001-06-29 Thomson Csf Sextant Dialogue equipment for aircraft pilot interrogating screen based indicators and measurements, comprises ministick with rotating button giving outputs to direct and validate screen displays
US10307671B2 (en) 2000-02-22 2019-06-04 Mq Gaming, Llc Interactive entertainment system
US8915785B2 (en) 2000-02-22 2014-12-23 Creative Kingdoms, Llc Interactive entertainment system
US9814973B2 (en) 2000-02-22 2017-11-14 Mq Gaming, Llc Interactive entertainment system
US9713766B2 (en) 2000-02-22 2017-07-25 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9579568B2 (en) 2000-02-22 2017-02-28 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US10188953B2 (en) 2000-02-22 2019-01-29 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9149717B2 (en) 2000-02-22 2015-10-06 Mq Gaming, Llc Dual-range wireless interactive entertainment device
US9480929B2 (en) 2000-10-20 2016-11-01 Mq Gaming, Llc Toy incorporating RFID tag
US8961260B2 (en) 2000-10-20 2015-02-24 Mq Gaming, Llc Toy incorporating RFID tracking device
US10307683B2 (en) 2000-10-20 2019-06-04 Mq Gaming, Llc Toy incorporating RFID tag
US9931578B2 (en) 2000-10-20 2018-04-03 Mq Gaming, Llc Toy incorporating RFID tag
US9162148B2 (en) 2001-02-22 2015-10-20 Mq Gaming, Llc Wireless entertainment device, system, and method
US10758818B2 (en) 2001-02-22 2020-09-01 Mq Gaming, Llc Wireless entertainment device, system, and method
US10179283B2 (en) 2001-02-22 2019-01-15 Mq Gaming, Llc Wireless entertainment device, system, and method
US8913011B2 (en) 2001-02-22 2014-12-16 Creative Kingdoms, Llc Wireless entertainment device, system, and method
US9737797B2 (en) 2001-02-22 2017-08-22 Mq Gaming, Llc Wireless entertainment device, system, and method
US9616334B2 (en) 2002-04-05 2017-04-11 Mq Gaming, Llc Multi-platform gaming system using RFID-tagged toys
US9272206B2 (en) 2002-04-05 2016-03-01 Mq Gaming, Llc System and method for playing an interactive game
US11278796B2 (en) 2002-04-05 2022-03-22 Mq Gaming, Llc Methods and systems for providing personalized interactive entertainment
US10507387B2 (en) 2002-04-05 2019-12-17 Mq Gaming, Llc System and method for playing an interactive game
US10478719B2 (en) 2002-04-05 2019-11-19 Mq Gaming, Llc Methods and systems for providing personalized interactive entertainment
US10010790B2 (en) 2002-04-05 2018-07-03 Mq Gaming, Llc System and method for playing an interactive game
US10022624B2 (en) 2003-03-25 2018-07-17 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US9039533B2 (en) 2003-03-25 2015-05-26 Creative Kingdoms, Llc Wireless interactive game having both physical and virtual elements
US9770652B2 (en) 2003-03-25 2017-09-26 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US11052309B2 (en) 2003-03-25 2021-07-06 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
US10583357B2 (en) 2003-03-25 2020-03-10 Mq Gaming, Llc Interactive gaming toy
US9707478B2 (en) 2003-03-25 2017-07-18 Mq Gaming, Llc Motion-sensitive controller and associated gaming applications
US9993724B2 (en) 2003-03-25 2018-06-12 Mq Gaming, Llc Interactive gaming toy
US8961312B2 (en) 2003-03-25 2015-02-24 Creative Kingdoms, Llc Motion-sensitive controller and associated gaming applications
US10369463B2 (en) 2003-03-25 2019-08-06 Mq Gaming, Llc Wireless interactive game having both physical and virtual elements
GB2418475B (en) * 2003-06-09 2007-10-24 Immersion Corp Interactive gaming systems with haptic feedback
US8994643B2 (en) 2003-10-30 2015-03-31 3D Systems, Inc. Force reflecting haptic interface
US9427659B2 (en) 2004-07-29 2016-08-30 Motiva Llc Human movement measurement system
US9675878B2 (en) 2004-09-29 2017-06-13 Mq Gaming, Llc System and method for playing a virtual game by sensing physical movements
US8907889B2 (en) 2005-01-12 2014-12-09 Thinkoptics, Inc. Handheld vision based absolute pointing system
US10155170B2 (en) 2005-08-22 2018-12-18 Nintendo Co., Ltd. Game operating device with holding portion detachably holding an electronic device
US9011248B2 (en) 2005-08-22 2015-04-21 Nintendo Co., Ltd. Game operating device
US10238978B2 (en) 2005-08-22 2019-03-26 Nintendo Co., Ltd. Game operating device
US10661183B2 (en) 2005-08-22 2020-05-26 Nintendo Co., Ltd. Game operating device
US9700806B2 (en) 2005-08-22 2017-07-11 Nintendo Co., Ltd. Game operating device
US9498709B2 (en) 2005-08-24 2016-11-22 Nintendo Co., Ltd. Game controller and game system
US9227138B2 (en) 2005-08-24 2016-01-05 Nintendo Co., Ltd. Game controller and game system
US10137365B2 (en) 2005-08-24 2018-11-27 Nintendo Co., Ltd. Game controller and game system
US9044671B2 (en) 2005-08-24 2015-06-02 Nintendo Co., Ltd. Game controller and game system
US11027190B2 (en) 2005-08-24 2021-06-08 Nintendo Co., Ltd. Game controller and game system
USRE45905E1 (en) 2005-09-15 2016-03-01 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
US8913003B2 (en) 2006-07-17 2014-12-16 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer using a projection marker system
US7815508B2 (en) 2006-09-13 2010-10-19 Nintendo Co., Ltd. Game device and storage medium storing game program
US9176598B2 (en) 2007-05-08 2015-11-03 Thinkoptics, Inc. Free-space multi-dimensional absolute pointer with improved performance
US9802364B2 (en) 2011-10-18 2017-10-31 3D Systems, Inc. Systems and methods for construction of an instruction set for three-dimensional printing of a user-customizableimage of a three-dimensional structure
FR3072942A1 (en) * 2017-10-31 2019-05-03 Safran Electronics & Defense DEVICE FOR CONTROLLING FLIGHT OF AN AIRCRAFT

Also Published As

Publication number Publication date
CA2233206C (en) 2001-04-03
DE69607189T2 (en) 2000-11-16
US20050195168A1 (en) 2005-09-08
DE69627046T2 (en) 2003-12-04
EP0852770A4 (en) 1998-12-16
EP0852770B1 (en) 2000-03-15
US7439951B2 (en) 2008-10-21
DE69627046D1 (en) 2003-04-30
DE69607189D1 (en) 2000-04-20
US20020126091A1 (en) 2002-09-12
US5907487A (en) 1999-05-25
US6271833B1 (en) 2001-08-07
US7038657B2 (en) 2006-05-02
CA2233206A1 (en) 1997-04-03
EP0852770A1 (en) 1998-07-15
US5691898A (en) 1997-11-25
US20090033624A1 (en) 2009-02-05
US5929607A (en) 1999-07-27
US6348911B1 (en) 2002-02-19
EP0974889B1 (en) 2003-03-26
EP0974889A1 (en) 2000-01-26

Similar Documents

Publication Publication Date Title
US5907487A (en) Force feedback device with safety feature
US7209117B2 (en) Method and apparatus for streaming force values to a force feedback device
US6050718A (en) Method and apparatus for providing high bandwidth force feedback with improved actuator feel
US7236157B2 (en) Method for providing high bandwidth force feedback with improved actuator feel
JP4929394B2 (en) Method and apparatus for controlling a force feedback interface using a host computer
WO1998033136A9 (en) Method and apparatus for providing high bandwidth, realistic force feedback including an improved actuator
WO1997012357A9 (en) Method and apparatus for controlling force feedback interface systems utilizing a host computer

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA CN JP KR MX

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2233206

Country of ref document: CA

Ref country code: CA

Ref document number: 2233206

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1996933888

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1996933888

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 1996933888

Country of ref document: EP