WO2007044870A2 - Human interface input acceleration system - Google Patents

Human interface input acceleration system Download PDF

Info

Publication number
WO2007044870A2
WO2007044870A2 PCT/US2006/039982 US2006039982W WO2007044870A2 WO 2007044870 A2 WO2007044870 A2 WO 2007044870A2 US 2006039982 W US2006039982 W US 2006039982W WO 2007044870 A2 WO2007044870 A2 WO 2007044870A2
Authority
WO
WIPO (PCT)
Prior art keywords
input
assembly
input assembly
elements
hand
Prior art date
Application number
PCT/US2006/039982
Other languages
French (fr)
Other versions
WO2007044870A3 (en
Inventor
Elaine Chen
Rob Podoloff
Lorraine Wheeler
Beth Marcus
Original Assignee
Zeemote, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=37684425&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2007044870(A2) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Zeemote, Inc. filed Critical Zeemote, Inc.
Priority to JP2008535689A priority Critical patent/JP2009515239A/en
Priority to CA2625758A priority patent/CA2625758C/en
Priority to KR1020107013626A priority patent/KR101206694B1/en
Priority to EP06825865A priority patent/EP1938174A2/en
Publication of WO2007044870A2 publication Critical patent/WO2007044870A2/en
Publication of WO2007044870A3 publication Critical patent/WO2007044870A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202Constructional details or processes of manufacture of the input device
    • G06F3/0219Special purpose keyboards
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0231Cordless keyboards
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning

Definitions

  • the following description relates to hand-held input acceleration devices for interfacing with electronic devices, such as cellular phones, personal digital assistants ("PDAs”), pocket personal computers, smart phones, hand-held game devices, bar code readers, MP3 players and other similar input devices having a keypad or one or more input elements, and also relates to human interface and input systems for use with the hand-held acceleration devices.
  • electronic devices such as cellular phones, personal digital assistants ("PDAs"), pocket personal computers, smart phones, hand-held game devices, bar code readers, MP3 players and other similar input devices having a keypad or one or more input elements
  • PDAs personal digital assistants
  • pocket personal computers such as cellular phones, personal digital assistants (“PDAs”), pocket personal computers, smart phones, hand-held game devices, bar code readers, MP3 players and other similar input devices having a keypad or one or more input elements
  • MP3 players digital music players
  • human interface and input systems for use with the hand-held acceleration devices.
  • many hand-held electronic devices in particular cellular phones, typically use a D-pad as the primary way to navigate up and down a list of items, such as a list of songs, on an item-by-item basis.
  • Such item-by-item scrolling is typically inefficient in navigating from the first item in the list to the last item in the list, especially if the list includes hundreds of items.
  • most of these electronic devices provide the user with page up and page down functionality, which permits the user the scroll a number of items at once, e.g., some applications may associate ten items per page, often times such page up and page down functionality must be executed through multiple taps or presses of one or more input elements, typically those making up the keypad.
  • Various human interface and input systems and techniques for hand-held electronic devices have been developed for data input and device control. These include miniature keyboards and keypads used in combination with chordal input techniques, modal input techniques and/or smart keys; and touch screens used in combination with on-screen keyboard or keypad software or hand-writing recognition software. Additionally, for gaming, some hand-held electronic devices, such as cellular phones, have incorporated miniature thumb joysticks on the face of the device itself in lieu of the directional navigation pad (D- pad).
  • D- pad directional navigation pad
  • Miniature keyboards and keypads are similar to their standard full-size versions — i.e., a keyboard generally has a full set or substantially full set of numeric, character, and functional input elements, while key pads typically have a reduced set of numeric, character and/or functional input elements compared to keyboards.
  • These miniature input devices typically are designed to fit the available space on one surface of a hand-held electronic device or are designed as small, easily transportable, external plug-in devices. Thus, as hand-held electronic devices become smaller, the size of the input elements typically has been reduced in order for the desired number of input elements to fit on one surface of the electronic device.
  • miniature keyboards and keypads typically either require one of two input techniques— use of one or more thumbs or fingers to press the desired input elements or use of a stylus to "peck" the desired input elements (which is usually done where the input element is of smaller size).
  • Various techniques such as chordal input techniques, modal input techniques and smart keys, have been developed and implemented to improve the efficiency and effectiveness of using miniature keyboards and keypads.
  • Chordal input techniques generally are based upon the principle that characters, symbols, words, phrases or concepts can be represented by a reduced set of input elements. Thus, by only having to press a reduced combination of input elements, functionality can be increased and quicker and more accurate data input can be realized.
  • Chordal input techniques can be used on any keyboard or keypad configuration or any device having more than one input element, and typically results in fewer input elements or more functions compared to conventional keyboards or keypads.
  • An example of an electronic device using two-handed chordal input techniques is a court reporter or stenographer's typewriter.
  • One chordal input technique using a keypad to decrease the number of actuations to achieve a large number of functions is described in U.S. Patent No. 5,973,621 to Levy, entitled “Compact Keyed Input Device,” which is incorporated herein by reference.
  • Modal input techniques are based on the concept that functions of the electronic device, e.g., text messaging in a cell-phone or PDA, can be accessed by pressing a particular input element (or combination of elements) on a keyboard or keypad. Once that particular input element is pressed, the functionality of all or a portion of the input elements on the keyboard or keypad may change. Modal techniques typically are used in calculators, cellular phones, and PDAs.
  • a modal technique called multi- tap is common, in which individual input elements on the keypad are associated with multiple symbols, such as characters, letters, numbers, icons or other types of symbols, which tends to reduce the number of input elements required to achieve the desired functions, e.g., a twelve- input-element keypad can be used to represent all letters of the English alphabet and the decimal digits.
  • a user can input a desired symbol within a set of symbols associated with a certain input element by tapping on that particular input element with a thumb, finger, or stylus, one or more times to input the desired character.
  • a functional input element e.g., a mode key
  • the user may press a functional input element, e.g., a mode key, to access the text messaging functionality of the cellular phone and then tap an individual input element one or more times to select the associated symbol for input.
  • the number of taps needed to input a particular symbol may differ depending on the language character set chosen. For example, Japanese keypad or keyboards typically require a minimum set of 46 characters for text input, while English or American keyboards and keypads usually require a minimum set of 26 characters for text input.
  • These modal input techniques have gained some popularity as users perform more text functions, but these techniques can be cumbersome because to access some letters or characters, an input element on the keypad may have to be tapped three or four times.
  • these modal input techniques typically rely on the user's thumb, which is not generally as dexterous as the user's fingers.
  • Smart keys are typically used on keypads and refer to a single key or combination of keys that, when pressed, predict the users next logical action. Some implementations work better than others and some applications reduce the number of keystrokes required to complete a function better than others.
  • Word-predictor software attempts to predict the word or character the user intends to input based upon one or more letters inputted by the user and the likely probabilities within a given language. The probability of the software guessing correctly increases with the length of the word or number of letters or characters inputted.
  • a user may tap the keys 2, 2 and 8 in sequence to generate the word "cat” and the device would display that word first because it is usually the most common combination, whereas the word "bat,” which can be generated by pressing the same keys, would not be displayed first because it is not as common. Also, the word "cat” may be displayed after pressing the 2 key the second time based on a guess by the word-predictor software.
  • Smart keys also are typically used for Japanese data input where a user phonetically inputs letters representing the sound of the Japanese character (e.g., a Kanji character). Based on the inputted letters, the predictor software guesses the Japanese character. To select the character, a user would press the accept button or use the scrolling function to go to the next character with a similar set of phonetic inputs.
  • letters representing the sound of the Japanese character e.g., a Kanji character
  • Using on-screen keyboard or keypad software with a touch screen offers users the ability to enter data with fingers or thumbs on a screen-sized keyboard or buttons, allowing faster data input without a stylus or physical keyboard or keypad accessory; while using handwriting recognition software with a touch screen, such as GraffitiTM on the Palm operating system, offers users the ability to enter text with a stylus by writing the text directly on the touch screen.
  • Touch screens usually consume more power and are more expensive than non touch-sensitive screens. This higher power consumption can be a problem for handheld electronic devices, which typically have limited power resources.
  • touch screens usually require the user to use both hands (e.g., one hand is used to hold and steady the device while the other hand is used to grasp the stylus), which is generally undesirable for interfacing with and controlling one handed hand-held electronic device, such as cellular phones.
  • Handwriting recognition software has improved the slowness and awkwardness inherent in stylus, finger or thumb input but other drawbacks still remain, such as high power consumption, the necessity to use both hands, and lack of tactile feedback to inform a user when an input element has been.
  • recognition software requires training to use properly, and, even then, still results in a high error rate.
  • a user typically controls game play through the use of some form of input element, such as on a miniature keypad and/or D-pad, which typically is located on the front surface of the device.
  • Game control on some hand-held electronic devices such as cellular phones, is inherently one handed or at most two thumbed because of the size of the device, while game control on other hand-held electronic devices, such as PDAs and conventional game console controllers, is typically two-handed.
  • the input elements associated with game control on these devices are typically digital, particularly the D-pad, even though analog input elements have been used on game controllers for PC and console game systems, such as Microsoft's Xbox or Sony's Play Station 2.
  • the present inventors recognized that conventional human interface and input systems for hand-held electronic devices tended to be relatively inflexible, cumbersome, and inefficient to use, among other reasons, because they were not designed to take advantage of the biomechanics of the human hand, particularly the advantages associated with the opposition of the thumb to the fingers and the beneficial attributes of the thumb, e.g., its large range of motion and ability to impart large sustained forces, and the beneficial attributes of the fingers, e.g., their fine motor control, spatial memory and rapidity of motion.
  • chordal and modal techniques were limited by the inefficiencies inherent in conventional input systems.
  • miniature keyboards and keypads used in combination with chordal input techniques not only required the user to memorize numerous input combinations and develop the necessary motor skills to control a reduced number of input elements to provide even more complex functionality compared to typical QWERTY keyboards, but also did not use or allocate input tasks to the fingers and thumb of the human hand effectively.
  • miniature keyboards and keypads used in combination with modal input techniques tended to limit the user's ability to efficiently input data depending on the number of taps required to input a particular symbol and how fast the user could tap the input element with his thumb or a stylus to select the particular symbol.
  • the present inventors also recognized that, with the emergence of multimedia capabilities, such as MP3, in many hand-held electronic devices, there is a need to support fast and intuitive scrolling and list navigation actions.
  • many hand-held electronic devices in particular cellular phones, typically use a D-pad as the primary way to navigate up and down a list of items, such as a list of songs, on an item-by-item basis.
  • Such item-by-item scrolling is typically inefficient in navigating from the first item in the list to the last item in the list, especially if the list includes hundreds of items.
  • page up and page down functionality provided on many of these devices to make it easier for a user to navigate long lists of items often must be executed through multiple taps or presses of one or more input elements.
  • the particular number of taps or number of input elements required to evoke such page up and down functionality usually depends on the application developer's preference, and therefore often differs from application to application within the same electronic device.
  • the present inventors also recognized that a user's ability to control game play in such devices was greatly limited.
  • analog game control has been available to users of PC and console game systems
  • analog game control generally has not been widely available on hand-held electronic devices, such as cellular phones and PDAs.
  • most high end games that run on a gaming platform such as the Xbox or the Play Station 2 involve analog or continuous inputs from one or more input elements, such as a miniature or full sized joystick.
  • Cellular phones and PDAs provide only buttons or keys as input elements for game play.
  • the D-pad provided on most of these cellular phones is not available to the game developer to use as a game input.
  • the result is that directional movement input is often provided using the number input elements on the keypad, particularly the "2", “8", “4", and “6" input elements on the keypad for up, down, left and right directional movement.
  • the present inventors recognized that this layout presents several problems.
  • the input is discrete, so there is no way to provide a continuous input, such as steering a car in a first person driving game. In such as game, the car can be steered to move only left, straight, or right in preset increments, which severely limits the quality of the gaming experience.
  • the number input elements are typically located on one end of the phone's surface, and are thus less comfortable to use than the D-pad which is typically located above the number input elements. The result is that game play is limited and not as widely adopted as it might be with a better interface.
  • An input accelerator device may connect to one or more conventional hand-held electronic devices (i.e., a host electronic device), such as a cellular phone, PDA, pocket PC, smart phone, MP3 player, or other similar devices using a wired or wireless communication protocol, such as Bluetooth, and remotely control all functions of the connected host electronic devices.
  • a host electronic device such as a cellular phone, PDA, pocket PC, smart phone, MP3 player, or other similar devices using a wired or wireless communication protocol, such as Bluetooth, and remotely control all functions of the connected host electronic devices.
  • the input accelerator device may be used in conjunction with the input elements on the host electronic device to accelerate the user's ability to perform functions such as text input, game play, list navigation and scrolling.
  • the input accelerator device can even eliminate the need to directly interface with the inefficient human interface and input systems of the connected host electronic devices.
  • the input accelerator device may also be implemented to include various hybrid devices including a wireless headset in addition to the functions of a remote control.
  • the input accelerator device (whether one handed or two handed) may also be implemented to utilize the opposed thumb and finger ergonomics inherent in the hand and the skills already developed for using conventional input techniques to accomplish data input, list navigation, device control, and game control in a timely, efficient, comfortable, fun, and intuitive manner. Thus, no specialized training beyond that normally expected with any newly purchased hand-held device is expected.
  • Implementations of the human interface and input system and techniques for the input accelerator device described here may include various combinations of the following features.
  • the input accelerator device may include or be configured to include a communication channel configured to interface with a hand-held host device, an input assembly having a number of input elements that can be selectively mapped to one or more functions of a software application in order to minimize the number of times a particular input element on the hand-held host device needs to be actuated (which may none), and an input controller communicatively coupled to the input assembly and the communication channel, the input controller being configured to generate an input signal upon actuation of at least one of the input elements and being further configured to relay the input signal to the communication channel for transmission to the hand-held host device to control execution of the one or more functions of the software application mapped to the actuated input element.
  • the input accelerator device may also include a display unit for displaying textual, graphical and video information.
  • the input accelerator device may also include a storage device for storing instructions, such as firmware, mapping software and/or software applications, such as text applications, scrolling/navigational applications and game applications.
  • the input accelerator device may further include a processor configured to interpret the input signal and execute the instructions, a main memory configured to load the instructions and a bus configured to direct communications to and from the processor.
  • the input assembly may include a front input assembly, a rear input, and/or a side input assembly.
  • the input elements of the input assembly may include or more of the following types of input elements: analog buttons, digital buttons, keys, rockers, sliders, rotary dials, touch pads, pressure sensors, force sensitive resistors, piezoelectric resistive sensors, capacitive sensors, positional sensors, rotary encoders, linear potentiometers, directional or D-pads, and miniature analog thumb joysticks.
  • the communication channel may be a Universal Serial Bus port, an IEEE 1394 Firewire port, a serial port, a parallel port, a headphone port, and/or a data port.
  • the communication channel may also be a wireless data connection such as a Bluetooth connection, an Infrared connection, and a Wi-Fi connection.
  • a technique of controlling multiple hand-held host devices may include providing an input accelerator device having a plurality of input elements, actuating one of the plurality of input elements; interpreting a generated input signal based on the one or more functions mapped to the actuated input element; and executing the one or more functions mapped to the actuated element.
  • the method may also include configuring one of the plurality of input elements to be mapped to one or more indexing functions, and actuating an input element on one of the plurality of hand-held host devices in conjunction with the input element mapped to one or more indexing functions.
  • the input accelerator device and human interface and input systems and techniques described herein may provide one or more of the following advantages.
  • the human interface and input system and associated techniques offer the functionality of a high performance game controller, which can support the most demanding game input requirements, and the speed and accuracy of data input that can be obtained with the use of a conventional standard QWERTY keyboard, but without the large footprint.
  • the human interface and input system and associated techniques can increase the number of functions that may be associated with a given number of input elements without increasing the number of keystrokes or taps that is required.
  • it allows the input element size to remain consistent with the ergonomics of the human hand without increasing the time it takes to learn how to use the input system compared to conventional input systems.
  • an input accelerator device can eliminate the need to interface with inflexible, cumbersome, and inefficient input systems provided with conventional hand-held electronic devices. Since the input accelerator device can connect to multiple hand-held electronic devices using wired or wireless communication protocols a singled input accelerator device can make up for deficiencies of multiple conventional hand-held electronic devices. Thus, the input accelerator device can eliminate the need to retrofit or redesign conventional hand-held electronic devices to directly implement the disclosed human interface and input system and associated techniques, hi addition, the input accelerator device can be small and aesthetically valuable as a fashion accessory. For example, the input accelerator device may be implemented to include logos of sports teams or cartoon characters in addition to a wide selection of colors. The input accelerator device also may be easily attached to a keychain or a phone leash or clipped on or carried in a pocket or purse.
  • FIG. 1 is a block diagram of a hand-held input accelerator device upon which the human interface and input system may be implemented.
  • FIG. 2 is another block diagram of a hand-held input accelerator device upon which the human interface and input system may be implemented.
  • FIG. 3 is a block diagram of the human interface and input system.
  • FIG. 4 is a detailed block diagram of the input assembly of the human interface and input system.
  • FIGS. 5a-d show front, side, and back views, respectively, of a hand-held input accelerator device wherein a second input assembly includes a pressure sensor arrays having a plurality of configurable active areas.
  • FIG. 6 illustrates an alternate implementation of the second input assembly on a hand-held input accelerator device.
  • FIGS. 7a-d depict one implementation of a hand-held input accelerator device comprising a combination of a remote control and a wireless headset.
  • the human hand comprises an opposable thumb and four fingers, i.e., the thumb may be used in opposition, in concert, in combination or functional relation with any of the four fingers.
  • the human thumb may be characterized as having larger range of motion, stronger sustaining force actuation and poorer dexterity.
  • the human base joint of the thumb has three degrees of freedom, such as side-to-side movement, up and down movement, and rotation about the thumb's long axis; while the base joint of the fingers has two degrees of freedom, such as side-to-side and up and down movement.
  • the thumb typically is considered to have better range of motion than any of the fingers.
  • the human thumb has a bigger actuation muscle than any of the fingers, it can provide larger sustaining forces than the fingers. But also because of the larger muscle, the human thumb may suffer from diminished fine motor control and rapidity of motion that can be exerted compared to the fingers. Thus, the human fingers are more suitable for performing tasks that require fine motor coordination or the ability to pinpoint or rapidly repeat actuation.
  • FIG. 1 is a high-level block diagram of a hand-held input accelerator device 100 upon which the human interface and input system and associated input techniques described herein may be implemented for controlling software applications stored and running on a hand-held host device 117.
  • the input accelerator device 100 is a companion auxiliary device to the hand-held host device 117, whereby a user may interface with the auxiliary device and the hand-held host device concurrently 117 or the auxiliary device alone in lieu of the hand-held host device 117.
  • the input accelerator device 100 is communicatively coupled to a hand-held host device 117, such as a cellular phone, PDA, pocket PC, or smart phone, or other similar devices using a communication link 111, such as the Bluetooth protocol.
  • the Bluetooth protocol is a short-range, low-power 1 Mbit/sec wireless network technology operated in the 2.4 GHz band, which is appropriate for use in piconets.
  • Apiconet can have a master and up to seven slaves. The master transmits in even time slots, while slaves transmits in odd time slots.
  • the devices in a piconet share a common communication data channel with total capacity of 1 Mbit/sec. Headers and handshaking information are used by Bluetooth devices to strike up a conversation and find each other to connect.
  • the communication link 111 alternatively may be a wired link using standard data ports such as Universal Serial Bus interface, IEEE 1394 firewire, or other serial or parallel port connections. Additionally, the communication link 111 can be other standard wireless links such as infrared, wireless fidelity (Wi-Fi), or any other wireless connection.
  • Wi-Fi refers to any type of IEEE 802.11 protocol including 802.11a/b/g. Wi-Fi generally provides wireless connectivity for a device to the Internet or connectivity between devices. Wi-Fi operates in the unlicensed 2.4 GHz radio bands, with an 11 Mbit/sec (802.11b) or 54 Mbit/sec (802.11a) data rate or with products that contain both bands.
  • Infrared refers to light waves of a lower frequency out of range of what a human eye can perceive. Used in most television remote control systems, information is carried between devices via beams of infrared light.
  • the standard infrared system is called infrared data association (IrDA) and is used to connect some computers with peripheral devices in digital mode.
  • the communication link 111 connects a communication interface 116 of the input accelerator device with a communication interface 118 of the hand-held host device 117.
  • the input accelerator device 100 includes an interface and input system 114 in communication with the communication interface 116.
  • the interface and input system 114 includes input elements (not shown), such as keys, buttons, pressure sensor pads, touch pads, rotary dials, thumb joysticks, linear strip sensors or other actuators associated with one or more sensors that can be manipulated by one or both of a human user's thumbs or fingers.
  • the input elements are selectively mapped to one or more functions of the software applications stored on the host device 100.
  • mapping or re-mapping of the input elements to one or more functions of the software applications may be accomplished by using one of the techniques disclosed in co-pending U.S. Patent Application Serial No. 11/221 ,412, entitled “A Method of Remapping the ftiput Elements of a Hand-Held Device,” which is incorporated herein in its entirety by reference.
  • the interface and input assembly 114 is implemented with four input elements, but may be implemented with more or fewer input elements.
  • an electrical signal is generated by the input assembly 114.
  • the generated electrical signal is converted into input signals 122, which are transmitted over the communication link 111 to the hand-held host device 117, which receives the input signals 122 through communication interface 118.
  • the input signals 122 are processed by the handheld host device 117 to execute the software function mapped to the actuated input element.
  • hand-held host device 117 has a processor (not shown), such as an ARM, OMAP, or other similar processor for processing the input signals and the software applications stored and running thereon.
  • FIG. 2 is a block diagram illustrating an input accelerator device 200 upon which the human interface and input system and associated input techniques described herein may be implemented, hi this implementation, optional hardware components are implemented to configure a more powerful auxiliary device to handle more of the processing duties from the hand-held host device 117 onto the input accelerator device 200.
  • the input accelerator device 200 may be used in conjunction with the hand-held host device 117 to control software applications stored and running on the input accelerator device 200 itself.
  • the input accelerator device 200 may have stored and running thereon re-mapping software such as that described in co-pending U.S. Patent Application Serial No. 11/221,412.
  • the input accelerator device 200 may have stored and running thereon an Internet browsing application, which may be used in combination with communication functionality provided with hand-held host devices, such as the cellular communication protocols (e.g., CDMA or GSM/GPRS) provided with cellular phones, to browse the Internet.
  • an Internet browsing application which may be used in combination with communication functionality provided with hand-held host devices, such as the cellular communication protocols (e.g., CDMA or GSM/GPRS) provided with cellular phones, to browse the Internet.
  • the cellular communication protocols e.g., CDMA or GSM/GPRS
  • the input accelerator device 200 is in wireless (or alternatively wired) communication with the hand-held host device 117.
  • the hand-held host device 117 may include some of the same components as shown for the input accelerator device 200.
  • the hand-held host device 117 is a conventional cellular phone, but other types of hand-held electronic devices may be used with the input accelerator device 200.
  • the input accelerator device 200 may include a bus 202 or other communication mechanism for communicating information, and a processor 204, such as an ARM, OMAP or other similar processor, coupled with bus 202 for processing information, such as one or more sequences of one or more instructions, which may be embedded software, firmware, or software applications for controlling the hand-held host device 117, such as re-mapping software or text, gaming or scrolling applications, or any other software application.
  • a processor 204 such as an ARM, OMAP or other similar processor, coupled with bus 202 for processing information, such as one or more sequences of one or more instructions, which may be embedded software, firmware, or software applications for controlling the hand-held host device 117, such as re-mapping software or text, gaming or scrolling applications, or any other software application.
  • the input accelerator device 200 also may include a main memory 206, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 202 for storing information and instructions to be executed by processor 204.
  • Main memory 206 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 204.
  • the input accelerator device 100 further may include a read only memory (ROM) 208 or other static storage device coupled to bus 202 for storing static information and instructions for processor 204.
  • ROM read only memory
  • a storage device 210 may be provided and coupled to bus 202 for storing information and instructions for the processor 204.
  • the storage device 210 can include a flash memory such as EEPROM, compact flash, or a similar storage unit for storing device firmware.
  • the input accelerator device 200 may also include an optional display 212, such as a liquid crystal display (LCD), for displaying information to a user, and a human interface and input system 114 for communicating information and command selections from a human user to processor 204.
  • the command selections from a human user are communicated as input signals 122 from the interface and input system 114 to the bus 202 for distribution to other components such as the processor 204.
  • Input accelerator device 200 also may include a communication interface 216 coupled to bus 202.
  • Communication interface 216 provides a two-way data communication 211 coupling to the hand-held host device 117, a wireless service device, or wireless service station.
  • the two-way data communication 211 allows for an exchange of interactive data between the hand-held host device 117 and the input accelerator device 200.
  • the interactive data may include voice data for conducting a conversation using a cellular phone host device.
  • the interactive data may also include a graphical user interface (GUI) for browsing the Internet, which may be displayed on the optional display 212.
  • GUI graphical user interface
  • the cellular phones host device serves as a communication conduit for receiving data from the Internet as previously mentioned.
  • Communication interface 216 may be a wireless link such as Bluetooth or any other wireless communication interface known to one of ordinary skill in the art. In the wireless link implementation, communication interface 216 may send and receive electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
  • the input accelerator device 200 also can display a graphical user interface (GUI) on the display unit 212 to provide a list of hand-held host devices 117 within communication range of the input accelerator device 200.
  • GUI graphical user interface
  • the list of hand-held host devices 117 within communication range can be displayed using text names of each device, an icon representing each device, or a combination of text name and icon representing each device.
  • the input elements in the input assemblies 406, 408, 409 (described in detail in FIG. 4 below) can be actuated in combination or individually to select a desired hand-held host device 117 from the list of devices in communication range of the input accelerator device 200.
  • the input accelerator device 100, 200 as described above can obviate the need to remove the hand-held host device 117 from the user's pocket, bag or other storage location by performing most simple text/voice control functions.
  • the input accelerator device 100, 200 may also include a device driver (not shown) to effect control over the host hand-held device 117 and all associated software applications on the hand-held host device 117.
  • FIG. 3 depicts a block diagram of the subsystems of the human interface and input system 114 of the input accelerator device 100 or the input accelerator device 200.
  • the human interface and input system 114 which is described in more detail in co-pending U.S. Patent Application Serial No. 10/699,555, entitled “Human Interface System,” which is incorporated herein in its entirety by reference, includes an input assembly 305 in communication with an input controller 316 to interpret and generate input signals in response to user interaction with the input assembly 305.
  • the input assembly 305 can include multiple input assemblies (described in detailed below in FIG. 4), each assembly including a number of input elements, located on one or more surfaces of the input accelerator device 100 or the input accelerator device 200.
  • the input elements are selectively mapped to one or more functions of a software application that is stored on the hand-held host device 117 so that when one of the input elements is actuated, the function mapped to the actuated input element is executed.
  • the input controller 316 which may include one or more processors, receives the one or more electrical signals 312 and converts them into input signals 122 which are transmitted to the hand-held host device 117 via communication link 111 connecting the communication interface 116 of the input accelerator device 100 with the communication interface 118 of the hand-held host device 117.
  • the input signals 122 are transmitted to the hand-held host device 117 via communication link 211 connecting the communication interface 216 of the input accelerator device 200 with the communication interface 118 of the hand-held host device 117.
  • the hand-held host device 117 interprets the input signals 122 on the fly using software, such as mapping software, to execute the function mapped to the actuated input element.
  • the input accelerator device 200 may interpret the input signals 122 using software stored in the storage unit 210.
  • FIG. 4 illustrates one implementation of input assembly 305 including multiple input assemblies.
  • the input assembly 305 includes a front input assembly 406, a rear input assembly 408, and a side input assembly 409.
  • the front input assembly 406 and the rear input assembly 408 includes one or more input elements.
  • the input elements produce one or more electrical signals 312 upon actuation of the input elements.
  • the input controller 316 which may include one or more processors, receives the one or more electrical signals 312 and converts them into input signals 122, which are in a form suitable to be received and interpreted by the hand-held host device 117. Alternatively the input signal 122 may be interpreted by the processor 104 on the input accelerator device 200.
  • the hand-held host device 117 receives the input signals 122 and interprets it using the re-mapping software noted above and described in more detail below, which may be loaded on the host hand-held device.
  • the input signals 122 transmitted from the input accelerator device 100,200 are received by a communication interface 118 on the hand-held host device 117 using standard communications protocols, such as the Bluetooth wireless protocol.
  • the Bluetooth protocol allows the input signals 122 transmitted from the input accelerator device 100, 200to control execution of embedded software, firmware, or software applications, such as a text messaging or game applications, on the hand-held host device 117.
  • the input signals 122 are received and used by the hand-held host device 117 to map and remap the input elements in the front input assembly 406, the rear input assembly 408 and the side input assembly 409 to one or more software functions of a software application running on the host hand-held device 117.
  • an input controller (not shown) on the hand-held host device 117 maps one or more input elements on the hand-held host device 117 (e.g., input elements forming the keypad on a cellular phone) to one or more symbols, such as characters, letters, numbers, icons, other types of symbols, or combinations of different types of symbols, and map one or more input elements of the front input assembly 406 on the input accelerator device 100, 200 to a shifting or indexing functionality.
  • the user may press a first shift key on the input accelerator device 100, 200 and then the number key "9" on the hand-held host device 117.
  • the user may press a second shift key on the input accelerator device 100, 200 and then the number key "9” on the hand-held host device 117.
  • the user may press a third shift key on the input accelerator device 100,200 and then the number key "9” on the hand-held host device 117 So instead of having to press the number key "9” on the hand-held host device 117 three times to insert the letter "Z", which is the norm on most multi-tap interfaces, the user can insert the same letter with one press of the number key "9” on the hand-held host device 117 in combination with one press of the third shift key on the input accelerator device 100, 200.
  • one or more input elements of the rear input assembly 408 on the input accelerator device 100, 200 can be mapped to scrolling, navigation, or cursor control functions.
  • one or more input elements of the side input assembly 409 can be mapped as a short-cut key for executing a favorite application on the host hand-held device 117, such as a text, game or music application. If the hand-held host device 117 is executing a game application, then the input signals 122 may be used to control game play. That is, the input controller (not shown) on the hand-held host device 117 may map the input elements of the input assemblies 406, 408, 409 from the input accelerator device 100, 200 to game functions.
  • mapping of the input elements to particular input functions for a given software application may be customized by the application developer or the user through downloads or other programming modalities. Moreover, the mapping of the input elements may be done for language key set changes, which may reduce the cost of manufacturing hand-held electronic devices for manufacturers servicing multiple countries.
  • the processor 204 of the input accelerator device 200 may perform the mapping function described above and alleviate some of the processing burden of the hand-held host device 117. Moreover, the human interface and input system 114 need not have the input controller 316, particularly where cost is a concern. In those instances, the processor 204 can directly receive the electrical signal 312 and interpret it into a suitable input signal 122, which is mapped using the mapping techniques noted above and described in more detail below.
  • the co-pending U.S. Patent Application Serial No. 11/221,412 describes techniques to selectively map and re-map the input elements on a hand-held electronic device optimally for a particular class of application software with common requirements (e.g., games, text entry, music and scrolling) and/or for a particular user. These techniques may also be used to map and remap the input elements of the input accelerator device 100, 200 disclosed herein and/or the hand-held host device 117. Alternatively, the input accelerator device 100, 200 may simply transmit the input signals 122 in response to user manipulation of the input elements to the hand-held host device 117, where an application software executing on the hand-held host device 117 interprets the input signals accordingly.
  • a technique for remapping a hand-held electronic device includes receiving configuration settings, which may include at least one physical input element associated with at least one function, for a software application or a class of software applications; modifying a mapping function based on the configuration settings; and executing the function associated with the physical input element upon an activation, e.g., a press or actuation, of the physical input element during operation of the software application.
  • the activation of the physical input elements may be from the three input assemblies 406, 408, 409 of the input accelerator device and/or the input assemblies of the host hand-held devices.
  • mapping function may comprise a keyboard device driver, a device layout or a translation layer of the keyboard device driver, a combination of these or another mapping function.
  • the step of executing the function associated with the physical input element upon an activation of the physical input element may include writing a scan code to a buffer; retrieving the scan code from the buffer; converting the retrieved scan code to a virtual input element code using the modified device layout; calling a keyboard event with the scan code and the virtual input element code; and executing the function associated with the keyboard event, which is the function associated with the physical input element.
  • the step of executing the function associated with the physical input element upon an activation of the physical input element may include writing a scan code to a buffer; retrieving the scan code from the buffer; converting the scan code to an original virtual input element code; converting the original virtual input element code to a new input element code using the modified translation layer of the keyboard device driver; calling a keyboard event with the scan code and the new virtual input element code; and executing the function associated with the keyboard event, which is the function associated with the physical input element.
  • a method of re-configuring or re-mapping a software application or class of software applications may include associating one or more physical input elements disposed on the input accelerator device with at least a first executable function; and causing a modification of a mapping function to form an association of the one or more physical input elements with a second executable function to an association of the one or more physical input elements with the first executable function so that the first executable function is configured to be initiated upon an activation of the one or more physical input elements during operation of the software application or the a software application within a class of software applications.
  • the second executable function is typically a default function typically provided with the software application to be executed in the default state when the one or more physical input elements are pressed or activated.
  • a graphical user interface identifying functions that are available to be associated with one or more physical input elements may be provided.
  • the graphical user interface may also identify software applications for which a user can select to apply his physical input element to function associations.
  • the graphical user interface may include input element icons, which correspond to physical input elements, and function icons, which correspond to an executable function. The user may then specify the functions to associate with physical input elements.
  • FIGS. 5a-d illustrates front, side, back, and "hand-held” views, respectively, of a hand-held input accelerator device 500 upon which the human interface and input system may be implemented.
  • the input accelerator device 500 is implemented as a remote control device including four planar or contoured surfaces: a front surface 502, a back surface 508, a left side surface 504, and a right side surface 306.
  • the input accelerator device 500 may have more or fewer planar and/or contoured surfaces.
  • the input accelerator device 500 may be a miniature standalone wireless accessory device that communicates with a variety of hand-held devices such as a cellular phone, PDA, pocket PC, smart phone, laptop, or other similar devices through a wired or wireless communications protocol, such as the Bluetooth wireless protocol.
  • a display such as an LCD, and a front input assembly 526 may be disposed adjacent to each other.
  • the display may be on a separate assembly such as those displays for PDA's and cellular phones with a swivel-mounted screen or flip-phone configurations.
  • the front input assembly 526 may be disposed on more than one surface.
  • the front input assembly 526 may include four input elements 510, 512, 514, and 516, although any number of input elements may be provided, which may be actuated by a user's thumb or fingers.
  • the input elements 510, 512, 514, and 516 maybe mapped to function as shift or index keys, such as Shiftl (510), Shift2 (512), Shift3 (514), and Shift4 (516), to facilitate shifting or indexing between symbols, such as characters, letters and/or numbers, associated with input elements on the host electronic device, such as a keypad on a cellular phone or PDA.
  • shift or index keys such as Shiftl (510), Shift2 (512), Shift3 (514), and Shift4 (516)
  • symbols such as characters, letters and/or numbers
  • a keypad typically a keypad is provided, which has a "7PQRS" key or input element.
  • any one of these symbols— P, Q, R, and S-- may be entered by tapping the appropriate input element 510, 512, 514, and 516 and tapping the "7PQRS" key on the host electronic device. That is, the "P" character, e.g., can be entered on the host electronic device by pressing input element 510 (which is mapped as Shiftl) and pressing the "7PQRS” key on the host electronic device. Likewise, the Shift2 input element 512 may be pressed with the "7PQRS” key to produce the "Q” character. The Shift3 input element 514 may be pressed with the "7PQRS” key to produce the "R” character.
  • Pressing the "7" key without shift keys can either produce the number "7” or the "P” character depending on user preference, which can be configured in software.
  • the Shift4 input element 516 can be pressed with the "7PQRS" key to produce the "S” character.
  • the need to tap the same key on the host device multiple times (i.e., three times) to enter, for example the "S" character” is eliminated.
  • the implementation of multiple shift or indexing input elements as described above can dramatically improve the comfort, accuracy and speed of text entry for a variety of host hand-held device users.
  • a rear input assembly 528 may be disposed on the back surface 308.
  • the front input assembly 526 (FIG.
  • the rear input assembly 528 may include two sensor arrays configured in software to represent one or more delineated active areas corresponding to different programmable functions depending on the application.
  • the sensor arrays may include a ring-shaped curved sensor array 518 and a strip-shaped linear sensor array 520.
  • the curved sensor array 518 may be implemented to be swept sideways along a natural freedom of motion of a thumb (or finger) to map horizontal cursor movements.
  • the linear sensor array 520 may be swept vertically using the thumb (or finger) to map vertical cursor movements or control the scroll bar in a long selection list.
  • the curved 518 and linear 520 sensor arrays in this implementation may include an actuator, such as an elastomeric material, attached to a force sensitive resistor array, a capacitive mat or array, or other similar pressure sensitive device or grid that can provide multiple outputs corresponding to the pressure readings of a plurality of active areas on the sensor arrays, hi another configuration of the pressure sensor arrays 518, 520, the entire surface of the sensor arrays 518, 520 may be covered by rectangular active areas interspersed between small rectangular inactive areas to achieve any desired number of active areas. Other configurations of the pressure sensor arrays 518, 520 may be realized depending on the requirements of the desired application.
  • the rear input assembly 528 can be free of sensors and the input elements on the front input surface 502 may be programmed in software to allow the user to stroke the linear sensor array 520 up or down to effect a vertical scrolling motion in list selection.
  • This implementation facilitates the user in navigating through long lists efficiently and effectively without any additional sensors on the back.
  • the front 502 or back 508 input surfaces can optionally provide access to a miniature thumb joystick with analog inputs in both left-right and up-down directions. This thumb joystick can provide analog signals to control a game on the mobile phone host device 117.
  • the side input assembly 529 may be disposed on the left-side surface 504 and/or the right-side surface 506 as shown in FIGS. 5a-c.
  • the left side surface 504 and right side surfaces 506 of the input accelerator 300 may be implemented to include additional input or selection elements 522, 524, 526, 528, which may be used to map to other types of cellular phone functions using re-mapping techniques described above and in the co-pending U.S. Patent Application Serial No. 11/221,412.
  • the input or selection elements of the side input assembly 529 can also be implemented to effect shifting between modes.
  • holding down one of the input or selection elements 522, 524, 526, 528 may act as a shortcut key whereby a favorite application such as short message service (SMS), instant messenger (IM) or music may be activated. Holding down one of the selection elements may also act as a shortcut key to activate cellular phone functions such as phone number search and select, phone number dial, and call answer.
  • Two of the input or selection elements 522, 524 may be implemented for left-handed users and the other two selection elements 526, 528 for right- handed users.
  • the input elements 510, 512, 514, 516 of the front input assembly 526, the side input elements 522, 524, 526, 528 of the side input assembly 529, and the back input elements 518, 510 of the rear input assembly 528 in this implementation and any other implementation may be analog and/or digital buttons, keys, rockers (which may be a one or more position buttons or an analog joystick-type button), sliders, dials or touch pads used in combination with pressure sensors (such as force sensitive resistors, piezoelectric resistive sensors, and capacitive sensors), positional sensors (such as rotary encoders, linear potentiometers and the like), miniature analog thumb joysticks or other sensors or a combination of them.
  • pressure sensors such as force sensitive resistors, piezoelectric resistive sensors, and capacitive sensors
  • positional sensors such as rotary encoders, linear potentiometers and the like
  • miniature analog thumb joysticks or other sensors or a combination of them may be analog and/or digital buttons, keys, rockers
  • FIG. 6 illustrates an alternative implementation of the rear input assembly 408.
  • Input element 610 is implemented as a conventional rotary dial (such as the Blackberry thumb wheel), which may be used to control horizontal and vertical cursor, scroll, and/or navigation movements.
  • other sensors as described above may be utilized depending Upon the user age and application categories to be covered.
  • FIGS. 7a-d illustrates an implementation of the hand-held input accelerator device as a wireless headset.
  • the headset 700 may be implemented to include a thumb wheel as input element 710 on a front surface 730 that allows the user to scroll left and right.
  • the front surface 730 may also include multiple input elements 722, 724, which with the input element 710, comprise a front input assembly.
  • the front input elements 722, 724 may be actuated in conjunction with the input element 710 to perform object selections while scrolling left and right.
  • a back surface 760 of the headset 700 represents one implementation of a rear input assembly.
  • the back surface 760 may include a linear sensor array 720 to facilitate vertical scrolling, selection from long lists, and navigation operations.
  • the input elements and active areas on the four surfaces may be substantially similar to those as described above.
  • FIGS. 7b and 7c also illustrate a left side surface 740 and aright side surface 750 on which is disposed a side input assembly of the headset 700, which may be configured to include at least four side selection elements 712, 714, 716, 718 to facilitate shifting or indexing between modes and text input.
  • the selection elements may be mapped to shortcuts to variety of functions, such as dialing and answering a call.
  • Two of the selection elements 712, 714 may be implemented for left-handed users and the other two selection elements 716, 718 for right-handed users.
  • FIG. 7d depicts the headset 700 being used as a remote control. That is, by integrating the remote control inputs into the headset 700, a user can remotely perform all functions of one or more host hand-held electronic devices using just the headset 700 that serves multiple functions.
  • a host device such as a cellular phone
  • the headset 700 may be use as a regular headset receiving and transmitting audio signals through a speaker (not shown) and a microphone (not shown).
  • the headset 700 may be held in either or both hands and used to accelerate text entry.
  • the thumb wheel 710 and the sensor array 720 may be used to navigate and scroll through long lists and icon arrays.
  • the headset 700 with integrated remote control may be implemented to operate a host device, such as a cellular phone, without ever removing the host device from its storage location (e.g., the user's pocket, jacket, backpack or purse).
  • the input accelerator device described herein can be implemented as a "Master" device in communication link with multiple "Slave” or host devices.
  • the user can easily switch from one host device to another easily just by selecting the desired host device from a list of host devices that may be displayed on a screen or LC disposed on the input accelerator device.
  • a user can selectively control a host device, such as a cellular phone, to answer a phone call using the input accelerator device.
  • a host device such as a cellular phone
  • the user can put the caller on hold and look up an e-mail address from another host device, such as a PDA by selectively controlling the PDA.
  • the user can return to the phone conversation by selectively switching back to controlling the cellular phone.
  • active and/or passive tactile feedback may be implemented.
  • the input elements of the first and/or second input assemblies may be combined with a palpable detent, such as a dome cap or dome spring so that a user can tactilely perceive, through his fingers or thumbs, activation and/or deactivation of an input element.
  • the palpable detent may be positioned between the actuator and sensor components of the input elements.
  • one ore more vibratory units or force producing units may be mounted in the hand-held electronic device and activated to provide tap or index level or other information to a user.
  • the vibratory unit may be an electric motor with an eccentric mass attached to the motor's shaft, a solenoid, a variable reluctance device, a loud speaker or any other vibrator that can provide tactile feedback.
  • a force producing unit may be a solenoid in non- vibratory mode, a motor, non- vibratory actuators or any other actuator that can produce forces.
  • a vibratory unit and/or force producing unit may be provided for each input element . In that case, the vibratory unit and/or force producing unit may be mounted below the input element so that when the vibratory unit and/or force producing unit is activated, the vibratory unit and/or force producing unit can push out the surface of the electronic device to a different level or position depending on the information to be communicated.
  • a stepped array may be configured to indicate higher and higher levels of index positions across the touch pad or pressure sensor pad.
  • the vibratory units and/or force producing units may also be used to provide tactile feedback to indicate the momentary achievement of an objective, such as target lock in game applications. Tactile feedback may also be accomplished by actuators, such as a solenoid, which changes the stiffness of the input element electronically or pushes against the user's hand or fingers to indicate an event of interest in the software application.
  • the systems and techniques described above may utilize the biomechanics of the thumb and fingers, i.e., it uses the function of opposition, the fine motor control of the fingers, and the larger range of motion and stronger actuation provided by the thumb.
  • the fingers and thumb uses the function of opposition, the fine motor control of the fingers, and the larger range of motion and stronger actuation provided by the thumb.
  • a number of implementations have been described. Other implementations may include different or additional features. For example, other configurations of the one or more input elements of the front, rear and side input assemblies may be realized. Also, the input accelerator devices described herein may have more or less than six planar or contoured surfaces. Moreover, the number of input elements in the input assemblies are not limited to the number of input elements described in the implementations above. Also, the one or more input elements of the input assemblies may be any input or selection type known to one of skill in the art, such as keys, buttons, touch pads, other types of pads, rockers, sliders, dials, contact sensors or other actuators associated with any sensor.
  • Each sensor associated with an actuator may include digital momentary on/off switches or analog sensors, such as pressure sensors (e.g., force sensitive resistors, piezoelectric film sensors, or capacitive sensors), or positional sensors (e.g., rotary or linear potentiometers or encoders), or other analog sensors known to those of ordinary skill, or accelerometers or gyroscopes.
  • the input assemblies may include a combination of these different types of input or selection elements, which may be mounted in the configurations shown in the figures or imbedded within the device to permit control through motion of the overall device.
  • hybrid auxiliary input acceleration device People already carry around existing accessory devices, which can be instrumented with additional sensors to provide additional input signals to the host device for input acceleration.
  • Devices carried in the purse, in the wallet, or on a keychain are ideal because these devices already serve another primary function, and providing input acceleration via these devices may result in a convergent accelerator device that substantially improves user experience without increasing the number of items that a person needs to carry around.
  • these convergent input accelerator devices may communicate with the host device wirelessly through a Bluetooth protocol or wirelessly through a rough-line-of-sight infrared link.
  • the convergent input accelerator devices may physically plug into the host device via connectors already present in the host device, such as a headset jack or one of many data ports described above.
  • the auxiliary input accelerator device maybe a car key with a remote keyless entry device, which is a common device that most people carry on their keychain.
  • the remote keyless entry device already has a button, a radio frequency (RF) link, and an on board processor to transmit security information from the remote keyless entry device to a host vehicle to open a door, window, or a trunk; alter climate control settings; or control any other vehicle functions remotely.
  • Most remote keyless entry devices are also small in size and possess comfortable form factor.
  • One or more input assemblies including buttons, touchpads, or continuous sensor strips may be integrated into the remote keyless entry device to convert it into a hybrid device, which may function as an input accelerator device for a host device.
  • the hybrid remote keyless entry input accelerator device can communicate with the host device using a Bluetooth protocol, a long range RP protocol, or Infrared protocol.
  • the auxiliary input accelerator device may be a remote garage door opener. While these remote openers typically tend to be clipped to the visor in a car, they can also be more miniature in size and carried on a keychain. These devices can easily be augmented to have buttons and sensors appropriate for use as an input accelerator device for host device.
  • the auxiliary input accelerator device may be a programmable radio frequency identification (RFID) keyfob.
  • RFID radio frequency identification
  • the circuitry in such a keyfob may be housed inside an input accelerator with buttons, sensor arrays and a wireless communication protocol to be used as an auxiliary input accelerator device to the host device.
  • the auxiliary input accelerator device may be a smartcard.
  • a smartcard hi Europe and Asia, contactless, wireless smartcards based on similar technologies as the RFID keyfob are increasingly being used for a variety of commerce transactions. For example, in District of Columbia Metro Subway System, every terminal is smartcard enabled and people can pay for their subway rides by waving their wallet containing a prepaid smartcard in front of a grounded receptor.
  • Such smartcard may be incorporated into an input accelerator device that may be carried on a keychain.
  • the smartcard input accelerator may be used to augment interactions with a host device as well as serve as the primary mode of identification and payment in everyday life.
  • the auxiliary input accelerator device may be a universal remote control device.
  • a pocket size universal remote control device with soft keys may be configured to control all standard home entertainment devices such as televisions, DVD players, VHS players, and sound systems in addition to a host device such as a cellular phone.
  • the universal remote control device may either use the same infrared link to communicate with home entertainment devices and with the cellular phone, or it may communicate with the cellular phone using another wireless protocol, such as Bluetooth protocol.
  • the auxiliary input accelerator device may be a digital wristwatch incorporating the functionality of the input accelerator device.
  • Digital wrist watches especially running or exercise watches, typically have a digital display and a number of buttons for tracking lap times, heart rate and other important biostatistics. They also typically have a larger surface area than typical wrist watches. These watches may readily be programmed and retrofitted with optional additional sensor arrays to be used as an input accelerator for the host device.
  • the auxiliary input accelerator device may be an MP3 device such as an iPod. While multimedia content delivery on the mobile platform is becoming a norm, currently many people still carry a separate MP3 player for listening to music.
  • the iPod or other MP3 players already incorporate sensors and buttons, which may be easily augmented to be used as the input accelerator device for interfacing with the host device, such as a cellular phone.
  • the MP3 player may connect to the host device using an existing or added wireless protocol, such as Bluetooth.
  • the auxiliary input accelerator device may be an ultimate wireless converged remote controller device. Some or all of the above implementations may be combined into a single converged input accelerator device,
  • the form factor of the device may be a keyfob form factor to go on a key chain, a wrist watch form factor to go on the wrist, or any other miniature form factor that facilitate portability.
  • the ultimate converged remote controller device may perform all of the following functions in addition to controlling any additional devices possessing a short or long range wireless link.
  • the ultimate converged remote controller device may function as an input accelerator for cellular phones, with keys and optional sensor arrays; a remote keyless entry device with a long range RF circuitry; a remote garage door opener; a RFID keyfob with a short range passive RF circuitry; a smartcard for identification and commerce with a short range passive RF circuitry; an universal remote controller device for home entertainment systems; and/or any other auxiliary functions people may want to incorporate.

Abstract

A human interface and input system is implemented on an input accelerator device to remotely operate hand-held host electronic devices such as cellular phones, PDA's, pocket PC's, and smart phone's. The input accelerator device can control some or all functions of the host device to eliminate the need to directly interface with the host device. The input accelerator device may be configured to optimize a biomechanical effect of a human user's opposing thumb and fingers by including, on one surface, one or more software configurable input elements manipulatable by the user's thumb(s) or finger, and, on another surface, one or more software configurable selection elements manipulatable by a user's finger(s). The input accelerator device can be a hybrid device combining a wireless headset with the device control features.

Description

Human Interface Input Acceleration System
BACKGROUND
[0001] The following description relates to hand-held input acceleration devices for interfacing with electronic devices, such as cellular phones, personal digital assistants ("PDAs"), pocket personal computers, smart phones, hand-held game devices, bar code readers, MP3 players and other similar input devices having a keypad or one or more input elements, and also relates to human interface and input systems for use with the hand-held acceleration devices.
[0002] Electronic devices have become increasingly sophisticated and physically smaller due in part to a decrease in the price of processing power and a concurrent increase in demand by consumers for smaller devices. Such devices, however, tend to be limited in function and utility by the user's ability to interface with the device for data input (e.g., text, numeric, and functional input) and/or device control, which becomes increasingly more difficult to do as the available space on the device's surface for positioning the input elements, which are used for data input and/or device control, continues to decrease.
[0003] Moreover, as the use of applications such as text centric applications (e.g., inputting data for e-mail, instant messaging, SMS, and MMS), list navigation applications (e.g. 1-D or 2 -D navigation such as scrolling down a long list of songs to choose a song), and game applications (e.g. steering a car in a first person driving game) increases, the keypad on electronic devices, such as a cellular phone, is increasingly becoming a bottleneck to speed, accuracy and ease of data entry, playing games, picking items from long lists, web browsing, and launching applications.
[0004] For example, many hand-held electronic devices, in particular cellular phones, typically use a D-pad as the primary way to navigate up and down a list of items, such as a list of songs, on an item-by-item basis. Such item-by-item scrolling, however, is typically inefficient in navigating from the first item in the list to the last item in the list, especially if the list includes hundreds of items. Although most of these electronic devices provide the user with page up and page down functionality, which permits the user the scroll a number of items at once, e.g., some applications may associate ten items per page, often times such page up and page down functionality must be executed through multiple taps or presses of one or more input elements, typically those making up the keypad. The particular number of taps or number of input elements required to evoke such page up and down functionality typically depends on the application developer's preference, and therefore often differ from application to application within the same electronic device. Even the same application may be implemented using different user interfaces in different hand-held electronic devices.
[0005] Various human interface and input systems and techniques for hand-held electronic devices have been developed for data input and device control. These include miniature keyboards and keypads used in combination with chordal input techniques, modal input techniques and/or smart keys; and touch screens used in combination with on-screen keyboard or keypad software or hand-writing recognition software. Additionally, for gaming, some hand-held electronic devices, such as cellular phones, have incorporated miniature thumb joysticks on the face of the device itself in lieu of the directional navigation pad (D- pad).
Keyboard or Key pad Used With Chordal, Modal and Smart Key Techniques
[0006] Miniature keyboards and keypads are similar to their standard full-size versions — i.e., a keyboard generally has a full set or substantially full set of numeric, character, and functional input elements, while key pads typically have a reduced set of numeric, character and/or functional input elements compared to keyboards. These miniature input devices typically are designed to fit the available space on one surface of a hand-held electronic device or are designed as small, easily transportable, external plug-in devices. Thus, as hand-held electronic devices become smaller, the size of the input elements typically has been reduced in order for the desired number of input elements to fit on one surface of the electronic device.
[0007] For data input and device control, miniature keyboards and keypads typically either require one of two input techniques— use of one or more thumbs or fingers to press the desired input elements or use of a stylus to "peck" the desired input elements (which is usually done where the input element is of smaller size). Various techniques, such as chordal input techniques, modal input techniques and smart keys, have been developed and implemented to improve the efficiency and effectiveness of using miniature keyboards and keypads.
Chordal Input Techniques
[0008] Chordal input techniques generally are based upon the principle that characters, symbols, words, phrases or concepts can be represented by a reduced set of input elements. Thus, by only having to press a reduced combination of input elements, functionality can be increased and quicker and more accurate data input can be realized. Chordal input techniques can be used on any keyboard or keypad configuration or any device having more than one input element, and typically results in fewer input elements or more functions compared to conventional keyboards or keypads. An example of an electronic device using two-handed chordal input techniques is a court reporter or stenographer's typewriter. One chordal input technique using a keypad to decrease the number of actuations to achieve a large number of functions is described in U.S. Patent No. 5,973,621 to Levy, entitled "Compact Keyed Input Device," which is incorporated herein by reference.
Modal Input Techniques
[0009] Modal input techniques are based on the concept that functions of the electronic device, e.g., text messaging in a cell-phone or PDA, can be accessed by pressing a particular input element (or combination of elements) on a keyboard or keypad. Once that particular input element is pressed, the functionality of all or a portion of the input elements on the keyboard or keypad may change. Modal techniques typically are used in calculators, cellular phones, and PDAs. For example, in cellular phones, a modal technique called multi- tap is common, in which individual input elements on the keypad are associated with multiple symbols, such as characters, letters, numbers, icons or other types of symbols, which tends to reduce the number of input elements required to achieve the desired functions, e.g., a twelve- input-element keypad can be used to represent all letters of the English alphabet and the decimal digits. A user can input a desired symbol within a set of symbols associated with a certain input element by tapping on that particular input element with a thumb, finger, or stylus, one or more times to input the desired character. Thus, if a user desires to send a text message, the user may press a functional input element, e.g., a mode key, to access the text messaging functionality of the cellular phone and then tap an individual input element one or more times to select the associated symbol for input. The number of taps needed to input a particular symbol may differ depending on the language character set chosen. For example, Japanese keypad or keyboards typically require a minimum set of 46 characters for text input, while English or American keyboards and keypads usually require a minimum set of 26 characters for text input. These modal input techniques have gained some popularity as users perform more text functions, but these techniques can be cumbersome because to access some letters or characters, an input element on the keypad may have to be tapped three or four times. Also, in hand-held devices with a keypad, such as a cellular phone, these modal input techniques typically rely on the user's thumb, which is not generally as dexterous as the user's fingers. Smart Keys
[0010] Smart keys are typically used on keypads and refer to a single key or combination of keys that, when pressed, predict the users next logical action. Some implementations work better than others and some applications reduce the number of keystrokes required to complete a function better than others. Word-predictor software, for example, attempts to predict the word or character the user intends to input based upon one or more letters inputted by the user and the likely probabilities within a given language. The probability of the software guessing correctly increases with the length of the word or number of letters or characters inputted. In a device using smart keys on the keypad, a user may tap the keys 2, 2 and 8 in sequence to generate the word "cat" and the device would display that word first because it is usually the most common combination, whereas the word "bat," which can be generated by pressing the same keys, would not be displayed first because it is not as common. Also, the word "cat" may be displayed after pressing the 2 key the second time based on a guess by the word-predictor software.
[0011] Smart keys also are typically used for Japanese data input where a user phonetically inputs letters representing the sound of the Japanese character (e.g., a Kanji character). Based on the inputted letters, the predictor software guesses the Japanese character. To select the character, a user would press the accept button or use the scrolling function to go to the next character with a similar set of phonetic inputs.
Touch Screen Using On-Screen Keyboard or Handwriting Recognition Software
[0012] Using on-screen keyboard or keypad software with a touch screen offers users the ability to enter data with fingers or thumbs on a screen-sized keyboard or buttons, allowing faster data input without a stylus or physical keyboard or keypad accessory; while using handwriting recognition software with a touch screen, such as Graffiti™ on the Palm operating system, offers users the ability to enter text with a stylus by writing the text directly on the touch screen. Touch screens usually consume more power and are more expensive than non touch-sensitive screens. This higher power consumption can be a problem for handheld electronic devices, which typically have limited power resources. Moreover, touch screens usually require the user to use both hands (e.g., one hand is used to hold and steady the device while the other hand is used to grasp the stylus), which is generally undesirable for interfacing with and controlling one handed hand-held electronic device, such as cellular phones. Handwriting recognition software has improved the slowness and awkwardness inherent in stylus, finger or thumb input but other drawbacks still remain, such as high power consumption, the necessity to use both hands, and lack of tactile feedback to inform a user when an input element has been. Moreover, recognition software requires training to use properly, and, even then, still results in a high error rate.
Game Control
[0013] For game control, many of the above approaches have been used, but in most hand-held electronic devices, a user typically controls game play through the use of some form of input element, such as on a miniature keypad and/or D-pad, which typically is located on the front surface of the device. Game control on some hand-held electronic devices, such as cellular phones, is inherently one handed or at most two thumbed because of the size of the device, while game control on other hand-held electronic devices, such as PDAs and conventional game console controllers, is typically two-handed. The input elements associated with game control on these devices are typically digital, particularly the D-pad, even though analog input elements have been used on game controllers for PC and console game systems, such as Microsoft's Xbox or Sony's Play Station 2.
SUMMARY
[0014] The present inventors recognized that conventional human interface and input systems for hand-held electronic devices tended to be relatively inflexible, cumbersome, and inefficient to use, among other reasons, because they were not designed to take advantage of the biomechanics of the human hand, particularly the advantages associated with the opposition of the thumb to the fingers and the beneficial attributes of the thumb, e.g., its large range of motion and ability to impart large sustained forces, and the beneficial attributes of the fingers, e.g., their fine motor control, spatial memory and rapidity of motion.
[0015] The present inventors also recognized that the input techniques developed to improve the efficiency of data input and device control, such as chordal and modal techniques, were limited by the inefficiencies inherent in conventional input systems. For example, miniature keyboards and keypads used in combination with chordal input techniques not only required the user to memorize numerous input combinations and develop the necessary motor skills to control a reduced number of input elements to provide even more complex functionality compared to typical QWERTY keyboards, but also did not use or allocate input tasks to the fingers and thumb of the human hand effectively. Moreover, miniature keyboards and keypads used in combination with modal input techniques tended to limit the user's ability to efficiently input data depending on the number of taps required to input a particular symbol and how fast the user could tap the input element with his thumb or a stylus to select the particular symbol.
[0016] The present inventors also recognized that, with the emergence of multimedia capabilities, such as MP3, in many hand-held electronic devices, there is a need to support fast and intuitive scrolling and list navigation actions. For example, many hand-held electronic devices, in particular cellular phones, typically use a D-pad as the primary way to navigate up and down a list of items, such as a list of songs, on an item-by-item basis. Such item-by-item scrolling, however, is typically inefficient in navigating from the first item in the list to the last item in the list, especially if the list includes hundreds of items. Moreover, the page up and page down functionality provided on many of these devices to make it easier for a user to navigate long lists of items often must be executed through multiple taps or presses of one or more input elements. The particular number of taps or number of input elements required to evoke such page up and down functionality usually depends on the application developer's preference, and therefore often differs from application to application within the same electronic device.
[0017] The present inventors also recognized that a user's ability to control game play in such devices was greatly limited. For example, while analog game control has been available to users of PC and console game systems, analog game control generally has not been widely available on hand-held electronic devices, such as cellular phones and PDAs. As noted above, most high end games that run on a gaming platform such as the Xbox or the Play Station 2 involve analog or continuous inputs from one or more input elements, such as a miniature or full sized joystick. Cellular phones and PDAs, in contrast, provide only buttons or keys as input elements for game play. Moreover, to the present inventors' knowledge, there are no standards for input element layout for cellular phones, or in the way that the input elements are mapped to gaming functions. For example, often times, the D-pad provided on most of these cellular phones is not available to the game developer to use as a game input. The result is that directional movement input is often provided using the number input elements on the keypad, particularly the "2", "8", "4", and "6" input elements on the keypad for up, down, left and right directional movement. The present inventors recognized that this layout presents several problems. First, the input is discrete, so there is no way to provide a continuous input, such as steering a car in a first person driving game. In such as game, the car can be steered to move only left, straight, or right in preset increments, which severely limits the quality of the gaming experience. Second, directional movement is provided by the number input elements while the clearly labeled arrow keys on the D-pad remain unused. This typically requires getting used to and may create user confusion. Third, the number input elements are typically located on one end of the phone's surface, and are thus less comfortable to use than the D-pad which is typically located above the number input elements. The result is that game play is limited and not as widely adopted as it might be with a better interface.
[0018] Consequently, the present inventors have developed a flexible and efficient human interface and input system and techniques that may be implemented on a variety of small hand-held accessory devices or "input accelerator" devices, such as a key fob or remote control. An input accelerator device may connect to one or more conventional hand-held electronic devices (i.e., a host electronic device), such as a cellular phone, PDA, pocket PC, smart phone, MP3 player, or other similar devices using a wired or wireless communication protocol, such as Bluetooth, and remotely control all functions of the connected host electronic devices. The input accelerator device may be used in conjunction with the input elements on the host electronic device to accelerate the user's ability to perform functions such as text input, game play, list navigation and scrolling. Alternatively, the input accelerator device can even eliminate the need to directly interface with the inefficient human interface and input systems of the connected host electronic devices. The input accelerator device may also be implemented to include various hybrid devices including a wireless headset in addition to the functions of a remote control. The input accelerator device (whether one handed or two handed) may also be implemented to utilize the opposed thumb and finger ergonomics inherent in the hand and the skills already developed for using conventional input techniques to accomplish data input, list navigation, device control, and game control in a timely, efficient, comfortable, fun, and intuitive manner. Thus, no specialized training beyond that normally expected with any newly purchased hand-held device is expected.
[0019] Implementations of the human interface and input system and techniques for the input accelerator device described here may include various combinations of the following features.
[0020] The input accelerator device may include or be configured to include a communication channel configured to interface with a hand-held host device, an input assembly having a number of input elements that can be selectively mapped to one or more functions of a software application in order to minimize the number of times a particular input element on the hand-held host device needs to be actuated (which may none), and an input controller communicatively coupled to the input assembly and the communication channel, the input controller being configured to generate an input signal upon actuation of at least one of the input elements and being further configured to relay the input signal to the communication channel for transmission to the hand-held host device to control execution of the one or more functions of the software application mapped to the actuated input element. The input accelerator device may also include a display unit for displaying textual, graphical and video information. The input accelerator device may also include a storage device for storing instructions, such as firmware, mapping software and/or software applications, such as text applications, scrolling/navigational applications and game applications. The input accelerator device may further include a processor configured to interpret the input signal and execute the instructions, a main memory configured to load the instructions and a bus configured to direct communications to and from the processor.
[0021] The input assembly may include a front input assembly, a rear input, and/or a side input assembly. The input elements of the input assembly may include or more of the following types of input elements: analog buttons, digital buttons, keys, rockers, sliders, rotary dials, touch pads, pressure sensors, force sensitive resistors, piezoelectric resistive sensors, capacitive sensors, positional sensors, rotary encoders, linear potentiometers, directional or D-pads, and miniature analog thumb joysticks. The communication channel may be a Universal Serial Bus port, an IEEE 1394 Firewire port, a serial port, a parallel port, a headphone port, and/or a data port. The communication channel may also be a wireless data connection such as a Bluetooth connection, an Infrared connection, and a Wi-Fi connection.
[0022] In another implementation, a technique of controlling multiple hand-held host devices may include providing an input accelerator device having a plurality of input elements, actuating one of the plurality of input elements; interpreting a generated input signal based on the one or more functions mapped to the actuated input element; and executing the one or more functions mapped to the actuated element. The method may also include configuring one of the plurality of input elements to be mapped to one or more indexing functions, and actuating an input element on one of the plurality of hand-held host devices in conjunction with the input element mapped to one or more indexing functions.
[0023] The input accelerator device and human interface and input systems and techniques described herein may provide one or more of the following advantages. The human interface and input system and associated techniques offer the functionality of a high performance game controller, which can support the most demanding game input requirements, and the speed and accuracy of data input that can be obtained with the use of a conventional standard QWERTY keyboard, but without the large footprint. Also, the human interface and input system and associated techniques can increase the number of functions that may be associated with a given number of input elements without increasing the number of keystrokes or taps that is required. Moreover, it allows the input element size to remain consistent with the ergonomics of the human hand without increasing the time it takes to learn how to use the input system compared to conventional input systems.
[0024] Implementing the human interface and input system and techniques on an input accelerator device can eliminate the need to interface with inflexible, cumbersome, and inefficient input systems provided with conventional hand-held electronic devices. Since the input accelerator device can connect to multiple hand-held electronic devices using wired or wireless communication protocols a singled input accelerator device can make up for deficiencies of multiple conventional hand-held electronic devices. Thus, the input accelerator device can eliminate the need to retrofit or redesign conventional hand-held electronic devices to directly implement the disclosed human interface and input system and associated techniques, hi addition, the input accelerator device can be small and aesthetically valuable as a fashion accessory. For example, the input accelerator device may be implemented to include logos of sports teams or cartoon characters in addition to a wide selection of colors. The input accelerator device also may be easily attached to a keychain or a phone leash or clipped on or carried in a pocket or purse.
[0025] Details of one or more implementations are set forth in the accompanying drawings and the description below. Other features and advantages will be apparent from the description and drawings, and from the claims.
DESCRIPTION OF DRAWINGS
[0026] FIG. 1 is a block diagram of a hand-held input accelerator device upon which the human interface and input system may be implemented.
[0027] FIG. 2 is another block diagram of a hand-held input accelerator device upon which the human interface and input system may be implemented.
[0028] FIG. 3 is a block diagram of the human interface and input system.
[0029] FIG. 4 is a detailed block diagram of the input assembly of the human interface and input system. [0030] FIGS. 5a-d show front, side, and back views, respectively, of a hand-held input accelerator device wherein a second input assembly includes a pressure sensor arrays having a plurality of configurable active areas.
[0031] FIG. 6 illustrates an alternate implementation of the second input assembly on a hand-held input accelerator device.
[0032] FIGS. 7a-d depict one implementation of a hand-held input accelerator device comprising a combination of a remote control and a wireless headset.
[0033] Like reference symbols in the various drawings indicate like elements.
DETAILED DESCRIPTION
Biomechanics of the Human Hand
[0034] The human hand comprises an opposable thumb and four fingers, i.e., the thumb may be used in opposition, in concert, in combination or functional relation with any of the four fingers. Compared to the human fingers, the human thumb may be characterized as having larger range of motion, stronger sustaining force actuation and poorer dexterity. The human base joint of the thumb has three degrees of freedom, such as side-to-side movement, up and down movement, and rotation about the thumb's long axis; while the base joint of the fingers has two degrees of freedom, such as side-to-side and up and down movement. Thus, the thumb typically is considered to have better range of motion than any of the fingers. Also, because the human thumb has a bigger actuation muscle than any of the fingers, it can provide larger sustaining forces than the fingers. But also because of the larger muscle, the human thumb may suffer from diminished fine motor control and rapidity of motion that can be exerted compared to the fingers. Thus, the human fingers are more suitable for performing tasks that require fine motor coordination or the ability to pinpoint or rapidly repeat actuation.
Hand-Held Input Accelerator Device Hardware Overview
[0035] FIG. 1 is a high-level block diagram of a hand-held input accelerator device 100 upon which the human interface and input system and associated input techniques described herein may be implemented for controlling software applications stored and running on a hand-held host device 117. The input accelerator device 100 is a companion auxiliary device to the hand-held host device 117, whereby a user may interface with the auxiliary device and the hand-held host device concurrently 117 or the auxiliary device alone in lieu of the hand-held host device 117. The input accelerator device 100 is communicatively coupled to a hand-held host device 117, such as a cellular phone, PDA, pocket PC, or smart phone, or other similar devices using a communication link 111, such as the Bluetooth protocol. The Bluetooth protocol is a short-range, low-power 1 Mbit/sec wireless network technology operated in the 2.4 GHz band, which is appropriate for use in piconets. Apiconet can have a master and up to seven slaves. The master transmits in even time slots, while slaves transmits in odd time slots. The devices in a piconet share a common communication data channel with total capacity of 1 Mbit/sec. Headers and handshaking information are used by Bluetooth devices to strike up a conversation and find each other to connect.
[0036] The communication link 111 alternatively may be a wired link using standard data ports such as Universal Serial Bus interface, IEEE 1394 firewire, or other serial or parallel port connections. Additionally, the communication link 111 can be other standard wireless links such as infrared, wireless fidelity (Wi-Fi), or any other wireless connection. Wi-Fi refers to any type of IEEE 802.11 protocol including 802.11a/b/g. Wi-Fi generally provides wireless connectivity for a device to the Internet or connectivity between devices. Wi-Fi operates in the unlicensed 2.4 GHz radio bands, with an 11 Mbit/sec (802.11b) or 54 Mbit/sec (802.11a) data rate or with products that contain both bands. Infrared refers to light waves of a lower frequency out of range of what a human eye can perceive. Used in most television remote control systems, information is carried between devices via beams of infrared light. The standard infrared system is called infrared data association (IrDA) and is used to connect some computers with peripheral devices in digital mode.
[0037] The communication link 111 connects a communication interface 116 of the input accelerator device with a communication interface 118 of the hand-held host device 117. The input accelerator device 100 includes an interface and input system 114 in communication with the communication interface 116. The interface and input system 114 includes input elements (not shown), such as keys, buttons, pressure sensor pads, touch pads, rotary dials, thumb joysticks, linear strip sensors or other actuators associated with one or more sensors that can be manipulated by one or both of a human user's thumbs or fingers. The input elements are selectively mapped to one or more functions of the software applications stored on the host device 100. The mapping or re-mapping of the input elements to one or more functions of the software applications may be accomplished by using one of the techniques disclosed in co-pending U.S. Patent Application Serial No. 11/221 ,412, entitled "A Method of Remapping the ftiput Elements of a Hand-Held Device," which is incorporated herein in its entirety by reference.
In this implementation, the interface and input assembly 114 is implemented with four input elements, but may be implemented with more or fewer input elements. Upon actuation of an input element, an electrical signal is generated by the input assembly 114. The generated electrical signal is converted into input signals 122, which are transmitted over the communication link 111 to the hand-held host device 117, which receives the input signals 122 through communication interface 118. The input signals 122 are processed by the handheld host device 117 to execute the software function mapped to the actuated input element. Typically, hand-held host device 117 has a processor (not shown), such as an ARM, OMAP, or other similar processor for processing the input signals and the software applications stored and running thereon.
[0038] FIG. 2 is a block diagram illustrating an input accelerator device 200 upon which the human interface and input system and associated input techniques described herein may be implemented, hi this implementation, optional hardware components are implemented to configure a more powerful auxiliary device to handle more of the processing duties from the hand-held host device 117 onto the input accelerator device 200. The input accelerator device 200 may be used in conjunction with the hand-held host device 117 to control software applications stored and running on the input accelerator device 200 itself. For example, in this implementation, the input accelerator device 200 may have stored and running thereon re-mapping software such as that described in co-pending U.S. Patent Application Serial No. 11/221,412. As another example, the input accelerator device 200 may have stored and running thereon an Internet browsing application, which may be used in combination with communication functionality provided with hand-held host devices, such as the cellular communication protocols (e.g., CDMA or GSM/GPRS) provided with cellular phones, to browse the Internet.
[0039] The input accelerator device 200 is in wireless (or alternatively wired) communication with the hand-held host device 117. The hand-held host device 117 may include some of the same components as shown for the input accelerator device 200. In this implementation, the hand-held host device 117 is a conventional cellular phone, but other types of hand-held electronic devices may be used with the input accelerator device 200. The input accelerator device 200 may include a bus 202 or other communication mechanism for communicating information, and a processor 204, such as an ARM, OMAP or other similar processor, coupled with bus 202 for processing information, such as one or more sequences of one or more instructions, which may be embedded software, firmware, or software applications for controlling the hand-held host device 117, such as re-mapping software or text, gaming or scrolling applications, or any other software application.
[0040] The input accelerator device 200 also may include a main memory 206, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 202 for storing information and instructions to be executed by processor 204. Main memory 206 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 204. The input accelerator device 100 further may include a read only memory (ROM) 208 or other static storage device coupled to bus 202 for storing static information and instructions for processor 204. A storage device 210 may be provided and coupled to bus 202 for storing information and instructions for the processor 204. The storage device 210 can include a flash memory such as EEPROM, compact flash, or a similar storage unit for storing device firmware. Upgrades to the firmware can be easily downloaded through the host device. The input accelerator device 200 may also include an optional display 212, such as a liquid crystal display (LCD), for displaying information to a user, and a human interface and input system 114 for communicating information and command selections from a human user to processor 204. The command selections from a human user are communicated as input signals 122 from the interface and input system 114 to the bus 202 for distribution to other components such as the processor 204. Input accelerator device 200 also may include a communication interface 216 coupled to bus 202.
[0041] Communication interface 216 provides a two-way data communication 211 coupling to the hand-held host device 117, a wireless service device, or wireless service station. The two-way data communication 211 allows for an exchange of interactive data between the hand-held host device 117 and the input accelerator device 200. The interactive data may include voice data for conducting a conversation using a cellular phone host device. The interactive data may also include a graphical user interface (GUI) for browsing the Internet, which may be displayed on the optional display 212. In this implementation, the cellular phones host device serves as a communication conduit for receiving data from the Internet as previously mentioned. Communication interface 216 may be a wireless link such as Bluetooth or any other wireless communication interface known to one of ordinary skill in the art. In the wireless link implementation, communication interface 216 may send and receive electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
[0042] The input accelerator device 200 also can display a graphical user interface (GUI) on the display unit 212 to provide a list of hand-held host devices 117 within communication range of the input accelerator device 200. The list of hand-held host devices 117 within communication range can be displayed using text names of each device, an icon representing each device, or a combination of text name and icon representing each device. The input elements in the input assemblies 406, 408, 409 (described in detail in FIG. 4 below) can be actuated in combination or individually to select a desired hand-held host device 117 from the list of devices in communication range of the input accelerator device 200.
[0043] The input accelerator device 100, 200 as described above can obviate the need to remove the hand-held host device 117 from the user's pocket, bag or other storage location by performing most simple text/voice control functions. The input accelerator device 100, 200 may also include a device driver (not shown) to effect control over the host hand-held device 117 and all associated software applications on the hand-held host device 117.
Human Interface and Input System Overview
[0044] FIG. 3 depicts a block diagram of the subsystems of the human interface and input system 114 of the input accelerator device 100 or the input accelerator device 200. The human interface and input system 114, which is described in more detail in co-pending U.S. Patent Application Serial No. 10/699,555, entitled "Human Interface System," which is incorporated herein in its entirety by reference, includes an input assembly 305 in communication with an input controller 316 to interpret and generate input signals in response to user interaction with the input assembly 305. The input assembly 305 can include multiple input assemblies (described in detailed below in FIG. 4), each assembly including a number of input elements, located on one or more surfaces of the input accelerator device 100 or the input accelerator device 200. The input elements are selectively mapped to one or more functions of a software application that is stored on the hand-held host device 117 so that when one of the input elements is actuated, the function mapped to the actuated input element is executed.
Specifically, when an input element is actuated, one or more electrical signals 312 are produced, which are received and interpreted by the input controller 316. The input controller 316, which may include one or more processors, receives the one or more electrical signals 312 and converts them into input signals 122 which are transmitted to the hand-held host device 117 via communication link 111 connecting the communication interface 116 of the input accelerator device 100 with the communication interface 118 of the hand-held host device 117. Similarly, the input signals 122 are transmitted to the hand-held host device 117 via communication link 211 connecting the communication interface 216 of the input accelerator device 200 with the communication interface 118 of the hand-held host device 117. In one implementation the hand-held host device 117 interprets the input signals 122 on the fly using software, such as mapping software, to execute the function mapped to the actuated input element. Alternatively, the input accelerator device 200 may interpret the input signals 122 using software stored in the storage unit 210.
[0045] FIG. 4 illustrates one implementation of input assembly 305 including multiple input assemblies. The input assembly 305 includes a front input assembly 406, a rear input assembly 408, and a side input assembly 409. The front input assembly 406 and the rear input assembly 408 includes one or more input elements. The input elements produce one or more electrical signals 312 upon actuation of the input elements. The input controller 316, which may include one or more processors, receives the one or more electrical signals 312 and converts them into input signals 122, which are in a form suitable to be received and interpreted by the hand-held host device 117. Alternatively the input signal 122 may be interpreted by the processor 104 on the input accelerator device 200.
[0046] The hand-held host device 117 receives the input signals 122 and interprets it using the re-mapping software noted above and described in more detail below, which may be loaded on the host hand-held device. Specifically, the input signals 122 transmitted from the input accelerator device 100,200 are received by a communication interface 118 on the hand-held host device 117 using standard communications protocols, such as the Bluetooth wireless protocol. The Bluetooth protocol allows the input signals 122 transmitted from the input accelerator device 100, 200to control execution of embedded software, firmware, or software applications, such as a text messaging or game applications, on the hand-held host device 117. The input signals 122 are received and used by the hand-held host device 117 to map and remap the input elements in the front input assembly 406, the rear input assembly 408 and the side input assembly 409 to one or more software functions of a software application running on the host hand-held device 117.
[0047] For example, if a text application is running on the hand-held host device 117, then an input controller (not shown) on the hand-held host device 117 maps one or more input elements on the hand-held host device 117 (e.g., input elements forming the keypad on a cellular phone) to one or more symbols, such as characters, letters, numbers, icons, other types of symbols, or combinations of different types of symbols, and map one or more input elements of the front input assembly 406 on the input accelerator device 100, 200 to a shifting or indexing functionality. Thus, if a user wants to insert the letter "X", the user may press a first shift key on the input accelerator device 100, 200 and then the number key "9" on the hand-held host device 117. If the user wants to insert the letter "Y", the user may press a second shift key on the input accelerator device 100, 200 and then the number key "9" on the hand-held host device 117. If the user wants to insert the letter "Z", the user may press a third shift key on the input accelerator device 100,200 and then the number key "9" on the hand-held host device 117 So instead of having to press the number key "9" on the hand-held host device 117 three times to insert the letter "Z", which is the norm on most multi-tap interfaces, the user can insert the same letter with one press of the number key "9" on the hand-held host device 117 in combination with one press of the third shift key on the input accelerator device 100, 200.
[0048] Also, one or more input elements of the rear input assembly 408 on the input accelerator device 100, 200 can be mapped to scrolling, navigation, or cursor control functions. Furthermore, one or more input elements of the side input assembly 409 can be mapped as a short-cut key for executing a favorite application on the host hand-held device 117, such as a text, game or music application. If the hand-held host device 117 is executing a game application, then the input signals 122 may be used to control game play. That is, the input controller (not shown) on the hand-held host device 117 may map the input elements of the input assemblies 406, 408, 409 from the input accelerator device 100, 200 to game functions. The mapping of the input elements to particular input functions for a given software application, whether done by an input controller or processor on the hand-held host device 117 in response to the input signals 122 transmitted by the input accelerator device 100, 200 , may be customized by the application developer or the user through downloads or other programming modalities. Moreover, the mapping of the input elements may be done for language key set changes, which may reduce the cost of manufacturing hand-held electronic devices for manufacturers servicing multiple countries.
[0049] Alternatively, the processor 204 of the input accelerator device 200 may perform the mapping function described above and alleviate some of the processing burden of the hand-held host device 117. Moreover, the human interface and input system 114 need not have the input controller 316, particularly where cost is a concern. In those instances, the processor 204 can directly receive the electrical signal 312 and interpret it into a suitable input signal 122, which is mapped using the mapping techniques noted above and described in more detail below.
[0050] The co-pending U.S. Patent Application Serial No. 11/221,412, describes techniques to selectively map and re-map the input elements on a hand-held electronic device optimally for a particular class of application software with common requirements (e.g., games, text entry, music and scrolling) and/or for a particular user. These techniques may also be used to map and remap the input elements of the input accelerator device 100, 200 disclosed herein and/or the hand-held host device 117. Alternatively, the input accelerator device 100, 200 may simply transmit the input signals 122 in response to user manipulation of the input elements to the hand-held host device 117, where an application software executing on the hand-held host device 117 interprets the input signals accordingly.
[0051] In one implementation, a technique for remapping a hand-held electronic device includes receiving configuration settings, which may include at least one physical input element associated with at least one function, for a software application or a class of software applications; modifying a mapping function based on the configuration settings; and executing the function associated with the physical input element upon an activation, e.g., a press or actuation, of the physical input element during operation of the software application. The activation of the physical input elements may be from the three input assemblies 406, 408, 409 of the input accelerator device and/or the input assemblies of the host hand-held devices. As described above, using standard wireless communication protocols, such as Bluetooth, signals generated from the physical activations of the input assemblies of the input accelerator device 100,200 is transmitted to the hand-held host device 117 to control execution of specific software or software application. And in response to the execution of the software or software application by the signal transmitted from the input accelerator device, mapping and remapping procedures are performed. The mapping function may comprise a keyboard device driver, a device layout or a translation layer of the keyboard device driver, a combination of these or another mapping function.
[0052] In an implementation where the mapping function comprises a device layout, the step of executing the function associated with the physical input element upon an activation of the physical input element may include writing a scan code to a buffer; retrieving the scan code from the buffer; converting the retrieved scan code to a virtual input element code using the modified device layout; calling a keyboard event with the scan code and the virtual input element code; and executing the function associated with the keyboard event, which is the function associated with the physical input element. [0053] In an implementation where the mapping function comprises a translation layer, the step of executing the function associated with the physical input element upon an activation of the physical input element may include writing a scan code to a buffer; retrieving the scan code from the buffer; converting the scan code to an original virtual input element code; converting the original virtual input element code to a new input element code using the modified translation layer of the keyboard device driver; calling a keyboard event with the scan code and the new virtual input element code; and executing the function associated with the keyboard event, which is the function associated with the physical input element.
[0054] hi another implementation, a method of re-configuring or re-mapping a software application or class of software applications may include associating one or more physical input elements disposed on the input accelerator device with at least a first executable function; and causing a modification of a mapping function to form an association of the one or more physical input elements with a second executable function to an association of the one or more physical input elements with the first executable function so that the first executable function is configured to be initiated upon an activation of the one or more physical input elements during operation of the software application or the a software application within a class of software applications. The second executable function is typically a default function typically provided with the software application to be executed in the default state when the one or more physical input elements are pressed or activated.
[0055] In yet another implementation , a graphical user interface identifying functions that are available to be associated with one or more physical input elements may be provided. The graphical user interface may also identify software applications for which a user can select to apply his physical input element to function associations. In one instance the graphical user interface may include input element icons, which correspond to physical input elements, and function icons, which correspond to an executable function. The user may then specify the functions to associate with physical input elements.
Hand-Held Input Accelerator Device Implementations
[0056] FIGS. 5a-d illustrates front, side, back, and "hand-held" views, respectively, of a hand-held input accelerator device 500 upon which the human interface and input system may be implemented. In one implementation, the input accelerator device 500 is implemented as a remote control device including four planar or contoured surfaces: a front surface 502, a back surface 508, a left side surface 504, and a right side surface 306. Although, in other implementations, the input accelerator device 500 may have more or fewer planar and/or contoured surfaces. The input accelerator device 500 may be a miniature standalone wireless accessory device that communicates with a variety of hand-held devices such as a cellular phone, PDA, pocket PC, smart phone, laptop, or other similar devices through a wired or wireless communications protocol, such as the Bluetooth wireless protocol.
[0057] As shown in FIG. 5 a, on the front surface 502, a display (not shown), such as an LCD, and a front input assembly 526 may be disposed adjacent to each other. Alternatively, the display may be on a separate assembly such as those displays for PDA's and cellular phones with a swivel-mounted screen or flip-phone configurations. Also, the front input assembly 526 may be disposed on more than one surface. The front input assembly 526 may include four input elements 510, 512, 514, and 516, although any number of input elements may be provided, which may be actuated by a user's thumb or fingers. The input elements 510, 512, 514, and 516 maybe mapped to function as shift or index keys, such as Shiftl (510), Shift2 (512), Shift3 (514), and Shift4 (516), to facilitate shifting or indexing between symbols, such as characters, letters and/or numbers, associated with input elements on the host electronic device, such as a keypad on a cellular phone or PDA. For example, on a host electronic device, such as a cellular phone, typically a keypad is provided, which has a "7PQRS" key or input element. By using the input accelerator device 500, any one of these symbols— P, Q, R, and S-- may be entered by tapping the appropriate input element 510, 512, 514, and 516 and tapping the "7PQRS" key on the host electronic device. That is, the "P" character, e.g., can be entered on the host electronic device by pressing input element 510 (which is mapped as Shiftl) and pressing the "7PQRS" key on the host electronic device. Likewise, the Shift2 input element 512 may be pressed with the "7PQRS" key to produce the "Q" character. The Shift3 input element 514 may be pressed with the "7PQRS" key to produce the "R" character. Pressing the "7" key without shift keys can either produce the number "7" or the "P" character depending on user preference, which can be configured in software. The Shift4 input element 516 can be pressed with the "7PQRS" key to produce the "S" character. Thus, the need to tap the same key on the host device multiple times (i.e., three times) to enter, for example the "S" character" is eliminated. The implementation of multiple shift or indexing input elements as described above can dramatically improve the comfort, accuracy and speed of text entry for a variety of host hand-held device users. [0058] As shown in FIG. 5b, a rear input assembly 528 may be disposed on the back surface 308. In this implementation, the front input assembly 526 (FIG. 5a) is disposed relative to the rear input assembly 528 to take advantage of the opposition of the human thumb and finger. Alternatively, a user may flip over the input accelerator device to use the rear input assembly his thumb instead of his fingers. The rear input assembly 528 may include two sensor arrays configured in software to represent one or more delineated active areas corresponding to different programmable functions depending on the application. The sensor arrays may include a ring-shaped curved sensor array 518 and a strip-shaped linear sensor array 520. The curved sensor array 518 may be implemented to be swept sideways along a natural freedom of motion of a thumb (or finger) to map horizontal cursor movements. In addition, the linear sensor array 520 may be swept vertically using the thumb (or finger) to map vertical cursor movements or control the scroll bar in a long selection list. The curved 518 and linear 520 sensor arrays in this implementation may include an actuator, such as an elastomeric material, attached to a force sensitive resistor array, a capacitive mat or array, or other similar pressure sensitive device or grid that can provide multiple outputs corresponding to the pressure readings of a plurality of active areas on the sensor arrays, hi another configuration of the pressure sensor arrays 518, 520, the entire surface of the sensor arrays 518, 520 may be covered by rectangular active areas interspersed between small rectangular inactive areas to achieve any desired number of active areas. Other configurations of the pressure sensor arrays 518, 520 may be realized depending on the requirements of the desired application.
[0059] Alternatively, the rear input assembly 528 can be free of sensors and the input elements on the front input surface 502 may be programmed in software to allow the user to stroke the linear sensor array 520 up or down to effect a vertical scrolling motion in list selection. This implementation facilitates the user in navigating through long lists efficiently and effectively without any additional sensors on the back. Additionally, the front 502 or back 508 input surfaces can optionally provide access to a miniature thumb joystick with analog inputs in both left-right and up-down directions. This thumb joystick can provide analog signals to control a game on the mobile phone host device 117.
[0060] The side input assembly 529 may be disposed on the left-side surface 504 and/or the right-side surface 506 as shown in FIGS. 5a-c. The left side surface 504 and right side surfaces 506 of the input accelerator 300 may be implemented to include additional input or selection elements 522, 524, 526, 528, which may be used to map to other types of cellular phone functions using re-mapping techniques described above and in the co-pending U.S. Patent Application Serial No. 11/221,412. The input or selection elements of the side input assembly 529 can also be implemented to effect shifting between modes. For example, holding down one of the input or selection elements 522, 524, 526, 528 may act as a shortcut key whereby a favorite application such as short message service (SMS), instant messenger (IM) or music may be activated. Holding down one of the selection elements may also act as a shortcut key to activate cellular phone functions such as phone number search and select, phone number dial, and call answer. Two of the input or selection elements 522, 524 may be implemented for left-handed users and the other two selection elements 526, 528 for right- handed users.
[0061] It is to be understood that the input elements 510, 512, 514, 516 of the front input assembly 526, the side input elements 522, 524, 526, 528 of the side input assembly 529, and the back input elements 518, 510 of the rear input assembly 528 in this implementation and any other implementation may be analog and/or digital buttons, keys, rockers (which may be a one or more position buttons or an analog joystick-type button), sliders, dials or touch pads used in combination with pressure sensors (such as force sensitive resistors, piezoelectric resistive sensors, and capacitive sensors), positional sensors (such as rotary encoders, linear potentiometers and the like), miniature analog thumb joysticks or other sensors or a combination of them.
[0062] FIG. 6 illustrates an alternative implementation of the rear input assembly 408. Input element 610 is implemented as a conventional rotary dial (such as the Blackberry thumb wheel), which may be used to control horizontal and vertical cursor, scroll, and/or navigation movements. In other implementations, other sensors as described above may be utilized depending Upon the user age and application categories to be covered.
[0063] FIGS. 7a-d illustrates an implementation of the hand-held input accelerator device as a wireless headset. As shown in FIG. 7a, the headset 700 may be implemented to include a thumb wheel as input element 710 on a front surface 730 that allows the user to scroll left and right. The front surface 730 may also include multiple input elements 722, 724, which with the input element 710, comprise a front input assembly. The front input elements 722, 724 may be actuated in conjunction with the input element 710 to perform object selections while scrolling left and right.
[0064] As shown in FIG. 7b, a back surface 760 of the headset 700 represents one implementation of a rear input assembly. The back surface 760 may include a linear sensor array 720 to facilitate vertical scrolling, selection from long lists, and navigation operations. The input elements and active areas on the four surfaces may be substantially similar to those as described above.
[0065] FIGS. 7b and 7c also illustrate a left side surface 740 and aright side surface 750 on which is disposed a side input assembly of the headset 700, which may be configured to include at least four side selection elements 712, 714, 716, 718 to facilitate shifting or indexing between modes and text input. The selection elements may be mapped to shortcuts to variety of functions, such as dialing and answering a call. Two of the selection elements 712, 714 may be implemented for left-handed users and the other two selection elements 716, 718 for right-handed users.
[0066] FIG. 7d depicts the headset 700 being used as a remote control. That is, by integrating the remote control inputs into the headset 700, a user can remotely perform all functions of one or more host hand-held electronic devices using just the headset 700 that serves multiple functions. When talking or listening to music on a host device, such as a cellular phone, the headset 700 may be use as a regular headset receiving and transmitting audio signals through a speaker (not shown) and a microphone (not shown). When inputting text, the headset 700 may be held in either or both hands and used to accelerate text entry. When executing applications on host devices, the thumb wheel 710 and the sensor array 720 may be used to navigate and scroll through long lists and icon arrays. Thus, the headset 700 with integrated remote control may be implemented to operate a host device, such as a cellular phone, without ever removing the host device from its storage location (e.g., the user's pocket, jacket, backpack or purse).
[0067] Moreover, the input accelerator device described herein can be implemented as a "Master" device in communication link with multiple "Slave" or host devices. The user can easily switch from one host device to another easily just by selecting the desired host device from a list of host devices that may be displayed on a screen or LC disposed on the input accelerator device. For example, a user can selectively control a host device, such as a cellular phone, to answer a phone call using the input accelerator device. While talking to the caller using the headset 700, the user can put the caller on hold and look up an e-mail address from another host device, such as a PDA by selectively controlling the PDA. After retrieving the e-mail address, the user can return to the phone conversation by selectively switching back to controlling the cellular phone.
[0068] In any of the above implementations, active and/or passive tactile feedback may be implemented. To provide passive tactile feedback, the input elements of the first and/or second input assemblies may be combined with a palpable detent, such as a dome cap or dome spring so that a user can tactilely perceive, through his fingers or thumbs, activation and/or deactivation of an input element. hi one implementation, among others, the palpable detent may be positioned between the actuator and sensor components of the input elements. To provide active tactile feedback, one ore more vibratory units or force producing units may be mounted in the hand-held electronic device and activated to provide tap or index level or other information to a user. The vibratory unit may be an electric motor with an eccentric mass attached to the motor's shaft, a solenoid, a variable reluctance device, a loud speaker or any other vibrator that can provide tactile feedback. A force producing unit may be a solenoid in non- vibratory mode, a motor, non- vibratory actuators or any other actuator that can produce forces. A vibratory unit and/or force producing unit may be provided for each input element . In that case, the vibratory unit and/or force producing unit may be mounted below the input element so that when the vibratory unit and/or force producing unit is activated, the vibratory unit and/or force producing unit can push out the surface of the electronic device to a different level or position depending on the information to be communicated. Thus, in implementations using a pressure sensor pad or touch-pad as the input element, a stepped array may be configured to indicate higher and higher levels of index positions across the touch pad or pressure sensor pad. The vibratory units and/or force producing units may also be used to provide tactile feedback to indicate the momentary achievement of an objective, such as target lock in game applications. Tactile feedback may also be accomplished by actuators, such as a solenoid, which changes the stiffness of the input element electronically or pushes against the user's hand or fingers to indicate an event of interest in the software application.
[0069] The computational aspects described here can be implemented in analog or digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. Where appropriate, aspects of these systems and techniques can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor; and method steps can be performed by a programmable processor executing a program of instructions to perform functions by operating on input data and generating output.
[0070] The systems and techniques described above may utilize the biomechanics of the thumb and fingers, i.e., it uses the function of opposition, the fine motor control of the fingers, and the larger range of motion and stronger actuation provided by the thumb. By using the fingers and thumb in concert, the number of taps and time needed to accomplish a given function is reduced, the accuracy is improved, and the natural programming inherent in the human hand replaces the training required for other systems.
[0071 ] A number of implementations have been described. Other implementations may include different or additional features. For example, other configurations of the one or more input elements of the front, rear and side input assemblies may be realized. Also, the input accelerator devices described herein may have more or less than six planar or contoured surfaces. Moreover, the number of input elements in the input assemblies are not limited to the number of input elements described in the implementations above. Also, the one or more input elements of the input assemblies may be any input or selection type known to one of skill in the art, such as keys, buttons, touch pads, other types of pads, rockers, sliders, dials, contact sensors or other actuators associated with any sensor. Each sensor associated with an actuator may include digital momentary on/off switches or analog sensors, such as pressure sensors (e.g., force sensitive resistors, piezoelectric film sensors, or capacitive sensors), or positional sensors (e.g., rotary or linear potentiometers or encoders), or other analog sensors known to those of ordinary skill, or accelerometers or gyroscopes. The input assemblies may include a combination of these different types of input or selection elements, which may be mounted in the configurations shown in the figures or imbedded within the device to permit control through motion of the overall device.
[0072] Further, other implementations of the hybrid auxiliary input acceleration device are possible. People already carry around existing accessory devices, which can be instrumented with additional sensors to provide additional input signals to the host device for input acceleration. Devices carried in the purse, in the wallet, or on a keychain are ideal because these devices already serve another primary function, and providing input acceleration via these devices may result in a convergent accelerator device that substantially improves user experience without increasing the number of items that a person needs to carry around. Like the standalone remote control implementation, these convergent input accelerator devices may communicate with the host device wirelessly through a Bluetooth protocol or wirelessly through a rough-line-of-sight infrared link. Alternatively, the convergent input accelerator devices may physically plug into the host device via connectors already present in the host device, such as a headset jack or one of many data ports described above.
[0073] m another implementation, the auxiliary input accelerator device maybe a car key with a remote keyless entry device, which is a common device that most people carry on their keychain. The remote keyless entry device already has a button, a radio frequency (RF) link, and an on board processor to transmit security information from the remote keyless entry device to a host vehicle to open a door, window, or a trunk; alter climate control settings; or control any other vehicle functions remotely. Most remote keyless entry devices are also small in size and possess comfortable form factor. One or more input assemblies including buttons, touchpads, or continuous sensor strips may be integrated into the remote keyless entry device to convert it into a hybrid device, which may function as an input accelerator device for a host device. The hybrid remote keyless entry input accelerator device can communicate with the host device using a Bluetooth protocol, a long range RP protocol, or Infrared protocol.
[0074] hi yet another implementation, the auxiliary input accelerator device may be a remote garage door opener. While these remote openers typically tend to be clipped to the visor in a car, they can also be more miniature in size and carried on a keychain. These devices can easily be augmented to have buttons and sensors appropriate for use as an input accelerator device for host device.
[0075] hi one implementation, the auxiliary input accelerator device may be a programmable radio frequency identification (RFID) keyfob. Today, many workers gain access to their secure workplace via an RFID keyfob. The circuitry in such a keyfob may be housed inside an input accelerator with buttons, sensor arrays and a wireless communication protocol to be used as an auxiliary input accelerator device to the host device.
[0076] hi another implementation, the auxiliary input accelerator device may be a smartcard. hi Europe and Asia, contactless, wireless smartcards based on similar technologies as the RFID keyfob are increasingly being used for a variety of commerce transactions. For example, in District of Columbia Metro Subway System, every terminal is smartcard enabled and people can pay for their subway rides by waving their wallet containing a prepaid smartcard in front of a grounded receptor. Such smartcard may be incorporated into an input accelerator device that may be carried on a keychain. Thus, the smartcard input accelerator may be used to augment interactions with a host device as well as serve as the primary mode of identification and payment in everyday life.
[0077] hi yet another implementation, the auxiliary input accelerator device may be a universal remote control device. A pocket size universal remote control device with soft keys may be configured to control all standard home entertainment devices such as televisions, DVD players, VHS players, and sound systems in addition to a host device such as a cellular phone. The universal remote control device may either use the same infrared link to communicate with home entertainment devices and with the cellular phone, or it may communicate with the cellular phone using another wireless protocol, such as Bluetooth protocol.
[0078] In yet another implementation, the auxiliary input accelerator device may be a digital wristwatch incorporating the functionality of the input accelerator device. Digital wrist watches, especially running or exercise watches, typically have a digital display and a number of buttons for tracking lap times, heart rate and other important biostatistics. They also typically have a larger surface area than typical wrist watches. These watches may readily be programmed and retrofitted with optional additional sensor arrays to be used as an input accelerator for the host device.
[0079] In one implementation, the auxiliary input accelerator device may be an MP3 device such as an iPod. While multimedia content delivery on the mobile platform is becoming a norm, currently many people still carry a separate MP3 player for listening to music. The iPod or other MP3 players already incorporate sensors and buttons, which may be easily augmented to be used as the input accelerator device for interfacing with the host device, such as a cellular phone. The MP3 player may connect to the host device using an existing or added wireless protocol, such as Bluetooth.
[0080] In one implementation, the auxiliary input accelerator device may be an ultimate wireless converged remote controller device. Some or all of the above implementations may be combined into a single converged input accelerator device, The form factor of the device may be a keyfob form factor to go on a key chain, a wrist watch form factor to go on the wrist, or any other miniature form factor that facilitate portability. The ultimate converged remote controller device may perform all of the following functions in addition to controlling any additional devices possessing a short or long range wireless link. The ultimate converged remote controller device may function as an input accelerator for cellular phones, with keys and optional sensor arrays; a remote keyless entry device with a long range RF circuitry; a remote garage door opener; a RFID keyfob with a short range passive RF circuitry; a smartcard for identification and commerce with a short range passive RF circuitry; an universal remote controller device for home entertainment systems; and/or any other auxiliary functions people may want to incorporate.
[0081] Moreover, the methods to provide data input, device control or game control may be perfoπned in a different order and still achieve desirable results. Accordingly, other implementations are within the scope of the following claims.

Claims

WHAT IS CLAIMED IS:
1. An input accelerator device for controlling a hand-held host device, the input accelerator device comprising: a communication channel configured to interface with the hand-held host device; an input assembly comprising a plurality of input elements, each input element being configured to be selectively mapped to one or more functions of a software application in order to minimize actuation required of at least one input element of the hand-held host device; and an input controller communicatively coupled to the input assembly and the communication channel, the input controller being configured to generate an input signal upon actuation of at least one of the plurality of input elements and being further configured to relay the input signal to the communication channel for transmission to the hand-held host device to control execution of the one or more functions of the software application mapped to the actuated input element.
2. The input accelerator device of claim 1, wherein the input assembly further comprises a front input assembly comprising at least a first one of the plurality of input elements, the first one of the plurality of input elements being located on a front surface; and a rear input assembly having at least a second one of the plurality of input elements, the second one of the plurality of input elements being located on a rear surface.
3. The input accelerator device of claim 1 further comprising a display unit.
4. The input accelerator device of claim 1 further comprising a storage device configured to store one or more instructions.
5. The input accelerator device of claim 4, wherein the one or more instructions comprise at least one of a text application, a mapping software, a firmware, a gaming application, or a scrolling application.
6. The input accelerator device of claim 4 further comprising: a processor configured to interpret the input signal and execute the one or more instructions; a main memory configured to load the one or more instructions executed by the processor; and a bus configured to direct communications to and from the processor.
7. The input accelerator device of claim 2, wherein the input assembly further comprises a side input assembly comprising at least a third one of the plurality of input elements, the third one of the plurality of input elements being located on a side surface.
8. The input accelerator device of claim 7, wherein at least one input element comprises at least one of an analog button, a digital button, a key, a rocker, a slider, a dial, a touch pad, a pressure sensor, a force sensitive resistor, a piezoelectric resistive sensor, a capacitive sensor, a positional sensor, a rotary encoder, a linear potentiometer, a D-pad, or a miniature analog thumb joystick.
9. The input accelerator device of claim 1 , wherein the communication channel comprises a wired data connection including at least one of a Universal Serial Bus port, a IEEE 1394 Firewire port, a serial port, a parallel port, a headphone port, or a data port.
10. The input accelerator device of claim 1, wherein the communication channel further comprises a wireless data connection including at least one of a Bluetooth connection, an Infrared connection, or a Wi-Fi connection.
11. The input accelerator device of claim 1 further comprising a secondary control unit configured to perform functions of one or more secondary devices including at least one of a headset, a garage door opener, an automobile keyless entry unit, a smartcard, a programmable RFID keyfob, a universal remote control unit, a digital wristwatch, or a MP3 player.
12. The input accelerator device of claim 7, wherein the front input assembly, the rear input assembly, and the side input assembly are further configured to optimize a biomechanical effect of the human user's opposing thumb and fingers.
13. The input accelerator device of claim 7, wherein at least one of the front input assembly, the side input assembly, and the rear input assembly is further configured to accelerate text input.
14. The input accelerator device of claim 7, wherein at least one of the front input assembly, the side input assembly, and the rear input assembly is further configured to accelerate at least one of scrolling, cursor control or navigational control.
15. The input accelerator device of claim 7, wherein at least one of the front input assembly, the side input assembly, and the rear input assembly is further configured to accelerate game play.
16. A method for configuring an input accelerator device, the method comprising: disposing on one or more surfaces an input assembly comprising a plurality of input elements configured to receive human input through manipulation of the input elements, wherein at least one of the input elements is further configured to be selectively mapped to one or more functions of a software application stored on a hand-held host device in order to minimize actuation required of at least one input element on the hand held host device; providing a communication channel configured to connect to the hand-held host device; and connecting the input assembly to the communication channel using an input controller configured to generate an input signal upon actuation of at least one of the plurality of input elements and being further configured to relay the input signal to the communication channel for transmission to the hand-held host device to control execution of the one or more functions of the software application mapped to the actuated input element.
17. The method of claim 16, wherein disposing the input assembly on one or more surfaces further comprises: disposing on a first surface a first input assembly comprising at least a first one of the plurality of input elements; .and disposing on a second surface a second input assembly comprising at least a second one of the plurality of input elements.
18. The method of claim 17, wherein disposing the input assembly on one or more surfaces further comprises disposing on a third surface a third input assembly comprising at least a third one of the plurality of input elements.
19. The method of claim 18, wherein disposing the input assembly on one or more surfaces further comprises disposing the first input assembly, the second assembly, and the third assembly in a configuration to optimize a biomechanical effect of the human user's opposing thumb and fingers.
20. The method of claim 16, wherein providing a communication channel further comprises providing a wired data connection including at least one of a Universal Serial Bus port, a IEEE 1394 Firewire port, a serial port, a parallel port, a headphone port, or a data port.
21. The method of claim 16, wherein providing a communication channel further comprises providing a wireless data connection including at least one of a Bluetooth connection, an infrared connection, or a Wi-Fi connection.
22. The method of claim 18, wherein disposing the input assembly on one or more surfaces further comprises disposing the first input assembly, the second input assembly, and the third input assembly in a configuration to provide control functions of one or more secondary devices including at least one of a headset, a garage door opener, an automobile keyless entry unit, a smartcard, a programmable RFID keyfob, a universal remote control unit, a digital wristwatch, or a MP3 player.
23. The method of claim 18, wherein disposing the input assembly on one or more surfaces further comprises disposing the first input assembly, the second input assembly and the third input assembly including at least one of an analog button, a digital button, a key, a rocker, a slider, a dial, a touch pad, a pressure sensor, a force sensitive resistor, a piezoelectric resistive sensor, a capacitive sensor, a positional sensor, a rotary encoder, a linear potentiometer, a D-pad, or a miniature analog thumb joystick.
24. The method of claim 18, wherein disposing on one or more surfaces the input assembly further comprises configuring at least one of the first input assembly, the second input assembly, and the third input assembly to accelerate textual inputs.
25. The method of claim 18, wherein disposing on one or one or more surfaces the input assembly further comprises configuring at least one of the first input assembly, the second input assembly, and the third input assembly to accelerate at least one of scrolling, cursor control or navigational control.
26. The method of claim 18, wherein disposing on one or more surfaces the input assembly further comprises configuring at least one of the first input assembly, the second input assembly, and the third input assembly to accelerate game play.
27. A method of controlling a plurality of hand-held host devices, the method comprising: providing an input accelerator device comprising: a communication channel configured to interface with the plurality of hand-held host devices; an input assembly comprising a plurality of input elements, each input element being configured to be selectively mapped to one or more functions of a software application in order to minimize a number of actuation required for an input element of one of the plurality of hand-held host devices; and an input controller communicatively coupled to the input assembly and the communication channel, the input controller being configured to generate an input signal upon actuation of one of the plurality of input elements and being further configured to relay the input signal to the communication channel for transmission to the hand-held host device to control execution of the one or more functions of the software application mapped to the actuated input element; actuating one of the plurality of input elements; interpreting the generated input signal based on the one or more functions mapped to the actuated input element; and executing the one or more functions mapped to the actuated element.
28. The method of claim 27, wherein the input assembly further comprises: a first input assembly comprising at least a first one of the plurality of input elements, the fist one of the plurality of input elements being located on a first surface; and a second input assembly having at least a second one of the plurality of input elements, the second one of the plurality of input elements being located on a second surface.
29. The method of claim 28, wherein the input assembly further comprises: a third input assembly comprising at least a third one of the plurality of input elements, the third one of the plurality of input elements being located on a third surface.
30. The method of claim 29, wherein the first input assembly, the second input assembly, and the third assembly are further configured to optimize a biomechanical effect of the human user's opposing thumb and fingers.
31. The method of claim 27, wherein the communication channel further comprises a wired data connection including at least one of a Universal Serial Bus port, a IEEE 1394 Firewire port, a serial port, a parallel port, a headphone port, or a data port.
32. The method of claim 27, wherein the communication channel further comprises a wireless data connection including at least one of a Bluetooth connection, an Infrared connection, or a Wi-Fi connection.
33. The method of claim 27, wherein the plurality of host devices comprises at least one of a cellular phone, a personal digital assistant, a smart phone, a laptop, a garage door opener, an automobile keyless entry unit, a smartcard, a programmable RFU) keyfob, a universal remote control unit, a digital wristwatch, a compact disc player or a MP3 player.
34. The method of claim 29, wherein at least one of the input elements comprises at least one of an analog button, a digital button, a key, a rocker, a slider, a dial, a touch pad, a pressure sensor, a force sensitive resistor, a piezoelectric resistive sensor, a capacitive sensor, a positional sensor, a rotary encoder, a linear potentiometer, a D-pad, or a miniature analog thumb joystick.
35. The method of claim 29, wherein at least one of the first input assembly, the second input assembly, or the third input assembly is further configured to accelerate textual inputs.
36. The method of claim 29, wherein at least one of the first input assembly, the second input assembly, or the third input assembly is further configured to accelerate at least one of scrolling, cursor control or navigational control.
37. The method of claim 29, wherein at least one of the first input assembly, the second input assembly, or the third input assembly is further configured to accelerate game play.
38. The method of claim 35, further comprising: configuring the second one of the plurality of input elements to be mapped to one or more indexing functions; and actuating an input element on one of the plurality of hand-held host devices in conjunction with the second one of the plurality of input elements.
PCT/US2006/039982 2005-10-11 2006-10-10 Human interface input acceleration system WO2007044870A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2008535689A JP2009515239A (en) 2005-10-11 2006-10-10 Human interface input acceleration system
CA2625758A CA2625758C (en) 2005-10-11 2006-10-10 Human interface input acceleration system
KR1020107013626A KR101206694B1 (en) 2005-10-11 2006-10-10 Human interface input acceleration system
EP06825865A EP1938174A2 (en) 2005-10-11 2006-10-11 Human interface input acceleration system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/249,009 2005-10-11
US11/249,009 US7280097B2 (en) 2005-10-11 2005-10-11 Human interface input acceleration system

Publications (2)

Publication Number Publication Date
WO2007044870A2 true WO2007044870A2 (en) 2007-04-19
WO2007044870A3 WO2007044870A3 (en) 2007-06-28

Family

ID=37684425

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/039982 WO2007044870A2 (en) 2005-10-11 2006-10-10 Human interface input acceleration system

Country Status (7)

Country Link
US (1) US7280097B2 (en)
EP (1) EP1938174A2 (en)
JP (3) JP2009515239A (en)
KR (2) KR101043942B1 (en)
CN (3) CN101313270A (en)
CA (1) CA2625758C (en)
WO (1) WO2007044870A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503461A (en) * 2006-09-13 2010-02-04 イマージョン コーポレイション System and method for haptics for casino games
JP2010533919A (en) * 2007-07-19 2010-10-28 株式会社ソニー・コンピュータエンタテインメント Computing system using Bluetooth and related method
CN103955283A (en) * 2014-04-28 2014-07-30 熊猫电子集团有限公司 Quasi-continuous adjustment personal computer (PC) keyboard circuit

Families Citing this family (135)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100076701A1 (en) * 2004-04-09 2010-03-25 Loadstar Sensors, Inc. Resistive force sensing device and method with an advanced communication interface
TWI254576B (en) * 2004-10-22 2006-05-01 Lite On It Corp Auxiliary function-switching method for digital video player
US8225231B2 (en) 2005-08-30 2012-07-17 Microsoft Corporation Aggregation of PC settings
US7652660B2 (en) 2005-10-11 2010-01-26 Fish & Richardson P.C. Mobile device customizer
US8142287B2 (en) * 2005-10-11 2012-03-27 Zeemote Technology Inc. Universal controller for toys and games
US7649522B2 (en) * 2005-10-11 2010-01-19 Fish & Richardson P.C. Human interface input acceleration system
US20070103431A1 (en) * 2005-10-24 2007-05-10 Tabatowski-Bush Benjamin A Handheld tilt-text computing system and method
US20070143120A1 (en) * 2005-11-28 2007-06-21 Amit Phadnis System and method for configuring an input arrangement for a computing device
US7716603B2 (en) * 2005-12-09 2010-05-11 Sony Corporation On screen display for alpha-numeric input
US7715831B2 (en) * 2006-03-24 2010-05-11 Sony Ericssson Mobile Communications, Ab Methods, systems, and devices for detecting and indicating loss of proximity between mobile devices
WO2007118253A2 (en) * 2006-04-11 2007-10-18 Pet Doors Usa Inc Spring-assisted mechanism for raising and lowering a load
US8814641B2 (en) * 2006-05-08 2014-08-26 Nintendo Co., Ltd. System and method for detecting moment of impact and/or strength of a swing based on accelerometer data
US20080033713A1 (en) * 2006-07-10 2008-02-07 Sony Ericsson Mobile Communications Ab Predicting entered text
US20080288891A1 (en) * 2006-09-01 2008-11-20 Peter Buth Using a number shortcut
US20080059911A1 (en) * 2006-09-01 2008-03-06 Taneli Kulo Advanced player
US7610813B2 (en) * 2006-09-29 2009-11-03 Intel Corporation Method and apparatus for a self-powered RFID-readable pedometer
KR101299682B1 (en) * 2006-10-16 2013-08-22 삼성전자주식회사 Universal input device
US8380246B2 (en) * 2007-03-01 2013-02-19 Microsoft Corporation Connecting mobile devices via interactive input medium
TW200909032A (en) * 2007-08-20 2009-03-01 Tai Sol Electronics Co Ltd Three-dimensional wireless rocking lever
US20090054069A1 (en) * 2007-08-24 2009-02-26 Zeetoo, Inc. Platform Independent Communication Protocol
US8015026B2 (en) * 2007-10-23 2011-09-06 Health Hero Network, Inc. Health management system for people and pets
US20090125848A1 (en) * 2007-11-14 2009-05-14 Susann Marie Keohane Touch surface-sensitive edit system
US20090160607A1 (en) * 2007-12-21 2009-06-25 General Motors Corporation Vehicle key fob having a communications circuit
US20090245532A1 (en) * 2008-03-26 2009-10-01 Sony Ericsson Mobile Communications Ab Headset
US20090278818A1 (en) * 2008-05-12 2009-11-12 Dinozzi Jon Mario Thumb worn tap devices and storage holders for use with handheld electronics
US8165398B2 (en) 2008-05-30 2012-04-24 Sony Ericsson Mobile Communications Ab Method and device for handwriting detection
US8208854B2 (en) * 2008-06-18 2012-06-26 Plantronics, Inc. Bluetooth control for VoIP telephony using headset profile
US8411046B2 (en) 2008-10-23 2013-04-02 Microsoft Corporation Column organization of content
US20100107100A1 (en) 2008-10-23 2010-04-29 Schneekloth Jason S Mobile Device Style Abstraction
US8385952B2 (en) 2008-10-23 2013-02-26 Microsoft Corporation Mobile communications device user interface
US8289162B2 (en) * 2008-12-22 2012-10-16 Wimm Labs, Inc. Gesture-based user interface for a wearable portable device
US20100241987A1 (en) * 2009-03-19 2010-09-23 Microsoft Corporation Tear-Drop Way-Finding User Interfaces
US8121640B2 (en) 2009-03-19 2012-02-21 Microsoft Corporation Dual module portable devices
US8849570B2 (en) * 2009-03-19 2014-09-30 Microsoft Corporation Projected way-finding
US20100241999A1 (en) * 2009-03-19 2010-09-23 Microsoft Corporation Canvas Manipulation Using 3D Spatial Gestures
US8019903B2 (en) 2009-03-27 2011-09-13 Microsoft Corporation Removable accessory for a computing device
US8238876B2 (en) 2009-03-30 2012-08-07 Microsoft Corporation Notifications
US8175653B2 (en) 2009-03-30 2012-05-08 Microsoft Corporation Chromeless user interface
US8355698B2 (en) 2009-03-30 2013-01-15 Microsoft Corporation Unlock screen
US8269736B2 (en) 2009-05-22 2012-09-18 Microsoft Corporation Drop target gestures
US8836648B2 (en) 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US20110110514A1 (en) * 2009-11-09 2011-05-12 Research In Motion Limited Multi-button remote control headset with improved signaling
KR101664430B1 (en) * 2009-11-13 2016-10-10 삼성전자주식회사 Method and apparatus for providing remote UI service
JP2011129983A (en) * 2009-12-15 2011-06-30 Ihi Aerospace Co Ltd Remote controller
US8548135B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8548131B1 (en) 2010-02-03 2013-10-01 Tal Lavian Systems and methods for communicating with an interactive voice response system
US8594280B1 (en) 2010-02-03 2013-11-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US9001819B1 (en) 2010-02-18 2015-04-07 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8687777B1 (en) 2010-02-03 2014-04-01 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8879698B1 (en) 2010-02-03 2014-11-04 Tal Lavian Device and method for providing enhanced telephony
US8537989B1 (en) 2010-02-03 2013-09-17 Tal Lavian Device and method for providing enhanced telephony
US8625756B1 (en) 2010-02-03 2014-01-07 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8903073B2 (en) 2011-07-20 2014-12-02 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8406388B2 (en) 2011-07-18 2013-03-26 Zvi Or-Bach Systems and methods for visual presentation and selection of IVR menu
US8681951B1 (en) 2010-02-03 2014-03-25 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8572303B2 (en) 2010-02-03 2013-10-29 Tal Lavian Portable universal communication device
US8553859B1 (en) 2010-02-03 2013-10-08 Tal Lavian Device and method for providing enhanced telephony
US8540571B2 (en) 2010-03-31 2013-09-24 Immersion Corporation System and method for providing haptic stimulus based on position
US8547335B2 (en) * 2010-07-30 2013-10-01 International Business Machines Corporation RFID-based input device
US8732697B2 (en) 2010-08-04 2014-05-20 Premkumar Jonnala System, method and apparatus for managing applications on a device
CN102467238A (en) * 2010-11-03 2012-05-23 常州市福驰电动车辆科技有限公司 Compound press key keyboard-touch panel compounding device for computer human-computer interface
US8337305B2 (en) * 2010-11-17 2012-12-25 Steelseries Aps Apparatus and method for managing user inputs in video games
US20120159383A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Customization of an immersive environment
US20120159395A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Application-launching interface for multiple modes
US8612874B2 (en) 2010-12-23 2013-12-17 Microsoft Corporation Presenting an application change through a tile
US8689123B2 (en) 2010-12-23 2014-04-01 Microsoft Corporation Application reporting in an application-selectable user interface
US9423951B2 (en) 2010-12-31 2016-08-23 Microsoft Technology Licensing, Llc Content-based snap point
US8483614B2 (en) 2011-01-31 2013-07-09 Koamtac, Inc. HID protocol-based soft keyboard toggle with initialization and synchronization capability for mobile phones and PDAs connected to a peripheral device
CN102698436A (en) * 2011-03-28 2012-10-03 德信互动科技(北京)有限公司 Somatic interactive game device and somatic online interactive system
US9383917B2 (en) 2011-03-28 2016-07-05 Microsoft Technology Licensing, Llc Predictive tiling
US20120304132A1 (en) 2011-05-27 2012-11-29 Chaitanya Dev Sareen Switching back to a previously-interacted-with application
US8893033B2 (en) 2011-05-27 2014-11-18 Microsoft Corporation Application notifications
US9658766B2 (en) 2011-05-27 2017-05-23 Microsoft Technology Licensing, Llc Edge gesture
US9104440B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9104307B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9158445B2 (en) 2011-05-27 2015-10-13 Microsoft Technology Licensing, Llc Managing an immersive interface in a multi-application immersive environment
US8687023B2 (en) 2011-08-02 2014-04-01 Microsoft Corporation Cross-slide gesture to select and rearrange
US20130055164A1 (en) * 2011-08-24 2013-02-28 Sony Ericsson Mobile Communications Ab System and Method for Selecting Objects on a Touch-Sensitive Display of a Mobile Communications Device
US20130057587A1 (en) 2011-09-01 2013-03-07 Microsoft Corporation Arranging tiles
US10353566B2 (en) 2011-09-09 2019-07-16 Microsoft Technology Licensing, Llc Semantic zoom animations
US8922575B2 (en) 2011-09-09 2014-12-30 Microsoft Corporation Tile cache
US9557909B2 (en) 2011-09-09 2017-01-31 Microsoft Technology Licensing, Llc Semantic zoom linguistic helpers
US9146670B2 (en) 2011-09-10 2015-09-29 Microsoft Technology Licensing, Llc Progressively indicating new content in an application-selectable user interface
US8933952B2 (en) 2011-09-10 2015-01-13 Microsoft Corporation Pre-rendering new content for an application-selectable user interface
US9244802B2 (en) 2011-09-10 2016-01-26 Microsoft Technology Licensing, Llc Resource user interface
US9223472B2 (en) 2011-12-22 2015-12-29 Microsoft Technology Licensing, Llc Closing applications
CN103249174B (en) * 2012-02-07 2017-03-01 联想(北京)有限公司 Method and electronic equipment that a kind of control electronics connect
US9778841B2 (en) 2012-02-10 2017-10-03 Hand Held Products, Inc. Apparatus having random ordered keypad
US9128605B2 (en) 2012-02-16 2015-09-08 Microsoft Technology Licensing, Llc Thumbnail-image selection of applications
US8867708B1 (en) 2012-03-02 2014-10-21 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US8731148B1 (en) 2012-03-02 2014-05-20 Tal Lavian Systems and methods for visual presentation and selection of IVR menu
US9674331B2 (en) * 2012-06-08 2017-06-06 Apple Inc. Transmitting data from an automated assistant to an accessory
WO2013192539A1 (en) 2012-06-21 2013-12-27 Nextinput, Inc. Wafer level mems force dies
EP2870445A1 (en) 2012-07-05 2015-05-13 Ian Campbell Microelectromechanical load sensor and methods of manufacturing the same
US10095659B2 (en) 2012-08-03 2018-10-09 Fluke Corporation Handheld devices, systems, and methods for measuring parameters
US20140035607A1 (en) * 2012-08-03 2014-02-06 Fluke Corporation Handheld Devices, Systems, and Methods for Measuring Parameters
CN102981622A (en) * 2012-11-29 2013-03-20 广东欧珀移动通信有限公司 External control method and system of mobile terminal
CA2902290C (en) 2013-03-14 2021-07-13 Ologn Technologies Ag Methods, apparatuses and systems for providing user authentication
JP6449232B2 (en) 2013-03-15 2019-01-09 フルークコーポレイションFluke Corporation Automatic recording and graphing of measurement data
US9450952B2 (en) 2013-05-29 2016-09-20 Microsoft Technology Licensing, Llc Live tiles without application-code execution
WO2014209386A1 (en) * 2013-06-28 2014-12-31 Hewlett-Packard Development Company, L.P. Attached computing device
CN105705384A (en) * 2013-11-11 2016-06-22 松下知识产权经营株式会社 Smart entry system
JP2015106174A (en) * 2013-11-28 2015-06-08 京セラ株式会社 Electronic apparatus
US9766270B2 (en) 2013-12-30 2017-09-19 Fluke Corporation Wireless test measurement
CN105934661B (en) 2014-01-13 2019-11-05 触控解决方案股份有限公司 Miniature reinforcing wafer-level MEMS force snesor
US10156976B2 (en) 2014-01-30 2018-12-18 Samsung Display Co., Ltd. System and method in managing low-latency direct control feedback
US9666005B2 (en) * 2014-02-14 2017-05-30 Infinitekey, Inc. System and method for communicating with a vehicle
KR102298602B1 (en) 2014-04-04 2021-09-03 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Expandable application representation
EP3129847A4 (en) 2014-04-10 2017-04-19 Microsoft Technology Licensing, LLC Slider cover for computing device
EP3129846A4 (en) 2014-04-10 2017-05-03 Microsoft Technology Licensing, LLC Collapsible shell cover for computing device
US10146330B2 (en) * 2014-06-18 2018-12-04 Matthew Swan Lawrence Systems and methods for character and command input
US10592080B2 (en) 2014-07-31 2020-03-17 Microsoft Technology Licensing, Llc Assisted presentation of application windows
US10254942B2 (en) 2014-07-31 2019-04-09 Microsoft Technology Licensing, Llc Adaptive sizing and positioning of application windows
US10678412B2 (en) 2014-07-31 2020-06-09 Microsoft Technology Licensing, Llc Dynamic joint dividers for application windows
US10642365B2 (en) 2014-09-09 2020-05-05 Microsoft Technology Licensing, Llc Parametric inertia and APIs
CN106662891B (en) 2014-10-30 2019-10-11 微软技术许可有限责任公司 Multi-configuration input equipment
CN105302321A (en) * 2015-05-08 2016-02-03 姚晓宁 Glass touch keyboard
US10466119B2 (en) 2015-06-10 2019-11-05 Nextinput, Inc. Ruggedized wafer level MEMS force sensor with a tolerance trench
US9978265B2 (en) 2016-04-11 2018-05-22 Tti (Macao Commercial Offshore) Limited Modular garage door opener
JP6711413B2 (en) 2016-04-15 2020-06-17 株式会社デンソー System and method for establishing real-time position
CN110574399B (en) 2016-12-14 2021-06-25 株式会社电装 Method and system for establishing micro-positioning area
EP3580539A4 (en) 2017-02-09 2020-11-25 Nextinput, Inc. Integrated digital force sensors and related methods of manufacture
WO2018148510A1 (en) 2017-02-09 2018-08-16 Nextinput, Inc. Integrated piezoresistive and piezoelectric fusion force sensor
IT201700036562A1 (en) * 2017-04-03 2018-10-03 Epic S R L Portable control device of a plurality of devices connected in an automation system, in particular a home automation system and relative command method
US11221263B2 (en) 2017-07-19 2022-01-11 Nextinput, Inc. Microelectromechanical force sensor having a strain transfer layer arranged on the sensor die
US11423686B2 (en) 2017-07-25 2022-08-23 Qorvo Us, Inc. Integrated fingerprint and force sensor
WO2019023552A1 (en) 2017-07-27 2019-01-31 Nextinput, Inc. A wafer bonded piezoresistive and piezoelectric force sensor and related methods of manufacture
US11579028B2 (en) 2017-10-17 2023-02-14 Nextinput, Inc. Temperature coefficient of offset compensation for force sensor and strain gauge
US11385108B2 (en) 2017-11-02 2022-07-12 Nextinput, Inc. Sealed force sensor with etch stop layer
US11874185B2 (en) 2017-11-16 2024-01-16 Nextinput, Inc. Force attenuator for force sensor
EP3721326A4 (en) 2018-02-27 2020-12-16 Samsung Electronics Co., Ltd. Method of displaying graphic object differently according to body portion in contact with controller, and electronic device
US10962427B2 (en) 2019-01-10 2021-03-30 Nextinput, Inc. Slotted MEMS force sensor
US10638229B1 (en) * 2019-03-29 2020-04-28 Bose Corporation Methods and systems for establishing user controls
US11269975B2 (en) 2019-11-07 2022-03-08 Bank Of America Corporation System for authenticating a user using an application specific integrated circuit embedded within a user device
CN114915598B (en) * 2021-02-08 2023-10-20 腾讯科技(深圳)有限公司 Network acceleration method and device of application program and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE29823417U1 (en) * 1997-12-27 1999-05-06 Sun Lei Ergonomic, wireless, multifunctional and compact input and display device
EP1253547A2 (en) * 2001-04-25 2002-10-30 Xybernaut Corporation A wireless pen-type input device for computers
WO2003007117A2 (en) * 2001-07-12 2003-01-23 Friedman Gary L Portable, hand-held electronic input device and combination with a personal digital device
US20030083114A1 (en) * 2000-04-13 2003-05-01 Daniel Lavin Hardware configuration for a navigation control unit for a wireless computer resource access device, such as a wireless web content access device
EP1376319A1 (en) * 2002-06-28 2004-01-02 Fujitsu Siemens Computers GmbH Portable computerbased input device

Family Cites Families (91)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4912462A (en) * 1982-07-29 1990-03-27 Sharp Kabushiki Kaisha Letter input device for electronic word retrieval device
US4891777A (en) * 1983-05-11 1990-01-02 The Laitram Corporation Single hand keyboard arrays providing alphanumeric capabilities from twelve keys
GB8423427D0 (en) * 1984-09-17 1984-10-24 Jones P S Music synthesizer
JPS62258136A (en) * 1986-04-30 1987-11-10 Mazda Motor Corp Fuel feed control device for engine
US4823311A (en) 1986-05-30 1989-04-18 Texas Instruments Incorporated Calculator keyboard with user definable function keys and with programmably alterable interactive labels for certain function keys
US4896554A (en) * 1987-11-03 1990-01-30 Culver Craig F Multifunction tactile manipulatable control
JPH07102255B2 (en) * 1989-04-25 1995-11-08 株式会社ハドソン Programmable controller for game consoles
US5287514A (en) * 1990-01-08 1994-02-15 Microsoft Corporation Method and system for customizing a user interface in a computer system
CA2104586A1 (en) 1991-02-21 1992-08-22 William M. Louis Ergonomic keyboard apparatus and method of using same
US6005496A (en) * 1991-04-10 1999-12-21 Kinesis Corporation Ergonomic keyboard apparatus
US5189416A (en) * 1991-04-29 1993-02-23 Walker-Estes Corporation Chordal keyboard method and apparatus
US5365589A (en) * 1992-02-07 1994-11-15 Gutowitz Howard A Method and apparatus for encryption, decryption and authentication using dynamical systems
JP3199130B2 (en) * 1992-03-31 2001-08-13 パイオニア株式会社 3D coordinate input device
AR247303A1 (en) 1992-08-21 1994-11-30 Gilligan Federico Gustavo Y Fa New computer keyboard.
US5553277A (en) * 1992-12-29 1996-09-03 Fujitsu Limited Image search method for searching and retrieving desired image from memory device
US5824931A (en) * 1993-03-12 1998-10-20 Musacus International Limited Electronic information aid
US5432510A (en) * 1993-03-22 1995-07-11 Matthews; Walter S. Ambidextrous single hand chordic data management device
US5973621A (en) * 1993-06-03 1999-10-26 Levy; David Compact keyed input device
US5612690A (en) * 1993-06-03 1997-03-18 Levy; David Compact keypad system and method
US5473325A (en) * 1993-08-11 1995-12-05 Mcalindon; Peter J. Ergonomic human-computer interface apparatus and method
US5515305A (en) 1993-12-09 1996-05-07 Dell Usa, L.P. PDA having chord keyboard input device and method of providing data thereto
JP3546337B2 (en) * 1993-12-21 2004-07-28 ゼロックス コーポレイション User interface device for computing system and method of using graphic keyboard
WO1995032461A1 (en) * 1994-05-23 1995-11-30 Australian Institute Of Marine Science A human/machine interface for computing devices
US5782642A (en) * 1995-12-19 1998-07-21 Goren; Michael Interactive video and audio display system network interactive monitor module interface
JP2001513918A (en) * 1996-01-26 2001-09-04 オラング―オタング コンピューターズ インコーポレイテッド Key palette
US5859629A (en) * 1996-07-01 1999-01-12 Sun Microsystems, Inc. Linear touch input device
US6297752B1 (en) 1996-07-25 2001-10-02 Xuan Ni Backside keyboard for a notebook or gamebox
US6115028A (en) * 1996-08-22 2000-09-05 Silicon Graphics, Inc. Three dimensional input system using tilt
JPH10222308A (en) * 1997-01-31 1998-08-21 Toshiba Corp Information processor and method for changing-over button assignment of remote controller being adapted to the same
US6232956B1 (en) * 1997-02-27 2001-05-15 Spice Technologies, Inc. OHAI technology user interface
DE19718711C1 (en) * 1997-05-02 1998-12-03 Easyphone Gmbh Mobile device with a reduced key set
US5825362A (en) * 1997-05-07 1998-10-20 Datahand Corporation Graphical user interface with keyboard display graphical
US6084576A (en) * 1997-09-27 2000-07-04 Leu; Neng-Chyang User friendly keyboard
TW401598B (en) * 1997-11-27 2000-08-11 United Microelectronics Corp The manufacture method of hemispherical grain silicon (HSG-Si)
US6919879B2 (en) * 1998-06-26 2005-07-19 Research In Motion Limited Hand-held electronic device with a keyboard optimized for use with the thumbs
US6512511B2 (en) * 1998-07-20 2003-01-28 Alphagrip, Inc. Hand grippable combined keyboard and game controller system
US6760013B2 (en) * 1998-07-20 2004-07-06 Alphagrip, Inc. Hand held gaming and data entry system
US6710790B1 (en) 1998-08-13 2004-03-23 Symantec Corporation Methods and apparatus for tracking the active window of a host computer in a remote computer display window
USRE43082E1 (en) * 1998-12-10 2012-01-10 Eatoni Ergonomics, Inc. Touch-typable devices based on ambiguous codes and methods to design such devices
US6219731B1 (en) * 1998-12-10 2001-04-17 Eaton: Ergonomics, Inc. Method and apparatus for improved multi-tap text input
US6489976B1 (en) * 1998-12-15 2002-12-03 International Business Machines Corporation System and method for displaying pop-up symbols for indicating accelerator keys for implementing computer software options
US6320942B1 (en) * 1998-12-31 2001-11-20 Keytouch Corporation Directionally-mapped, keyed alpha-numeric data input/output system
US6107877A (en) 1999-04-09 2000-08-22 General Instrument Corporation Predistortion generator coupled with an RF amplifier
US6377685B1 (en) * 1999-04-23 2002-04-23 Ravi C. Krishnan Cluster key arrangement
US6606486B1 (en) * 1999-07-29 2003-08-12 Ericsson Inc. Word entry method for mobile originated short messages
JP2001046742A (en) * 1999-08-04 2001-02-20 Namco Ltd Game system and information memory medium
US6164853A (en) * 1999-09-09 2000-12-26 Foote; Lisa L. Ergonomic housing for a handheld device
SE9903405L (en) * 1999-09-21 2001-03-22 Ericsson Telefon Ab L M Accessory keyboard for a portable radiotelephone, portable radiotelephone connected to such an accessory keyboard and a method for entering text into a portable radiotelephone.
US6865718B2 (en) * 1999-09-29 2005-03-08 Microsoft Corp. Accelerated scrolling
US6909424B2 (en) 1999-09-29 2005-06-21 Gateway Inc. Digital information appliance input device
US6542091B1 (en) * 1999-10-01 2003-04-01 Wayne Allen Rasanen Method for encoding key assignments for a data input device
JP3434751B2 (en) * 1999-11-11 2003-08-11 エヌイーシーアクセステクニカ株式会社 Mobile phone system
JP2001142618A (en) * 1999-11-16 2001-05-25 Canon Inc Device and method for image processing, storage medium and program element
US6498601B1 (en) 1999-11-29 2002-12-24 Xerox Corporation Method and apparatus for selecting input modes on a palmtop computer
US6573844B1 (en) * 2000-01-18 2003-06-03 Microsoft Corporation Predictive keyboard
US6654733B1 (en) * 2000-01-18 2003-11-25 Microsoft Corporation Fuzzy keyboard
US6615299B1 (en) 2000-01-31 2003-09-02 Intel Corporation Dynamically translating commands from an input device into commands understandable by an application
JP2001331251A (en) * 2000-05-24 2001-11-30 Alps Electric Co Ltd Character inputting device
US6741235B1 (en) * 2000-06-13 2004-05-25 Michael Goren Rapid entry of data and information on a reduced size input area
JP2002010380A (en) * 2000-06-19 2002-01-11 Canon Inc Apparatus of operation, system thereof, control method thereof and recording medium
WO2002011838A1 (en) * 2000-08-03 2002-02-14 Mattel, Inc. Handheld driving simulation game apparatus
US20020023265A1 (en) * 2000-08-08 2002-02-21 Metcalf Darrell J. Wireless controller with publicly-accessible communications link for controlling the content seen on large-screen systems
JP2002157070A (en) * 2000-11-16 2002-05-31 Enos:Kk Handy type internet input device
US6520699B2 (en) * 2001-02-16 2003-02-18 Toshiyasu Abe Keyboard
US6738045B2 (en) * 2001-02-26 2004-05-18 Microsoft Corporation Method and system for accelerated data navigation
US20020163504A1 (en) * 2001-03-13 2002-11-07 Pallakoff Matthew G. Hand-held device that supports fast text typing
CN1319448A (en) * 2001-04-09 2001-10-31 孕龙科技股份有限公司 Push-button combination operated game controller
JP2002315076A (en) * 2001-04-12 2002-10-25 Nec Corp Input device using portable telephone
US7072975B2 (en) 2001-04-24 2006-07-04 Wideray Corporation Apparatus and method for communicating information to portable computing devices
US6541715B2 (en) * 2001-05-24 2003-04-01 Philip Swanson Alphanumeric keyboard for hand-held electronic devices
JP2002373048A (en) * 2001-06-18 2002-12-26 Nec Yonezawa Ltd System and device for processing information and remote control system
GB0116083D0 (en) * 2001-06-30 2001-08-22 Koninkl Philips Electronics Nv Text entry method and device therefor
US20040196265A1 (en) 2001-07-17 2004-10-07 Nohr Steven P. System and method for finger held hardware device
US20030048205A1 (en) 2001-08-10 2003-03-13 Junru He 3D electronic data input device with key mapping card
WO2003026135A1 (en) * 2001-09-20 2003-03-27 Higginson Timothy B Universal keyboard
JP2003099704A (en) * 2001-09-21 2003-04-04 Mitsubishi Electric Corp Handy terminal device with programmable vibration pattern, and application software for handy terminal device
FI115861B (en) 2001-11-12 2005-07-29 Myorigo Oy Method and apparatus for generating a response
US8176432B2 (en) 2001-11-20 2012-05-08 UEI Electronics Inc. Hand held remote control device having an improved user interface
TW531700B (en) * 2001-11-22 2003-05-11 Darfon Electronics Corp Universal input device for hand-held electronic device and computer
WO2003052948A1 (en) 2001-12-18 2003-06-26 Nokia Corporation Removable housing cover for a portable radio communication device
JP2003198871A (en) * 2001-12-25 2003-07-11 Matsushita Electric Ind Co Ltd Home electric appliance control system and method, remote controller employed for the system, and home electric appliance
US6947028B2 (en) 2001-12-27 2005-09-20 Mark Shkolnikov Active keyboard for handheld electronic gadgets
US20030193418A1 (en) * 2002-04-10 2003-10-16 Xiaodong Shi Method and Apparatus To Input Text On Devices Requiring A Small Keypad
AU2003237247A1 (en) * 2002-05-23 2003-12-12 Digit Wireless, Llc Keypads and key switches
JP2003345459A (en) * 2002-05-28 2003-12-05 Sony Corp Electronic equipment and expansion device detachable for electronic equipment body
KR20040013356A (en) * 2002-08-06 2004-02-14 주식회사 팬코테크놀로지 Portable terminal using a mobile phone as a peripheral device
US6998871B2 (en) 2002-11-29 2006-02-14 Sigmatel, Inc. Configurable integrated circuit for use in a multi-function handheld device
US20040208681A1 (en) 2003-04-19 2004-10-21 Dechene Joseph Fernand Computer or input device with back side keyboard
US7283125B2 (en) * 2003-05-09 2007-10-16 Microsoft Corporation Text input device and adapter mechanism
US7218313B2 (en) 2003-10-31 2007-05-15 Zeetoo, Inc. Human interface system
JP4214070B2 (en) * 2004-03-12 2009-01-28 任天堂株式会社 Portable game system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE29823417U1 (en) * 1997-12-27 1999-05-06 Sun Lei Ergonomic, wireless, multifunctional and compact input and display device
US20030083114A1 (en) * 2000-04-13 2003-05-01 Daniel Lavin Hardware configuration for a navigation control unit for a wireless computer resource access device, such as a wireless web content access device
EP1253547A2 (en) * 2001-04-25 2002-10-30 Xybernaut Corporation A wireless pen-type input device for computers
WO2003007117A2 (en) * 2001-07-12 2003-01-23 Friedman Gary L Portable, hand-held electronic input device and combination with a personal digital device
EP1376319A1 (en) * 2002-06-28 2004-01-02 Fujitsu Siemens Computers GmbH Portable computerbased input device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SONY ERICSSON MOBULE COMMUNICATIONS AB: "Developers Guideline Bluetooth HID remote control (K700 series, S700 series, V800 series)" INTERNET CITATION, [Online] October 2004 (2004-10), XP007901961 Retrieved from the Internet: URL:http://mybox.trenger.ro/~torgeir/dg_hid_bt_r2b.pdf> [retrieved on 2007-04-11] *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503461A (en) * 2006-09-13 2010-02-04 イマージョン コーポレイション System and method for haptics for casino games
JP2014028267A (en) * 2006-09-13 2014-02-13 Immersion Corp System and method for haptics for casino game
JP2010533919A (en) * 2007-07-19 2010-10-28 株式会社ソニー・コンピュータエンタテインメント Computing system using Bluetooth and related method
CN103955283A (en) * 2014-04-28 2014-07-30 熊猫电子集团有限公司 Quasi-continuous adjustment personal computer (PC) keyboard circuit

Also Published As

Publication number Publication date
KR101043942B1 (en) 2011-06-24
JP2012135024A (en) 2012-07-12
EP1938174A2 (en) 2008-07-02
JP2009515239A (en) 2009-04-09
JP5717670B2 (en) 2015-05-13
CA2625758C (en) 2012-07-31
KR20100089881A (en) 2010-08-12
US20070080931A1 (en) 2007-04-12
KR101206694B1 (en) 2012-11-29
CN101326480A (en) 2008-12-17
US7280097B2 (en) 2007-10-09
CN101326479A (en) 2008-12-17
CA2625758A1 (en) 2007-04-19
WO2007044870A3 (en) 2007-06-28
CN101313270A (en) 2008-11-26
JP2014241159A (en) 2014-12-25
KR20080066793A (en) 2008-07-16

Similar Documents

Publication Publication Date Title
CA2625758C (en) Human interface input acceleration system
US8063880B2 (en) Mobile device customizer
US7649522B2 (en) Human interface input acceleration system
US8142287B2 (en) Universal controller for toys and games
US7667692B2 (en) Human interface system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680043924.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2008535689

Country of ref document: JP

Kind code of ref document: A

Ref document number: 2625758

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2006825865

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006825865

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 3248/DELNP/2008

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 1020087011270

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 1020107013626

Country of ref document: KR