WO2015028849A1 - A2touch (aselsan air touch) virtual control system - Google Patents

A2touch (aselsan air touch) virtual control system Download PDF

Info

Publication number
WO2015028849A1
WO2015028849A1 PCT/IB2013/058221 IB2013058221W WO2015028849A1 WO 2015028849 A1 WO2015028849 A1 WO 2015028849A1 IB 2013058221 W IB2013058221 W IB 2013058221W WO 2015028849 A1 WO2015028849 A1 WO 2015028849A1
Authority
WO
WIPO (PCT)
Prior art keywords
a2touch
button
control system
virtual control
sensor unit
Prior art date
Application number
PCT/IB2013/058221
Other languages
French (fr)
Inventor
Ismail OZSARAC
Original Assignee
Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi filed Critical Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi
Priority to PCT/IB2013/058221 priority Critical patent/WO2015028849A1/en
Publication of WO2015028849A1 publication Critical patent/WO2015028849A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Definitions

  • A2TOUCH (ASELSAN AIR TOUCH)
  • This invention is related with a system that enables pilots to control avionic functions without any hard button press, only moving their hands in free air. Background of the invention
  • Pilots should stoop to the display to control the MFDs or KDUs by pressing hard buttons. This body movement may decrease the situational awareness. Also, the possible combination of controls is limited by the number of the hard buttons. On the other hand, HMD systems have limited input control interfaces like push buttons. Because of this, their display modules can't be used for function control, instead they can only be used for viewing.
  • the United States patent application numbered US2013135240 discloses an apparatus for remotely operating a computer using a combination of voice commands and finger movements.
  • the apparatus includes a microphone and a plurality of control elements in the form of touch- sensitive touchpads and/or motion- sensitive elements that are used to operate the computer and to move an on-screen cursor.
  • the related invention can be a solution to remotely control the avionic functions. But pilots should wear glove and glove usage may create problems in touchpads and motion-sensitive elements.
  • the United States patent application numbered US8373658 discloses a motion sensing system includes a hand-held device and a receiver device.
  • the hand-held device includes a microcontroller, a G-sensor (one 3-axis accelerometer), only one 2- axisgyroscope, and a wireless transmitter.
  • the receiver device is preferably a dongle and includes a microcontroller and a wireless receiver.
  • the related invention can be a solution to remotely control the avionic functions. But the environment that the pilots need to use the system has EMC/EMI constraints; good shielding is required for the sensors to be compatible to EMI. Also, wireless communication may be effected from the noises.
  • the object of the invention is to give pilots opportunity to control all the functions without any body movement, by just moving their hands.
  • Another object of the invention is to ease combination of the control increase by only software upgrades.
  • Another object of the invention is to provide interface to HMDs for function control.
  • Another object of the invention is to provide an EMI/EMC compatible sensing device.
  • Another object of the invention is to provide user friendly device in terms of use with glove. Another object of the invention is to provide settings to ease the integration of the system to master systems.
  • Figure 1 is the schematic of the A2Touch virtual control system.
  • Figure 2 is the connection of the system to pilot's glove.
  • the inventive system for virtual control system (1) essentially comprises
  • At least one sensor unit (2) which detects the hand motion
  • control unit (4) which calculates the hand position according to the data coming from the sensor unit (2)
  • At least one programming interface (6) to set the properties of the communication interface (5) and calculations ,
  • At least one sensor unit shield box (9) to protect sensors on the sensor unit (2) from EMI.
  • the step A2Touch system ON operation comprises the sub-steps of
  • OFF operation comprises the sub-steps of
  • A2Touch system sending stop command to master systems by the control unit (4),
  • the communication interface (5) supports the following standards
  • the programming interface (6) supports the following standard
  • the step programming via programming interface (6) comprises the sub-steps of
  • Selection distance is used to detect a selection command when the pilot moves his/her hand in downward direction trough z-axis (105) longer than or equal to selection distance.
  • A2Touch system sends the position data to master systems as pixel coordinates.
  • Sensitivity is used to update the position in terms of pixels according to setting when the hand moves certain millimeters.
  • A2Touch system In manual mode, A2Touch system waits for position request command from the master system. After the request command, A2Touch system calculates the position at that time and sends the information.
  • selection information is only send by the A2Touch system when the selection is done by the pilot.
  • A2Touch calculates and sends the position data according to refresh rate.
  • selection information is send always with the position data. In case of no selection, dummy information is sent.
  • the step communication via communication interface (5) comprises the sub-steps of
  • the step initialization comprises the sub-steps of
  • the sensor unit (2) is sticked to user glove and ON/OFF button (7) is sticked to pointing finger.
  • ON/OFF button cable (10) carries the electrical signal when the press action occurs. Also, this cable is strong enough to disconnect ON/OFF button from pointing finger when the sensor unit is pulled.
  • sensor unit shield box (9) protects the sensors on the sensor unit (2) from electromagnetic radiation.
  • shielded data & power cable (3) have four wires, two wires for power and two wires for data transfer.
  • the wire pairs have their own shielding around which are ended at sensor unit shield box (9) and control unit (4).
  • A2Touch virtual control system (1) consists of a sensor unit (2), a shielded power and data cable (3), a control unit (4), a communication interface (5), a programming interface (6), an ON/OFF button (7), a sensor unit connection interface (8), a sensor unit shield box (9), an ON/OFF button cable (10) and an ON/OFF button connection interface (11).
  • the ON/OFF button (7) is sticked to pilot pointing finger by the connection interface (11). The pilot presses the ON/OFF button (7) by his/her thumb (104) to start the A2Touch system.
  • Control unit (4) realizes the press action and sends a start command to master systems via communication interface (5).
  • the master systems display an icon (103) on their screens (102). The pilot releases the button after seeing the icon.
  • the A2Touch virtual control system (1) uses three coordinate axes (x, y, z (105)).
  • the user hand (101) movements are detected in these axes. These movements are detected by the sensor unit (2) which is stick on the user glove.
  • the motion data is transferred via data cable (3).
  • the movements on the x and y axes (105) will be result in position change.
  • a movement through z axes is accepted as a selection.
  • the position information is sent as pixel coordinates by the control unit (4).
  • selection command is sent if the user makes a selection by moving his/her hand downward through z-axis.
  • To stop the A2Touch system pilot presses the ON/OFF button (7) and waits until the icon (103) disappears from the screen (102). Then pilot releases the button. It is possible to remove sensor unit (2) and ON/OFF button (7) from the glove by just pulling the sensor unit (2).

Abstract

The present invention relates to system (1) to give pilots opportunity to control all the functions without any body movement, by just moving their hands (101). Another object of the invention is to ease combination of the control increase by only software upgrades. The invention is also an input device for HMD systems. Because of the shielding structure, the invention can be used at military platforms with EMI/EMC compatibility.

Description

DESCRIPTION
A2TOUCH (ASELSAN AIR TOUCH)
VIRTUAL CONTROL SYSTEM Field of the invention
This invention is related with a system that enables pilots to control avionic functions without any hard button press, only moving their hands in free air. Background of the invention
Pilots should stoop to the display to control the MFDs or KDUs by pressing hard buttons. This body movement may decrease the situational awareness. Also, the possible combination of controls is limited by the number of the hard buttons. On the other hand, HMD systems have limited input control interfaces like push buttons. Because of this, their display modules can't be used for function control, instead they can only be used for viewing.
(Here and after MFD, KDU, HMD and other avionic systems will be named as master systems.)
The United States patent application numbered US2013135240 discloses an apparatus for remotely operating a computer using a combination of voice commands and finger movements. The apparatus includes a microphone and a plurality of control elements in the form of touch- sensitive touchpads and/or motion- sensitive elements that are used to operate the computer and to move an on-screen cursor. The related invention can be a solution to remotely control the avionic functions. But pilots should wear glove and glove usage may create problems in touchpads and motion-sensitive elements. The United States patent application numbered US8373658 discloses a motion sensing system includes a hand-held device and a receiver device. The hand-held device includes a microcontroller, a G-sensor (one 3-axis accelerometer), only one 2- axisgyroscope, and a wireless transmitter. The receiver device is preferably a dongle and includes a microcontroller and a wireless receiver. The related invention can be a solution to remotely control the avionic functions. But the environment that the pilots need to use the system has EMC/EMI constraints; good shielding is required for the sensors to be compatible to EMI. Also, wireless communication may be effected from the noises.
Objects of the invention
The object of the invention is to give pilots opportunity to control all the functions without any body movement, by just moving their hands.
Another object of the invention is to ease combination of the control increase by only software upgrades.
Another object of the invention is to provide interface to HMDs for function control.
Another object of the invention is to provide an EMI/EMC compatible sensing device.
Another object of the invention is to provide user friendly device in terms of use with glove. Another object of the invention is to provide settings to ease the integration of the system to master systems.
Detailed description of the invention A2Touch virtual control system in order to fulfill the objects of the present invention is illustrated in the attached figures, where: Figure 1 is the schematic of the A2Touch virtual control system.
Figure 2 is the connection of the system to pilot's glove.
Elements shown in the figures are numbered as follows:
1. A2Touch Virtual Control System
2. Sensor Unit
3. Shielded Data & Power Cable
4. Control Unit
5. Communication Interface
6. Programming Interface
7. ON/OFF Button
8. Sensor unit connection Interface
9. Sensor Unit Shield Box
10. ON/OFF Button Cable
11. ON/OFF Button Connection Interface
101. User hand
102. Screen
103. Icon
104. Thumb
105. Axes
The inventive system for virtual control system (1) essentially comprises
at least one sensor unit (2) which detects the hand motion,
at least one shielded data and power cable (3)
· which carries the power and the data between sensor unit (2) and control unit (4)
• which is compatible for EMC/EMI.
at least one control unit (4) which calculates the hand position according to the data coming from the sensor unit (2),
- at least one communication interface (5) to send the calculated data by the control unit (4) to master systems,
at least one programming interface (6) to set the properties of the communication interface (5) and calculations ,
at least one ON/OFF button (7) to start and stop the A2Touch system (1) at least one sensor unit connection interface (8) to stick sensor unit (2) to pilot glove,
- at least one sensor unit shield box (9) to protect sensors on the sensor unit (2) from EMI.
at least one ON/OFF button cable (10) to connect ON/OFF button to sensor unit (2),
at least one ON/OFF button connection interface (11) to stick ON/OFF button (7) to pilot pointing finger.
In the preferred embodiment of the invention, the step A2Touch system ON operation comprises the sub-steps of
- pilot, pressing the ON/OFF button (7) with the thumb (104),
- A2Touch system, sending start command to master system by the control unit
(4),
master system, displaying an icon (103) on the screen (102),
pilot, releasing the ON/OFF button. In the preferred embodiment of the invention, while the A2Touch system is running, OFF operation comprises the sub-steps of
- pilot, pressing the ON/OFF button (7) with the thumb (104),
A2Touch system, sending stop command to master systems by the control unit (4),
- Master system, removing the icon (103) from the screen (102),
pilot, releasing the ON/OFF button.
In the preferred embodiment of the invention, the communication interface (5) supports the following standards
- full-duplex RS-485, In the preferred embodiment of the invention, the programming interface (6) supports the following standard
- RS-232,
In the preferred embodiment of the invention, the step programming via programming interface (6) comprises the sub-steps of
setting the preferred communication interface (5) standard,
setting the baud rate of the communication interface (5),
- setting the selection distance in terms of millimeters,
setting the resolution of the screen (102) that A2Touch system will be used in terms of pixel number,
setting the sensitivity of the A2Touch system in terms of pixels/milimeters, setting the mode of the A2Touch system operation; automatic or manual, - setting the refresh rate of the A2Touch system in automatic mode.
Selection distance is used to detect a selection command when the pilot moves his/her hand in downward direction trough z-axis (105) longer than or equal to selection distance.
A2Touch system sends the position data to master systems as pixel coordinates.
Resolution of the screen is used by the A2Touch system to know the screen borders. Sensitivity is used to update the position in terms of pixels according to setting when the hand moves certain millimeters.
In manual mode, A2Touch system waits for position request command from the master system. After the request command, A2Touch system calculates the position at that time and sends the information.
In manual mode, selection information is only send by the A2Touch system when the selection is done by the pilot.
In automatic mode, A2Touch calculates and sends the position data according to refresh rate.
In automatic mode, selection information is send always with the position data. In case of no selection, dummy information is sent.
In the preferred embodiment of the invention, the step communication via communication interface (5) comprises the sub-steps of
sending start / stop command to master system,
sending position data in terms of pixel coordinates,
sending selection command when a selection occurs,
receiving calculation request in manual mode,
- receiving platform position data to calculate relative position for the hand movements.
In the preferred embodiment of the invention, the step initialization comprises the sub-steps of
- waiting for ON/OFF button press,
sending center pixel coordinates to master systems after start command, setting the related hand position as the center when the ON/OFF button press detected. In the preferred embodiment of the invention, the sensor unit (2) is sticked to user glove and ON/OFF button (7) is sticked to pointing finger.
In the preferred embodiment of the invention, ON/OFF button cable (10) carries the electrical signal when the press action occurs. Also, this cable is strong enough to disconnect ON/OFF button from pointing finger when the sensor unit is pulled. In the preferred embodiment of the invention, sensor unit shield box (9) protects the sensors on the sensor unit (2) from electromagnetic radiation.
In the preferred embodiment of the invention, shielded data & power cable (3) have four wires, two wires for power and two wires for data transfer. The wire pairs have their own shielding around which are ended at sensor unit shield box (9) and control unit (4).
In the preferred embodiment of the invention, A2Touch virtual control system (1) consists of a sensor unit (2), a shielded power and data cable (3), a control unit (4), a communication interface (5), a programming interface (6), an ON/OFF button (7), a sensor unit connection interface (8), a sensor unit shield box (9), an ON/OFF button cable (10) and an ON/OFF button connection interface (11). In the preferred embodiment of the invention, the ON/OFF button (7) is sticked to pilot pointing finger by the connection interface (11). The pilot presses the ON/OFF button (7) by his/her thumb (104) to start the A2Touch system. Control unit (4) realizes the press action and sends a start command to master systems via communication interface (5). The master systems display an icon (103) on their screens (102). The pilot releases the button after seeing the icon.
In the preferred embodiment of the invention, the A2Touch virtual control system (1) uses three coordinate axes (x, y, z (105)). The user hand (101) movements are detected in these axes. These movements are detected by the sensor unit (2) which is stick on the user glove. The motion data is transferred via data cable (3). The movements on the x and y axes (105) will be result in position change. A movement through z axes is accepted as a selection.
In the preferred embodiment of the invention, the position information is sent as pixel coordinates by the control unit (4). With the position data, selection command is sent if the user makes a selection by moving his/her hand downward through z-axis. To stop the A2Touch system pilot presses the ON/OFF button (7) and waits until the icon (103) disappears from the screen (102). Then pilot releases the button. It is possible to remove sensor unit (2) and ON/OFF button (7) from the glove by just pulling the sensor unit (2).

Claims

The inventive A2Touch virtual control system (1) essentially comprises at least one sensor unit (2) which detects the hand motion,
at least one shielded data and power cable (3)
• which carries the power and the data between sensor unit (2) and control unit (4)
• which is compatible for EMC/EMI.
at least one control unit (4) which calculates the hand position according to the data coming from the sensor unit (2),
at least one communication interface (5) to send the calculated data by the control unit (4) to master systems,
at least one programming interface (6) to set the properties of the communication interface (5) and calculations ,
at least one ON/OFF button (7) to start and stop the A2Touch system
(1) ,
at least one sensor unit (2) connection interface (8) to stick sensor unit
(2) to pilot glove,
at least one sensor unit shield box (9) to protect sensors on the sensor unit (2) from EMI,
- at least one ON/OFF button (7) cable (10) to connect ON/OFF button to sensor unit (2),
at least one ON/OFF button (7) connection interface (11) to stick ON/OFF button (7) to pilot pointing finger.
In the preferred embodiment of the invention, the step A2Touch ON operation comprises the sub-steps of
- pilot, pressing the ON/OFF button (7) with the thumb (104),
A2Touch system, sending start command to master systems by the control unit (4),
master system, displaying an icon (103) on the screen (102),
pilot, releasing the ON/OFF button. In the preferred embodiment of the invention, while the A2Touch system is running, OFF operation comprises the sub-steps of
- pilot, pressing the ON/OFF button (7) with the thumb (104),
A2Touch system, sending stop command to master systems by the control unit (4),
master system, removing the icon (103) from the screen (102), pilot, releasing the ON/OFF button.
In the preferred embodiment of the invention, the step programming via programming interface (6) comprises the sub-steps of
setting the preferred communication interface (5) standard,
setting the baud rate of the communication interface (5),
setting the selection distance (105) in terms of millimeters,
setting the resolution of the screen (102) that A2Touch system will be used in terms of pixel number,
setting the sensitivity of the A2Touch system in terms of pixels/ millimeters,
setting the mode of the A2Touch system operation; automatic or manual, setting the refresh rate of the A2Touch system in automatic mode.
The A2Touch virtual control system (1) according to claim 1 characterized by using the selection distance to detect a selection by hand movement downward through z axes (105).
The A2Touch virtual control system (1) according to claim 1 characterized by sending the position data as pixel coordinates.
The A2Touch virtual control system (1) according to claim 1 characterized by using the master system screen (102) resolution to know the screen borders.
8. The A2Touch virtual control system (1) according to claim 7 characterized by stopping to update hand position when the pilot's hand move outside the screen borders.
9. The A2Touch virtual control system (1) according to claim 1 characterized by using sensitivity information to update the position in terms of pixels when the hand moves certain millimeters.
10. The A2Touch virtual control system (1) according to claim 1 characterized by having operation modes; automatic or manual.
11. In manual mode, the A2Touch virtual control system (1) according to claim 10 characterized by waiting for position request command from the master system. After the request command, calculating the position at that time and sending the information.
12. In manual mode, the A2Touch virtual control system (1) according to claim 10 characterized by sending selection information when the selection is done
13. In automatic mode, the A2Touch virtual control system (1) according to claim 10 characterized by calculating and sending the position data according to refresh rate.
14. In automatic mode, the A2Touch virtual control system (1) according to claim 10 characterized by, sending selection information always with the position data. In case of no selection, sending dummy information.
15. In the preferred embodiment of the invention, the step communication via communication interface (5) comprises the sub-steps of
sending start / stop command to master system, sending position data in terms of pixel coordinates,
sending selection command when a selection occurs,
receiving calculation request in manual mode,
receiving platform position data to calculate relative position for the hand movements.
16. In the preferred embodiment of the invention, the step initialization comprises the sub-steps of
waiting for ON/OFF button press,
- sending center pixel coordinates to master systems after start command, setting the related hand position as the center when the ON/OFF button press detected.
17. The A2Touch virtual control system (1) according to claim 1 characterized by sticking the sensor unit (2) is to user glove.
18. The A2Touch virtual control system (1) according to claim 1 characterized by sticking ON/OFF button (7) to pointing finger.
19. The A2Touch virtual control system (1) according to claim 1 characterized by having the ON/OFF button cable strong enough to disconnect ON/OFF button from pointing finger when the sensor unit is pulled.
20. The A2Touch virtual control system (1) according to claim 1 characterized by having sensor unit shield box (9) to protect the sensors on the sensor unit (2) from electromagnetic radiation.
21. The A2Touch virtual control system (1) according to claim 1 characterized by having shielded data & power cable (3) with four wires, two wires for power and two wires for data transfer. The wire pairs have their own shielding around which are ended at sensor unit shield box (9) and control unit (4).
PCT/IB2013/058221 2013-09-02 2013-09-02 A2touch (aselsan air touch) virtual control system WO2015028849A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IB2013/058221 WO2015028849A1 (en) 2013-09-02 2013-09-02 A2touch (aselsan air touch) virtual control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2013/058221 WO2015028849A1 (en) 2013-09-02 2013-09-02 A2touch (aselsan air touch) virtual control system

Publications (1)

Publication Number Publication Date
WO2015028849A1 true WO2015028849A1 (en) 2015-03-05

Family

ID=49448229

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2013/058221 WO2015028849A1 (en) 2013-09-02 2013-09-02 A2touch (aselsan air touch) virtual control system

Country Status (1)

Country Link
WO (1) WO2015028849A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US5128671A (en) * 1990-04-12 1992-07-07 Ltv Aerospace And Defense Company Control device having multiple degrees of freedom
US6025831A (en) * 1997-11-19 2000-02-15 Avrotec, Inc. Method and apparatus for accurate controls input
US20060125968A1 (en) * 2004-12-10 2006-06-15 Seiko Epson Corporation Control system, apparatus compatible with the system, and remote controller
US20080136385A1 (en) * 2006-12-08 2008-06-12 Aten International Co., Ltd. Power transmission system
US20090322680A1 (en) * 2008-06-30 2009-12-31 Maurizio Sole Festa Radio frequency pointing device
US20110285623A1 (en) * 2010-05-24 2011-11-24 Cywee Group Limited Motion Sensing System
US20130135240A1 (en) 2000-07-01 2013-05-30 Stephen S. Miller Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US4988981B1 (en) * 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US5128671A (en) * 1990-04-12 1992-07-07 Ltv Aerospace And Defense Company Control device having multiple degrees of freedom
US6025831A (en) * 1997-11-19 2000-02-15 Avrotec, Inc. Method and apparatus for accurate controls input
US20130135240A1 (en) 2000-07-01 2013-05-30 Stephen S. Miller Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements
US20060125968A1 (en) * 2004-12-10 2006-06-15 Seiko Epson Corporation Control system, apparatus compatible with the system, and remote controller
US20080136385A1 (en) * 2006-12-08 2008-06-12 Aten International Co., Ltd. Power transmission system
US20090322680A1 (en) * 2008-06-30 2009-12-31 Maurizio Sole Festa Radio frequency pointing device
US20110285623A1 (en) * 2010-05-24 2011-11-24 Cywee Group Limited Motion Sensing System
US8373658B2 (en) 2010-05-24 2013-02-12 Cywee Group Limited Motion sensing system

Similar Documents

Publication Publication Date Title
US10001833B2 (en) User input system for immersive interaction
US10948950B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
US9268400B2 (en) Controlling a graphical user interface
US20140022171A1 (en) System and method for controlling an external system using a remote device with a depth sensor
WO2017177006A1 (en) Head mounted display linked to a touch sensitive input device
JP2015507803A (en) System and method for enhanced gesture-based dialogue
US10890982B2 (en) System and method for multipurpose input device for two-dimensional and three-dimensional environments
CN111258420B (en) Information interaction method, head-mounted device and medium
US11209937B2 (en) Error correction for seamless transition between hover and touch sensing
US10768718B2 (en) Touch sensor
CN105302021A (en) Wearable gesture control device for controlling movement of robot in human-computer collaborative remanufacturing
EP2538308A2 (en) Motion-based control of a controllled device
CN106716304B (en) Control unit and method for interacting with a graphical user interface
US20150009136A1 (en) Operation input device and input operation processing method
TW201325101A (en) Distant multipoint remote control device and system
KR101339655B1 (en) System for driving smart tv using motion sensor user experience bases and the method
KR20210010361A (en) Electronic device for remote hover touch and remote inetraction method
US20120062477A1 (en) Virtual touch control apparatus and method thereof
WO2015028849A1 (en) A2touch (aselsan air touch) virtual control system
WO2009063781A1 (en) Cursor control device, cursor control system and control method of cursor control device
CN108563376B (en) Application program starting method and mobile terminal
EP3764212A1 (en) Electronic device for recognizing user input using sensor and method thereof
WO2014014461A1 (en) System and method for controlling an external system using a remote device with a depth sensor
US20120182231A1 (en) Virtual Multi-Touch Control Apparatus and Method Thereof
CN110888529B (en) Virtual reality scene control method, virtual reality device and control device thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13779932

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2016/02517

Country of ref document: TR

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13779932

Country of ref document: EP

Kind code of ref document: A1