WO2012164043A1 - Système comportant un oculomètre, procédé mis en oeuvre sur un tel système et produit programme d'ordinateur correspondant - Google Patents
Système comportant un oculomètre, procédé mis en oeuvre sur un tel système et produit programme d'ordinateur correspondant Download PDFInfo
- Publication number
- WO2012164043A1 WO2012164043A1 PCT/EP2012/060309 EP2012060309W WO2012164043A1 WO 2012164043 A1 WO2012164043 A1 WO 2012164043A1 EP 2012060309 W EP2012060309 W EP 2012060309W WO 2012164043 A1 WO2012164043 A1 WO 2012164043A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- eye
- display
- operator
- movements
- frame
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F4/00—Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Definitions
- the invention relates to a system comprising an oculometer for measuring movements of at least one eye of an operator.
- the invention also relates to a method implemented on such a system, and a corresponding computer program product.
- Systems comprising an eye tracker for measuring movements of at least one eye of an operator, for example having lost a traction of his upper limbs, to select objects proposed on a display, for example for a written communication.
- the objects proposed on the known displays are for example the letters and / or numbers and / or commands of a keyboard, for example of the type of a computer keyboard.
- a fixation of the eye on the object to be selected for a predetermined duration and / or blinking of the eyelids
- the known systems require a reiterated and very precise calibration of the oculometer, because they use the direction of gaze of the eye to designate as target the object to be selected.
- the invention proposes to overcome at least one of these disadvantages.
- a system comprising an oculometer for measuring movements of at least one eye of an operator, characterized in that it further comprises a display for displaying, for the purpose of at least one movement is flicked so that the operator can perform at least one movement of the eye while looking at the display in operation.
- the display comprises at least one coordinate sensor of a projection of a direction from a glance of the eye on the display, and is adapted to display a marker in the frame, the position of the marker on the display being a function of the coordinates of the projection of the direction of gaze of the eye on the display;
- the system comprises a unit for processing the movements of the eye of the operator, for a generation of at least one graphic, and / or of at least one letter, and / or of at least one digit, and / or at least one sound, and / or at least one command;
- the oculometer is adapted to also measure a pupil diameter of the eye of the operator, the unit being adapted to modulate the graph and / or the letter and / or the number and / or the sound and / or or the control according to the diameter of the pupil of the eye of the operator;
- the system further comprises an interface for adjusting the contrast and / or flicker frequency of the frame;
- the invention also relates to a method implemented on such a system, and a corresponding computer program product.
- the invention has many advantages.
- El allows a generation of objects under a custom form u, the plot being derived from a smooth tracking movement of the eye of the operator, measured by the eye tracker.
- Custom layout allows generation
- the operator is therefore more limited to objects having a predefined form, but can give free rein to his creativity, and generate objects imbued with his personality (as for example a personal cursive writing and / or a signature), especially in an operator authentication solution.
- the invention requires an inaccurate calibration because it uses the relative movements of the eye to form the object to be generated, and not the direction of the gaze of the eye to designate as target the object to be selected as in the prior art.
- the invention has many fields of application. It is thus possible to cite, by way of non-limiting examples:
- AMD age-related macular degeneration
- cognitive dislexia, dyspraxia
- neurological disorders or neurological disorders
- FIG. 1 diagrammatically represents a possible embodiment of a system according to the invention
- FIG. 2 diagrammatically represents a possible implementation of a method according to the invention
- FIG. 3 schematically represents the display of a frame on a display
- FIGS. 4A and 4B schematically represent a flicker of a frame on a display
- FIGS. 5A, 5B, 5C and 5D schematically represent examples of objects generated by a system according to the invention.
- FIG. 1 diagrammatically represents a possible embodiment of a system according to the invention, implementing a possible method shown diagrammatically in FIG. 2.
- the system mainly comprises an eye tracker 1, for measuring, during a step E1, movements of at least one eye O of an operator.
- the oculometer 1 is a device for measuring the movements of the eye, known to those skilled in the art, and available commercially.
- It generally comprises at least one camera 10 oriented towards the eye O of the operator, for a direct observation of the eye O and a measurement of the movements of the eye O in an orbit of the operator.
- the camera 10 is connected to a processor 1 1 of the eye tracker 1 for recording and processing the movements of the eye O of the operator. It is worn by a helmet 12 on the operator.
- a non-limiting example of an oculometer 1 that can be used is the oculometer of the Eye-Link II brand, from the company called SR-Research.
- the system further comprises a display 2 for displaying, for the eye O and in a step E2, a frame T consisting of at least one point P performing a flicker.
- the frame T is any pattern consisting of at least the point P, visible by the operator. Preferentially, the frame T comprises a plurality of points P.
- the points P may, for example, be distributed randomly on the display 2.
- the points P may be of unequal sizes with each other, and the frame T may have several densities of points P on the display 2.
- Figures 4A and 4B show more precisely that the frame T flickers on the display 2, visible by the operator.
- Flicker of the weft T perceptible by the eye O, is called flicker on the display 2.
- the frame T is poorly contrasted with respect to a screen background of the display 2, to avoid excessive fatigue of the eye O of the operator.
- the wallpaper may for example be of medium gray color, but any other color can of course be considered.
- the flicker is obtained by rhythmically inverting a shade of the points of the frame T.
- the frame T is displayed with a clear shade (for example in white or in a shade lighter than the color of the screen of the display 2) for a predetermined period of time, by the display 2, as the shows Figure 4A; then
- the frame T is displayed with a dark shade (for example in black or in a shade darker than the screen background color of the display 2) during the same predetermined period of time, by the display 2, as shown in Figure 4B.
- a dark shade for example in black or in a shade darker than the screen background color of the display 2
- the flicker frequency is for example between 10Hz and 40Hz, preferably between 20Hz and 30Hz, with a preferred value at 25Hz, for example.
- the display 2 may be a computer or television monitor, or a passive screen on which the frame T is projected by a projector for example.
- the system comprises a processing unit 3 (preferably but not exclusively in the form of a processor of a computer), connected to the monitor or connected to the aforementioned projector, and which controls the display of the frame T on the display 2.
- the processing unit 3 also controls an interface 31 (for example in the form of a graphic control screen) of the system, the interface 31 allowing the operator to adjust the contrast and / or the frequency flickering of the weft T.
- the operator can perform at least one smooth tracking movement of the eye O, while viewing the display 2 in operation, that is to say displaying the flickering of the frame T.
- a smooth tracking movement is a continuous movement of the eye in the orbit, and not a movement by saccade.
- the movements of the eye O are measured continuously and in real time by the eye tracker 1: the processor 1 1 records and processes the movements of the eye O measured by the camera 10.
- the processor 11 is connected to the processing unit 3, for example in the form of an Ethernet port when the processing unit 3 is in the form of a processor of a computer .
- the movements of the eye are interpreted as a trajectory by the unit 3, and recorded on a memory of the unit 3 of treatment.
- the trajectory is rendered in the form of a graphic trace that can be processed by the unit 3.
- the treatment of the movements of the eye O includes taking into account a separation of the trace in successive segments.
- the separation can be controlled by the operator, for example by stopping the movements of the eye for a predetermined period or by blinking the eyelids of the eye.
- the unit 3 thus makes it possible, during a step E4, to generate, from the segments of the graphic trace:
- FIG. 5A At least one graph (FIG. 5A), and / or
- Unit 3 can be connected to a device 4, taking into account the generation from unit 3.
- the device 4 can be of any type, for example a computer comprising
- the graph of FIG. 5A can be any graphic, figurative (here symbolizing a house) or abstract, which allows in particular a communication and an artistic expression of the operator, by display on the screen and / or printing on the screen. printer and / or plot on the plotter of the device 4.
- FIG. 5B shows that the words of the expression "eye on line” in FIG. 5B are separated from one another by, for example, blinking, and each word corresponds to a segment of the graphic trace.
- Figure 5C shows that it is also possible to generate the number 123 by numbers 1, 2 and 3 separated from each other for example by a blink of the eyelids.
- FIG. 5B or the number of FIG. 5A may be displayed on the screen and / or printed on the printer and / or plotted on the plotter and / or recorded on the memory of the device 4.
- the processing by the unit 3 also comprises a reduction and / or formatting and / or layout of the segments. of the graphic trace.
- the smooth tracking movements of the eye O while viewing the display 2 are in fact of a large amplitude, for a greater comfort of movement of the eye O, and therefore do not generally correspond to a conventional format, as an A4 format in portrait mode.
- the aforementioned treatment may also be carried out in whole or in part by the device 4.
- the device 4 can also emit a modulated sound, for example in the intensity and / or the pitch and / or the timbre, in function of the object generated by the movements of the eye O.
- the device comprises in combination the word processing and / or drawing software and the sound generation software and a loudspeaker, the device 4 can also emit a sound corresponding to a letter generated by the movements of the eye O.
- FIG. 5D shows that it is also possible to generate an "upward" command, for example for lifting a blind from a window connected to the device 4.
- FIG. 1 shows that the display 2 comprises at least one sensor 21 with coordinates (x, y) of a projection C of a direction DR of a look of the eye O on the display 2, this measurement of the sensor 21 being performed during a step E3.
- the sensor 21 can thus measure the position, in particular of marks 1 21 of the helmet 1 2, and use the measurements of the oculometer 1, since the sensor 121 is connected to the unit 3.
- the sensor 21 thus allows a calibration of the oculometer 1 with respect to the display 2.
- the calibration can be relatively inaccurate, and therefore be performed quickly during initialization of the system, the calibration is not used for the generation of objects, the latter mainly using the smooth tracking movements of the eye O.
- the display 2 is also advantageously adapted to display, during the step E3, a mark R in the frame T, the position of the mark R on the display 2 being a function of the coordinates (x, y) of the projection C from the direction DR eyes eye O on the display 2.
- the marker R thus forms a real-time indicator, perceptible by the operator, allowing the latter to control the movement and speed of his eye O .
- the reference R may be of any shape, but is very preferably peripheral with respect to the projection C of the direction DR of the gaze of the eye O on the display 2.
- the diameter of the ring may be arbitrary, but advantageously represents between 1/16 e and 1/8 e of the surface of the display 2 for example.
- the R mark may be permanently displayed during operation of the display 2, but may also be flashing.
- the mark must be perceptible to the eye, and is therefore more contrasted than the frame T relative to the wallpaper of the display 2.
- the shape, size and contrast of the marker can be set by the operator via the interface 31 of the system.
- the oculometer 1 is adapted to also measure a pupil diameter of the eye O of the operator
- the unit 3 is adapted to modulate the graph and / or the letter and / or the number and / or the sound and / or control as a function of the pupil diameter of the eye O of the operator.
- the line thickness of the line can thus increase as the diameter of the pupil increases, to increase the expressiveness of the writing, because the diameter of the pupil of the eye reflects the emotions of the operator.
- processor 1 1 can be included in the unit 3, and conversely, and / or
- all or part of the device 4 can be included in the unit 3, and conversely, and / or
- the invention also relates to a computer program product comprising instructions which, when loaded onto a memory of a computer, allow the implementation of a method according to the invention.
- the product can be on any computer support, such as memory or a CD-ROM.
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2837867A CA2837867C (fr) | 2011-06-01 | 2012-05-31 | Systeme comportant un oculometre, procede mis en oeuvre sur un tel systeme et produit programme d'ordinateur correspondant |
JP2014513197A JP5937204B2 (ja) | 2011-06-01 | 2012-05-31 | オキュロメータを有するシステム、このようなシステムに実装される方法及び対応するコンピュータプログラム |
KR1020137034547A KR101915273B1 (ko) | 2011-06-01 | 2012-05-31 | 눈 측정기를 포함하는 시스템, 이 시스템에서 구현되는 방법 및 대응하는 컴퓨터 프로그램 제품 |
US14/122,412 US20140240217A1 (en) | 2011-06-01 | 2012-05-31 | System comprising an oculometer, method implemented on such a system and corresponding computer program product |
EP12724649.4A EP2713850B1 (fr) | 2011-06-01 | 2012-05-31 | Système comportant un oculomètre, procédé mis en oeuvre sur un tel système et produit programme d'ordinateur correspondant |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1101695A FR2975885B1 (fr) | 2011-06-01 | 2011-06-01 | Systeme comportant un oculometre, procede mis en oeuvre sur un tel systeme et produit programme d'ordinateur correspondant |
FR11/01695 | 2011-06-01 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012164043A1 true WO2012164043A1 (fr) | 2012-12-06 |
Family
ID=46197283
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2012/060309 WO2012164043A1 (fr) | 2011-06-01 | 2012-05-31 | Système comportant un oculomètre, procédé mis en oeuvre sur un tel système et produit programme d'ordinateur correspondant |
Country Status (7)
Country | Link |
---|---|
US (1) | US20140240217A1 (fr) |
EP (1) | EP2713850B1 (fr) |
JP (1) | JP5937204B2 (fr) |
KR (1) | KR101915273B1 (fr) |
CA (1) | CA2837867C (fr) |
FR (1) | FR2975885B1 (fr) |
WO (1) | WO2012164043A1 (fr) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150015489A1 (en) * | 2010-06-01 | 2015-01-15 | Vladimir Vaganov | System and method for digital recording of handpainted, handdrawn and handwritten information |
US9377852B1 (en) * | 2013-08-29 | 2016-06-28 | Rockwell Collins, Inc. | Eye tracking as a method to improve the user interface |
US9483115B2 (en) * | 2013-05-31 | 2016-11-01 | Disney Enterprises, Inc. | Triggering control of audio for walk-around characters |
WO2015127146A1 (fr) | 2014-02-19 | 2015-08-27 | Evergaze, Inc. | Appareil et procédé pour optimiser, augmenter ou améliorer la vision |
CN106325500B (zh) * | 2016-08-08 | 2019-04-19 | 广东小天才科技有限公司 | 信息框选方法及装置 |
US10839520B2 (en) * | 2017-03-03 | 2020-11-17 | The United States Of America, As Represented By The Secretary, Department Of Health & Human Services | Eye tracking applications in computer aided diagnosis and image processing in radiology |
JP6928382B2 (ja) * | 2018-08-24 | 2021-09-01 | 学校法人北里研究所 | 視認性評価システム |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1219243A1 (fr) * | 2000-12-28 | 2002-07-03 | Matsushita Electric Works, Ltd. | Examen de la fonction cérébrale non invasife |
US7918558B1 (en) * | 2010-07-22 | 2011-04-05 | Preventive Ophthalmics | System and method for testing retinal function |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5801807A (en) * | 1995-08-08 | 1998-09-01 | Nikon Corporation | Ophthalmic illumination device having adjustable transmittance member and microscope for operation using the same |
JP2000010722A (ja) * | 1998-06-18 | 2000-01-14 | Mr System Kenkyusho:Kk | 視線ユーザ・インタフェース装置、そのインタフェース方法、コンピュータ装置、その制御方法、およびプログラム記憶媒体 |
US7753524B2 (en) * | 2002-02-08 | 2010-07-13 | Novavision, Inc. | Process and device for treating blind regions of the visual field |
JP2006277192A (ja) * | 2005-03-29 | 2006-10-12 | Advanced Telecommunication Research Institute International | 映像表示システム |
US20100010370A1 (en) * | 2008-07-09 | 2010-01-14 | De Lemos Jakob | System and method for calibrating and normalizing eye data in emotional testing |
US8482562B2 (en) * | 2009-12-03 | 2013-07-09 | International Business Machines Corporation | Vision-based computer control |
-
2011
- 2011-06-01 FR FR1101695A patent/FR2975885B1/fr not_active Expired - Fee Related
-
2012
- 2012-05-31 US US14/122,412 patent/US20140240217A1/en not_active Abandoned
- 2012-05-31 WO PCT/EP2012/060309 patent/WO2012164043A1/fr active Application Filing
- 2012-05-31 EP EP12724649.4A patent/EP2713850B1/fr not_active Not-in-force
- 2012-05-31 KR KR1020137034547A patent/KR101915273B1/ko active IP Right Grant
- 2012-05-31 CA CA2837867A patent/CA2837867C/fr not_active Expired - Fee Related
- 2012-05-31 JP JP2014513197A patent/JP5937204B2/ja not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1219243A1 (fr) * | 2000-12-28 | 2002-07-03 | Matsushita Electric Works, Ltd. | Examen de la fonction cérébrale non invasife |
US7918558B1 (en) * | 2010-07-22 | 2011-04-05 | Preventive Ophthalmics | System and method for testing retinal function |
Non-Patent Citations (2)
Title |
---|
SATO, T.: "Reversed apparent motion with random dot patterns", VISION RESEARCH, vol. 29, 1989, pages 1749 - 1758, XP024311491, DOI: doi:10.1016/0042-6989(89)90157-0 |
SPILLMANN L. ET AL.: "Reversed visual motion and self-sustaining eye oscillations", PERCEPTION, vol. 26, no. 7, 1997, pages 823 - 30 |
Also Published As
Publication number | Publication date |
---|---|
FR2975885A1 (fr) | 2012-12-07 |
US20140240217A1 (en) | 2014-08-28 |
EP2713850A1 (fr) | 2014-04-09 |
FR2975885B1 (fr) | 2013-06-21 |
JP5937204B2 (ja) | 2016-06-22 |
CA2837867A1 (fr) | 2012-12-06 |
JP2014515295A (ja) | 2014-06-30 |
EP2713850B1 (fr) | 2017-07-05 |
KR20140058448A (ko) | 2014-05-14 |
KR101915273B1 (ko) | 2018-11-06 |
CA2837867C (fr) | 2019-07-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2713850B1 (fr) | Système comportant un oculomètre, procédé mis en oeuvre sur un tel système et produit programme d'ordinateur correspondant | |
EP3368170B1 (fr) | Réglage de trames d'images basé sur le suivi du mouvement des yeux | |
JP6470334B2 (ja) | 車両の表示システム及び車両の表示システムの制御方法 | |
KR20170104463A (ko) | 개선된 디스플레이를 위한 시스템 및 방법 | |
WO2015024790A1 (fr) | Procede d'assistance a l'exploration visuelle pour un individu atteint d'une pathologie retinienne se traduisant par un scotome | |
JP5109750B2 (ja) | 運転者状態検出装置、意識状態検出方法 | |
US10881289B2 (en) | Device for testing the visual behavior of a person, and method for determining at least one optical design parameter of an ophthalmic lens using such a device | |
CN107077822A (zh) | 控制设备、控制方法和程序 | |
EP3145387B1 (fr) | Méthode de test visuel d'un individu | |
TWI642407B (zh) | 腦波偵測情緒裝置 | |
FR2994736A1 (fr) | Systeme de visualisation, notamment pour aeronef, a ecran transparent et a symbologie peripherique | |
Murakami | Illusory jitter in a static stimulus surrounded by a synchronously flickering pattern | |
EP3361930B1 (fr) | Méthode de détermination d'un paramètre de comportement visuel d'un individu et dispositif de test associé | |
JP2017536872A (ja) | 乳幼児検査方法及びその検査方法の実装に適した装置 | |
EP3334328B1 (fr) | Procédé de détermination de moyens d'aide visuelle par rapport au comportement d'un individu soumis a un test | |
CN111938600B (zh) | 数字数据的艺术表示 | |
EP1686886B1 (fr) | Appareil de diagnostic ophtalmique pour differents types de tests | |
Riecke et al. | Spatial updating experiments in Virtual Reality: What makes the world turn around in our head? | |
US11033219B2 (en) | Apparatus and method for identifying gaze stability of patient | |
JP2007014417A (ja) | 視力回復訓練装置 | |
WO2020065203A1 (fr) | Procédé et dispositif d'observation oculaire, et application biométrique | |
Shishavan et al. | Closed-Loop Brain Machine Interface System for In-Vehicle Function Controls Using Head-Up Display and Deep Learning Algorithm | |
van Leeuwen et al. | Rapid spatial oculomotor updating across saccades is malleable | |
FR3132571A1 (fr) | Positionnement et repositionnement avec une référence visuelle pour la navigation virtuelle | |
Gish | Fixation instability and visual performance |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12724649 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2837867 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 2014513197 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2012724649 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20137034547 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14122412 Country of ref document: US |