CA2381977A1 - Variable immersion vignetting display - Google Patents
Variable immersion vignetting display Download PDFInfo
- Publication number
- CA2381977A1 CA2381977A1 CA002381977A CA2381977A CA2381977A1 CA 2381977 A1 CA2381977 A1 CA 2381977A1 CA 002381977 A CA002381977 A CA 002381977A CA 2381977 A CA2381977 A CA 2381977A CA 2381977 A1 CA2381977 A1 CA 2381977A1
- Authority
- CA
- Canada
- Prior art keywords
- conformally
- display
- variably transmissive
- real world
- transmissive element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0118—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B2027/0192—Supplementary details
- G02B2027/0198—System for aligning or maintaining alignment of an image in a predetermined direction
Abstract
A see through display includes a variably transmissive element (14) positioned between a real world view and an eye of a user, and a generated display optical system for generating a displayed information image superimposed over the real world view in the visual field of the user. The variably transmissive element is controllable to dynamically vary the light intensity passing through the element into the visual field of the user. The variably transmissive element may be spatially addressed to allow selective variable transfer of light intensity through the element into the visual field of the user.
Description
VARIABLE IMMERSION VIGNETTING DISPLAY
Field The present invention relates generally to conformally registered display systems including but not limited to head mounted displays, and more specifically to see-through displays for conformally registered display systems.
Background In current head mounted display (HMD) systems, two views are presented to the user of the system. The two views are typically a real world outside view, and a displayed information view which is a generated view. The generated view may be provided by a situational awareness system (SAS). The two views can be overlaid one on top of the other in the sight line of the user in a see-through HMD.
Head mounted displays (HMDs) are extremely useful in any number of situations, including military applications such as flight operations, field operations, and the like. Commercial flight operations also can make use of HMD systems in much the same fashion as military operations. Other uses of HMD systems include use in maintenance operations. For example, a HMD
could be used to overlay a schematic of a work area or circuit over the work area or circuit. Also, a list of instructions could be placed in the visual field of the user so as to be seen while a worker is also viewing a real world object on which maintenance is to be performed. The applications are many and varied, and these are just some of the uses of HMDs.
The utility of the see-through HMD design whether implemented in monocular, binocular, or biocular form is that it allows simultaneous viewing of the outside world's visual field in addition to the information directed to the viewer via the Electrooptic display. There are many applications for this such as the coupling of an electronically generated targeting reticule conformally registered to an outside scene for bore sighted weapons system control. Such see-through HMD systems have also been proposed as the visual information conveyance channel for computer-aided situational awareness systems (SAS).
The basic idea of these SASs is to provide an individual team worker (or soldier for military applications) the timely and contextually task appropriate information needed to perform his job plan via autonomous SW agents polling, analyzing, fusing all networked data resources available as the work plan/mission
Field The present invention relates generally to conformally registered display systems including but not limited to head mounted displays, and more specifically to see-through displays for conformally registered display systems.
Background In current head mounted display (HMD) systems, two views are presented to the user of the system. The two views are typically a real world outside view, and a displayed information view which is a generated view. The generated view may be provided by a situational awareness system (SAS). The two views can be overlaid one on top of the other in the sight line of the user in a see-through HMD.
Head mounted displays (HMDs) are extremely useful in any number of situations, including military applications such as flight operations, field operations, and the like. Commercial flight operations also can make use of HMD systems in much the same fashion as military operations. Other uses of HMD systems include use in maintenance operations. For example, a HMD
could be used to overlay a schematic of a work area or circuit over the work area or circuit. Also, a list of instructions could be placed in the visual field of the user so as to be seen while a worker is also viewing a real world object on which maintenance is to be performed. The applications are many and varied, and these are just some of the uses of HMDs.
The utility of the see-through HMD design whether implemented in monocular, binocular, or biocular form is that it allows simultaneous viewing of the outside world's visual field in addition to the information directed to the viewer via the Electrooptic display. There are many applications for this such as the coupling of an electronically generated targeting reticule conformally registered to an outside scene for bore sighted weapons system control. Such see-through HMD systems have also been proposed as the visual information conveyance channel for computer-aided situational awareness systems (SAS).
The basic idea of these SASs is to provide an individual team worker (or soldier for military applications) the timely and contextually task appropriate information needed to perform his job plan via autonomous SW agents polling, analyzing, fusing all networked data resources available as the work plan/mission
2 progresses. The SAS computer condensed data is then conveyed via several channels (e.g. visual, aural, tactile) to the appropriate individuals in the team.
The intent of the SAS is to optimally exploit the available data resources for the best possible collaborative team outcome against the mission/plan objective.
HMD systems typically use a beam sputter in combination with a combiner, as well as software and support hardware, to generate the two superimposed views. The beam sputter has a defined fixed splitting ratio. The beam splitter splits light intensities which are directed to the display in a fixed ratio. The typical beam splitter ratio is a fixed ratio of fifty per cent light intensity from the outside or real world view, and fifty per cent intensity from the displayed information view. As a result, the views overlie one another and are superimposed. Each view is therefore in the visual field of the user. Changing the ratio of real world to displayed information light intensity requires changing the beam sputter for a different ratio beam sputter.
Some tasks are aided well by information available both via direct view and displayed information (such as an oil refinery worker team trying to manage an abnormal situation, or a team of soldiers on a combat mission). However, the compromise 50/50 split is clearly not optimal for all phases of the work/task cycle to be completed. During some phases of plan execution, the displayed information channel is the desired focus of attention for the user. During other phases of plan execution, the direct view is the desired focus of attention.
Certain problems exist with the use of a fixed ratio beam splitter, no matter what the fixed ratio is. Situations in which a HMD system is used may dramatically and rapidly change over small time periods. It is not practical to reconfigure a current HMD system during use. The beam sputter ratio in place when the situation use begins is for all practical purposes the beam sputter ratio in place when the particular use ends.
However, changing situations may call for or be best served by a change in the beam splitter ratio or real world to displayed information light intensity. For example, in certain situations, it is desirable for the entire visual display to be provided solely by either the real world outside or displayed information views.
In the case of a worker studying a schematic, any outside world background may interfere with a portion or portions of the schematic, making it difficult or even impossible to read. In this situation, it would be desirable to exclude the outside world view, and instead transmit only the displayed view. In another instance, the focus of the user may need to be directed entirely to the outside world.
For example, when the real world visual field must be searched for a certain object or
The intent of the SAS is to optimally exploit the available data resources for the best possible collaborative team outcome against the mission/plan objective.
HMD systems typically use a beam sputter in combination with a combiner, as well as software and support hardware, to generate the two superimposed views. The beam sputter has a defined fixed splitting ratio. The beam splitter splits light intensities which are directed to the display in a fixed ratio. The typical beam splitter ratio is a fixed ratio of fifty per cent light intensity from the outside or real world view, and fifty per cent intensity from the displayed information view. As a result, the views overlie one another and are superimposed. Each view is therefore in the visual field of the user. Changing the ratio of real world to displayed information light intensity requires changing the beam sputter for a different ratio beam sputter.
Some tasks are aided well by information available both via direct view and displayed information (such as an oil refinery worker team trying to manage an abnormal situation, or a team of soldiers on a combat mission). However, the compromise 50/50 split is clearly not optimal for all phases of the work/task cycle to be completed. During some phases of plan execution, the displayed information channel is the desired focus of attention for the user. During other phases of plan execution, the direct view is the desired focus of attention.
Certain problems exist with the use of a fixed ratio beam splitter, no matter what the fixed ratio is. Situations in which a HMD system is used may dramatically and rapidly change over small time periods. It is not practical to reconfigure a current HMD system during use. The beam sputter ratio in place when the situation use begins is for all practical purposes the beam sputter ratio in place when the particular use ends.
However, changing situations may call for or be best served by a change in the beam splitter ratio or real world to displayed information light intensity. For example, in certain situations, it is desirable for the entire visual display to be provided solely by either the real world outside or displayed information views.
In the case of a worker studying a schematic, any outside world background may interfere with a portion or portions of the schematic, making it difficult or even impossible to read. In this situation, it would be desirable to exclude the outside world view, and instead transmit only the displayed view. In another instance, the focus of the user may need to be directed entirely to the outside world.
For example, when the real world visual field must be searched for a certain object or
3 occurrence, displayed information might interfere with the real world view, or obscure the real world view in some way.
Moreover, the real world, external view is both a see through view and a see in view. HMDs and SASS are also used in widely different ambient lighting conditions. The brighter the ambient light, the more light intensity is admitted into the real world part of the HMD. In very bright light, traditional HMD and SAS systems do not allow light to be denied entrance into the view. Because of this, the intensity of the displayed information must be increased in order to be able to even see it. Since see through ambient light impinges on the display seen by the user, the display electronics for the displayed image must be driven harder to generate a displayed information view that may be seen by the user. The required increase in intensity of the displayed information view puts added stress on the displayed information components. The harder the display electronics must be driven, the more power is used, and the faster the components wear out.
Other displays used with the present technology include conformally registered displays. A conformally registered display need not be head mounted.
Instead, a conformally registered display may be generated by a flat panel display placed in the visual field of a user. Further, an entire cockpit canopy of an aircraft may be used as a display.
Summary The present invention overcomes the problems of the prior art by providing a conformally registered display system with a variable light intensity ratio between the real world and displayed information views. A conformally registered display system according to one embodiment of the invention includes a variably transmissive element positioned in the optical train of the user.
The variably transmissive element is capable of adjustment of the ratio of light intensity passed to the user from the real world view to the light intensity passed from the displayed information view of the conformally registered display system to the user.
In another embodiment, the variably transmissive element is physically addressed so that light intensity may be spatially controlled in the visual field of the user. In this embodiment, light intensity in areas of the visual display of the user may be controlled separately from the light intensity of other areas of the display. This allows the user or the controller of the SAS, conformally registered display, or HMD involved with the displayed information to concentrate focus of the user on a specific area of the visual field, or to simultaneously configure one
Moreover, the real world, external view is both a see through view and a see in view. HMDs and SASS are also used in widely different ambient lighting conditions. The brighter the ambient light, the more light intensity is admitted into the real world part of the HMD. In very bright light, traditional HMD and SAS systems do not allow light to be denied entrance into the view. Because of this, the intensity of the displayed information must be increased in order to be able to even see it. Since see through ambient light impinges on the display seen by the user, the display electronics for the displayed image must be driven harder to generate a displayed information view that may be seen by the user. The required increase in intensity of the displayed information view puts added stress on the displayed information components. The harder the display electronics must be driven, the more power is used, and the faster the components wear out.
Other displays used with the present technology include conformally registered displays. A conformally registered display need not be head mounted.
Instead, a conformally registered display may be generated by a flat panel display placed in the visual field of a user. Further, an entire cockpit canopy of an aircraft may be used as a display.
Summary The present invention overcomes the problems of the prior art by providing a conformally registered display system with a variable light intensity ratio between the real world and displayed information views. A conformally registered display system according to one embodiment of the invention includes a variably transmissive element positioned in the optical train of the user.
The variably transmissive element is capable of adjustment of the ratio of light intensity passed to the user from the real world view to the light intensity passed from the displayed information view of the conformally registered display system to the user.
In another embodiment, the variably transmissive element is physically addressed so that light intensity may be spatially controlled in the visual field of the user. In this embodiment, light intensity in areas of the visual display of the user may be controlled separately from the light intensity of other areas of the display. This allows the user or the controller of the SAS, conformally registered display, or HMD involved with the displayed information to concentrate focus of the user on a specific area of the visual field, or to simultaneously configure one
4 spatial region of the conformally registered display to present solely a displayed information view, while another spatial region presents a combined view or a solely real world view. This spatial discrimination of transmitted light intensity can be used in arbitrarily complex combinations, up to the limit of the spatial resolution of the addressable transmissive element.
In yet another embodiment, the conformally registered display of the present invention may be combined with an auditory domain system that uses the same variable transmissive technique, using active or passive noise suppression to mask undesirable sounds. Further, desirable or necessary sounds could even be enhanced. The directional cueing afforded by the addressable windowing feature of the present invention described above may also be reinforced by the additional auditory channel. Here, the three-dimensional aural cues are presented to the user in coordination with the displayed directional window cue to reinforce its directional information content, Active or passive noise suppression as well as signal enhancement extraction techniques could be used to augment the three-dimensional cueing channels as well.
A method embodiment of the present invention comprises adjusting the ratio of real world to displayed information light intensity to conform the ratio to a dynamically changing situation. This is done by varying the transmittance of a variably transmissive window. The method further comprises spatially addressing the variably transmissive window to selectively change the light intensity passing from the real world view to the visual field of the user.
The present method may further comprise auditory domain control using passive or active noise suppression to mask undesirable sounds. This adds high quality three-dimensional aural cueing to reinforce the directional content implicit in the addressable windowing feature of the invention.
The variable splitting ratio so achieved allows adjustable immersion. For example, total immersion is appropriate for some tasks such as collaborative planning in which team members are primarily using their SAS to communicate via a common displayed picture. Here the intrusion of the outside world is a liability and a distraction. However, when in the real time operations mode, the worker requires just the opposite balance of attention focus.
Another operational advantage offered by variable transmissive elements is the maintenance of displayed information contrast ratio performance against high ambient light levels (i.e. an automatic "sunglass" function).
This invention is equally applicable to heads-up displays, head mounted displays, flat panel displays, glareshield displays, and the like, in which a user such as a driver, navigator, or pilot may need to have the real world view S
contrasted more sharply with the displayed information channel, especially in situations which may rapidly change, such as combat.
Present designs have only a 50/50 or fixed ratio split between the outside world and the displayed information channel. The ratio may not be 50/50, but it is fixed, and cannot be changed, certainly not dynamically. Hardware enables different ways of portraying information. Because the display system is coordinated with the variable transmissive element, variations can be made not only spatially but also in intensity - for example, a target could be the only thing in the outside world visual field of a pilot, allowing the pilot to focus more intently on the target. Specific targets among many could also be visually selected and isolated, allowing better chance for targeting at the proper target.
Such variations are well within the scope and skill of one skilled in the art, and many will be thought of, which are still within the scope of the invention.
Brief Description of the Drawings Figure 1 shows a perspective view of an embodiment of the present invention;
Figure 2 is a view of a representative visual field as seen through the embodiment of Figure 1;
Figure 3 is a perspective view of an alternative embodiment of the present invention;
Figure 4 is a view of a representative visual field as seen through the embodiment of Figure 3;
Figure S shows a representative sample of optical trains that may be used with embodiments of the present invention;
Figure 6 is a flow chart diagram of a method embodiment of the present invention;
Figure 7 is a flow chart diagram of another method embodiment of the present invention;
Figure 8 is a flow chart diagram of another method embodiment of the present invention; and Figure 9 is a block diagram of a computer system of the type on which embodiments of the present invention may be utilized.
Description of Embodiments In the following detailed description of the embodiments, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
Figure 1 shows a conformally registered display 10 according to one embodiment of the invention. Display 10 in one embodiment is a HMD 10 comprising a combiner 12, a variably transmissive element 14, and display optical system 16. The combiner 12 is positioned in the visual field of a user 18.
The combiner 12 focuses optical data generated by the display optical system toward the eye 20 of user 18. Display optical system 16 generated display information through the use of display drivers, as is known in the art. The display optical system 16 may be any system capable of generating a display information optical train for use in a conformally registered display or situational awareness system (SAS). The display optical system could also include the combiner, so that the display optical system includes the optical train and the combiner.
Real world, or outside, imagery is also in the visual field of the user 18.
The real world imagery passes through variably transmissive element 14 and combiner 12 to reach the eye 20 of user 18. In this manner, the real world view and the display information view are both presented to the visual field of the user 18.
While variably transmissive element is shown just outside the combiner 12 in Figure 1, insertion of the element 14 at other locations in the optical train could help to reduce overall size and weight of a HMD system such as HMD 10. Such modification is within the scope of one skilled in the art.
Variably transmissive element 14 is adjustable to allow a variable amount of light intensity to pass through to the eye 20 of user 18. As shown in Figure 1, real world information 22 passes through variably transmissive element 14, emerging with light intensity 24. Variably transmissive element 14 is operatively connected to a control module 26 which controls the amount of light intensity of the real world information passes through element 14. Control module 26 may be operated manually, or may be controlled through use of a computer program or electrical control system, which may or may not be integrated with the display optical system 16.
Variably transmissive element 14 may be any structure which allows for varying the intensity of light which passes through it. For example, variably transmissive element 14 may allow for adjustment of the light intensity passing therethrough in any number of ways. For example, element 14 could employ a polarizer arrangement, in which the relative orientation of the polarization can be varied to adjust the light intensity passing through the element 14.
Similarly, cholesteric liquid crystals could be used in element 14, allowing electrooptic transmittance adjustment. While these schemes would effectively allow dynamic and variable adjustment of the light intensity passing through element 14, each also is characterized by a 50% transmittance loss imposed by the use of polarizers. Variably transmissive element 14 may be implemented in a flat panel window, or other transmissive structures known in the art.
Other electrooptic approaches that do not have the polarizer loss penalty would be preferred. Such approaches include electrochromic and electric field alignable suspended particle shutters. Electrochromic options include both liquid cell and thin film solid state electrolyte devices. Both use electric current to drive reversible chemical reactions in thin film electrodes, whose chemical oxidation-reduction state determines their optical transmittance. Such electrochromic devices may also be spatially addressable with the use of pixel sub electrodes or any transmissivity control effectors.
In another embodiment, another display uses a variably transmissive element which is not uniform across the EO spectrum. Such a display uses subtractive elements to vary transmissivity with chromatic preference. For example, such an embodiment may block all ambient red light, or the like. In further embodiments, spectrally differentiable transmissivity elements are used.
Figure 2 is a view of a representative variably transmissive element 14 as has been described above. Varying the intensity of the light that passes through the element 14 results in a visual field for the user 20 which may present real world and displayed information views with emphasis placed on one or the other, and which may be varied by control of the transmissivity of element 14. Figure 3, for example, shows a representative visual field of a user when the variably transmissive element 14 has completely blocked light intensity from the real world view to the user, and the visual field of the user is fully focused on a schematic 28 and a set of instructions 30 generated by the display optical system 16. When a user has finished studying the schematic 28 and instructions 30, the variably transmissive element 14 can have its transmission of light intensity increased to allow the real world view of an actual electric circuit 32 to appear in the user's visual field. The display optical system can at the same time eliminate the transmission of the schematic 28 and instructions 30 to the combiner 12, and instead allow the user to see the entire visual field of the circuit 30.
The visual field of a user can be strictly and widely controlled by the present invention, so as to provide adjustable immersion between the real world and the displayed information. For example, Figure 2 shows a representative example of the type of displays and visual field effects capable of presentation by the present invention. The displays 30 and 32 are presented to the visual field of a user as best shown in Figure 1. Display 30 is presented showing a schematic diagram 34 of a circuit, and instructions for testing or maintaining the circuit 36.
The schematic 34 and instructions 36 are placed in the visual field of a user by controlling the light intensity of the real world view passing through the variably transmissive element 14, which is shown in shadow in Figure 2. It should be understood that the image viewed is not displayed on the variably transmissive element, but is placed in the visual field of the user by the display optical system 16, combiner 12, and variably transmissive element 14.
Display 30 is generated by blocking all or substantially all of the light intensity from the real world view from passing through variably transmissive element 14. This allows the user to see the circuit schematic 34 and instructions 36 without interference from outside light or a real world view. When the user has sufficiently studied or reviewed the schematic 34 and instructions 36, the control module 26 adjusts the light intensity passing through variably transmissive element 14 to permit light intensity from the real world view to pass through element 14. At the same time, display optical system 16 reduces or even eliminates the transmission of the displayed information, i.e. the schematic and instructions 36. The user then sees the actual circuit 38 in real world view in the visual field. In this manner, the real world and displayed information views may be superimposed with variable intensity ration between the real world and displayed information views. Either the real world or displayed information views may be completely eliminated, by the variably transmissive element 14 or the display optical system 16, respectively.
In another embodiment of the present invention, a variably transmissive element 40 may be spatially addressed using a plurality of electrodes 42 as is best shown in Figure 3. Each electrode 42 could allow the specifically addressed area of the face 44 of element 40 to be varied in the amount of light intensity of the real world scene passes through the element 40. In this manner, certain external views could be transmitted with greater intensity, and other external views could be transmitted with lesser light intensity. This configuration allows a control module 36 to control the light intensity of the external view passing through the transmissive element 34 according to the addressing of the element 40. The spatially addressable nature of element 40 allows for spatial attention focus of the user on specific areas in the visual field. The addressing of the element 40 allows for the adjustment of light intensity passing through from the real world view to the visual field of the user in increments smaller than the full field.
For example, Figure 4 is a set of views of representative visual fields 48 and 50 of a user of the addressable variably transmissive element 40. In view 48, the addressable variably transmissive element 40 has been addressed to allow light intensity to pass through from the real world to the visual field of the user to allow the use to see objects in the real world. In view 48, the user sees trucks 52 and 54, tank 56, and background forest 60. In certain situations, where the visual field, such as field 48, has many different objects in view, it may be desirable to isolate the focus of the user on a particular object or area of the visual field. The addressable nature of element 40 allows that focus to be made.
In view 50, suppose for example that a determination has been made that the focus of the user should be on truck 54. The spatial addressing capability of element 40 allows control of the light intensity passing from the real world through the element 40 so as to block light intensity in spatial area 64, and transmit real world light intensity in spatial area 62 to isolate truck 54 in the visual field of the user. Further, a display optical system such as system 16 could be used to place an electronically generated targeting reticule 66 over the truck 54 to be targeted. Specific target instructions could be displayed in spatial area 68.
The variably transmissive element 14 and the addressable variably transmissive element 40 may be implemented in a HMD system such as system as shown in Figure 1. Any number of optical designs for display optical system 16 may be employed with the variably transmissive elements 14 and 40.
Figure 5 shows a representative sample of optical designs A, B, C, D, E, F, and G
which are each capable of use in a system such as system 10. In all of the designs, a variably transmissive element such as element 14 or element 40 may be placed between a user's eye and the real world visual field. Placement of an element 14 or 40 has been discussed above.
The addressable nature of variably transmissive element 40 is particularly valuable if used in a head tracked conformally registered system. In such systems, the viewers's gaze position is tracked so that his display channel information may be geometrically registered with the real world view. Hence, in such a system the SAS could display information relevant to the task on a 0%
transmission background, while allowing 100% transmission view of other parts of the real world scene. In other words, the real world image could be registered with the generated image to be coincident with the eye gaze direction of the user via head/eye tracking devices as appropriate to the specific application.
For example, maintenance workers need to view reference materials while nearly simultaneously viewing the work space and operation of their hands.
Similarly, a moveable highlighting window or box could focus attention to any arbitrary interesting item identified by the SAS. This may result in a less confusing and more intuitively interpretable attention directing conveyance means than alternative approaches such as flashing icons, variable colors, and the like.
Figure 6 is a flow chart diagram of a method 70 embodying the present invention. Method 70 comprises providing a variably transmissive element in a head mounted display system in block 72, and varying the ratio of real world light intensity to generated display light intensity in block 74. The varying of the ratio of real world light intensity to generated display light intensity in block 74 may further comprise spatially addressing the variably transmissive element in block 76, selectively varying the ratio of real world to generated display light intensity in block 78, and superimposing a displayed light intensity object selectively in the user's visual field in block 80, as is best shown in Figure 7. The method 70 could also optionally include registering the real world image with the generated image to be coincident with the eye gaze direction of the user as described above. This is shown in Figure 7 as optional block 73.
In a further method embodiment 82 shown in Figure 8, a method 82 for varying the light intensity in a head mounted display comprises generating a displayed image for presentation to a user's visual field in block 84, superimposing a real world view on the displayed image in the user's visual field in block 86, varying the light intensity of the real world view by altering the transmissivity of a variable transmissive window in block 88, and dynamically controlling the ratio of displayed image intensity to real world light intensity in the user's visual field in block 90. The method 82 could also optionally include registering the real world image with the generated image to be coincident with the eye gaze direction of the user as described above. This is shown in Figure as optional block 87.
Another application of the methods and apparatus of the present invention is to other modes of conveyance. For example, in the auditory domain, active noise suppression techniques may be used to fully mask undesirable environmental sounds. However, in many domains, external auditory cues may have great importance and meaning. For example, in a military domain, the sound of a branch cracking underfoot may be highly relevant to a combat soldier, while the noise from weapons fire of his teammates may be nearly irrelevant.
This of course depends on context. In particular, when the SAS is attempting to convey information via the auditory channel (e.g. mechanized threat location), environmental sound which masks the input is distracting and also a liability.
Similarly, in a refinery application, motor or pump noise may be highly relevant in some situations, as are radio transmissions from the board operator or field team members in other situations. A variably transmissive aural element would allow active control of the focus of the attention of the user. Such an element 100 is shown in Figure 1. Variably transmissive auditory element 100 may be connected to and controlled by control module 26. Alternatively, element 100 may have its own control module.
Further, as discussed for the visual domain, an addressable capability auditory element would allow an additional level of control flexibility. For example, the ability to mask sounds from a particular sector (which contains the unit mortar or refinery compressor for example) while allowing full pass-through (or even amplified pass-through) transmission of sounds from the sector ahead provides the spatial attention focusing capability of the spatially addressable variable transmissive element 40 discussed above.
In another embodiment, a variably transmissive auditory element such as element 100 is utilized separate from the HMD or conformally registered display.
In this embodiment, the variably transmissive auditory element, such as element 100, is equipped with its own control module as discussed above. The variably transmissive auditory element selectively passes auditory signals to the ear of the user. The control module is operatively connected to the variably transmissive auditory element to control the sound passing through the variably transmissive auditory element.
The embodiments of the present invention are described in terms of a head mounted display. It should be understood that a conformally registered display may be used for all embodiments. Conformally registered displays as defined above include such displays as entire windshield or canopy views. In a conformally registered display, given a point in the real world view, often referred to as 3-space, and an eye position for the user, the pixel or pel that lies on a vector connecting the point in 3-space and the eye of the user can be determined. Any system of a conformally registered display is capable of use with the various embodiments of the invention, and such conformally registered displays are within the scope of the invention.
Views in a conformally registered display may be in an aircraft or a vehicle. For example, a panoramic cockpit display in an aircraft may be used as a display. A heads-up display may be implemented in a portion of a windshield or canopy, or in a glare shield or the like.
The apparatuses 10 and 100 shown in Figure 1, and the various display optics trains shown in Figure 5, may be contained or arranged in any number of see through displays, including but not limited to helmet mounted displays, head mounted displays, conformally registered displays, flat panel displays, glareshield mounted displays, and the like. The elements may be combined in visors, entire aircraft canopy or vehicle windshield views and other conformally registered displays. Such displays may be implemented in monocular, biocular, and binocular form, and the like, without departing from the scope of the invention.
Methods 70 and 82 in one embodiment may comprise computer programs written to perform the methods on a personal computer 110 as shown in Figure 9.
The computer programs run on the central processing unit 112 out of main memory, and may be transferred to main memory from permanent storage via disk drive 114 when stored on removable media or via a network connection or modem connection when stored outside of the personal computer, or via other types of computer or machine readable medium from which it can be read and utilized. The computer programs comprise multiple modules or objects to perform the methods 70 and 82. The type of computer programming languages used to write the code may vary between procedural code type languages to object oriented languages. The files or objects need not have a one to one correspondence to the modules or method steps described depending on the desires of the programmer. Further, the method and apparatus may comprise combinations of software, hardware and firmware as is well known to those skilled in the art.
It is to be understood that the above description is intended to be illustrative, and not restrictive. Many other embodiments will be apparent to those of skill in the art upon reading and understanding the above description.
The scope of the invention should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
In yet another embodiment, the conformally registered display of the present invention may be combined with an auditory domain system that uses the same variable transmissive technique, using active or passive noise suppression to mask undesirable sounds. Further, desirable or necessary sounds could even be enhanced. The directional cueing afforded by the addressable windowing feature of the present invention described above may also be reinforced by the additional auditory channel. Here, the three-dimensional aural cues are presented to the user in coordination with the displayed directional window cue to reinforce its directional information content, Active or passive noise suppression as well as signal enhancement extraction techniques could be used to augment the three-dimensional cueing channels as well.
A method embodiment of the present invention comprises adjusting the ratio of real world to displayed information light intensity to conform the ratio to a dynamically changing situation. This is done by varying the transmittance of a variably transmissive window. The method further comprises spatially addressing the variably transmissive window to selectively change the light intensity passing from the real world view to the visual field of the user.
The present method may further comprise auditory domain control using passive or active noise suppression to mask undesirable sounds. This adds high quality three-dimensional aural cueing to reinforce the directional content implicit in the addressable windowing feature of the invention.
The variable splitting ratio so achieved allows adjustable immersion. For example, total immersion is appropriate for some tasks such as collaborative planning in which team members are primarily using their SAS to communicate via a common displayed picture. Here the intrusion of the outside world is a liability and a distraction. However, when in the real time operations mode, the worker requires just the opposite balance of attention focus.
Another operational advantage offered by variable transmissive elements is the maintenance of displayed information contrast ratio performance against high ambient light levels (i.e. an automatic "sunglass" function).
This invention is equally applicable to heads-up displays, head mounted displays, flat panel displays, glareshield displays, and the like, in which a user such as a driver, navigator, or pilot may need to have the real world view S
contrasted more sharply with the displayed information channel, especially in situations which may rapidly change, such as combat.
Present designs have only a 50/50 or fixed ratio split between the outside world and the displayed information channel. The ratio may not be 50/50, but it is fixed, and cannot be changed, certainly not dynamically. Hardware enables different ways of portraying information. Because the display system is coordinated with the variable transmissive element, variations can be made not only spatially but also in intensity - for example, a target could be the only thing in the outside world visual field of a pilot, allowing the pilot to focus more intently on the target. Specific targets among many could also be visually selected and isolated, allowing better chance for targeting at the proper target.
Such variations are well within the scope and skill of one skilled in the art, and many will be thought of, which are still within the scope of the invention.
Brief Description of the Drawings Figure 1 shows a perspective view of an embodiment of the present invention;
Figure 2 is a view of a representative visual field as seen through the embodiment of Figure 1;
Figure 3 is a perspective view of an alternative embodiment of the present invention;
Figure 4 is a view of a representative visual field as seen through the embodiment of Figure 3;
Figure S shows a representative sample of optical trains that may be used with embodiments of the present invention;
Figure 6 is a flow chart diagram of a method embodiment of the present invention;
Figure 7 is a flow chart diagram of another method embodiment of the present invention;
Figure 8 is a flow chart diagram of another method embodiment of the present invention; and Figure 9 is a block diagram of a computer system of the type on which embodiments of the present invention may be utilized.
Description of Embodiments In the following detailed description of the embodiments, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
Figure 1 shows a conformally registered display 10 according to one embodiment of the invention. Display 10 in one embodiment is a HMD 10 comprising a combiner 12, a variably transmissive element 14, and display optical system 16. The combiner 12 is positioned in the visual field of a user 18.
The combiner 12 focuses optical data generated by the display optical system toward the eye 20 of user 18. Display optical system 16 generated display information through the use of display drivers, as is known in the art. The display optical system 16 may be any system capable of generating a display information optical train for use in a conformally registered display or situational awareness system (SAS). The display optical system could also include the combiner, so that the display optical system includes the optical train and the combiner.
Real world, or outside, imagery is also in the visual field of the user 18.
The real world imagery passes through variably transmissive element 14 and combiner 12 to reach the eye 20 of user 18. In this manner, the real world view and the display information view are both presented to the visual field of the user 18.
While variably transmissive element is shown just outside the combiner 12 in Figure 1, insertion of the element 14 at other locations in the optical train could help to reduce overall size and weight of a HMD system such as HMD 10. Such modification is within the scope of one skilled in the art.
Variably transmissive element 14 is adjustable to allow a variable amount of light intensity to pass through to the eye 20 of user 18. As shown in Figure 1, real world information 22 passes through variably transmissive element 14, emerging with light intensity 24. Variably transmissive element 14 is operatively connected to a control module 26 which controls the amount of light intensity of the real world information passes through element 14. Control module 26 may be operated manually, or may be controlled through use of a computer program or electrical control system, which may or may not be integrated with the display optical system 16.
Variably transmissive element 14 may be any structure which allows for varying the intensity of light which passes through it. For example, variably transmissive element 14 may allow for adjustment of the light intensity passing therethrough in any number of ways. For example, element 14 could employ a polarizer arrangement, in which the relative orientation of the polarization can be varied to adjust the light intensity passing through the element 14.
Similarly, cholesteric liquid crystals could be used in element 14, allowing electrooptic transmittance adjustment. While these schemes would effectively allow dynamic and variable adjustment of the light intensity passing through element 14, each also is characterized by a 50% transmittance loss imposed by the use of polarizers. Variably transmissive element 14 may be implemented in a flat panel window, or other transmissive structures known in the art.
Other electrooptic approaches that do not have the polarizer loss penalty would be preferred. Such approaches include electrochromic and electric field alignable suspended particle shutters. Electrochromic options include both liquid cell and thin film solid state electrolyte devices. Both use electric current to drive reversible chemical reactions in thin film electrodes, whose chemical oxidation-reduction state determines their optical transmittance. Such electrochromic devices may also be spatially addressable with the use of pixel sub electrodes or any transmissivity control effectors.
In another embodiment, another display uses a variably transmissive element which is not uniform across the EO spectrum. Such a display uses subtractive elements to vary transmissivity with chromatic preference. For example, such an embodiment may block all ambient red light, or the like. In further embodiments, spectrally differentiable transmissivity elements are used.
Figure 2 is a view of a representative variably transmissive element 14 as has been described above. Varying the intensity of the light that passes through the element 14 results in a visual field for the user 20 which may present real world and displayed information views with emphasis placed on one or the other, and which may be varied by control of the transmissivity of element 14. Figure 3, for example, shows a representative visual field of a user when the variably transmissive element 14 has completely blocked light intensity from the real world view to the user, and the visual field of the user is fully focused on a schematic 28 and a set of instructions 30 generated by the display optical system 16. When a user has finished studying the schematic 28 and instructions 30, the variably transmissive element 14 can have its transmission of light intensity increased to allow the real world view of an actual electric circuit 32 to appear in the user's visual field. The display optical system can at the same time eliminate the transmission of the schematic 28 and instructions 30 to the combiner 12, and instead allow the user to see the entire visual field of the circuit 30.
The visual field of a user can be strictly and widely controlled by the present invention, so as to provide adjustable immersion between the real world and the displayed information. For example, Figure 2 shows a representative example of the type of displays and visual field effects capable of presentation by the present invention. The displays 30 and 32 are presented to the visual field of a user as best shown in Figure 1. Display 30 is presented showing a schematic diagram 34 of a circuit, and instructions for testing or maintaining the circuit 36.
The schematic 34 and instructions 36 are placed in the visual field of a user by controlling the light intensity of the real world view passing through the variably transmissive element 14, which is shown in shadow in Figure 2. It should be understood that the image viewed is not displayed on the variably transmissive element, but is placed in the visual field of the user by the display optical system 16, combiner 12, and variably transmissive element 14.
Display 30 is generated by blocking all or substantially all of the light intensity from the real world view from passing through variably transmissive element 14. This allows the user to see the circuit schematic 34 and instructions 36 without interference from outside light or a real world view. When the user has sufficiently studied or reviewed the schematic 34 and instructions 36, the control module 26 adjusts the light intensity passing through variably transmissive element 14 to permit light intensity from the real world view to pass through element 14. At the same time, display optical system 16 reduces or even eliminates the transmission of the displayed information, i.e. the schematic and instructions 36. The user then sees the actual circuit 38 in real world view in the visual field. In this manner, the real world and displayed information views may be superimposed with variable intensity ration between the real world and displayed information views. Either the real world or displayed information views may be completely eliminated, by the variably transmissive element 14 or the display optical system 16, respectively.
In another embodiment of the present invention, a variably transmissive element 40 may be spatially addressed using a plurality of electrodes 42 as is best shown in Figure 3. Each electrode 42 could allow the specifically addressed area of the face 44 of element 40 to be varied in the amount of light intensity of the real world scene passes through the element 40. In this manner, certain external views could be transmitted with greater intensity, and other external views could be transmitted with lesser light intensity. This configuration allows a control module 36 to control the light intensity of the external view passing through the transmissive element 34 according to the addressing of the element 40. The spatially addressable nature of element 40 allows for spatial attention focus of the user on specific areas in the visual field. The addressing of the element 40 allows for the adjustment of light intensity passing through from the real world view to the visual field of the user in increments smaller than the full field.
For example, Figure 4 is a set of views of representative visual fields 48 and 50 of a user of the addressable variably transmissive element 40. In view 48, the addressable variably transmissive element 40 has been addressed to allow light intensity to pass through from the real world to the visual field of the user to allow the use to see objects in the real world. In view 48, the user sees trucks 52 and 54, tank 56, and background forest 60. In certain situations, where the visual field, such as field 48, has many different objects in view, it may be desirable to isolate the focus of the user on a particular object or area of the visual field. The addressable nature of element 40 allows that focus to be made.
In view 50, suppose for example that a determination has been made that the focus of the user should be on truck 54. The spatial addressing capability of element 40 allows control of the light intensity passing from the real world through the element 40 so as to block light intensity in spatial area 64, and transmit real world light intensity in spatial area 62 to isolate truck 54 in the visual field of the user. Further, a display optical system such as system 16 could be used to place an electronically generated targeting reticule 66 over the truck 54 to be targeted. Specific target instructions could be displayed in spatial area 68.
The variably transmissive element 14 and the addressable variably transmissive element 40 may be implemented in a HMD system such as system as shown in Figure 1. Any number of optical designs for display optical system 16 may be employed with the variably transmissive elements 14 and 40.
Figure 5 shows a representative sample of optical designs A, B, C, D, E, F, and G
which are each capable of use in a system such as system 10. In all of the designs, a variably transmissive element such as element 14 or element 40 may be placed between a user's eye and the real world visual field. Placement of an element 14 or 40 has been discussed above.
The addressable nature of variably transmissive element 40 is particularly valuable if used in a head tracked conformally registered system. In such systems, the viewers's gaze position is tracked so that his display channel information may be geometrically registered with the real world view. Hence, in such a system the SAS could display information relevant to the task on a 0%
transmission background, while allowing 100% transmission view of other parts of the real world scene. In other words, the real world image could be registered with the generated image to be coincident with the eye gaze direction of the user via head/eye tracking devices as appropriate to the specific application.
For example, maintenance workers need to view reference materials while nearly simultaneously viewing the work space and operation of their hands.
Similarly, a moveable highlighting window or box could focus attention to any arbitrary interesting item identified by the SAS. This may result in a less confusing and more intuitively interpretable attention directing conveyance means than alternative approaches such as flashing icons, variable colors, and the like.
Figure 6 is a flow chart diagram of a method 70 embodying the present invention. Method 70 comprises providing a variably transmissive element in a head mounted display system in block 72, and varying the ratio of real world light intensity to generated display light intensity in block 74. The varying of the ratio of real world light intensity to generated display light intensity in block 74 may further comprise spatially addressing the variably transmissive element in block 76, selectively varying the ratio of real world to generated display light intensity in block 78, and superimposing a displayed light intensity object selectively in the user's visual field in block 80, as is best shown in Figure 7. The method 70 could also optionally include registering the real world image with the generated image to be coincident with the eye gaze direction of the user as described above. This is shown in Figure 7 as optional block 73.
In a further method embodiment 82 shown in Figure 8, a method 82 for varying the light intensity in a head mounted display comprises generating a displayed image for presentation to a user's visual field in block 84, superimposing a real world view on the displayed image in the user's visual field in block 86, varying the light intensity of the real world view by altering the transmissivity of a variable transmissive window in block 88, and dynamically controlling the ratio of displayed image intensity to real world light intensity in the user's visual field in block 90. The method 82 could also optionally include registering the real world image with the generated image to be coincident with the eye gaze direction of the user as described above. This is shown in Figure as optional block 87.
Another application of the methods and apparatus of the present invention is to other modes of conveyance. For example, in the auditory domain, active noise suppression techniques may be used to fully mask undesirable environmental sounds. However, in many domains, external auditory cues may have great importance and meaning. For example, in a military domain, the sound of a branch cracking underfoot may be highly relevant to a combat soldier, while the noise from weapons fire of his teammates may be nearly irrelevant.
This of course depends on context. In particular, when the SAS is attempting to convey information via the auditory channel (e.g. mechanized threat location), environmental sound which masks the input is distracting and also a liability.
Similarly, in a refinery application, motor or pump noise may be highly relevant in some situations, as are radio transmissions from the board operator or field team members in other situations. A variably transmissive aural element would allow active control of the focus of the attention of the user. Such an element 100 is shown in Figure 1. Variably transmissive auditory element 100 may be connected to and controlled by control module 26. Alternatively, element 100 may have its own control module.
Further, as discussed for the visual domain, an addressable capability auditory element would allow an additional level of control flexibility. For example, the ability to mask sounds from a particular sector (which contains the unit mortar or refinery compressor for example) while allowing full pass-through (or even amplified pass-through) transmission of sounds from the sector ahead provides the spatial attention focusing capability of the spatially addressable variable transmissive element 40 discussed above.
In another embodiment, a variably transmissive auditory element such as element 100 is utilized separate from the HMD or conformally registered display.
In this embodiment, the variably transmissive auditory element, such as element 100, is equipped with its own control module as discussed above. The variably transmissive auditory element selectively passes auditory signals to the ear of the user. The control module is operatively connected to the variably transmissive auditory element to control the sound passing through the variably transmissive auditory element.
The embodiments of the present invention are described in terms of a head mounted display. It should be understood that a conformally registered display may be used for all embodiments. Conformally registered displays as defined above include such displays as entire windshield or canopy views. In a conformally registered display, given a point in the real world view, often referred to as 3-space, and an eye position for the user, the pixel or pel that lies on a vector connecting the point in 3-space and the eye of the user can be determined. Any system of a conformally registered display is capable of use with the various embodiments of the invention, and such conformally registered displays are within the scope of the invention.
Views in a conformally registered display may be in an aircraft or a vehicle. For example, a panoramic cockpit display in an aircraft may be used as a display. A heads-up display may be implemented in a portion of a windshield or canopy, or in a glare shield or the like.
The apparatuses 10 and 100 shown in Figure 1, and the various display optics trains shown in Figure 5, may be contained or arranged in any number of see through displays, including but not limited to helmet mounted displays, head mounted displays, conformally registered displays, flat panel displays, glareshield mounted displays, and the like. The elements may be combined in visors, entire aircraft canopy or vehicle windshield views and other conformally registered displays. Such displays may be implemented in monocular, biocular, and binocular form, and the like, without departing from the scope of the invention.
Methods 70 and 82 in one embodiment may comprise computer programs written to perform the methods on a personal computer 110 as shown in Figure 9.
The computer programs run on the central processing unit 112 out of main memory, and may be transferred to main memory from permanent storage via disk drive 114 when stored on removable media or via a network connection or modem connection when stored outside of the personal computer, or via other types of computer or machine readable medium from which it can be read and utilized. The computer programs comprise multiple modules or objects to perform the methods 70 and 82. The type of computer programming languages used to write the code may vary between procedural code type languages to object oriented languages. The files or objects need not have a one to one correspondence to the modules or method steps described depending on the desires of the programmer. Further, the method and apparatus may comprise combinations of software, hardware and firmware as is well known to those skilled in the art.
It is to be understood that the above description is intended to be illustrative, and not restrictive. Many other embodiments will be apparent to those of skill in the art upon reading and understanding the above description.
The scope of the invention should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
Claims (35)
1. A conformally registered display, comprising:
a display optical system for generating a displayed information view superimposed over a real world view;
a combiner; and a variably transmissive element imposed between the real world view and the eye of a user.
a display optical system for generating a displayed information view superimposed over a real world view;
a combiner; and a variably transmissive element imposed between the real world view and the eye of a user.
2. The conformally registered display of claim 1, wherein the variably transmissive element is a flat panel window.
3. The conformally registered display of claim 1, wherein the variably transmissive element is disposed outside the combiner.
4. The conformally registered display of claim 1, and further comprising:
a control module, operatively connected to the variably transmissive element to control the amount of light intensity passing through the variably transmissive element.
a control module, operatively connected to the variably transmissive element to control the amount of light intensity passing through the variably transmissive element.
5. The conformally registered display of claim 1, wherein the variably transmissive element is an electrochromic window.
6. The conformally registered display of claim 1, wherein the variably transmissive element is a pair of cross polarized panels wherein relative orientation of polarization can be varied.
7. The conformally registered display of claim 1, wherein the variably transmissive element is a cholesteric liquid crystal window.
8. The conformally registered display of claim l, wherein the variably transmissive element is a window having electric field alignable suspended particle shutters.
9. The conformally registered display of claim 1, and further comprising:
a plurality of spaced apart transmissivity control effectors positioned on the variably transmissive element, each transmissivity control effector spatially addressing a portion of the variably transmissive element.
a plurality of spaced apart transmissivity control effectors positioned on the variably transmissive element, each transmissivity control effector spatially addressing a portion of the variably transmissive element.
10. The conformally registered display of claim 1, wherein the conformally registered display is a head mounted display.
11. The conformally registered display of claim 1, wherein the conformally registered display is a see through display.
12. The conformally registered display of claim 1, wherein the variably transmissive element is spectrally differentiable.
13. A conformally registered display, comprising:
a variably transmissive element positioned between a real world view and an eye of a user; and a display optical system for generating a displayed information image superimposed over the real world view in the visual field of the user.
a variably transmissive element positioned between a real world view and an eye of a user; and a display optical system for generating a displayed information image superimposed over the real world view in the visual field of the user.
14. The conformally registered display of claim 13, wherein the variably transmissive element is an electrochromic window.
15. The conformally registered display of claim 13, wherein the variably transmissive element is a pair of cross polarized panels wherein relative orientation of polarization can be varied.
16. The conformally registered display of claim 13, wherein the variably transmissive element is a cholesteric liquid crystal window.
17. The conformally registered display of claim 13, wherein the variably transmissive element is a window having electric field alignable suspended particle shutters.
18. The conformally registered display of claim 13, and further comprising:
a plurality of spaced apart transmissivity control effectors spatially addressing the variably transmissive element.
.19 The conformally registered display of claim 18, wherein each of the plurality of transmissivity control effectors spatially addresses a unique portion of the variably transmissive element.
a plurality of spaced apart transmissivity control effectors spatially addressing the variably transmissive element.
.19 The conformally registered display of claim 18, wherein each of the plurality of transmissivity control effectors spatially addresses a unique portion of the variably transmissive element.
15
20. The conformally registered display of claim 13, wherein the conformally registered display is a head mounted display.
21. The conformally registered display of claim 13, wherein the conformally registered display is a see through display.
22. A method, comprising:
providing a variably transmissive element in a conformally registered display system having a displayed information image;
and varying the ratio of the intensity of real world light entering a visual field of a user of the system to the displayed information image.
providing a variably transmissive element in a conformally registered display system having a displayed information image;
and varying the ratio of the intensity of real world light entering a visual field of a user of the system to the displayed information image.
23. The method of claim 22, wherein varying the ratio further comprises:
spatially addressing the variably transmissive element; and selectively varying the transmission of real world light intensity through the variably transmissive element to change the ratio of the light intensity of the real world view to the light intensity of the displayed information image.
spatially addressing the variably transmissive element; and selectively varying the transmission of real world light intensity through the variably transmissive element to change the ratio of the light intensity of the real world view to the light intensity of the displayed information image.
24. A machine readable medium comprising machine readable instructions for causing a computer to perform a method comprising:
varying the ratio of the intensity of real world light entering a visual field of a user of a conformally registered display system to a displayed information image.
varying the ratio of the intensity of real world light entering a visual field of a user of a conformally registered display system to a displayed information image.
25. The machine readable medium of claim 24, wherein the machine readable medium further comprises machine readable instructions for causing the computer to selectively vary the transmission of real world light intensity through a variably transmissive element of the conformally registered display system to change the ratio of the light intensity of the real world view to the light intensity of the displayed information image.
26. The conformally registered display of claim 1, and further comprising:
a variably transmissive auditory element for selectively passing auditory signals to an ear of the user.
a variably transmissive auditory element for selectively passing auditory signals to an ear of the user.
27. The method of claim 22, and further comprising:
providing filtered ambient sound to an ear of the user.
providing filtered ambient sound to an ear of the user.
28. A method of operating a conformally registered display, comprising:
generating a displayed image in a visual field of a user;
superimposing a real world view and the displayed image in the visual field of the user;
varying the light intensity of the real world view in the visual field of the user;
dynamically controlling the ratio of light intensity of the real world view to the light intensity of the displayed image view in the visual field of the user.
generating a displayed image in a visual field of a user;
superimposing a real world view and the displayed image in the visual field of the user;
varying the light intensity of the real world view in the visual field of the user;
dynamically controlling the ratio of light intensity of the real world view to the light intensity of the displayed image view in the visual field of the user.
29. The method of claim 28, wherein varying the light intensity of the real world view comprises:
passing the real world view through a variably transmissive element.
passing the real world view through a variably transmissive element.
30. The method of claim 29, wherein passing the real world view through a variably transmissive element further comprises passing the real world view through a spectrally differentiable variably transmissive element.
31. The method of claim 27, wherein varying also comprises spatially varying the light intensity of the real world view.
32. An auditory system, comprising:
a variably transmissive auditory element for selectively passing auditory signals to an ear of the user;
a control module operatively connected to the variably transmissive auditory element to control the sound passing through the variably transmissive auditory element.
a variably transmissive auditory element for selectively passing auditory signals to an ear of the user;
a control module operatively connected to the variably transmissive auditory element to control the sound passing through the variably transmissive auditory element.
33. A conformally registered display system, comprising:
a display for display of a generated view, wherein the display is variably transmissive; and a tracking module, the tracking module spatially registering a real world view and the generated view; and a control module operatively connected to the display to control the amount of light intensity passing through the display.
a display for display of a generated view, wherein the display is variably transmissive; and a tracking module, the tracking module spatially registering a real world view and the generated view; and a control module operatively connected to the display to control the amount of light intensity passing through the display.
34. The conformally registered display system of claim 33, wherein the tracking module is a head tracking module.
35. The conformally registered display system of claim 33, wherein the tracking module is an eye tracking module.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/372,824 | 1999-08-12 | ||
| US09/372,824 US6456438B1 (en) | 1999-08-12 | 1999-08-12 | Variable immersion vignetting display |
| PCT/US2000/022135 WO2001016640A2 (en) | 1999-08-12 | 2000-08-11 | Variable immersion vignetting display |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2381977A1 true CA2381977A1 (en) | 2001-03-08 |
Family
ID=23469769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002381977A Abandoned CA2381977A1 (en) | 1999-08-12 | 2000-08-11 | Variable immersion vignetting display |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US6456438B1 (en) |
| EP (1) | EP1200867B1 (en) |
| JP (1) | JP2003508808A (en) |
| AT (1) | ATE310257T1 (en) |
| AU (1) | AU2246001A (en) |
| CA (1) | CA2381977A1 (en) |
| DE (1) | DE60024096T2 (en) |
| WO (1) | WO2001016640A2 (en) |
Families Citing this family (159)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5910854A (en) | 1993-02-26 | 1999-06-08 | Donnelly Corporation | Electrochromic polymeric solid films, manufacturing electrochromic devices using such solid films, and processes for making such solid films and devices |
| US8294975B2 (en) | 1997-08-25 | 2012-10-23 | Donnelly Corporation | Automotive rearview mirror assembly |
| US6693517B2 (en) | 2000-04-21 | 2004-02-17 | Donnelly Corporation | Vehicle mirror assembly communicating wirelessly with vehicle accessories and occupants |
| US6477464B2 (en) | 2000-03-09 | 2002-11-05 | Donnelly Corporation | Complete mirror-based global-positioning system (GPS) navigation solution |
| US6329925B1 (en) | 1999-11-24 | 2001-12-11 | Donnelly Corporation | Rearview mirror assembly with added feature modular display |
| US7370983B2 (en) | 2000-03-02 | 2008-05-13 | Donnelly Corporation | Interior mirror assembly with display |
| US7167796B2 (en) | 2000-03-09 | 2007-01-23 | Donnelly Corporation | Vehicle navigation system for use with a telematics system |
| WO2007053710A2 (en) | 2005-11-01 | 2007-05-10 | Donnelly Corporation | Interior rearview mirror with display |
| US6814859B2 (en) * | 2002-02-13 | 2004-11-09 | Nanostream, Inc. | Frit material and bonding method for microfluidic separation devices |
| WO2003105099A1 (en) | 2002-06-06 | 2003-12-18 | Donnelly Corporation | Interior rearview mirror system with compass |
| US7329013B2 (en) | 2002-06-06 | 2008-02-12 | Donnelly Corporation | Interior rearview mirror system with compass |
| AU2003278863A1 (en) | 2002-09-20 | 2004-04-08 | Donnelly Corporation | Mirror reflective element assembly |
| US7310177B2 (en) | 2002-09-20 | 2007-12-18 | Donnelly Corporation | Electro-optic reflective element assembly |
| US6943754B2 (en) * | 2002-09-27 | 2005-09-13 | The Boeing Company | Gaze tracking system, eye-tracking assembly and an associated method of calibration |
| EP1623266B1 (en) * | 2003-05-12 | 2009-10-28 | Elbit Systems Ltd. | Method and system for audiovisual communication |
| DE10325894B4 (en) | 2003-06-06 | 2010-12-09 | Siemens Ag | Tool or production machine with display unit for the visualization of work processes |
| DE10325895A1 (en) * | 2003-06-06 | 2005-01-05 | Siemens Ag | Tool or production machine with head-up display |
| US7446924B2 (en) | 2003-10-02 | 2008-11-04 | Donnelly Corporation | Mirror reflective element assembly including electronic component |
| US7308341B2 (en) | 2003-10-14 | 2007-12-11 | Donnelly Corporation | Vehicle communication system |
| ATE517368T1 (en) | 2005-05-16 | 2011-08-15 | Donnelly Corp | VEHICLE MIRROR ARRANGEMENT WITH CHARACTER ON THE REFLECTIVE PART |
| JP4534922B2 (en) * | 2005-09-16 | 2010-09-01 | 株式会社デンソー | Virtual leading vehicle image display system |
| US9658473B2 (en) * | 2005-10-07 | 2017-05-23 | Percept Technologies Inc | Enhanced optical and perceptual digital eyewear |
| US11428937B2 (en) * | 2005-10-07 | 2022-08-30 | Percept Technologies | Enhanced optical and perceptual digital eyewear |
| US7744216B1 (en) * | 2006-01-06 | 2010-06-29 | Lockheed Martin Corporation | Display system intensity adjustment based on pupil dilation |
| KR101367958B1 (en) | 2007-12-18 | 2014-02-26 | 삼성전자주식회사 | Head mounted Display terminal having a light shutter |
| US9158116B1 (en) | 2014-04-25 | 2015-10-13 | Osterhout Group, Inc. | Temple and ear horn assembly for headworn computer |
| US8582052B2 (en) * | 2008-08-22 | 2013-11-12 | Gentex Corporation | Discrete LED backlight control for a reduced power LCD display system |
| US20100110069A1 (en) * | 2008-10-31 | 2010-05-06 | Sharp Laboratories Of America, Inc. | System for rendering virtual see-through scenes |
| US9952664B2 (en) | 2014-01-21 | 2018-04-24 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US20150277120A1 (en) | 2014-01-21 | 2015-10-01 | Osterhout Group, Inc. | Optical configurations for head worn computing |
| US9229233B2 (en) | 2014-02-11 | 2016-01-05 | Osterhout Group, Inc. | Micro Doppler presentations in head worn computing |
| US9400390B2 (en) | 2014-01-24 | 2016-07-26 | Osterhout Group, Inc. | Peripheral lighting for head worn computing |
| US9715112B2 (en) | 2014-01-21 | 2017-07-25 | Osterhout Group, Inc. | Suppression of stray light in head worn computing |
| US9965681B2 (en) | 2008-12-16 | 2018-05-08 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US9366867B2 (en) | 2014-07-08 | 2016-06-14 | Osterhout Group, Inc. | Optical systems for see-through displays |
| US20150205111A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | Optical configurations for head worn computing |
| FR2950982B1 (en) * | 2009-10-06 | 2017-05-19 | Thales Sa | VISION EQUIPMENT COMPRISING AN OPTICAL LAMP WITH A CONTROLLED LIGHT TRANSMISSION COEFFICIENT |
| US9182596B2 (en) | 2010-02-28 | 2015-11-10 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light |
| US9223134B2 (en) | 2010-02-28 | 2015-12-29 | Microsoft Technology Licensing, Llc | Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses |
| US9091851B2 (en) | 2010-02-28 | 2015-07-28 | Microsoft Technology Licensing, Llc | Light control in head mounted displays |
| US10180572B2 (en) | 2010-02-28 | 2019-01-15 | Microsoft Technology Licensing, Llc | AR glasses with event and user action control of external applications |
| US9097890B2 (en) | 2010-02-28 | 2015-08-04 | Microsoft Technology Licensing, Llc | Grating in a light transmissive illumination system for see-through near-eye display glasses |
| US9229227B2 (en) | 2010-02-28 | 2016-01-05 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses with a light transmissive wedge shaped illumination system |
| US9134534B2 (en) | 2010-02-28 | 2015-09-15 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses including a modular image source |
| US9097891B2 (en) | 2010-02-28 | 2015-08-04 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment |
| US9129295B2 (en) | 2010-02-28 | 2015-09-08 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear |
| US9341843B2 (en) | 2010-02-28 | 2016-05-17 | Microsoft Technology Licensing, Llc | See-through near-eye display glasses with a small scale image source |
| US20120249797A1 (en) | 2010-02-28 | 2012-10-04 | Osterhout Group, Inc. | Head-worn adaptive display |
| US20150309316A1 (en) | 2011-04-06 | 2015-10-29 | Microsoft Technology Licensing, Llc | Ar glasses with predictive control of external device based on event input |
| US9285589B2 (en) | 2010-02-28 | 2016-03-15 | Microsoft Technology Licensing, Llc | AR glasses with event and sensor triggered control of AR eyepiece applications |
| US9366862B2 (en) | 2010-02-28 | 2016-06-14 | Microsoft Technology Licensing, Llc | System and method for delivering content to a group of see-through near eye display eyepieces |
| EP2539759A1 (en) * | 2010-02-28 | 2013-01-02 | Osterhout Group, Inc. | Local advertising content on an interactive head-mounted eyepiece |
| US9128281B2 (en) | 2010-09-14 | 2015-09-08 | Microsoft Technology Licensing, Llc | Eyepiece with uniformly illuminated reflective display |
| US9759917B2 (en) | 2010-02-28 | 2017-09-12 | Microsoft Technology Licensing, Llc | AR glasses with event and sensor triggered AR eyepiece interface to external devices |
| JP5661788B2 (en) * | 2010-10-04 | 2015-01-28 | パナソニックＩｐマネジメント株式会社 | Transmission display device, moving body, and control device |
| US10036891B2 (en) * | 2010-10-12 | 2018-07-31 | DISH Technologies L.L.C. | Variable transparency heads up displays |
| US9400384B2 (en) | 2010-10-26 | 2016-07-26 | Bae Systems Plc | Display assembly, in particular a head mounted display |
| EP2447757A1 (en) * | 2010-10-26 | 2012-05-02 | BAE Systems PLC | Display assembly, in particular a head-mounted display |
| US9510765B2 (en) * | 2010-11-24 | 2016-12-06 | Awear Technologies, Llc | Detection and feedback of information associated with executive function |
| US9213405B2 (en) * | 2010-12-16 | 2015-12-15 | Microsoft Technology Licensing, Llc | Comprehension and intent-based content for augmented reality displays |
| US9690099B2 (en) * | 2010-12-17 | 2017-06-27 | Microsoft Technology Licensing, Llc | Optimized focal area for augmented reality displays |
| US9217867B2 (en) * | 2011-03-24 | 2015-12-22 | Seiko Epson Corporation | Head-mounted display device and control method for the head-mounted display device |
| US10019962B2 (en) | 2011-08-17 | 2018-07-10 | Microsoft Technology Licensing, Llc | Context adaptive user interface for augmented reality display |
| US9153195B2 (en) | 2011-08-17 | 2015-10-06 | Microsoft Technology Licensing, Llc | Providing contextual personal information by a mixed reality device |
| WO2013028908A1 (en) | 2011-08-24 | 2013-02-28 | Microsoft Corporation | Touch and social cues as inputs into a computer |
| US9323325B2 (en) | 2011-08-30 | 2016-04-26 | Microsoft Technology Licensing, Llc | Enhancing an object of interest in a see-through, mixed reality display device |
| US8752963B2 (en) * | 2011-11-04 | 2014-06-17 | Microsoft Corporation | See-through display brightness control |
| US8950867B2 (en) * | 2011-11-23 | 2015-02-10 | Magic Leap, Inc. | Three dimensional virtual and augmented reality display system |
| US9265458B2 (en) | 2012-12-04 | 2016-02-23 | Sync-Think, Inc. | Application of smooth pursuit cognitive testing paradigms to clinical drug development |
| US9521976B2 (en) | 2013-01-24 | 2016-12-20 | Devon Greco | Method and apparatus for encouraging physiological change through physiological control of wearable auditory and visual interruption device |
| US9380976B2 (en) | 2013-03-11 | 2016-07-05 | Sync-Think, Inc. | Optical neuroinformatics |
| US9293079B2 (en) * | 2013-03-15 | 2016-03-22 | University Of Southern California | Control of ambient and stray lighting in a head mounted display |
| FR3011091A1 (en) * | 2013-09-26 | 2015-03-27 | Valeo Vision | DATA DISPLAY LENSES HAVING AN ANTI-GLARE SCREEN |
| FR3011090B1 (en) * | 2013-09-26 | 2016-12-23 | Valeo Vision | DATA DISPLAY LENSES HAVING AN ANTI-GLARE SCREEN |
| US9466150B2 (en) | 2013-11-06 | 2016-10-11 | Google Inc. | Composite image associated with a head-mountable device |
| US20150228119A1 (en) | 2014-02-11 | 2015-08-13 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
| US9575321B2 (en) | 2014-06-09 | 2017-02-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
| US9448409B2 (en) | 2014-11-26 | 2016-09-20 | Osterhout Group, Inc. | See-through computer display systems |
| US9529195B2 (en) | 2014-01-21 | 2016-12-27 | Osterhout Group, Inc. | See-through computer display systems |
| US9810906B2 (en) | 2014-06-17 | 2017-11-07 | Osterhout Group, Inc. | External user interface for head worn computing |
| US10684687B2 (en) | 2014-12-03 | 2020-06-16 | Mentor Acquisition One, Llc | See-through computer display systems |
| US10191279B2 (en) | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US9671613B2 (en) | 2014-09-26 | 2017-06-06 | Osterhout Group, Inc. | See-through computer display systems |
| US20150277118A1 (en) | 2014-03-28 | 2015-10-01 | Osterhout Group, Inc. | Sensor dependent content position in head worn computing |
| US11227294B2 (en) | 2014-04-03 | 2022-01-18 | Mentor Acquisition One, Llc | Sight information collection in head worn computing |
| US9939934B2 (en) | 2014-01-17 | 2018-04-10 | Osterhout Group, Inc. | External user interface for head worn computing |
| US20160019715A1 (en) | 2014-07-15 | 2016-01-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
| US11103122B2 (en) | 2014-07-15 | 2021-08-31 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
| US9746686B2 (en) | 2014-05-19 | 2017-08-29 | Osterhout Group, Inc. | Content position calibration in head worn computing |
| US9841599B2 (en) | 2014-06-05 | 2017-12-12 | Osterhout Group, Inc. | Optical configurations for head-worn see-through displays |
| US10649220B2 (en) | 2014-06-09 | 2020-05-12 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
| US10254856B2 (en) | 2014-01-17 | 2019-04-09 | Osterhout Group, Inc. | External user interface for head worn computing |
| US9366868B2 (en) | 2014-09-26 | 2016-06-14 | Osterhout Group, Inc. | See-through computer display systems |
| US9299194B2 (en) | 2014-02-14 | 2016-03-29 | Osterhout Group, Inc. | Secure sharing in head worn computing |
| US9594246B2 (en) | 2014-01-21 | 2017-03-14 | Osterhout Group, Inc. | See-through computer display systems |
| US9829707B2 (en) | 2014-08-12 | 2017-11-28 | Osterhout Group, Inc. | Measuring content brightness in head worn computing |
| US9494800B2 (en) | 2014-01-21 | 2016-11-15 | Osterhout Group, Inc. | See-through computer display systems |
| US11892644B2 (en) | 2014-01-21 | 2024-02-06 | Mentor Acquisition One, Llc | See-through computer display systems |
| US9532714B2 (en) | 2014-01-21 | 2017-01-03 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US20150205135A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
| US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
| US11737666B2 (en) | 2014-01-21 | 2023-08-29 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
| US9811159B2 (en) | 2014-01-21 | 2017-11-07 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US9766463B2 (en) | 2014-01-21 | 2017-09-19 | Osterhout Group, Inc. | See-through computer display systems |
| US9651788B2 (en) | 2014-01-21 | 2017-05-16 | Osterhout Group, Inc. | See-through computer display systems |
| US9310610B2 (en) | 2014-01-21 | 2016-04-12 | Osterhout Group, Inc. | See-through computer display systems |
| US9651784B2 (en) | 2014-01-21 | 2017-05-16 | Osterhout Group, Inc. | See-through computer display systems |
| US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
| US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
| US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
| US9140554B2 (en) * | 2014-01-24 | 2015-09-22 | Microsoft Technology Licensing, Llc | Audio navigation assistance |
| US9846308B2 (en) | 2014-01-24 | 2017-12-19 | Osterhout Group, Inc. | Haptic systems for head-worn computers |
| US9401540B2 (en) | 2014-02-11 | 2016-07-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
| US20150241963A1 (en) | 2014-02-11 | 2015-08-27 | Osterhout Group, Inc. | Eye imaging in head worn computing |
| US9852545B2 (en) | 2014-02-11 | 2017-12-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
| US20160187651A1 (en) | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
| US9733478B2 (en) | 2014-04-03 | 2017-08-15 | Thomson Licensing | Ambient light management for virtual reality glasses |
| US20150309534A1 (en) | 2014-04-25 | 2015-10-29 | Osterhout Group, Inc. | Ear horn assembly for headworn computer |
| US9423842B2 (en) | 2014-09-18 | 2016-08-23 | Osterhout Group, Inc. | Thermal management for head-worn computer |
| US9672210B2 (en) | 2014-04-25 | 2017-06-06 | Osterhout Group, Inc. | Language translation with head-worn computing |
| US10853589B2 (en) | 2014-04-25 | 2020-12-01 | Mentor Acquisition One, Llc | Language translation with head-worn computing |
| US9651787B2 (en) | 2014-04-25 | 2017-05-16 | Osterhout Group, Inc. | Speaker assembly for headworn computer |
| US20160137312A1 (en) | 2014-05-06 | 2016-05-19 | Osterhout Group, Inc. | Unmanned aerial vehicle launch system |
| US10663740B2 (en) | 2014-06-09 | 2020-05-26 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
| US9684172B2 (en) | 2014-12-03 | 2017-06-20 | Osterhout Group, Inc. | Head worn computer display systems |
| USD743963S1 (en) | 2014-12-22 | 2015-11-24 | Osterhout Group, Inc. | Air mouse |
| USD751552S1 (en) | 2014-12-31 | 2016-03-15 | Osterhout Group, Inc. | Computer glasses |
| USD753114S1 (en) | 2015-01-05 | 2016-04-05 | Osterhout Group, Inc. | Air mouse |
| US10339896B2 (en) | 2015-01-13 | 2019-07-02 | Ricoh Company, Ltd. | Head-mounted display apparatus, and display method |
| US10878775B2 (en) | 2015-02-17 | 2020-12-29 | Mentor Acquisition One, Llc | See-through computer display systems |
| US20160239985A1 (en) | 2015-02-17 | 2016-08-18 | Osterhout Group, Inc. | See-through computer display systems |
| US10139966B2 (en) | 2015-07-22 | 2018-11-27 | Osterhout Group, Inc. | External user interface for head worn computing |
| US11609427B2 (en) | 2015-10-16 | 2023-03-21 | Ostendo Technologies, Inc. | Dual-mode augmented/virtual reality (AR/VR) near-eye wearable displays |
| US11106273B2 (en) | 2015-10-30 | 2021-08-31 | Ostendo Technologies, Inc. | System and methods for on-body gestural interfaces and projection displays |
| US10345594B2 (en) | 2015-12-18 | 2019-07-09 | Ostendo Technologies, Inc. | Systems and methods for augmented near-eye wearable displays |
| US10578882B2 (en) | 2015-12-28 | 2020-03-03 | Ostendo Technologies, Inc. | Non-telecentric emissive micro-pixel array light modulators and methods of fabrication thereof |
| US10850116B2 (en) | 2016-12-30 | 2020-12-01 | Mentor Acquisition One, Llc | Head-worn therapy device |
| US9826299B1 (en) | 2016-08-22 | 2017-11-21 | Osterhout Group, Inc. | Speaker systems for head-worn computer systems |
| US9880441B1 (en) | 2016-09-08 | 2018-01-30 | Osterhout Group, Inc. | Electrochromic systems for head-worn computer systems |
| US10353203B2 (en) | 2016-04-05 | 2019-07-16 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
| US10684478B2 (en) | 2016-05-09 | 2020-06-16 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
| US10824253B2 (en) | 2016-05-09 | 2020-11-03 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
| US10466491B2 (en) | 2016-06-01 | 2019-11-05 | Mentor Acquisition One, Llc | Modular systems for head-worn computers |
| US9910284B1 (en) | 2016-09-08 | 2018-03-06 | Osterhout Group, Inc. | Optical systems for head-worn computers |
| US10453431B2 (en) | 2016-04-28 | 2019-10-22 | Ostendo Technologies, Inc. | Integrated near-far light field display systems |
| US10522106B2 (en) | 2016-05-05 | 2019-12-31 | Ostendo Technologies, Inc. | Methods and apparatus for active transparency modulation |
| US10690936B2 (en) | 2016-08-29 | 2020-06-23 | Mentor Acquisition One, Llc | Adjustable nose bridge assembly for headworn computer |
| USD840395S1 (en) | 2016-10-17 | 2019-02-12 | Osterhout Group, Inc. | Head-worn computer |
| USD864959S1 (en) | 2017-01-04 | 2019-10-29 | Mentor Acquisition One, Llc | Computer glasses |
| US11409105B2 (en) | 2017-07-24 | 2022-08-09 | Mentor Acquisition One, Llc | See-through computer display systems |
| US10422995B2 (en) | 2017-07-24 | 2019-09-24 | Mentor Acquisition One, Llc | See-through computer display systems with stray light management |
| US10578869B2 (en) | 2017-07-24 | 2020-03-03 | Mentor Acquisition One, Llc | See-through computer display systems with adjustable zoom cameras |
| US10969584B2 (en) | 2017-08-04 | 2021-04-06 | Mentor Acquisition One, Llc | Image expansion optic for head-worn computer |
| US10152141B1 (en) | 2017-08-18 | 2018-12-11 | Osterhout Group, Inc. | Controller movement tracking with light emitters |
| US10502944B2 (en) | 2017-10-02 | 2019-12-10 | Nanotronics Imaging, Inc. | Apparatus and method to reduce vignetting in microscopic imaging |
| US10558895B2 (en) * | 2018-03-30 | 2020-02-11 | Tobii Ab | Deep learning for three dimensional (3D) gaze prediction |
| CA3115076A1 (en) | 2018-10-08 | 2020-04-16 | E-Vision Smart Optics, Inc. | Augmented reality device with adjustable electroactive beam splitter |
| SE1851597A1 (en) * | 2018-12-17 | 2020-06-02 | Tobii Ab | Gaze tracking via tracing of light paths |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4028725A (en) * | 1976-04-21 | 1977-06-07 | Grumman Aerospace Corporation | High-resolution vision system |
| JPS5880616A (en) * | 1981-11-09 | 1983-05-14 | Mitsubishi Electric Corp | Head-up display device |
| EP0177134A2 (en) | 1984-08-31 | 1986-04-09 | General Motors Corporation | Liquid crystal head-up display |
| US4805988A (en) | 1987-07-24 | 1989-02-21 | Nelson Dones | Personal video viewing device |
| US5050966A (en) * | 1988-07-06 | 1991-09-24 | Kaiser Aerospace & Electronics Corporation | Optical combiner collimating apparatus |
| US4900133A (en) | 1988-10-27 | 1990-02-13 | Kaiser Electronics | Heads-up display combiner utilizing a cholesteric liquid crystal element |
| JPH02220575A (en) | 1989-02-21 | 1990-09-03 | Eisuke Imanaga | Portable television set for face mount |
| JP2762677B2 (en) | 1990-04-24 | 1998-06-04 | ソニー株式会社 | Optical device |
| FR2683918B1 (en) | 1991-11-19 | 1994-09-09 | Thomson Csf | MATERIAL CONSTITUTING A RIFLE SCOPE AND WEAPON USING THE SAME. |
| US6160666A (en) * | 1994-02-07 | 2000-12-12 | I-O Display Systems Llc | Personal visual display system |
| GB9415894D0 (en) * | 1994-08-05 | 1994-09-28 | Central Research Lab Ltd | An apparatus for displaying an image |
| US5621572A (en) * | 1994-08-24 | 1997-04-15 | Fergason; James L. | Optical system for a head mounted display using a retro-reflector and method of displaying an image |
| JPH0915527A (en) | 1995-06-27 | 1997-01-17 | Olympus Optical Co Ltd | Head-mounted video display device |
| US5896232A (en) * | 1997-08-07 | 1999-04-20 | International Business Machines Corporation | Highly efficient and compact frontlighting for polarization-based reflection light valves |
| US6008946A (en) * | 1997-11-07 | 1999-12-28 | Honeywell, Inc. | Ambient light display illumination for a head-mounted display |
-
1999
- 1999-08-12 US US09/372,824 patent/US6456438B1/en not_active Expired - Lifetime
-
2000
- 2000-08-11 CA CA002381977A patent/CA2381977A1/en not_active Abandoned
- 2000-08-11 AT AT00986178T patent/ATE310257T1/en not_active IP Right Cessation
- 2000-08-11 DE DE60024096T patent/DE60024096T2/en not_active Expired - Lifetime
- 2000-08-11 WO PCT/US2000/022135 patent/WO2001016640A2/en active IP Right Grant
- 2000-08-11 EP EP00986178A patent/EP1200867B1/en not_active Expired - Lifetime
- 2000-08-11 JP JP2001520541A patent/JP2003508808A/en not_active Withdrawn
- 2000-08-11 AU AU22460/01A patent/AU2246001A/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| AU2246001A (en) | 2001-03-26 |
| US6456438B1 (en) | 2002-09-24 |
| WO2001016640A2 (en) | 2001-03-08 |
| DE60024096D1 (en) | 2005-12-22 |
| ATE310257T1 (en) | 2005-12-15 |
| JP2003508808A (en) | 2003-03-04 |
| EP1200867A2 (en) | 2002-05-02 |
| WO2001016640A3 (en) | 2001-09-20 |
| EP1200867B1 (en) | 2005-11-16 |
| DE60024096T2 (en) | 2006-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6456438B1 (en) | Variable immersion vignetting display | |
| US11029521B2 (en) | Head-mounted device with an adjustable opacity system | |
| US4994794A (en) | Methods and apparatus for displaying data | |
| US4697879A (en) | Airborne system for display of collimated images | |
| US9500868B2 (en) | Space suit helmet display system | |
| US6747612B1 (en) | Head-up display | |
| US6151081A (en) | Large screen display with projected overlay and method of using same | |
| US6639706B2 (en) | Optical path switch and method of using thereof | |
| US5550585A (en) | Video inter-view system | |
| CN114730068A (en) | Ambient light management system and method for wearable device | |
| US5416633A (en) | Twin-image binoculars | |
| US10996467B2 (en) | Head-mounted display and control apparatus and method | |
| McLean et al. | Developing a wide field of view HMD for simulators | |
| AU2016378943B2 (en) | Improvements in and relating to displays | |
| Thomson et al. | The benefits of using head mounted displays and wearable computers in a military maintenance environment | |
| Rash et al. | Design issues for helmet-mounted display systems for rotary-wing aviation | |
| EP3454175A1 (en) | Head-mounted display and control apparatus and method | |
| Schnell et al. | A comparison of helmet-mounted display symbologies during live flight operational tasks | |
| EP1141769A1 (en) | Screening device | |
| Edmondson et al. | 3D vision upgrade kit for TALON robot | |
| Ruffner et al. | Near-to-eye display concepts for air traffic controllers | |
| Calhoun et al. | Simulation assessment of synthetic vision system concepts for UAV operations | |
| Belenkii et al. | Head-worn display for control of unmanned vehicles | |
| Lohmann et al. | Helmet-Mounted Displays For Helicopter Pilotage: Design Configuration Tradeoffs, Analyses, And Test | |
| EP4089469A1 (en) | Head-up display with display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |