CN106662750A - See-through computer display systems - Google Patents

See-through computer display systems Download PDF

Info

Publication number
CN106662750A
CN106662750A CN201680002425.3A CN201680002425A CN106662750A CN 106662750 A CN106662750 A CN 106662750A CN 201680002425 A CN201680002425 A CN 201680002425A CN 106662750 A CN106662750 A CN 106662750A
Authority
CN
China
Prior art keywords
light
image
eyes
user
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680002425.3A
Other languages
Chinese (zh)
Other versions
CN106662750B (en
Inventor
J.N.博尔德
N.L.尚斯
J.比特里
J.D.哈迪
R.F.奥斯特豪特
K.埃尔卡查
R.M.罗斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Manto first acquisition Co.,Ltd.
Original Assignee
Osterhout Group Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/623,932 external-priority patent/US20160239985A1/en
Priority claimed from US14/635,390 external-priority patent/US20150205135A1/en
Priority claimed from US14/670,677 external-priority patent/US20160286203A1/en
Priority claimed from US14/741,943 external-priority patent/US20160018645A1/en
Priority claimed from US14/813,969 external-priority patent/US9494800B2/en
Priority claimed from US14/851,755 external-priority patent/US9651784B2/en
Priority claimed from US14/861,496 external-priority patent/US9753288B2/en
Priority claimed from US14/884,567 external-priority patent/US9836122B2/en
Priority to CN202110186961.6A priority Critical patent/CN113671703A/en
Application filed by Osterhout Group Inc filed Critical Osterhout Group Inc
Publication of CN106662750A publication Critical patent/CN106662750A/en
Publication of CN106662750B publication Critical patent/CN106662750B/en
Application granted granted Critical
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/1006Beam splitting or combining systems for splitting or combining different wavelengths
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/142Coating structures, e.g. thin films multilayers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0118Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Abstract

A head mounted display with improved high transmission see-through view of the surrounding environment with an overlaid high contrast displayed image includes upper optics with a first optical axis including an emissive image source that provides image light comprised of one or more narrow spectral bands of light, one or more lenses, a stray light trap and non-polarized lower optics with a second optical axis including a planar beam splitter angled relative to the first and second optical axes and a curved partially reflective mirror, wherein one or more of the reflective surfaces are treated to reflect a majority of incident light within the one or more narrow spectral bands and transmit a majority of incident visible light from the surrounding environment.

Description

Perspective computer display system
Prioity claim
U.S.'s non-provisional application of the Application No. 14/884,567 that the application was submitted to on October 15th, 2015(ODGP-3017- U01)The rights and interests for claiming priority.
The application is claimed priority to the following U.S. Patent application being merged in its whole herein by reference Rights and interests:The U.S. Patent application of the Application No. 14/635,390 that on March 2nd, 2015 submits to(ODGP-2014-U01).
The application was submitted to on March 27th, 2015, entitled " See-Through Computer Display Systems ", The rights and interests that U.S.'s non-provisional application (ODGP-2015-U01) of Application No. 14/670,677 is claimed priority.
U. S. application (the ODGP-2016- of the Application No. 14/741,943 that the application was submitted to on June 17th, 2015 U01 the rights and interests for) claiming priority.
The application was submitted to on July 30th, 2015, entitled " SEE-THROUGH COMPUTER DISPLAY SYSTEMS ", The rights and interests that U.S.'s non-provisional application (ODGP-2017-U01) of Application No. 14/813,969 is claimed priority.
The application was submitted on the 11st to September in 2015, entitled " SEE-THROUGH COMPUTER DISPLAY SYSTEMS ", The rights and interests that U.S.'s non-provisional application (ODGP-2018-U01) of Application No. 14/851,755 is claimed priority.
The application was submitted on the 22nd to September in 2015, entitled " SEE-THROUGH COMPUTER DISPLAY SYSTEMS ", The rights and interests that U.S.'s non-provisional application (ODGP-2019-U01) of Application No. 14/861,496 is claimed priority.
The application was submitted to on 2 17th, 2015, the U.S. non-provisional application (ODGP- of Application No. 14/623,932 The rights and interests for 3016-U01) claiming priority.
Application more than all is incorporated herein by quoting with its whole.
Technical field
The present invention relates to perspective computer display system.
Background technology
Head mounted display(HMD)And it is valuable instrument to be especially to provide the HMD of the see-through view of environment. When attempting to ensure that Consumer's Experience is optimised, presentation content is probably complicated operation in see-through display.Need to use Improve Consumer's Experience in the improved system and method for the presentation content in see-through display.
The content of the invention
Each aspect of the present invention is related to for from augmented reality(I.e. by the high perspective transmission of display)To virtual Reality(I.e. by the low perspective of display or without perspective transmission)Transfer capability perspective computer display system method and System.
On the one hand, head mounted display can include display floater and processor, the display floater be sized and Be positioned to produce visual field digital content presented to the eyes of user, the processor be adapted to be in by the digital content It is described to be partially in described regarding now to display floater so that the digital content is only present in a part for the visual field The centre of field is so that the level of relative edge of the visual field is white space.The processor can be further adapted into will Digital content is displaced in one of white space, to adjust the focusing distance of digital content and so as to change from user to numeral The perceived distance of content.Digital content can include augmented reality object.Perceived distance can be in the arm's reach of user.Meeting Poly- distance can with associated by the type of shown digital content or augmented reality object in service condition accordingly It is conditioned.The convergence can be measured by the eye imaging system of head mounted display.Eye imaging system is to user's eye The front perspective of eyeball is imaged.
On the one hand, head mounted display can include display floater and processor, the display floater be sized and Be positioned to produce visual field digital content presented to the eyes of user, the processor be adapted to be in by the digital content It is described to be partially in described regarding now to display floater so that the digital content is only present in a part for the visual field The centre of field is so that the level of relative edge of the visual field is white space.The processor can be further adapted into will Digital content is displaced in one of white space, to adjust the position of digital content based on the focusing distance of digital content.
On the one hand, head mounted display can include display floater and processor, the display floater be sized and Be positioned to produce visual field digital content presented to the eyes of user, the processor be adapted to be in by the digital content It is described to be partially in described regarding now to display floater so that the digital content is only present in a part for the visual field The centre of field is so that the level of relative edge of the visual field is white space.The processor can be further adapted into will Digital content is displaced in one of white space, is adjusted in numeral with just seeing the instruction at the edge to digital content based on user The position of appearance.User is just seeing that the instruction at the edge to digital content can be based on what is captured by the camera in head mounted display Eye image.It is quickly user that user is just seeing that the instruction at the edge to digital content can be based on user and rotate after the head of user Rotate the instruction of the eyes of user.
On the one hand, head mounted display can include display floater and processor, the display floater be sized and Be positioned to produce visual field digital content presented to the eyes of user, the processor be adapted to be in by the digital content It is described to be partially in described regarding now to display floater so that the digital content is only present in a part for the visual field Centre so that the level of relative edge of the visual field is white space, wherein each white space include approximate 10% or Bigger field-of-view lateral region.The processor can be further adapted into and digital content is displaced in one of white space To adjust the position of digital content.Including the white space in the visual field including the combined left half and right half of visual field Total amount keeps constant, while changing the left half and right half digital content is positioned in visual field.Digital content can be with It is positioned to adjust the focusing distance being associated with digital content.Digital content can be positioned to adjust related to digital content The interpupillary distance of connection.
According to the described in detail below of preferred embodiments and drawings, these and other systems of the present invention, method, target, Feature and advantage will be apparent for those skilled in the art.All documents mentioned in this article from there through quote with Its whole is merged in.
Description of the drawings
Embodiment is described with reference to figure below.Quoted using identical numeral everywhere the similar characteristics that illustrate in figure and Part.
Fig. 1 illustrates the wear-type computing system of principle of the invention.
Fig. 2 illustrates the wear-type computing system with optical system of principle of the invention.
Fig. 3 a illustrate large-scale prior art optical arrangement.
Fig. 3 b illustrate the top optical module of principle of the invention.
Fig. 4 illustrates the top optical module of principle of the invention.
Fig. 4 a illustrate the top optical module of principle of the invention.
Fig. 4 b illustrate the top optical module of principle of the invention.
Fig. 5 illustrates the top optical module of principle of the invention.
Fig. 5 a illustrate the top optical module of principle of the invention.
Fig. 5 b illustrate the top optical module and half-light trap of principle of the invention.
Fig. 5 c illustrate the top optical module and half-light trap of principle of the invention.
Fig. 5 d illustrate the top optical module and half-light trap of principle of the invention.
Fig. 5 e illustrate the top optical module and half-light trap of principle of the invention.
Fig. 6 illustrates the upper and lower optical module of principle of the invention.
Fig. 7 illustrates the angle of the combiner element of principle of the invention.
Fig. 8 illustrates the upper and lower optical module of principle of the invention.
Fig. 8 a illustrate the upper and lower optical module of principle of the invention.
Fig. 8 b illustrate the upper and lower optical module of principle of the invention.
Fig. 8 c illustrate the upper and lower optical module of principle of the invention.
Fig. 9 illustrates the eye imaging system of principle of the invention.
Figure 10 illustrates the light source of principle of the invention.
Figure 10 a illustrate the back illumination of principle of the invention(lighting)System.
Figure 10 b illustrate the back illumination system of principle of the invention.
Figure 11 a to 11d illustrate the light source and light filter of principle of the invention.
Figure 12 a to 12c illustrate the light source and quantum dot system of principle of the invention.
Figure 13 a to 13c illustrate the peripheral illumination system of principle of the invention.
Figure 14 a to 14h illustrate the Xanthophyll cycle system of principle of the invention.
Figure 15 illustrates the external user interface of principle of the invention.
Figure 16 a to 16c illustrate the distant-control system of principle of the invention.
Figure 17 a to 17c illustrate the power interpretation of principle of the invention(interpretation)System.
Figure 18 a to 18c illustrate the user interface mode of principle of the invention and select system.
Figure 19 illustrates the interactive system of principle of the invention.
Figure 20 illustrates the external user interface of principle of the invention.
Figure 21 illustrates the mD tracks of principle presentation of the invention and represents.
Figure 22 illustrates the mD tracks of principle presentation of the invention and represents.
Figure 23 illustrates the environment of the mD scannings of principle of the invention.
Figure 23 a illustrate the mD tracks of principle presentation of the invention and represent.
Figure 24 illustrates the veiling glare suppression technology of principle of the invention.
Figure 25 illustrates the veiling glare suppression technology of principle of the invention.
Figure 26 illustrates the veiling glare suppression technology of principle of the invention.
Figure 27 illustrates the veiling glare suppression technology of principle of the invention.
Figure 28 a to 28c illustrate DLP mirror angles.
Figure 29 to 33 illustrates the eye imaging system of principle of the invention.
Figure 34 and 34a illustrates the structurized eyes illumination system of principle of the invention.
Figure 35 illustrates the eyes flash of light in the prediction of eyes Orientation of principle of the invention.
Figure 36 a illustrate the eyes characteristic that can be used for personal identification by the analysis of system of principle of the invention.
Figure 36 b diagrams can represent anti-with the digital content of the analyzed eyes for leaving wearer of principle of the invention Penetrate.
Figure 37 illustrate principle of the invention along various virtual target lines and the eye imaging of various focal planes.
Figure 38 illustrates the content-control with regard to eyes movement based on eye imaging of principle of the invention.
Figure 39 illustrates the eye imaging and eyes of principle of the invention and assembles.
Figure 40 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 41 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 42 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 43 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 44 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 45 diagrams various directions in this example over time(heading).
Figure 46 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 47 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 48 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 49 illustrates the location of content for depending on sensor feedback of principle of the invention.
Figure 50 illustrates the shock of principle of the invention(impinging)The light of eyes.
Figure 51 illustrates the view of the eyes of principle of the invention.
Figure 52 a and 52b illustrate the view of the eyes with structurized smooth pattern of principle of the invention.
Figure 53 illustrates the optical device module of principle of the invention.
Figure 54 illustrates the optical device module of principle of the invention.
Figure 55 is shown with a series of exemplary spectroscopies for various controlled substances measured by the form of infrared spectrometry.
Figure 56 is shown for the infrared absorption spectroscopy of glucose.
Figure 56 a, 56b, 56c and 56d depict the example of eyes flicker.
Figure 56 e depict the chart of the measured front and rear radius of sphericity of human eye.
Figure 57 illustrates the scene that personnel walk with the HWC being mounted on his head.
Figure 58 illustrate for receive, develop and use from(It is multiple)Being moved towards of HWC, the visual field are towards, eyes direction And/or the system of persistent information.
Figure 59 illustrates the presentation technology of principle of the invention.
Figure 60 illustrates the presentation technology of principle of the invention.
Figure 61 illustrates the presentation technology of principle of the invention.
Figure 62 illustrates the presentation technology of principle of the invention.
Figure 63 illustrates the presentation technology of principle of the invention.
Figure 64 illustrates the presentation technology of principle of the invention.
Figure 65 illustrates the presentation technology of principle of the invention.
Figure 66 illustrates the presentation technology of principle of the invention.
Figure 67 illustrates the optical arrangement of principle of the invention.
Figure 68 illustrates the optical arrangement of principle of the invention.
Figure 69 illustrates the optical arrangement of principle of the invention.
Figure 70 illustrates the optical arrangement of principle of the invention.
Figure 71 illustrates the optical arrangement of principle of the invention.
Figure 72 illustrates the optical element of principle of the invention.
Figure 73 illustrates the optical element of principle of the invention.
Figure 74 illustrates the optical element of principle of the invention.
Figure 75 illustrates the optical element of principle of the invention.
Figure 76 illustrates the optical element in perspective computer display of principle of the invention.
Figure 77 illustrates the optical element of principle of the invention.
Figure 78 illustrates the optical element of principle of the invention.
Figure 79 a illustrate the schematic diagram of the top optics of principle of the invention.
Figure 79 illustrates the schematic diagram of the top optics of principle of the invention.
Figure 80 illustrates the veiling glare control technology of principle of the invention.
Figure 81 a and 81b illustrate the display with gap and macking technique of principle of the invention.
Figure 82 illustrates the upper module with finishing polariser of principle of the invention.
Figure 83 illustrates the optical system of the multiple polarizer film with stacking of principle of the invention.
Figure 84 a and 84b illustrate the partially reflecting layer of principle of the invention.
Figure 84 c illustrate the multiple polariser of the stacking with complicated bend of principle of the invention.
Figure 84 d illustrate the multiple polariser of the stacking with bending of principle of the invention.
Figure 85 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 86 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 87 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 88 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 89 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 90 illustrates the optical system for being adapted to head mounted display of principle of the invention.
Figure 91 illustrates the optical system of principle of the invention.
Figure 92 illustrates the optical system of principle of the invention.
Figure 93 illustrates the optical system of principle of the invention.
Figure 94 illustrates the optical system of principle of the invention.
Figure 95 illustrates the optical system of principle of the invention.
Figure 96 illustrates the optical system of principle of the invention.
Figure 97 illustrates the optical system of principle of the invention.
Figure 98 illustrates the optical system of principle of the invention.
Figure 99 illustrates the optical system of principle of the invention.
Figure 100 illustrates the optical system of principle of the invention.
Figure 101 illustrates the optical system of principle of the invention.
Figure 102 illustrates the optical system of principle of the invention.
Figure 103,103a and 103b illustrate the optical system of principle of the invention.
Figure 104 illustrates the optical system of principle of the invention.
Figure 105 illustrates the stop optics of principle of the invention.
Figure 106 a, 106b and 106c illustrate the stop light optic system of principle of the invention.
Figure 107 illustrates the full-colour image of principle of the invention.
Figure 108 A and 108B illustrate the color division management of principle of the invention.
Figure 109 illustrates the timing sequence of principle of the invention.
Figure 110 illustrates the timing sequence of principle of the invention.
Figure 111 a and 111b illustrate the image that the order of principle of the invention shows.
Figure 112 illustrates the see-through display with rotary part of principle of the invention.
Figure 113 illustrates the optical device module with torsion reflecting surface of principle of the invention.
Figure 114 illustrates the PCB within the shape of glasses factor of principle of the invention and perspective optical device module Position.
Figure 115 illustrates the PCB within the shape of glasses factor of principle of the invention and perspective optical device module Position.
Figure 116 illustrates the PCB within the shape of glasses factor of principle of the invention and perspective optical device module Position.
Figure 117 illustrates the user interface of principle of the invention.
Figure 118 illustrates the user interface of principle of the invention.
Figure 119 illustrates the lens arrangement of principle of the invention.
The eye imaging system of the diagrams of Figure 120 and 121 principle of the invention.
Figure 122 illustrates the identification process of principle of the invention.
The combination device assembly of the diagrams of Figure 123 and 124 principle of the invention.
Figure 125 shows chart of the human eye for the sensitivity of brightness.
Figure 126 shows the brightness perceived by human eye(L*)Relative to the brightness measured by color and luster(Illumination)Figure Table.
Figure 127 is the diagram of the see-through view with profile of surrounding, and the profile illustrates display visual field less than typical case Perspective visual field.
Figure 128 is the diagram of the captured images of surrounding, and the image for being captured can be with compared with shown image It is much bigger visual field so that the version that cuts of the captured images of environment can be used for alignment procedures.
Figure 129 a and 129b first and second target images of the diagram with invisible labelling.
The diagram principles of the invention of Figure 130 and 131 by the target in superimposition to see-through view, wherein by using Eye tracks control is moving the target.
Figure 132 illustrates the multiple folding light including solid prisms for head mounted display of principle of the invention Learn the diagram of device.
Figure 133 a, 133b and 133c illustrate being associated to solid prisms with reflecting plate is engaged for principle of the invention The step of diagram.
Figure 134 illustrates the diagram of the multiple folding optics for reflectogram image source of principle of the invention, its Middle backlight assembly is positioned in reflecting plate rear.
Figure 135 illustrates the diagram of the prism film for being joined to reflecting plate of principle of the invention.
Figure 135 a illustrate the diagram of the multiple folding optics of principle of the invention, illustrated therein is by prism film Two cones of the illumination light of offer.
Figure 136,137 and 138 illustrate principle of the invention in the solid for being imaged to the eyes of user The diagram of the different embodiments of included additional optics in prism.
Figure 139 illustrates the diagram of the eye imaging system for multiple folding optics of principle of the invention, Wherein image source is self-emitting display.
Figure 140 a and 140b are the diagrams of the eye imaging system of principle of the invention.
Figure 141 a and 141b are the diagrams of the folded optics of principle of the invention, the folded optics bag Waveguide is included, the waveguide has the partially reflecting surface and the reflecting surface with refractive power being at an angle of.
Figure 142 a and 142b are the diagrams of the folded optics for head mounted display of principle of the invention, The folded optics include waveguide, and the waveguide has at least one holographic optical elements (HOE) and image source.
Figure 143 is the diagram of the folded optics for head mounted display of principle of the invention, wherein according to Mingguang City is injected in waveguide and is redirected by holographic optical elements (HOE), so that the eyes of user are illuminated.
Figure 144 illustrates the diagram of the folded optics for head mounted display of principle of the invention, wherein A series of angled partially reflecting mirrors are included in the waveguide.
Figure 145 illustrates the figure of the optical module based on beam splitter for head mounted display of principle of the invention Show.
Figure 146 illustrates the diagram of the optical module for head mounted display of principle of the invention.
Figure 146 a illustrate the diagram of the side view of the optical device module including correcting lens element.
Figure 147 illustrates the left optical device module being joined together in frame and right light of principle of the invention Learn the diagram of device blocks.
Figure 148 illustrates the nominal vergence distance in left display visual field and right display visual field of principle of the invention Left image and right image that place provides.
Figure 149 illustrates how regarding left image and right image in left display visual field and right display for principle of the invention Transversely toward being shifted each other in.
Figure 150 a and 150b illustrate the mechanism for mobile image source of principle of the invention.
Figure 151 a and 151b illustrate the upper wedge thing of the position from image source of principle of the invention and bottom The diagram of wedge.
Figure 152 illustrates the diagram of the alligator clamp to image source applying power of principle of the invention.
Figure 153 a, 153b and the 154 example display optics devices including eye imaging for illustrating principle of the invention The diagram of part.
Figure 155 a, 155b, 156a, 156b, 157a, 157b, 158a, 158b, 159a and 159b illustrate of the invention The diagram of the focus adjustment module of principle.
Figure 160 illustrates the figure of the example of the multiple folding optics from eye position viewing of principle of the invention Show.
The optical system of the diagrams of Figure 161 and 162 principle of the invention.
Figure 163 A are shown in the apparent suddenly change of the content in the visual field of see-through display.
Figure 163 B outward appearance systems for being managed of diagram, wherein content in the transition region that it is entered near field of view edge outside It is contracted by sight.
Figure 164 diagram mixing visual field, it includes visual field placed in the middle and extends visual field, and the extension visual field is positioned in and regards between two parties The edge of field or its neighbouring or imbricate with visual field placed in the middle.
Figure 165 illustrates mixed display system, wherein leading visual field placed in the middle is generated using the optics in upper module And extend visual field be using on combiner install display system and generate.
Figure 166 A-166D diagrams extend the example for showing or extending picture material optical arrangement.
Figure 167 illustrates another optical system, and it uses hybrid optical system, the hybrid optical system to include main display light System and extension visual field optical system.
Figure 168 A-168E illustrate various embodiments, wherein display floater is had an X-rayed in Wearing-on-head type computer is positioned at user The dead ahead of eyes, to provide visual field extend and/or overlap in mixed display system.
Figure 169 illustrates the cross section of the example optical apparatus assembly for head mounted display of principle of the invention Diagram.
Figure 170 illustrates the operation of principle of the invention to reduce the diagram of the ligh trap of veiling glare.
Figure 171 illustrates the diagram of the simple optical system of 60 degree of display visual fields of offer of principle of the invention.
Figure 172 illustrates chart of the typical human eye relative to the acuity of angle position in visual field.
Figure 173 illustrates that the acuity of typical human eye in simplified form contrasts the chart of eccentricity, and it highlights acuity Difference with the reduction of eccentricity and between colourless acuity and coloured acuity.
Figure 174 A and 174B illustrate the typical chart of the eyes movement and head movement provided relative to the time with radian.
Figure 175 is showed and fovea centraliss(fovea)The chart of effective relatively colourless acuity compared of acuity, should Effectively relative to colourless acuity be including eyes it is mobile when provided in eyes visual field by typical human eye.
Figure 176 is chart, be it illustrates for needed for the uniform sharp keen viewing image of offer in wide visual field display image The minimal design MTF contrast angle field position wanted.
Figure 177 is chart, be it illustrates for wide visual field display is provided and human eye in the external zones for showing visual field The relative MTF provided by display optics is provided for the acutance that acuity matches.
Figure 178 shows the modeled MTF curve being associated with the optical system of Figure 171, illustrated therein is for aobvious Show the MTF curve of the various Difference angles in visual field.
Figure 179 is the diagram of resolution chart, and wherein the acutance of image is by making the periphery of image fuzzy It is lowered to simulate the image from optics, the optics provides less sharp keen for +/- 15 degree of central sharp keen area External zones.
Figure 180 and 181 be principle of the invention is shown how to show visual field when user moves their head Inside make the diagram of image shift.
Figure 182 illustrates the blank parts of the display visual field of principle of the invention, and wherein image is therefrom shifted Where be shown as dark space, enable a user in blank parts perspective to surrounding.
Figure 183 illustrates the wide diagram for showing visual field of principle of the invention, wherein user can select be directed to Determine image or application(For example play)Show less visual field to improve personal viewing experience.
Figure 184 and 185 illustrates the physical layout of the optical system of principle of the invention.
Figure 186 illustrates the 30 of principle of the invention:The visual field of 9 forms and 22:The visual field of 9 forms, wherein described two Individual visual field has identical vertical field of view and different horizontal field of view.
Figure 187 depicts the eyes of user watched through display visual field.
Figure 188 depicts the landscape images displacement shown in visual field.
Figure 189 depicts the diagram that left display image and right display image will be present in when showing in visual field at them.
Figure 190 depicts the diagram that left display image and right display image will be present in when showing in visual field at them.
Figure 191 depicts the diagram illustrated through the eyes of user that visual field is watched is shown.
Figure 192 depicts the diagram that left display image and right display image will be present in when showing in visual field at them.
Although the present invention is been described by already in connection with some preferred embodiments, other embodiment is by by this area Those of ordinary skill understands and covered in herein.
Specific embodiment
One aspect of the present invention is related to wear-type calculating(“HWC”)System.HWC is related in some instances imitation and wears The system of the outward appearance of formula glasses or sunglassess.Glasses can be the calculating platform developed completely, such as including computer display, The computer display is presented to the eyes of user in each in the lens of glasses.In embodiment, lens and aobvious Show that device can be configured to allow the personnel of wearing spectacles to see environment by lens, and while also see digital image, its shape Strengthen image or augmented reality for the numeral of environment into by person sensitive(“AR”)Superimposition image.
HWC is related to more than place computing system on the head of personnel.System may need to be designed to light weight, tight Computer display gather and Full Featured, such as wherein computer display includes providing by the digital content and ring for showing The high level reproduction of the see-through view composition of the surrounding in border(emersion)High-resolution digital display.Unlike being used for More conventional computer(Such as notebook computer)Those user interfaces and control system, it may be necessary to be suitable for HWC equipment User interface and control system.In order that HWC and associated system are most effective, glasses can be equipped with sensor really Determine environmental condition, geographical position and other point-of-interests relative localization, by by user or connection group in other users It is imaged and the object that moved and recognized, etc..In the method for pressing context awareness HWC is commonly referred to as, then HWC can be Change the pattern of operation with matching condition, position, positioning, movement etc..Glasses it may also be desirable to locally or through network by nothing Line ground is otherwise connected to other systems.Can by using external equipment, by by situation collect information it is automatic Ground, realize being controlled glasses by user's posture for being captured by glasses sensor etc..Every kind of technology can according to just by with Software application in glasses and by further perfect.Glasses can be further used for the external equipment for controlling to be associated with glasses Or mutually coordinate with it.
With reference to Fig. 1, the general survey of HWC systems 100 is presented.As shown, HWC systems 100 include HWC 102, described What HWC 102 was configured with this example sensor will be worn on the glasses on head so that HWC 102 perceives To object and condition in environment 114.In this example, HWC 102 also receives and interprets control input, such as posture and shifting Dynamic 116.HWC 102 can communicate with external user interface 104.External user interface 104 physical user interface can be provided with Control instruction is obtained from the user of HWC 102, and external user interface 104 and HWC 102 can be with two-way communications realizing using The order at family simultaneously provides feedback to external equipment 108.HWC 102 can also be with the local device 108 pairs of external control or coordination To communication.For example, external user interface 104 can be used in conjunction with controlling the sheet of external control or coordination with HWC 102 Ground equipment 108.The local device 108 of external control or coordination can provide feedback to HWC 102, and can be based on concrete knowledge The type of other equipment 108 or equipment is presented the GUI of customization in HWC 102.HWC 102 can also pass through network connection 110 Interact with remote equipment and information source 112.And, external user interface 104 can with HWC 102 be used in conjunction with so as to With when external user interface 104 be used to controlling the local device 108 of external control or coordination or otherwise with it is described During similar manner when the local device 108 of external control or coordination is interacted is to control remote equipment 108 and information source 112 It is any or otherwise with the remote equipment 108 and information source 112 in arbitrarily interact.Similarly, HWC 102 can interpret(For example, from the sensor for facing forward, prone sensor, the sensor for facing upwards, the sensing towards after Device(Such as(It is multiple)Camera, diastimeter, IR sensors etc.)Capture)Posture 116 or the environment bar sensed in environment 114 Part, to control Local or Remote equipment 108 or 112.
We will be described in further detail each in the main element described on Fig. 1 now;However, these descriptions are intended to General guidance and the property of should not be construed as limited to are provided.The attached of each element can also be described further herein Plus description.
The calculating platform on head that HWC 102 is intended to be worn on personnel.HWC 102 can take many different Form is with suitable many different functional requirements.In some cases, by the form of conventional eyeglass designing HWC 102.Eye Mirror can have or can not have active Computer Graphic Display.Wherein integrated computer shows HWC 102 In the case of device, the display can be configured to see-through display so that digital image can be with regard to the use of environment 114 Family view and by superimposition.There are many perspective optical designs that can be used, including with reflective display(For example, LCoS, DLP), emission display(For example, OLED, LED), hologram, the perspective optical design of TIR waveguides etc..It is and aobvious in embodiment Show that illumination system that device optics is used in conjunction with can be solid-state illumination system, such as LED, OLED, quantum dot, quantum Point LED etc..Additionally, optical arrangement can be monocular or binocular.It can also include vision correcting opticses.Implementing In example, optics can be encapsulated as contact lenses.In other embodiments, HWC 102 can be with following every shapes Formula:The helmet with perspective screen, sunglassess, safety glasses, protective eye lens, mask, the fire hat with perspective screen, tool Have perspective screen police helmet, with perspective screen military helmet, for certain task(For example, stock control System, logistics, repairing, maintenance etc.)And useful form for customizing etc..
HWC 102 can also have many integrated calculating facilities, the such as management of integrated processor, integrated power, communication knot Structure(For example, cell networks(cell net), WiFi, bluetooth, local interconnection, netted connection, long-range connection(For example, client server Deng))Etc..HWC 102 can also have many positions to perceive sensor, such as GPS, electronic compass, altitude meter, inclination sensing Device, IMU etc..It can also have other sensors, such as camera, diastimeter, super spectrum camera, geiger counter, mike, Spectral illumination detector, temperature sensor, chemical sensor, biosensor, humidity sensor, sonac etc..
HWC 102 can also have integration control technology.Integration control technology can be based on the control of situation, passive control System, active control, user's control etc..For example, HWC 102 can have integrated sensor(For example, camera), its capture user's hands Or body gesture 116 so that Integrated Processing System can interpret the posture and generate for the control command of HWC 102. In another example, HWC 102 can have detection movement(For example, nod, shake the head)Sensor, including acceleration Meter, gyroscope and other inertia measurements, wherein integrated processor can be interpreted mobile and generate control command as response. HWC 102 can also automatically control its own based on measured or perception environmental condition.For example, if being in the environment bright Bright, then HWC 102 can improve brightness or the contrast of display image.In embodiment, integration control technology can be pacified It is mounted on HWC 102 and enables a user to and its direct interaction.For example, HWC 102 can have(It is multiple)Button, touch electricity Hold interface etc..
As described in this article like that, HWC 102 can communicate with external user interface 104.External user interface can To occur in many different forms.For example, cellular telephone screen may adapt to obtain user input for controlling HWC 102 aspect.External user interface can be special UI, such as keyboard, touch-surface,(It is multiple)Button, stick etc..In reality In applying example, peripheral control unit can be integrated into another equipment(Ring, wrist-watch, bicycle, automobile etc.)In.Every In the case of kind, external user interface 104 can include sensor(For example, IMU, accelerometer, compass, altitude meter etc.)To carry For additional input for control HWD 104.
As described in this article like that, HWC 102 can control other local devices 108 or coordinate with it.It is outside Equipment 108 can be audio frequency apparatus, visual apparatus, vehicle, cell phone, computer etc..For example, local external equipment 108 can To be another HWC 102, wherein and then information can be exchanged between detached HWC 108.
Can similar, the HWC in the way of controlling local device 106 or coordinate to the local device 106 to HWC 102 102 can control remote equipment 112 or coordinate with the remote equipment 112, such as HWC 102 by network 110 with it is long-range Equipment 112 communicates.Furthermore, the form of remote equipment 112 can have many forms.Included in these forms is another Individual HWC 102.For example, each HWC 102 can transmit its GPS location so that all HWC 102 know all HWC 102 Positioned at where.
Fig. 2 HWCs 102 of the diagram with optical system, the optical system includes top optical module 202 and bottom light Learn module 204.Although top optical module 202 and lower optical module 204 will be generally described as detached module, should It should be appreciated that, this is merely illustrative and the present invention includes other physical configurations, is such as combined in two modules During individual module or constitute the physical configuration that the element of two modules is configured in the case of more than two module.In embodiment In, upper module 202 includes the display of computer controls(For example, LCoS, DLP, OLED etc.)Optics device is delivered with image light Part.In embodiment, lower module includes being configured to the image light of reception upper module and being delivered to described image light The ocular delivery optics of the eyes of the wearer of HWC.In fig. 2, it should be noted that although top optical module 202 It is illustrated in the side of HWC with lower optical module 204 so that image light can be delivered to an eyes of wearer, But by present invention foresees that, embodiment will be comprising two image light delivery systems, each eye one.
Fig. 3 b illustrate the top optical module 202 of principle of the invention.In this embodiment, top optical module 202 include DLP(Also referred to as DMD or digital micromirror device)The display 304 of computer operation(It is included by pivotable reflective Mirror(Such as, for example from DLP3000 obtained by Texas Instrument)The pixel of composition), polarized light source 302, ripple chronotron film 308, Reflective polarizer 310 and field lenses 312.Polarized light source 302 is provided and is typically toward the substantially uniform of the guiding of reflective polarizer 310 Polarized light.Reflective polarizer reflects the light of a polarization state(For example, S-polarization light)And transmit another polarization state Light(For example, P polarization light).Polarized light source 302 and reflective polarizer 310 are oriented such that the polarization from polarized light source 302 Light is typically toward DLP 304 and reflects.Then light passed through ripple film 308 once before the pixel of illumination DLP 304, and and then The ripple film 308 is again passed through after the pixel reflection by DLP 304.When the ripple film 308 is passed twice through, light is from one Plant polarization state and be converted into another polarization state(For example, light is converted into P polarization light from S-polarization light).It is inclined that light then passes through reflection Shake device 310.(It is multiple)DLP pixels are in " unlatching " state(I.e. reflecting mirror is oriented to towards the reflected light of field lenses 312)'s In the case of, " unlatching " pixel is generally along optical axis reflected light and reflects light in field lenses 312.Reflected by " unlatching " pixel And this light guided generally along the optical axis of field lenses 312 will be referred to as image light 316.Image light 316 then passes through field Lens by lower optical module 204 being used.
The light provided by polarized light source 302(The light is subsequent by reflective polarizer 310 from before the reflections of DLP 304 at it Reflection)By commonly referred to as illumination light.By DLP 304 " closing " pixel reflect light with the light reflected by " unlatching " pixel Different angles is reflected so that be generally off-site from the optical axis of field lenses 312 and towards such as in Fig. 3 from the light of " closing " pixel In the side of top optical module 202 that illustrates and be directed.The light reflected by " closing " pixel of DLP 304 will be referred to as secretly State light 314.
DLP 304 is operated and is generally considered to be MEMs equipment as the display of computer controls.DLP pixels It is made up of the small reflector that can be directed.Reflecting mirror is typically turned to another angle from an angle.Described two angles Commonly referred to as state.When light be used to illuminate DLP, reflecting mirror by depending on state direction on reflected light.At this In embodiment in text, we typically referred to as " open two states " and " closing ", and it is intended to describe the shape of display picture element Condition." unlatching " pixel regards the beholder of shown device as launching light, because light is directed and guides to show up along optical axis In the associated remainder of mirror and display system." closing " pixel regards the beholder of shown device as not launching light, because It is to be directed into the side of optical enclosure and be directed to the absorbed ligh trap of wherein light or light heap from the light of these pixels (light dump)In.The schema creation image light of " unlatching " and " closing " pixel, it is perceived as meter by the beholder of display The image that calculation machine is generated.By sequentially providing complementary colors for illumination light(Such as red, green and blueness)To be presented to user Full-colour image.Wherein sequence is presented to send out circulation again, it is described to send out recycle ratio user again and be perceived as detached image faster, and And as a result user is perceived by full-colour image that is sequential picture and constituting.Bright pixel in image is by being maintained at " unlatching " shape State up to the circulation full-time pixel providing, and pixel dark in image by within the time of the circulation or The pixel switched between state and "Off" state in " unlatching " in frame time when in the video sequence of image is providing.
Fig. 3 a illustrate the diagram of the system for DLP 304, wherein unpolarized light source 350 is pointing directly at DLP 304. In this case, it is that angle required for illumination light is so that field lenses 352 significantly must position to avoid away from DLP 304 Illumination light is pruned by field lenses 352.Straight line path of the big distance between field lenses 352 and DLP 304 together with dark state light 354 Footpath mean the ligh trap for dark state light 354 also be located at from DLP significantly with a distance from place.For these reasons, this configuration with It is bigger that the top optical device module 202 of preferred embodiment is compared in terms of size.
The configuration for illustrating in fig 3b can be light weight and compact, so that it is coupled in the fraction of HWC.Example Such as, herein the upper module 202 of diagram can be physically adapted to be mounted within the upper frame of HWC so that image Light can be directed in lower optical module 204 for digital content is presented to the eyes of wearer.Combine to generate figure As the part of light(That is, polarized light source 302, DLP 304, reflective polarizer 310 and l/4 ripples film 308)Encapsulation be very light And it is compact.Excluding the height of field lenses system outside can be less than 8 mm.Width(I.e., from front to back)Can be less than 8 mm.Weight can be less than 2 grams.The compactedness of this top optical module 202 allows the compact Machine Design of HWC, and this The light weight property of a little embodiments helps make HWC be light weight, to provide the comfortable HWC for the wearer of HWC.
The configuration for illustrating in fig 3b can produce sharp keen contrast, high brightness and atrouss, especially when be used for When LCD the or LCoS display of HWC is compared." unlatching " of DLP and "Off" state represent " unlatchings " pixel and " closing " as Strong differentiator is provided in the light reflection path of element.As will be discussed in greater detail below, from the dark of " closing " pixel reflection State light can be managed to reduce display system in veiling glare, to produce the image with high-contrast.
Fig. 4 illustrates another embodiment of the top optical module 202 of principle of the invention.This embodiment includes Light source 404, but in this case, the light source can provide unpolarized illumination light.From the illumination light quilt of light source 404 It is directed in TIR wedges 418 so that illumination light is incident on TIR with the angle beyond the critical angle for such as being limited by equation 1 The inner surface of wedge 418(The angled lower surface of the TRI wedges 418 being shown as in Fig. 4)On.
Critical angle=arc-sin (l/n) equation 1.
Wherein critical angle is following angles:When inner surface is included from higher refractive index(n)Solid(solid)Arrive During the interface with the air that refractive index is 1, beyond the angle, illumination light reflects from the inner surface(For example, for n To the interface of air, critical angle is 41.8 degree to the acrylic acid of=1.5 refractive index;For the refractive index with n=1.59 To the interface of air, critical angle is 38.9 degree to Merlon).Therefore, TIR wedges 418 are along between inner surface and thin air Gap 408 is associated, to create interface between the solid with higher refractive index and air.By with TIR wedges 418 in The angle on surface accordingly selects light source 404 relative to the angle of DLP 402, and illumination light is suitable for providing from " unlatching " pixel The angle of the image light 414 of reflection is rotated towards DLP 402.Wherein, being in during illumination light is to be approximately twice DLP 402 The angle of the pixel reflecting mirror of " unlatching " state is provided to DLP 402 so that from after pixel reflecting mirror reflection, scheme As optical axis of the light 414 generally along field lenses is directed.Depending on the state of DLP pixels, from the illumination light of " unlatching " pixel The image light 414 guided towards field lenses and lower optical module 204 is reflected as, and from the illumination light of " closing " pixel reflection (Generally referred herein to as " dark " state light, " closing " pixel light or "Off" state light)410 on detached direction quilt Guiding, it can be captured and be not used in the image of the eyes that finally be presented to wearer.
Dark state can be positioned for along the optical axis limited by the direction of dark state light 410 and in the side of shell The ligh trap of light 410, it has the function of absorbing dark state light.For this purpose, ligh trap can be with the image light 414 of oneself " unlatching " pixel of origin Cone outside region composition.Ligh trap is generally by the light absorbing material or other light absorbs materials of the coating including blacking Material is constituted, the image degradation perceived by user with preventing the light scattering from dark state light from making.Additionally, ligh trap can be recessed into Seen with stopping scattered light and preventing ligh trap to be adjacent to display image in the wall of shell or including mask or preventer See.
The embodiment of Fig. 4 also includes correction wedge 420 to correct it when image light 414 is from TIR 418 outgoing of wedge Refraction effect.By including correction wedge 420 and providing thin the air gap 408(For example, 25 microns), from " unlatching " The image light of pixel is generally maintained at the direction along the optical axis of field lenses(That is, it is identical with the direction limited by image light 414 Direction)On, therefore it is delivered in field lenses and lower optical module 204.As figure 4 illustrates, from " opening Open " image light 414 of pixel be generally perpendicular to the surface of correction wedge 420 and from the correction outgoing of wedge 420, and dark state Light is with angle of inclination outgoing.As a result, from " unlatching " pixel image light 414 direction described image light 414 from rectify Refractive effect is not received during the surface outgoing of positive wedge 420 to a great extent.By contrast, when dark state light 410 is from correction During 420 outgoing of wedge, dark state light 410 is refracted on direction and significantly changes.
The embodiment illustrated in Fig. 4 has the advantage similar to those advantages that the embodiment with reference to Fig. 3 b is discussed.Fig. 4 The size and weight of the upper module 202 of middle description can be approximate 8 × 8 mm, and it has the weight less than 3 grams.In Fig. 3 b The difference on overall performance between the configuration illustrated in the configuration of diagram and Fig. 4 is that the embodiment of Fig. 4 need not be used Such as the polarized light supplied by light source 404.This can be in some cases it is favourable, as will be discussed in greater detail below (For example, as viewed from the perspective of user the increase of HWC optics perspective transparency).Can be with reference in Fig. 4 in embodiment The embodiment of description uses polarized light.Attendant advantages of the embodiment of Fig. 4 compared with the embodiment for illustrating in fig 3b are:By In the increase refraction met with when dark state light 410 is from correction 420 outgoing of wedge, dark state light(It is shown as DLP and closes light 410) It is directed away from the optical axis of image light 414 with more steep angle.This more steep angle of dark state light 410 allows ligh trap more It is positioned near DLP 402, so as to reduce the size of population of upper module 202.Because ligh trap does not disturb field lenses, also Ligh trap can be made bigger such that it is able to improve ligh trap efficiency and can reduce as a result veiling glare and can improve by The contrast of the image that user perceives.Fig. 4 a illustrate embodiment described in conjunction with Figure 4, and it has right at various surfaces The example collection of angle, the wherein reflection angle of light beam is answered to pass through top optical module 202.In this illustration, with DLP The surface of equipment provides DLP reflecting mirrors in 17 degree.With select TIR wedges angle with corresponding to each other so as to for Correct angle is providing TIR reflection illumination light for DLP reflecting mirrors, while allowing image light and dark state light to pass through thin air Gap, various angle combinations are possible for this point is realized.
Fig. 5 illustrates the another embodiment of the top optical module 202 of principle of the invention.As figure 4 illustrates Embodiment it is the same, the embodiment that figure 5 illustrates need not use polarized light.Can in connection with the embodiment using polarization Light, but what this was not required.The optical module 202 described in Figure 5 is similar to the optical module presented with reference to Fig. 4;So And, the embodiment of Fig. 5 includes closing light-redirecting wedge 502.If as seeing from diagram, closing light-redirecting wedge Shape thing 502 allows image light 414 to continue and enter in lower optical module 204 generally along the optical axis towards field lenses (As illustrated).However, close light 504 is delivered to correction wedge 420 present in ligh trap generally toward it Side and be redirected.This configuration can allow the further high compactness in HWC, because be intended to absorb closing light 504 ligh trap(It is not shown)Can adjacent upper portions optical module 202 be laterally positioned, it is positioned below contrary with it.In Figure 5 In the embodiment of description, there is thin the air gap between TIR wedges 418 and correction wedge 420(With the embodiment of Fig. 4 It is similar).Thin the air gap is there is also between correction wedge 420 and closing light-redirecting wedge 502.There may be guarantee HWC mechanical arrangements of the positioning needle to the ligh trap of dark state light elsewhere, and the diagram described in Figure 5 should be counted as explanation Following concepts:Closing light can be redirected to create the compactedness of overall HWC.Fig. 5 a illustrate reality described in conjunction with Figure 5 The example of example is applied, with the addition in greater detail with regard to the relative angle at various surfaces, and for the light of image light Line tracking and the ray trajectory for half-light are illustrated when it passes through top optical module 202.Furthermore, various angle combinations are It is possible.
Fig. 4 b illustrate the diagram of further embodiment, and the wedge group 456 of wherein solid transparent matching is provided with wedge The reflective polarizer 450 of the interface between shape thing.The interface between wedge wherein in wedge group 456 is with certain angle Degree is provided so that the illumination light 452 from polarized light source 458 with suitable angle for DLP reflecting mirrors " unlatchings " state Degree(For example, 34 degree for 17 degree of DLP reflecting mirrors)Reflected, so that optical axis of the reflected image light 414 along field lenses It is provided.The general geometry of the wedge in wedge group 456 is similar to the geometry illustrated in Fig. 4 and 4a. Quarter-wave film 454 is provided on the surfaces of DLP 402 so that illumination light 452 is a kind of polarization state(For example, S-polarization State), and when passing through quarter-wave film 454, reflecting and pass back through quarter-wave film 454 from DLP reflecting mirrors, figure As light 414 is converted into another kind of polarization state(For example, P polarization state).Reflective polarizer is oriented such that with it The illumination light 452 of polarization state is reflected and the image light 414 of another polarization state with it is transmitted.Due to from The dark state light of " closing " pixel 410 also through quarter-wave film 454 twice, so it is also other polarization states(For example, P polarization state)So that it is transmitted by reflective polarizer 450.
The angle in the face of wedge group 450 corresponds to required angle, and the required angle is used for anti-by DLP Penetrate mirror and angle offer illumination light 452 required during " unlatching " state is provided so that light of the reflected image light 414 along field lenses Axle is reflected from DLP.Wedge group 456 provides internal interface, and wherein reflective polarizer film can be positioned to towards DLP 402 Reflecting mirror illumination light 452 is redirected.Wedge group also provides the wedge of matching on the opposite side of reflective polarizer 450 Shape thing, so that the image light 414 from " unlatching " pixel is substantially perpendicular to exit surface and from the outgoing of wedge group 450, And from " closing " pixel 410 dark state light with the inclined angle outgoing of exit surface.As a result, image light 414 exists Substantially be not refracted when wedge 456 outgoing of group, and from " closing " pixel 410 dark state light from wedge group Significantly reflected during 456 outgoing, as illustrated in fig. 4b.
By the wedge group for providing solid transparent matching, the flatness at interface is reduced, because the change in flatness Change and there is insignificant effect, as long as they are within the cone angle of illumination light 452.It can have 26 degree of cone angles F# 2.2.In a preferred embodiment, reflective polarizer is bonded on the matching of wedge group 456 using optical adhesive Between inner surface, to reduce the Fresnel reflection of the interface on the either side of reflective polarizer 450.Optical adhesive energy The section of enough match materials and wedge group 456 on refractive index with wedge group 456 can all by identical material(It is all Such as BK7 glass casts acrylic acid processed)Make.Wherein wedge material can be selected as also having low birefringence bright to reduce Inhomogeneities in degree.Wedge group 456 and quarter-wave film 454 can also be engaged to DLP 402 further to reduce Fresnel reflection at DLP interface loss.Further, since image light 414 is substantially hung down with the exit surface of wedge group 456 Directly, so the flatness on surface is not crucial for the wavefront for maintaining image light 414, to obtain in display image Flatness of the high image quality without the very severe tolerance on exit surface.
The not shown another embodiment of the present invention is combined the embodiment illustrated in Fig. 4 b and Fig. 5.At this In embodiment, wedge group 456 is made up of three wedges, wherein the general geometry correspondence of the wedge in wedge group The geometry illustrated in Fig. 5 and 5a.With situation about illustrating in Fig. 4 b similarly, reflective polarizer is bonded on into first and Between two wedges, but the 3rd wedge is similarly provided with the embodiment of Fig. 5.Wherein in second and the 3rd between wedge There is angled thin the air gap, so that dark state light is absorbed the side of the second wedge being located towards it in ligh trap Face is by TIR reflection.This embodiment(As the embodiment for illustrating in fig. 4b)It is such as previously described using polarized light source Like that.Difference in this embodiment is that image light is transmitted through reflective polarizer and is transmitted through angled thin sky Gas gap, so that its exit surface vertically outgoing with the 3rd wedge.
Fig. 5 b top optical modules 202 of the diagram with half-light trap 514a.As described in reference to Fig. 4 and 4a, when Image light can be generated when configuring using TIR and correcting lens from DLP.Upper module can be installed in HWC shells 510 simultaneously And shell 510 can include half-light trap 514a.General positioning/construction in the position of the optical alignment of half-light optical axis 512/formed Half-light trap 514a.As illustrated, half-light trap can have depth, and the depth causes the internally reflected half-light of the trap with power Spend further absorbing light and prevent half-light to be combined with the image light through field lenses.Half-light trap can have shape and depth Degree, the shape and depth cause half-light trap to absorb half-light.Additionally, half-light trap 514b can be by light absorbing material system in embodiment Into or be coated with light absorbing material.In embodiment, recessed ligh trap 514a can include baffle plate to stop dark state light View.This can be combined with black surface and textured or fibrous surface helping absorbing light.Baffle plate can be and shell Or the part of the associated ligh trap such as field lenses.
Fig. 5 c another embodiment of diagram with ligh trap 514b.As in the example shown it can be seen that as, the shape of trap It is configured to strengthen absorption of the internal reflection in ligh trap 514b to increase half-light 512.Fig. 5 d diagrams are another with ligh trap 514c One embodiment.As in the example shown it can be seen that as, the shape of trap 514c is configured to strengthen internal reflection dark to increase The absorption of light 512.
Another embodiment of Fig. 5 e top optical modules 202 of the diagram with half-light trap 514d.Upper module 202 this Individual embodiment includes closing light reflection wedge 502, as with reference to illustrated in the embodiment of Fig. 5 and 5a and as description.Such as exist In Fig. 5 e it can be seen that as, ligh trap 514d is positioned along the optical path of half-light 512.Half-light trap 514d can such as at this It is configured described in other embodiment in text.The embodiment of the ligh trap 514d illustrated in Fig. 5 e includes the side of wedge Black region on wall, wherein the side wall is significantly positioned away from the optical axis of image light 414.Additionally, baffle plate 5252 can be by The regarding with the adjacent ligh trap 514d of the display image for stopping with seen by user that be added to one or more edges of field lenses 312 Figure.
Fig. 6 illustrates the combination of top optical module 202 and lower optical module 204.In this embodiment, from top light Learning the image light of the projection of module 202 can be polarized or can be not polarized.Image light reflects from flat combiner element 602 Leave so that it is directed toward the eyes of user.Wherein, combiner element 602 is partially reflecting mirror, and it is in transmission from ring Reflected image light while sizable part of the light in border, therefore user can watch through combiner element and see Environment around HWC.
Combiner 602 can include holographic pattern to form holographic mirror.If monochrome image is desired, can be with Exist for the single wavelength reflection design of the holographic pattern on the surface of combiner 602.If be intended that with from combiner 602 surface reflection multiple colors, then multiple wavelength holographic mirrors can be included on combiner surface.For example, exist In three color embodiments, wherein generate red, green and blue pixel in image light, holographic mirror for carried by light source For the wavelength that substantially matches of red, green and blue light wavelength be reflexive.This configuration can be used as wavelength Particular mirror, wherein the light from the predetermined wavelength of image light is reflected to the eyes of user.This configuration can be with by structure Become and cause essentially all other wavelength in visible ray through combiner element 602, therefore user is through combiner unit Part 602 has the substantially clearly view of surrounding when watching.When using being the combiner of holographic mirror, in user Eyes and surrounding between transparency can be approximated to be 80%.Wherein can be using laser come in the holographic material of combiner Producing in material interferes pattern to constitute holographic mirror, wherein the wavelength of laser corresponding to by holographic mirror with back reflection light Wavelength.
In another embodiment, combiner element 602 can include trap reflecting mirror(notch mirror), it is by more The substrate composition of layer coating, its floating coat is designed to substantially reflect the wavelength of the light provided by light source and substantially transmit Remaining wavelength in the visible spectrum.For example, wherein red, green and blue light are provided so that full-colour image energy by light source In the case of being enough provided to user, trap reflecting mirror is trichroism trap reflecting mirror, wherein laminated coating be designed to reflection with By light source provide wave band matching red, green and blue light narrow-band and remaining visible wavelength is transmitted through coating Enable to realize the view of environment by combiner.Wherein monochrome image is provided in another example of user, Trap reflecting mirror is designed to reflect the single narrow-band of the light matched with the wave-length coverage of the light provided by light source, while transmission Remaining visible wavelength enables to realize the see-through view of environment.Combiner 602 with trap reflecting mirror is by from user's Visual angle is operated in the mode similar to the combiner of holographic pattern is included in combiner element 602.Due to image light Matching between the reflection wavelength of color and trap reflecting mirror, the combiner with trichroism trap reflecting mirror will be to eye reflections " unlatching " pixel, and wearer is possible to see surrounding with height definition.When using trichroism trap reflecting mirror, Transparency between the eyes and surrounding of user can be approximated to be 80%.Further, since by combiner to the less of imaging Scattering, the image provided by the top optical module 202 with trap speculum group clutch can be than holographic mirror combiner More high-contrast image is provided.
Light can be escaped by combiner 602 and because light is typically directed downward to be produced on the cheek of user Dough portion aura(face glow).When using holographic mirror combiner or trichroism trap speculum group clutch, can capture Escape light to avoid facial aura.In embodiment, if image light was polarized before combiner, linear polarization can It is laminated to combiner or is otherwise associated with combiner, wherein the axis of homology of polariser is relative to polarization image light Carry out being oriented so that any effusion image light is absorbed by polariser.In embodiment, image light will be polarized with by S-polarization light Combiner is supplied to for preferably reflection.As a result, the linear polarization on combiner will be oriented it is inclined to absorb S Shake and light and transmit P polarization light.This also provides the preferred orientation of polarization sunglassess.
If image light is not polarized, micro- louver film(microlouvered film)(Such as privacy filter (privacy filter))Absorption effusion image light is can be used, while providing the user with the see-through view of environment.This In the case of, the absorption of micro- louver film or transmission depend on the angle of light, wherein steep angle light absorbed and in compared with Low-angle light is transmitted.For this reason, in embodiment, the light of the combiner with micro- louver film and image light Axle is in the angle more than 45 degree(For example, combiner can be orientated with 50 degree, therefore from the image light of field lenses inclining Rake angle is incident on combiner.
Fig. 7 illustrates the reality of the combiner element 602 when combiner element 602 includes holographic mirror in various angles Apply example.Generally, mirror-polishing surface is with light described in the equal angle reflection of the angle that mirror-polishing surface is incided with light.Generally, this Combiner element is set to be in 45 degree(That is 602a)Necessitate, if light vertically presents to combiner, therefore light being capable of direction The eye level reflection of wearer.In embodiment, incident illumination can be presented so that reflecting mirror table with being different from vertical angle Face to be orientated different from 45 degree, but can be wherein adopted under all situations on mirror-polishing surface(Including being previously described Trichroism trap reflecting mirror), incident angle is equal to reflection angle.As a result, increasing the angle of combiner 602a needs incidence Image light presents to combiner 602a with different angles, and top optical module 202 is navigated to combiner by the different angles Left part, as figure 7 illustrates.By contrast, the holographic mirror combiner being included in embodiment can be configured To cause light to be reflected to incide the different angle of the angle on holographic mirror-polishing surface from light.This is allowed independently of incidence The angle of the angle of image light and the light in reflexing to the eyes of wearer and the angle of unrestricted choice combiner element 602b. In embodiment, the angle of combiner element 602b is more than 45 degree(Figure 7 illustrates), because this permission more transversely compact HWC is designed.The angle of the increase of combiner element 602b reduces the width in front and back of lower optical module 204 and can allow more Thin HWC display(That is, can be closer to the face of wearer from the farthest element of the eyes of wearer).
Another embodiment of Fig. 8 diagram lower opticals module 204.In this embodiment, by top optical module 202 The polarization image light of offer is directed in lower optical module 204.Image light is reflect off polarizer 804 and is directed into Focusing block reflecting mirror 802, it is suitable for polarization by reflection light.Optics unit between polarizer 804 and partially reflecting mirror 802 Part(Such as ripple film)For changing the polarization state of image light so that the light reflected by partially reflecting mirror 802 is by polarizer 804 Transmission is with to the eyes of wearer presentation image light.User can also have an X-rayed polarizer 804 and partially reflecting mirror 802 to see week Collarette border.As a result, user perceives the combination image being made up of the display image light in the see-through view of superimposition to environment.
Although many embodiments of the present invention are referred to as the upper module comprising some opticses and lower module, It is it should be understood that the image light and half-light with reference to described by upper module is produced and management function can be arranged in it Other party is upwards(For example, upwards, to side etc.)Direct light.In embodiment, upper module 202 is arranged on into the eyes of wearer Top can be preferred, and in this case image light will be guided downward.In other embodiments, from the eyes of wearer Side can be preferred from the eyes lower section generation light of wearer.Additionally, lower optical module be configured generally to The ocular delivery image light of wearer and allow wearer have an X-rayed lower optical module, this can by various opticses come Realize.
Fig. 8 a illustrate embodiments of the invention, and its middle and upper part optical module 202 is arranged to and for image light to be directed to TIR ripples Lead in 810.In this embodiment, top optical module 202 is positioned in above the eyes 812 of wearer and light is by level In being directed to TIR waveguides 810.TIR waveguides are designed to carry out internal reflection image light with a series of downward TIR reflections, until it The part before wearer's eyes is reached, there light leaves TIR waveguides 812 and is delivered in the eyes of wearer.At this In embodiment, exterior shield thing 814 is positioned in before TIR waveguides 810.
Fig. 8 b illustrate embodiments of the invention, and its middle and upper part optical module 202 is arranged to and for image light to be directed to TIR ripples Lead in 818.In this embodiment, top optical module 202 is disposed on the side of TIR waveguides 818.For example, when HWC quilts When being configured to a pair of wearing type glasses, top optical module may be located in the arm of HWC or near the arm of HWC.TIR ripples Lead 818 to be designed to a series of TIR reflection internal reflection image lights, until it reaches the part before wearer's eyes, There light leaves TIR waveguides 812 and is delivered in the eyes of wearer.
Polarization image light is directed to light by the other embodiment of Fig. 8 c diagram present invention, its middle and upper part optical module 202 Lead(optical guide)In 828, image light passes through polarization reflector 824 at photoconduction 828, once optical element 822(Its For example include ripple film)Reflection just change polarization state, it is and and then anti-by polarization due to the change in the polarization of image light Emitter 824 is reflected towards the eyes of wearer.Top optical module 202 can be positioned as to the direct light of reflecting mirror 820, With located lateral top optical module 202, in other embodiments, top optical module 202 can be directly toward reflection of polarization The navigational figure light of device 824.It should be understood that the present invention includes being intended to other light of the navigational figure light in the eyes of wearer Learn arrangement.
Another aspect of the present invention is related to eye imaging.In embodiment, with reference to top optical module 202 phase is used Machine, enabling the eyes of wearer are imaged using the pixel in "Off" state on DLP.Fig. 9 is illustrated A kind of system, wherein eye imaging camera 802 are mounted and angled so that the visual field of eye imaging camera 802 is by being in The mirror pixel of the DLP 402 of "Off" state is redirected towards the eyes of wearer.In this way, eye imaging Camera 802 can be used along carrying out into the eyes of wearer with the display image identical optical axis for presenting to wearer Picture.Wherein, the image light for being presented to the eyes of wearer illuminates the eyes of wearer, so that eyes can be by eye imaging Camera 802 is imaged.In this process, the optical system of lower optical module 204 is passed back through by the light of eye reflections with And a part for top optical module, it is delivered to what light was reflected by " closing " pixel of DLP 402 towards eye imaging camera 802 Place.
In embodiment, can wherein there is enough " closing " pixels to realize required eye in eye imaging camera The moment of eyeball image resolution ratio is imaged to the eyes of wearer.In another embodiment, eye imaging camera is over time Collect the eye image information from " closing " pixel and form the image of time passage.In another embodiment, will repair The image for changing presents to user, and the expectation for being imaged to the eyes of wearer that can be obtained including camera is differentiated Rate and enough "Off" state pixels of brightness, and eye image capture and the presentation of the image of modification are synchronized.
Eye imaging system can be used for security system.If eyes are not identified(For example, by including retina or The eyes characteristic of iris characteristic etc. is distinguished), then HWC can not allow to access HWC or other systems.In some embodiments In, HWC can be used to provide for lasting secure access.For example, eye-safe confirm can be continuous, nearly continuity, In real time, quasi real time, the cycle etc. process, therefore wearer be often verified as by effectively Jing it is known.In embodiment In, HWC can be worn and be followed the trail of eye-safe for accessing other computer systems.
Eye imaging system can be used to control HWC.For example, flicker, blink or particularly eyes movement can by with Make for the control mechanism of the software application operated on HWC or associated device.
Eye imaging system is determined for HWC 102 how or when by the content delivery of numerical monitor to wearer During.For example, eye imaging system can determine user just in one direction viewing and and then HWC can change aobvious Certain for showing that the resolution in the region of device or certain things in the environment that may watch with user of offer be associated Content.Alternatively, eye imaging system can recognize different user and change is supplied to the feature for enabling or the display of user Content.Can be from the eyes of user characteristic quantity on being either remotely located network 110 or server 112 on HWC 102 According to storehouse identifying user.Additionally, HWC can recognize the group of main users or main users from eyes characteristic, wherein(It is multiple)It is main Want that user is provided with enhanced characteristic set and every other user is provided with different characteristic sets.Therefore, at this Under individual service condition, HWC 102 uses recognized eyes characteristic to enable or do not enable feature, and eyes characteristic is only needed It is analyzed compared to relatively small individual eye property database.
The light source that Figure 10 diagrams can associatedly be used with top optical device module 202(For example, if from solid-state light The light in source is polarized light source if being polarized(Such as polarized light source 302 and 458))With light source 404.In embodiment, in order to carry For will be directly or indirectly directed in top optical module 202 and towards the uniform tables that guide of DLP of top optical module The light 1008 in face, solid state light emitter 1002 can be projected onto in the optical system 1004 of back illumination.Solid state light emitter 1002 can be with It is one or more LED, laser diode, OLED.In embodiment, the optical system 1004 of back illumination includes having and is more than The extension of section of 3 length/distance ratio, wherein light are experienced multiple reflections and are supplied by solid state light emitter 1002 with homogeneity mixing from side wall The light answered.The optical system 1004 of back illumination can also be included with uniform light 1008 from the outgoing of backlight 1004 with towards DLP 302 change on surface relative where the direction of light with reflective polarizer 310 or DLP 402 with TIR wedges 418( As shown in Figure 10 on left side)Structure.The optical system 1004 of back illumination can also include following structures:The structure is used To collimate uniform light 1008 to provide light to DLP with less angular distribution or narrower cone angle.Bubbler or polarization Device can be used on the incidence surface of the optical system of back illumination or exit surface.Bubbler can be used in extension from backlight Emergent light either make its homogenization with improve uniform light 1008 uniformity or increase uniform light 1008 angular spread.One The oval bubbler for more spreading light and less spreading light in the other direction on a little directions can be used improvement uniformly Uniformity or the latitude of emulsion of the light 1008 on the direction vertical with the optical axis of uniform light 1008.Linear polarization can be used in by solid The non-polarized light of the supply of state light source 1002 is converted to polarized light, therefore uniform light 1008 is carried out partially with desired polarization state Shake.Reflective polarizer can be used in backlight 1004 exit surface on so that uniform light 1008 polarization be desired polarization state, Other polarization states are reflected back in backlight simultaneously, there the uniform light is in backlight 1004 and in solid state light emitter It is recycled by multiple reflections at 1002.Therefore, by including reflective polarizer at the exit surface of backlight 1004, improve The efficiency of polarized light source.
Figure 10 a and 10b illustrate the diagram of the structure in backlight optical system 1004, and the backlight optical system can be used In change by light source be supplied to the plane of incidence 1045 light direction and and then in the optical axis with outgoing uniform light 1008 in horizontal Direction on light is collimated.Structure 1060 includes angled sawtooth patterns in transparent waveguide, wherein each sawtooth Left hand edge is pruned to steep angle light, thus limits the angle of the light being redirected.On the right side of each sawtooth(Such as show Go out)Abrupt surface then light is redirected so that light is reflect off from the left part angled surface of each sawtooth And it is redirected towards exit surface 1040.The serrated surface illustrated on lower surface in Figure 10 a and 10b can be smooth And be applied(For example, it is coated with aluminized coating or dielectric mirror coating)To provide in the case of without scattering High-caliber reflectance.Structure 1050 includes curved surface in left side(As shown)With right after passing through exit surface 1040 in ray They are focused, and thus provide the mechanism for collimating uniform light 1008.In a further embodiment, bubbler can be by There is provided between solid state light emitter 1002 and the plane of incidence 1045 so that the light homogeneity provided by solid state light emitter 1002.In another enforcement In example, polariser can be used between bubbler and the plane of incidence 1045 of backlight 1004 to provide polarized light source.Because sawtooth Pattern provides smooth reflecting surface, it is possible to retaining the polarization state of light from the plane of incidence 1045 to exit facet 1040.At this In individual embodiment, the light of backlight is incided through polariser, so that light is with desired polarization state quilt from solid state light emitter 1002 Polarization.If polariser is to absorb linear polarization, the light of desired polarization state is transmitted and the light of another polarization state Absorbed.If polariser is reflective polarizer, the light of desired polarization state be transmitted in backlight 1004 and it is another partially The light of state of shaking is reflected back in solid state light emitter 1002, and there light can be recycled as previously described to improve The efficiency of polarized light source.
The light source 1100 that Figure 11 a diagrams can be used in association with top optical device module 202.In embodiment, Light source 1100 can provide the light to the optical system 1004 of back illumination, as described in above in association with Figure 10.In reality In applying example, light source 1100 includes trichroism notch filter 1102.Trichroism notch filter 1102 has for the narrow of three wavelength Band pass filter, as in Figure 11 c transmission chart 1108 in it is indicated as.1104 chart figure is shown as in Figure 11 b The output of three different coloured LED is shown.It can be seen that the bandwidth of transmitting is narrow, but they have long-tail Portion.Trichroism notch filter 1102 can be used in conjunction with to provide light source 1100 with such LED, and its transmitting is such as in figure The light of narrow filter wavelength as transmitted chart 1110 illustrated in 11d.Wherein it can be seen that trichroism notch filter 1102 Pruning effect cut away the afterbody from LED emission chart 1104 to provide narrower wavelength band to top optical module 202 Light.Light source 1100 can be used in conjunction with providing with the combiner 602 with holographic mirror or trichroism trap reflecting mirror The light of arrowband, the light is with compared with little waste light(It is not able to the device reflection that is combined)In the case of towards wearer eye Eyeball is reflected, and thus improves efficiency and reduction can cause the effusion light of facial aura.
Another light source 1200 that Figure 12 a diagrams can be used in association with top optical device module 202.Implementing In example, light source 1200 can provide the light to the optical system 1004 of back illumination, as described in above in association with Figure 10. In embodiment, light source 1200 includes quantum dot cover cover glass 1202.Wherein, quantum dot absorbs shorter wavelengths of light and launches The light of longer wavelength(Figure 12 b illustrate an example, cause quantum dot emission to be shown as wherein being applied to the UV spectrum 1202 of quantum dot The arrowband of PL spectrum 1204), this depends on the size of quantum dot and material composition.As a result, in quantum dot cover cover glass Quantum dot in 1202 can be trimmed to provide the narrow bandwidth of one or more bands of the different quantum dots for depending on included Light(For example, red, green and blue)Transmitting, as illustrating in the chart as shown in Figure 12 c, wherein using three different amounts Sub- point.In embodiment, LED driver lamp transmitting UV light, dark blue or blue light.For the sequential illumination of different colours, Duo Geguang Source 1200 will be used, and wherein each light source 1200 will include the quantum dot cover cover glass 1202 with quantum dot, the quantum dot It is selected to be launched with the one kind in desired color.Light source 1100 can be anti-with holographic mirror or trichroism trap The combiner 602 for penetrating mirror is used in conjunction with to provide the light of narrow transmission belt, and the light is with compared with little waste light(It is not able to Reflection)In the case of reflected towards the eyes of wearer.
Another aspect of the present invention is related to the personnel for wearing HWC and generates peripheral images lighting effect.In embodiment In, solid-state illumination system(For example, LED, OLED etc.)Or other illumination systems can be included in the light of lower optical module 204 Learn element internal.Solid-state illumination system can be laid out such that the visual field of presented digital content(FOV)Outer illumination effect Fruit is presented with the immersion effect for creating the personnel for wearing HWC.For this purpose, lighting effect can be presented to for wearer Any part of visible HWC.Solid-state illumination system can be digital control by the integrated processor on HWC.In embodiment, collection Mutually lighting effect will be in phase controlled into processor with the digital content being presented within the FOV of HWC.For example, film, picture, Game or other guide can be shown within the FOV of HWC or play.Content can be on the right side of FOV and identical Moment illustrates bomb blast, and the solid-state illumination system inside upper module optics can mutually be echoed with FOV image effects Ground quick-flash.The effect can not be quickly, and it can be with more longlasting indicating the aura such as on the side of user Or color.For example color control can be carried out to solid-state illumination system with red, green and blue led, so that color control The content that can be presented with the numeral within visual field is mutually coordinated.
Figure 13 a illustrate the opticses of the lower optical module 204 together with outer lens 1302.Figure 13 a also show Go out the embodiment including effect LED 1308a and 1308b.Figure 13 a illustrate being directed into as described in herein elsewhere Image light 1312 in portion's optical module, light will reflect off combiner element 1304 at the top optical module, such as exist As describing elsewhere herein.By the combiner element 1304 in this embodiment towards wearing at the top of module The eyes of person and angle is formed away from the eyes of the wearer at module bottom, as described by also in relation with Fig. 8 and shown in As(For example, with 45 degree of angles).By top optical module 202(Not shown in Figure 13 a)The image light 1312 of offer is remote Eyes from wearer are reflect off combiner element 1304 towards collimating mirror 1310, as described in herein elsewhere Like that.Image light 1312 is then departed from collimating mirror 1304 and is reflected and focused on, and passes back through combiner element 1304 simultaneously And be directed in the eyes of wearer.Wearer can also pass through combiner element 1304, collimating mirror 1310 and outside Lens 1302(If including it)The transparency watching surrounding.As described elsewhere herein, respectively Kind surface to be polarized be directed to the optical path of image light with establishment and provided the transparency of element so that wearer can see Look around environment.General perceptual image light is formed image by wearer in FOV 1305.In embodiment, outside can be included Lens 1302.Outer lens 1302 are following outer lens, and it can be or can not be chastening, and it can be set Count into hidden lower optical modular unit to attempt to look like HWC in the form similar to Standard spectacles or sunglassess.
In the embodiment illustrated in Figure 13 a, effect LED 1308a and 1308b are positioned in the He of combiner element 1304 At the side of outer lens 1302 and/or collimating mirror 1310.In embodiment, effect LED 1308a is positioned in by group Within the boundary that clutch element 1304 and outer lens 1302 and/or collimating mirror are limited.Effect LED 1308a and 1308b It is also positioned in outside FOV 1305.In this arrangement, effect LED 1308a and 1308b can be provided outside FOV 1305 Lighting effect within the lower optical module in portion.In embodiment, the light from effect LED 1308a and 1308b transmitting can be with Polarized so that light passes through combiner element 1304 and is not passed through outer lens 1302 and/or standard towards the eyes of wearer Straight reflecting mirror 1310.This is arranged through the front portion not via HWC and lighting effect is transmitted in surrounding and with more secret Arrange to wearer and peripheral lighting effect is provided.However, in other embodiments, effect LED 1308a and 1308b can be not Polarized, therefore provided lighting effect is purposefully may be viewed by entertain by the environment other people, Such as, the effect of the eyes aura of wearer is accordingly given with the picture material watched by wearer.
Figure 13 b illustrate the cross section of the embodiment with reference to described by Figure 13 a.As illustrated, effect LED 1308a In the upper-forefoot area inside the opticses of lower optical module.It should be understood that effect in the described embodiment Fruit LED 1308a positions are merely illustrative and cover alternative arrangement by the present invention.In addition, in embodiment, HWC's There may be one or more effects LED 1308a in every side in both sides to carry in the one of wearer or two ocular vicinities For peripheral lighting effect.
Figure 13 c are illustrated(For example, according to the holographic or notch filter embodiment being described herein)Wherein combine Device element 1304 forms the embodiment of angle away from the eyes at top and towards the eyes in bottom.In this embodiment In, effect LED 1308a is located on the side of outer lens 1302 of combiner element 1304 to provide the hidden outer of lighting effect See.As other embodiment, the effect LED 1308a of Figure 13 c can include polariser so that the light of transmitting can be passed through The polarizer that is associated with combiner element 1304 and stopped by the polarizer being associated with outer lens 1302.
Another aspect of the present invention is related to mitigate the light of the space effusion from the face and HWC of wearer between its own. Another aspect of the present invention is related to be maintained near to the controlled photoenvironment of the eyes of wearer.In embodiment, light Maintenance according to environment and light effusion mitigate both by include for HWC can be removed and interchangeable flexible shielding thing come Realize.Wherein, with the use of the display for each eye accordingly, can provide for an eyes or two eyes can Remove and interchangeable screen.For example, in noctovision application, for the display of an only eyes can be used in night Vision, and for the display of another eyes is turned off to visible ray to be available region and wherein need night wherein Good perspective is provided when moving between the dark areas of vision enhancement.
Removable and interchangeable flexible eyeshield 1402 of Figure 14 a diagrams with opening 1408, it is described to can be removed and replace The flexible eyeshield 1402 for changing can be quickly attached to HWC 102 and be removed from HWC 102 by using magnet 1404. Other attachment methods can be used, but in order to illustrate the present invention, we will focus on magnet embodiment.In embodiment, magnetic Body can be included in eyeshield 1402, and the magnet of opposite polarity can be included(For example, it is embedded into)HWC's 102 In framework.Configured using opposite polarity, the magnet of two elements attracts considerably more intense.In another embodiment, element In one can have magnet and opposite side to have the metal for attracting.In embodiment, eyeshield 1402 is soft The elastic screen of property.In embodiment, eyeshield 1402 can be elastomeric bellow(bellows)Design is adapting to flexibility and more Closely it is aligned with the face of wearer.Figure 14 b diagrams are adapted to the removable and interchangeable flexible eyeshield of single eyeshield 1402.In embodiment, single eyeshield can be used for every side of HWC to cover two eyes of wearer.It is single in embodiment Individual eyeshield can be used in conjunction with the HWC for only including a computer display for an eyes.These configurations are logical The space crossed between the face and HWC that cover wearer is preventing the light of face be generated and being typically toward wearer guiding. Opening 1408 allow wearers through opening 1408 watched with by the front portion of HWC check shown by content and surrounding ring Border.The figure being prevented from for example, by interior optics polarization schemes as described in this article in lower optical module 204 As light is launched from the front portion of HWC.
Figure 14 c illustrate another embodiment of Xanthophyll cycle system.In this embodiment, eyeshield 1410 can be with eyeshield 1402 is similar, but eyeshield 1410 includes anterior light shield 1412.Anterior light shield 1412 can be it is opaque in case Only light escapes the front lenses of HWC.In other embodiments, anterior light shield 1412 is polarized to prevent light effusion anterior thoroughly Mirror.In polarization arrangement, in embodiment, HWC's(For example, lower optical module 204)Internal optical component can make court Can be polarized to prevent light transmission from passing through anterior optical screen to the light polarization and anterior light shield 1412 of the anterior transmission of HWC Cover thing 1412.
In embodiment, opaque anterior light shield 1412 can be included and digital content can include surrounding The image of environment is so that wearer can make circumstance visible.Noctovision environment map can be presented for an eyes And the surrounding optical path of this eye can be covered using opaque anterior light shield 1412.In other realities In applying example, this arrangement can be associated with two eyes.
Another aspect of the present invention is related to automatically configure in HWC 102(It is multiple)Illumination system.In embodiment In, display light as described in this article is shone and/or effect illumination can be suitable for when eyeshield 1402 is attached to HWC 102 Or from HWC 102 remove when mode being controlled.For example, at night, when the light in environment is weaker, in HWC(It is many It is individual)Illumination system can enter low light level pattern with any of the veiling glare that further region of the control from around HWC and HWC escapes Amount.Masking operation at night while using noctovision or standard vision may need a solution, and it is prevented Effusion light as much as possible, therefore user can press from both sides(It is multiple)Eyeshield 1402 and and then HWC can enter low light level pattern.Such as Fruit HWC environment-identifications are if low light condition(For example, detected by ambient light level sensor), low light level pattern is in some realities Applying low light level pattern of can enter only when eyeshield 1402 is attached in example.In embodiment, low light level level can be according to environment bar Part and at the intermediate point that is determined to be between full light and the low light level.
Another aspect of the present invention is related to automatically control HWC when eyeshield 1402 is attached to HWC or removes from HWC The type of the content of middle display.In embodiment, when(It is multiple)When eyeshield 1402 is attached to HWC, the content of display can be It is restrained in amount or in amount of color.For example,(It is multiple)Display can be shown into simple content delivery modality with constraining The amount of the information shown.This can be finished to reduce by(It is multiple)The amount of the light that display is generated.In embodiment,(It is multiple)It is aobvious Show that device can change into monochrome display to reduce the amount of produced light from color display.In embodiment, monochromatic light shines Can be the red impact to limit the eyes to wearer, so as to maintain to see to obtain more preferable ability in the dark.
Another aspect of the present invention is related to a kind of system, and the system is adapted to rapidly to be transformed into from fluoroscopy system non- The fluoroscopy system of fluoroscopy system or very low transmission for more immersion Consumer's Experience.Converting system can include replaceable Lens, eyeshield and be adapted to both of which provide Consumer's Experience optics.Lens for example can be by " shading (black-out)" to provide a kind of experience, wherein whole user's attention be devoted to digital content and and then lens can be with High perspective lens are switched to, therefore digital content will strengthen viewing of the user to surrounding.Another aspect of the present invention is related to And low transmission lens, it permits user's perspective lens, but is to maintain enough secretly so that most user's attention is maintained into number In word content.Slight perspective can be provided the user and is connected with the vision of surrounding, and this can reduce or eliminate evil The heart and with remove completely when digital content is watched around the other problemses that are associated of view.
Figure 14 d illustrate Wearing-on-head type computer system 102, and it has perspective digital content display 204, the perspective number Word content indicator 204 is adapted to include removable outer lens 1414 with removable eyeshield 1402.Eyeshield 1402 can With using magnet 1404 or other attachment systems(Such as mechanical attachment, the suitable patch friction between the arm of Wearing-on-head type computer 102 Coordinate etc.)And it is attached to Wearing-on-head type computer 102.When user wants to cut down the limit that veiling glare escapes out Wearing-on-head type computer System, the otherwise visual peripheral view by removing surrounding and when create experience of more immersion etc., can be with attached Connect eyeshield 1402.Removable outer lens can have several species for various experience.It can be without transmission or tool There is dark background of the low-down transmission to create for digital content, so as to experience for digital content creation (DCC) immersion.It can be with With highly transmissive, therefore user can be had an X-rayed to check surrounding to see-through display and lens, be used for so as to create The system of head up displays, augmented reality display, augment reality display etc..Lens 1414 can be dark in mid portion To provide dark background for digital content(I.e. from the visual angle of user in the dark background curtain for having an X-rayed visual field rear)And elsewhere More highly transmissive region is provided.For example, lens 1414 can have the model for immersing 2 to 5%, 5 to 10%, 10 to the 20% of effect The transmission enclosed and the transmission for augmented reality effect 10% or more than 20%.Lens 1414 can also have adjustable Penetrate with the change in accelerating system effect.For example, lens 1414 can be the lens of the adjustable tone of electronics(Such as liquid crystal, or tool There is the polariser of intersection, it has for the regulation of intersection level).
In embodiment, eyeshield can have transparent or partially transparent region, to provide and the surrounding of user Certain vision connection.This other sense that can also be reduced or eliminated nausea or be associated with the view for removing surrounding completely Feel.
Figure 14 e are illustrated in the Wearing-on-head type computer 102 assembled with eyeshield 1402 in the case of in place without lens.In reality Applying lens in example can be held in position to be easily removed and replace using magnet 1418.In embodiment, lens can be with profit Use other systems(Such as mechanical system)To be held in place.
Another aspect of the present invention is related to effect system, and the effect system is in the see-through display of Wearing-on-head type computer Generate the effect outside visual field.Effect can be such as lighting effect, sound effect, haptic effect(For example by vibration), air Mobile effect etc..In embodiment, effect generates system and is installed on eyeshield 1402.For example, illumination system(For example(It is many It is individual)LED, OLED etc.)Can be installed on inner surface 1420, or be exposed by inner surface 1420, as schemed in Figure 14 f Show so that they can in phase create lighting effect with the content shown just in the visual field of see-through display(For example, it is bright Light, colored light, subtle color effect).Content may, for example, be film or game, and be compiled by script, and blast may occur On the right side of content, and with content matchingly, bright flash of light can be generated by effect illumination system, it is higher to create Effect.Used as another example, effect system can include being arranged on side or temple(temple)Nearby or otherwise pacify The vibrational system of dress, and when identical blast occurs, vibrational system can generate vibration to increase Consumer's Experience on right side, There is the true sound wave for producing vibration so as to indicate to explode.Used as another example, effect system can have air system, wherein Effect is to blow to user's one air on the face.This can create the close sensation with certain rapid moving object in content. Effect system can also have speaker or the attachment for earplug of sensing user's ear etc..
In embodiment, the effect generated by effect system can be by author's scripting to coordinate with content.Implementing In example, sensor can be placed in eyeshield, and then generation will be caused with to(It is multiple)The content effect of effect is monitored (For example, optical sensor, to measure intense light irradiation effect or peripheral lighting effect).
Effect system in eyeshield can be powered by internal cell, and in embodiment, and battery can be with to wearing Formula computer 102 provides additional power, used as back-up system.In embodiment, effect system is by Wearing-on-head type computer Battery is powering.Power can pass through attachment system(Such as magnet, mechanical system)Or special power system is delivering.
Effect system can be by wired or wireless data cube computation from wear-type computer receiving data and/or life Order.Data for example can be arrived by attachment system, single circuit or by bluetooth or other short-range communication protocols.
In embodiment, eyeshield is made up of reticulated polymer foam, the profile of its very light and user's face that can coincide.Due to material The property of the open micropore of material, reticulated polymer foam also allows air circulation, and this can reduce the fatigue of user and increase user and relax Appropriateness.Eyeshield can by soft, rigidity, can the other materials of flexing etc. make, and can have in order to comfortable in periphery And contact another kind of material of face.In embodiment, eyeshield can include fan between external environment condition and inner space Exchange of air, wherein inner space by user face part limit.Fan can be carried out very slowly and with low-power Operation, the face that user is kept so as to exchange of air is felt nice and cool.In embodiment, fan can have variable speed control and/ Or temperature sensor can be positioned to measure the temperature in inner space, so as to by the temperature control in inner space to specified Scope, temperature etc..Inner space typically by user eyes and upper cheek front space-closed space(There Eyeshield encloses region)To characterize.
Another aspect of the present invention is related to flexibly install audio frequency ear in Wearing-on-head type computer 102 and/or eyeshield 1402 Machine.In embodiment, audio earphone is mounted using the system of relative stiffness, and the system of the relative stiffness has(It is multiple) Flexible joint(For example in the swivel joint with the junction of eyeshield, swivel joint in the middle of rigid arm etc.)And(It is many It is individual)Extension(Such as telescopic arm), to provide a user with adjustability, to allow on the ear of user, it is in ear or periotic It is comfortable to coordinate.In embodiment, audio earphone is utilized throughout flexiblesystem more flexible everywhere(Such as using the company based on line Connect)To be mounted.
Figure 14 g illustrate the Wearing-on-head type computer 102 with removable lens 1414 and the eyeshield 1402 installed.In reality In applying example, Wearing-on-head type computer includes see-through display(As disclosed herein).Eyeshield 1402 also includes the audio frequency installed Earphone 1422.In this embodiment, the audio earphone 1422 of installation is installed to eyeshield 1402 and with tone frequency channel wire connection(Not Illustrate).In embodiment, the connection of tone frequency channel wire may be coupled to internal radio communication system(Such as bluetooth, NFC, WiFi)With Constitute the connection with the processor in Wearing-on-head type computer.In embodiment, tone frequency channel wire may be coupled to magnetic connector, machinery Adapter etc. is constituting connection.
Figure 14 h illustrate the uninstalled eyeshield 1402 with the audio earphone 1422 installed.As illustrated, eyeshield Machine Design is adapted to be coupled in Wearing-on-head type computer to provide visual isolation or part isolation and audio earphone.
In embodiment, eyeshield 1402 can be adapted to be removably mounted at the head with perspective computer display Wear on formula computer 102.Audio earphone 1422 with adjustable installation may be coupled to eyeshield, wherein adjustable installation can be provided Extension and rotation provide a kind of mechanism and are directed at audio earphone with the ear of user with the user as Wearing-on-head type computer.In reality In applying example, audio earphone includes being connected to the tone frequency channel wire of adapter on eyeshield, and eyeshield adapter can be adapted to can Match with the adapter in Wearing-on-head type computer with removing.In embodiment, audio earphone can be adapted to by wirelessly connecting Connect(Such as bluetooth, WiFi)Audio signal is received from Wearing-on-head type computer.Such as described elsewhere herein, Wearing-on-head type computer There can be removable and interchangeable frontal lens.The system power supply that eyeshield can come inside for eyeshield including battery.Eyeshield can To come as the system power supply inside Wearing-on-head type computer with battery.
In embodiment, eyeshield can include fan, and the fan is adapted to what is limited in the face part by user Exchange of air between inner space and external environment condition, so as to cool down inner space in and user air on the face.In embodiment In, audio earphone can include vibrational system(For example, in armature and/or in ear upper curtate vibrating motor, piezoelectric electro Motivation etc.), the vibrational system is adapted to the digital content for providing the user with being presented in perspective computer display The touch feedback of coordination.In embodiment, Wearing-on-head type computer includes vibrational system, and the vibrational system is adapted to as user The touch feedback coordinated with the digital content presented in perspective computer display is provided.
In embodiment, eyeshield 1402 is adapted to be removably mounted at the wear-type with perspective computer display On computer.Eyeshield can also include being installed to the flexible audio earphone of eyeshield, wherein the flexibility is Wearing-on-head type computer User provides a kind of mechanism and is directed at audio earphone with the ear of user.In embodiment, flexible audio earphone utilizes magnetic Connect to be installed to eyeshield.In embodiment, flexible audio earphone can be installed to eyeshield using mechanical connection.
In embodiment, audio earphone can be spring or otherwise be loaded so that earphone inwardly user Ear press for stronger cooperation.
With reference to Figure 15,, turning now to specific external user interface 104 is described, it is commonly referred to as pen 1500 for we.Pen 1500 is the external user interface 104 of special design and can be used as such as the use of many HWC 102 not in specie Family interface is operated.Pen 1500 typically follows the form of conventional pen, and it is familiar user's handheld device and is by HWC Many establishments physical interface directly perceived in the operation being performed in system 100.Pen 1500 can be and control in HWC systems 100 Some user interfaces 104 for being used in conjunction with of operation in one.For example, HWC 102 can notice posture 116 and by appearance Gesture 116 is interpreted as control signal, and wherein pen 1500 is also used as the user interface with regard to identical HWC 102.Similarly, far Cheng Jianpan can serve as the external user interface 104 mutually echoed with pen 1500.The combination of user interface or only one control system The use of system is generally dependent on what is performed just in the system 100 of HWC(It is multiple)Operation.
Although pen 1500 can follow the general type of conventional pen, it includes and enables it to play external user interface Many technologies of 104 effect.Figure 15 is shown in the technology that pen 1500 includes.If as seeing, pen 1500 can be with Including camera 1508, it is arranged to be watched through lens 1502.Then camera such as can be focused on by lens 1502 So that to surface imaging, user writes on said surface or carries out other movements to interact with HWC 102.There is wherein pen 1500 also by with ink, graphite or other systems so that what the content being just written can be seen on a writing surface Situation.There are following other situations:Wherein not there is pen 1500 such physics writing system therefore not have on a writing surface Deposit, wherein pen only to HWC 102 will transmit data or order always.Lens configuration is described in more detail herein.Camera Function be so that stroke can be as being interpreted by as user view from non-structured writing surface capturing information.For Aided in terms of the prediction of the stroke path being intended to, pen 1500 can include sensor, such as IMU 1512.When So, IMU can be with the single part of pen(For example, gyroscope, accelerometer etc.)In being included in pen 1500, or IMU energy It is enough to be included as individual unit.In this example, IMU 1512 is used to measuring and predicting the motion of pen 1500.Further, Integrated microprocessor 1510 will move IMU information and camera information to form nib as being input into and processing described information Prediction.
Pen 1500 can also include pressure monitoring system 1504, such as to measure the pressure applied on lens 1502. As will be described in more detail herein, pressure measxurement can be used in predicting thickness, the type of line, the pen for changing line The user view of type, click, the double-click of picture etc..In embodiment, pressure transducer can be using behind lens 1502 Any power or pressure measurement sensor(Including such as electric resistance sensor, current sensor, capacitance sensor, voltage sensor (Such as piezoelectric transducer), etc.)To construct.
Pen 1500 can also include the communication module 1518 for being such as used to carry out two-way communication with HWC 102.In embodiment In, communication module 1518 can be short-range communication module(For example, bluetooth).Communication module 1518 can be with the safety of HWC 102 Matching.Communication module 1518 be arranged to the transmission data and order of microprocessor 1510 from pen 1500.Microprocessor 1510 can be programmed to interpret from the data of the generations such as camera 1508, IMU 1512 and pressure transducer 1504, and and then For example order is transmitted on HWC 102 by communication module 1518.In another embodiment, by microprocessor from input source (For example, camera 1508, IMU 1512, pressure transducer 1504)In any one collect data can be by communication module 1518 are sent to HWC 102, and HWC 102 can work as using the pre- of the intention that data processing and user are performed during pen 1500 Survey.In yet another embodiment, data can be further transferred remote equipment 112 by network 110(Such as server) For data processing and prediction.Then order can be transferred back to HWC 102 for performing(For example, show in glasses Carry out display in device write, selected within the UI of glasses display, controlling remote peripheral equipment 112, control locally External equipment 108)Deng.Pen can also include memorizer 1514 for long-term or short-period used.
Pen 1500 can also include many physical user interfaces, such as quickly start(launch)Button 1522, touch are passed Sensor 1520 etc..Quick start button 1522 can be adapted to provide the user the software application jumped in HWC systems 100 Immediate mode.For example, user can be communication software bag(For example, Email, text, Twitter(Push away spy)、Instagram (Photo shares software)、Facebook(Types of facial makeup in Beijing operas net)、Google+(Google+)Deng)The normal users of Jing, and user can compile The quick start button 1522 of journey starts application to order HWC 102.Pen 1500 can be provided with several quick start buttons 1522, it can be that user-programmable or manufacturing firm are programmable.Quick start button 1522 can be programmed to perform Operation.For example, in button can be programmed to remove the character display of HWC 102.This will be user for any Reason(Such as more preferable viewing environment)And the screen on HWC 102 is removed creating immediate mode.One will below be entered Step discusses quick start button function in detail.Touch sensor 1520 can be used for obtaining posture token import from user.For example, User can take out single finger and across touch sensor 1520 with the finger to realize page scroll.
Pen 1500 can also include laser designator 1524.Laser designator 1524 can be coordinated so that appearance with IMU 1512 Gesture and laser designation are coordinated.For example, user can help instruct using laser instrument 1524 when presenting using graphic rendition Spectators, and IMU 1512 user's posture can be interpreted as into order simultaneously or when laser instrument 1524 is closed or data are defeated Enter.
Several embodiments of Figure 16 A-C diagrams for the lens and camera arrangement 1600 of pen 1500.It is related on one side The constant distance between camera and writing surface is maintained so that writing surface can be held at focusing on, preferably to follow the trail of 1500 movements on a writing surface of pen.The circumference for being related to the writing tip with random notes 1500 on the other hand remains angled Surface so that pen 1500 can in the handss of user rolling or partly rolling with create conventional writing implement sensation and from By.
Figure 16 A illustrate the embodiment for writing lens end of pen 1500.It is described configuration include sphere lenses 1604, camera or Image capture surface 1602 and dome lid lens 1608.In this arrangement, camera is by sphere lenses 1604 and dome Lid lens 1608 watch writing surface.Sphere lenses 1604 cause camera to focus on, so that when pen 1500 is with natural writing position In being held in handss(Such as, wherein pen 1500 is contacted with writing surface)Shi Xiangji watches writing surface.It is spherical in embodiment Mirror 1604 should separate to obtain the highest resolution of writing surface at camera 1602 with writing surface.In embodiment, ball Shape lens 1604 are separated approximate 1 to 3 mm.In this configuration, dome lid lens 1608 provide surface, and the surface can Keep sphere lenses 1604 and writing surface with(Such as it is substantially independent of angle for writing on a writing surface)It is permanent Set a distance is separated.For example, in embodiment, the visual field of the camera in this arrangement will be approximate 60 degree.
Dome lid lens or for the other lenses 1608 that interact with writing surface physics in the effective of camera 1602 To be transparent or radioparent in bandwidth.In embodiment, dome lid lens 1608 can be spherical or other shapes And it is made up of glass, plastics, sapphire, diamond etc..In other embodiments, wherein surface low resolution imaging be can Receive.Pen 1500 can omit dome lid lens 1608 and sphere lenses 1604 can be with surface directly contact.
Figure 16 B illustrate another structure, wherein constructing similar to the construction with reference to described by Figure 16 A to a certain extent; But this embodiment does not use dome lid lens 1608, but sphere lenses 1604 and book are maintained using spacer 1610 The predictable distance between surface is write, wherein spacer can be spherical, cylinder, tubulose or provide interval simultaneously The other shapes for allowing image to be obtained by lens 1604 by camera 1602.In a preferred embodiment, spacer 1610 is Transparent.In addition, although spacer 1610 is shown as spherical, but can be to use other shapes, such as oval, ring Shape, hemisphere, cone, cylinder or other forms.
Figure 16 C illustrate another embodiment, and wherein structure is included such as through the center of the lensed end of pen 1500 Post 1614.Post 1614 can be ink depositing system(For example, ink cartridge), graphite deposits system(For example, graphite keeper)、 Or its purpose is mainly only that the feigned column of alignment.The selection of post type depends on the use of pen.For example, want pen in user In the case that 1500 are used as normal ink deposition pen and global function external user interface 104, inking system post will be best Select.If there is no for " writing " visible needs are made on a writing surface, then it will be feigned column to select.The enforcement of Figure 16 C Example includes(It is multiple)Camera 1602 and associated lens 1612, wherein camera 1602 and lens 1612 are oriented to capture book Surface is write without the substantial interference from post 1614.In embodiment, pen 1500 can include multiple cameras 1602 and lens 1612, so that the more or whole in the circumference of tip 1614 can act as input system.In embodiment, pen 1500 includes Contoured handle, it keeps, and pen is aligned so that camera 1602 in the handss of user and lens 1612 remain pointing to surface.
The other side of pen 1500 is related to sense the power applied to writing surface using pen 1500 from user.Can be with perhaps Multimode is measured using power.For example, power measurement can serve as centrifugal pump or discontinuous track of issues, and be used to determine user Intention during compare with threshold value.For example, user may wish to be interpreted as the power of " click " in selecting object.User The multiple power that multiple click may be intended to be interpreted as applies.There may be when user holds pen 1500 in a certain position or holds Certain part of pen 1500(For example, button or touch pad)Clicked on to realize a certain operation simultaneously(For example, ' right click ')'s Time.In embodiment, power measurement can be used for tracking force and power trend.For example, power trend can be with tracked and and threshold value Restriction ratio compared with.There may be such threshold restriction, multiple restrictions, related group for limiting etc..For example, when power measurement refers to Show that when falling generally into the fairly constant power within the scope of dependent thresholds, power trend can be interpreted as one by microprocessor 1510 Plant and indicate, i.e., what user's expectation maintenance was current writes style, writing tip type, the thickness of line, stroke type etc..In power trend In the case of seeming intentionally to walk out threshold value set, the action can be interpreted as a kind of instruction by microprocessor:Use Family is wanted to change and current writes style, writing tip type, the thickness of line, stroke type etc..Once microprocessor is made The determination of the intention of user, it is possible to perform and current write the side such as style, writing tip type, the thickness of line, stroke type The change in face.In embodiment, the change can be with(For example, in the display of HWC 102)Point out to user, and can be with The chance for receiving the change is presented to user.
The power of Figure 17 A diagram pens 1500 senses the embodiment of surface tip 1700.Power sensing surface tip 1700 include with The surface connection tip 1702 that power or pressure monitoring system 1504 combine(For example, it is saturating as described in herein elsewhere Mirror).When user is write on the surface using pen 1500 or on the surface simulation is write, the measurement user of power monitoring system 1504 The power or pressure and the power monitoring system for being applied to writing surface transfers data to microprocessor 1510 for processing. In this configuration, microprocessor 1510 receives force data and processes the data and applied with making from power monitoring system 1504 Plus the prediction of the user view in terms of the certain force being currently just applied in.In embodiment, process may be provided in except pen At position outside upper(For example, at the server in HWC systems 100, on HWC 102).For simplicity, when at this To when processing information carries out reference on microprocessor 1510, the process to information is expected in the position in addition on pen in text The place of putting is processed information.Microprocessor 1510 can be used(It is multiple)Force threshold,(It is multiple)Power feature(signature), power Feature database and/or want other characteristics of deduction program are instructed in terms of power or pressure based on measurement determine the intention of user come Programming.Microprocessor 1510 can be further programmed to be to have attempted to initiate discrete action with regard to user(For example, Yong Hujie Mouth selects ' click ')Still it is carrying out constant action(For example, write in specific writing in style)Measured according to power Make deduction.Deduction process is important because it makes pen 1500 serve as intuitively external user interface 104.
The trend chart of Figure 17 B power 1708 reduced times 1710 of the diagram with single threshold value 1718.Threshold value 1718 can be with It is arranged at the level for indicating discrete force applying, the discrete force applies the expectation that instruction user causes action(For example, select Object in GUI)'s.For example, event 1712 can be interpreted as clicking on or select command, because power is fast from threshold value 1718 is less than Speed increases to threshold value more than 1718.Event 1714 can be interpreted as double-clicking, because power is increased rapidly to threshold value more than 1718, drop It is low and then substantially to repeat below 1718 and quickly to threshold value.User can also make power exceed threshold value 1718 and be kept for one section Time, so as to instruction user is just intended to select GUI(For example, the GUI being presented in the display of HWC 102)In object and " holding " is for further operation(For example, mobile object).
Although threshold value can be used for the intention of auxiliary decoding user, characteristic force event trend can also be used.Threshold value Can be applied in combination with feature or each method can be used alone.For example, single-click feature can be by a certain power trend feature Or characteristic set is representing.For example,(It is multiple)Single-click feature may need trend to meet following standards:Between x and y values Rise time, the retention time between a and b values and the fall time between c and d values.Various functions can be directed to (Click, double-click, right click, holding, movement etc.)Preservative feature.Microprocessor 1510 can by real-time force or pressure follow the trail of with Compare from the feature of feature database with make decision and in GUI perform software application issue order.
The trend chart of Figure 17 C power 1708 reduced times 1710 of the diagram with multiple threshold values 1718.As an example, if using The dry vigour of style in literary composition or pressure events to be marked and drawed on chart power trend.As noted, there is event 1720 intentional by inference By inference unintentionally event 1722 both.Two threshold values 1718 of Fig. 4 C create three Ge Li areas:It is relatively low, medium and higher Scope.The beginning part instruction user of trend just throws in the power of relatively low area's amount.This might mean that user is using what is given The thickness that user is writing is write and be not intended to change to line thickness.Then trend is illustrated in power to middle power scope In dramatically increase 1720.It has been unexpected that this power change from the trend seems and after this it is held It is continuous.This can be interpreted as intentional change and be changed according to preset rules as a result to operate by microprocessor 1510(For example, Change line width, increase line thickness etc.).The trend is then with to the substantially intentional event 1720 of second in more high-tensile strength scope To continue.During performance in more high-tensile strength scope, power drops to top threshold value below 1718.This can indicate that unintentionally power changes Change and microprocessor with the change in detection range, but can not realize the change in the operation just coordinated by pen 1500.Such as As indicated above, trend analysiss can be completed with threshold value and/or feature.
Usually, in the disclosure, utensil stroke parameter change also refers to line type, line thickness, tip type, pen Draw the change in terms of type, stroke width, stroke pressure, color and the other forms writing, colour, tinting etc..
The other side of pen 1500 be related to according to contextual information and/or(It is multiple)Interface is selected to select for pen 1500 Operator scheme.Pen 1500 can have several operator schemes.For example, pen 1500 can have write mode, wherein pen 1500(It is multiple)User interface(For example, writing surface end, quick start button 1522, touch sensor 1520, based on fortune Dynamic posture etc.)It is optimised or select for write being associated for task.Used as another example, pen 1500 can have to be known Other pen mode(wand mode), wherein pen(It is multiple)User interface is optimised or selects for controlling with software or equipment(Example Such as, HWC 102, outside local equipment, remote equipment 112 etc.)Associated task.Used as another example, pen 1500 can be with With the pattern of presentation, wherein(It is multiple)User interface is optimised or selects to aid in user to provide presentation(For example, laser designation is used Device 1524 is indicated, while using(It is multiple)Button 1522 and/or posture are controlling the presentation or relevant with presentations answer With).For example, pen can have following patterns, its it is optimised or select for user just attempt control particular device.Pen 1500 There can be various other patterns and one aspect of the present invention is related to select such pattern.
Figure 18 A diagrams are based on the automatic of contextual information(It is multiple)User interface mode is selected.Microprocessor 1510 can be with Programmed with IMU threshold values 1814 and 1812.Threshold value 1814 and 1812 can serve as being directed to for the angle 1804 and 1802 of pen 1500 The upper bound of some estimating positions during some predictive modes and the instruction of lower bound.For example, when microprocessor 1510 determines pen 1500 when being just held or being otherwise positioned within the angle 1802 corresponding with threshold value 1814 is write, microprocessor 1510 write modes that can then initiate the user interface for pen.Similarly, if microprocessor 1510(For example, pass through IMU 1512)It is determined that when pen is just held with the angle 1804 between a predetermined identification threshold value 1812 that falls, microprocessor can To initiate the identification pen mode of the user interface for pen.The two examples can be said to based on the user interface mould of situation Formula is selected, because model selection is based on contextual information(For example, position), the contextual information is automatically collected and and then passes through Automatically evaluation process is used to automatically select pen(It is multiple)User interface mode.
As other examples for presenting herein, microprocessor 1510 can monitor situation trend(For example, pen with The angle of time)Rested in a kind of pattern or change pattern with attempting decision.For example, by feature, threshold value, trend Analysis etc., microprocessor can determine that change is unintentionally to change and therefore undesirable user interface mode change.
Figure 18 B diagrams are based on the automatic of contextual information(It is multiple)User interface mode is selected.In this illustration, pen 1500(For example, by its microprocessor)Just monitoring camera at writing surface end 1508 whether to close proximity to The writing surface of the writing surface end of pen 1500 is imaged.If pen 1500 determine writing surface it is predetermined it is relatively short away from Within, then pen 1500 can be determined that writing surface has 1820 and pen can enter write mode(It is multiple)User interface mould In formula.In the case where pen 1500 is not detected by relatively close writing surface 1822, pen can predict that the pen does not currently have Having just be used as writing implement and the pen can enter non-writing(It is multiple)In user interface mode.
Figure 18 C diagrams are manual(It is multiple)User model is selected.Section 1824, the point for reversing the shell of pen 1500 can be based on Hit end button 1828, the quick start button 1522 of pressing to interact with touch sensor 1520, detect at pressure monitoring system Predetermined action(For example, click on), detection posture(For example, detected by IMU)Etc. selecting(It is multiple)User interface mode.Manually Model selection can be related to the item in the GUI that selection is associated with pen 1500(For example, in being presented on the display of HWC 102 Image).
In embodiment, can present to user in the case where pattern will change and confirm to select.Presentation can be thing Reason(For example, the vibration in pen 1500), by GUI, by optical indicator, etc..
Figure 19 illustrates a pair and uses scene 1900 and 1901.There are many use scenes, and enter one for reader Step understands that we are presented a pair and use scene as diagram already in connection with Figure 19 using the mode of scene.Like this, using scene It is considered as illustrative and nonrestrictive.
The use of scene 1900 is to write scene, wherein pen 1500 is used as writing implement.In this illustration, it is quick to start Button 122A is pressed with the note application 1910 in the GUI 1908 for starting the display 1904 of HWC 102.Once quick start Button 122A is pressed, and HWC 102 just starts note program 1910 and pen is put into into write mode.User uses pen 1500 Carve on a writing surface and paint(scribe)Symbol 1902, the notes are recorded to paint at the quarter and paint the quarter and are sent to HWC 102, wherein representing the symbol shown 1912 painted at quarter within note application 1910.
The use of scene 1901 is posture scene, wherein pen 1500 is used as posture capture and order equipment.In this example In, quick start button 122B is activated and the activation identification pen mode of pen 1500, so that the application started on HWC 102 Can be controlled.Herein, user sees HWC's 102(It is multiple)Application selector 1918 in display, wherein different software Using can be selected by user.User does posture with pen(For example, slide, rotate, rotating etc.)Come make application selector 1918 from It is applied to apply and moves.Once recognize in selector 1918(For example, highlight)Correct application, user can just do appearance Gesture is either clicked on or otherwise interacted with pen 1500, so that the application for being recognized is chosen and starts.Once should With being activated, identification pen mode just can for example be used to scroll through, rotate, changing application, optionies, initiation process etc..
In embodiment, quick start button 122A can be activated and HWC 102 can start application selector with Set of applications is presented to user.For example, quick start button can start selector to illustrate all communications that can be used for selection Program(For example, SMS, Twitter, Instagram, Facebook, Email etc.), enable a user to select user to think The program wanted and subsequently into write mode.Used as further example, trigger can be proposed in quilt preset time Selection that is related or classifying as usual selected various other groups(For example, Microsoft Office products, communication is produced Product, productivity's product, note product, tissue products, etc.).
Another embodiment of Figure 20 diagram present invention.Figure 20 diagram watchband clips controller 2000.Watchband clip Controller could be for the controller for controlling HWC 102 or the equipment in HWC systems 100.Watchband clip controller 2000 With securing member 2018(For example, rotatable clip), it is mechanically adapted to be attached to watchband, as illustrated in 2004 's.
Wrist-watch tape controller 2000 can have(For example, apply as described in this article and selector for starting) Quick startup interface 2008,(For example, the contact type mouse for the GUI controls in the display of HWC 102 will be used as)Touch Template 2014 and display 2012.Clip 2018 can be adapted to be adapted to various watchbands, therefore it can be Its function and be used in conjunction with the independent wrist-watch for selecting.In embodiment, clip is rotatable so that user It can be positioned in the desired manner.In embodiment, clip can be flexible strip.In embodiment, flexible strip can To be adapted to be stretched to be attached in one's hands, wrist, finger, equipment, weapon etc..
In embodiment, wrist-watch tape controller can be configured to removable and interchangeable watchband.For example, controller Can be incorporated in band, so that watchband can together with its combined controller with a certain width, section interval etc. Enough it is attached to wrist-watch main body.In embodiment, attachment can be mechanically adapted to be attached with pin, and watchband is described Rotate on pin.In embodiment, wrist-watch tape controller may be electrically coupled to wrist-watch and/or wrist-watch main body, so that wrist-watch, handss Table main body and/or wrist-watch tape controller can between them transmit data.
Wrist-watch tape controller can have(For example, carried out by IMU, accelerometer, magnetometer, gyroscope etc.)3 axles Moving surveillance is capturing user movement.Then user movement can be interpreted for ability of posture control.
In embodiment, wrist-watch tape controller can include body-building(fitness)Sensor and body-building computer.Sensor Heart rate, the calorie of burning, stride, distance for being covered etc. can be followed the trail of.Data then can be with performance objective and/or standard Compare for user feedback.
Another aspect of the present invention is related to visual display technologies, and the visual display technologies are related to micro-doppler(“mD”) Target tracking feature(" mD features ").MD be use a series of angle dependency electromagnetic pulses Radar Technology, the angle according to Bad electromagnetic pulse is broadcast in environment and returns pulse and is captured.Change between broadcast pulse and return pulse refers to Show the change in shape, distance and the angle position of object in the environment or target.These change offer and can be used in passing through MD tracking features target and recognize the signal of target.Each target or target type have unique mD features.In radar sample It is analyzed to draw with regard to following information in time domain and frequency domain that displacement in formula can be based on mD technologies:The target of presence Type(For example, people whether there is), the motion of target and the relative angular position of target and range-to-go.By selecting For the frequency relative to the known object in environment of mD pulses, pulse can penetrate known object so that with regard to the letter of target Breath can be collected, even when target is visually stopped by known object.For example, can use will penetrate coagulation Civil engineering builds to enable a person to identified pulse frequency in building.Multiple pulse frequencies also can be used in mD radars so as to close The different types of information of the object in environment can be collected.Additionally, mD radar informations can be with other information(Such as ring The image for being captured in border or range measurement)Combined, it is analyzed to provide improved Object identifying and improved mesh jointly Mark is other and follows the trail of.In embodiment, analysis can be performed to HWC or information can be transferred to telecommunication network for dividing Analysis, and as a result it is transmitted back to HWC.Can be carried by laser ranging, structured light photograph, three-dimensional depth map or sonar to measure For range measurement.The image of capturing ambient can be carried out using one or more cameras, one or more of cameras can be from can See light, ultraviolet light or infrared light capture images.MD radars can be attached to HWC, positioned adjacent(For example, in vehicle)And With HWC wireless associations or be the remotely located.Map or other previously determined information with regard to environment also can be used in analysis MD radar informations.Embodiments of the invention are related to make mD feature visualizations in a useful way.
Figure 21 illustrates the FOV 2102 from the HWC 102 at the visual angle of wearer.That as described in herein elsewhere Sample, wearer has perspective FOV 2102, and wherein wearer watches neighbouring surrounding, and what is such as illustrated in figure 21 builds Build.As described elsewhere herein, wearer can also see present within the part of FOV 2102 shown Digital content.The embodiment for illustrating in figure 21 just indicating wearer it can be seen that building and environment in other around unit The track of the bullet that element and expression are just being shot by the different people in region or the digital content of travel path.By FOV's 2102 Transparency viewing surrounding.Track is presented via digital computer display, as described elsewhere herein. In embodiment, the track of presentation is based on by real-time collecting and sends to the mD features of HWC.MD radars itself can be in HWC 102 wearer is above or near the wearer, or it may be located remotely from wearer's positioning.In embodiment, mD radars Scanning area, follow the trail of and recognize target(Such as bullet), and HWC 102 to is sent track based on position.
There are several tracks 2108 and 2104 for being presented to wearer in the embodiment for illustrating in figure 21.From mD thunders Track up to transmission can be associated with GPS location, and GPS location can be with the object in environment(Such as people, building, car Etc.)It is associated, associate in latitude with longitude visual angle and height above sea level visual angle these two aspects.Position is used as being directed to The labelling of HWC is so that the track presented such as in FOV can be associated or be fixed in the space relative to labelling.Example Such as, if friendly troop's shooting track 2108 is defined as having originated from the upper right window in the building in left side by mD radars, such as in figure As illustrating in 21, then virtual labelling can be arranged on window or near windows.When HWC for example passes through its During the window of camera or other sensors viewing building, track and then can carry out virtual grappling with the virtual tag on window (anchor).Similarly, labelling can be arranged on the final position or other flight positions of friendly troop's shooting track 2108(Such as In the upper left window of the Center Building on right side)Near, as shown in figure 21.This technology retaining rail in space Mark, so that track seems to be fixed to the environment position where watching independently of wearer.Thus, for example when pendant During the head rotation of wearer, track seems the position for being fixed to institute's labelling.
In embodiment, certain user position can be known and therefore recognized it in FOV.For example, friendly troop's shooting The shooter of track 2108 can come from known friendly troop soldier and like this his position can be learned.Position can be based on his GPS location and know, the GPS location is based on the mobile communication system with him, such as another HWC 102.In other realities In applying example, friendly troop soldier can carry out labelling by another friendly troop.For example, if known by visual touch or the information for being transmitted Friendly troop position in environment, then the wearer of HWC 102 can carry out mark position using posture or external user interface 104. Knowing how friendly troop soldier position, then the originated location of friendly troop's shooting track 2108 can be color-coded or otherwise Make a distinction with the Unidentified track in shown digital content.Similarly, enemy army's shooting track 2104 can be by color Coding otherwise makes a distinction in shown digital content.In embodiment, in shown digital content On there may be the additional outward appearance being distinguished for unknown track.
Except the track outward appearance associated on scene, track color or outward appearance can from originated location to final position and not Together.This path outward appearance change can be based on mD features.MD features can indicate that for example bullet is slack-off as it is propagated, And this slack-off pattern can be reflected as color in FOV 2102 or pattern changes.This can create shooter positioned at where Understanding directly perceived.For example, the color that originates from may refer to show the redness of high speed, and it can be changed on the route of track Indicate the yellow of slack-off track.This pattern change can with for friendly troop, enemy army and unknown soldier but it is different.For example, Enemy army can become blue to green for friendly troop track.
Figure 21 diagram wherein users see environment and also can see that the enforcement of the color-coded tracks of Jing by FOV Example, the color-coded track of the Jing depends on bullet velocity and soldier's type, wherein track to be fixed on independently of wearer Visual angle environment position in.Other information(Such as distance, scope, range ring, the time on the same day, date, belligerent type(Example Such as, adhere to, lift fire, retreat))Can also be displayed in FOV.
Another aspect of the present invention is related to mD Radar Technology and relative visualization technique, the mD Radar Technology Through other objects of such as wall(MD commonly referred to as through walls)Follow the trail of and recognize target.Figure 22 illustrates original of the invention The mD visualization techniques through walls of reason.As described elsewhere herein, the mD radars of scanning circumstance can be local Or away from the wearer of HWC 102.MD radars can recognize visible target(For example, people)2204, and and then walk at him To following the trail of target during behind walls 2208.Tracking can be then presented to the wearer of HWC 102, so that reflection(Even if In behind walls)The digital content of the movement of target and target is present in the FOV 2202 of HWC 102.In embodiment In, target can be in FOV by incarnation when outside visual fields(avatar)Represent mesh to provide to wearer to represent Target image.
MD target discriminations method can recognize the identity of target based on the vibration of target or other little movements.This can Individual characteristicss are provided for target.In the case of humans, this can cause the personal identification of the target being previously characterized.In body Aerobatic exercise within body(cardio), heartbeat, lung expansion and other little movements for personnel can be unique, and If those attributes are recognized in advance, they can be recognized by real-time matching with providing the personal of personnel in FOV 2202. The mD features of personnel can be determined based on the position of personnel.For example, the data base of personal mD characteristic attributes can include being directed to The mD features of the personnel stand, sit down, lying down, running, walking, jumping etc..MD feature technologies in by the field are followed the trail of During target, this can improve the accuracy of personal data matching.In the case of individualized ground identification personnel, the identity of personnel Concrete identification can be present in FOV 2202.Indicate the type that can be color, shape, shade, name, personnel(For example, Enemy army, friendly troop etc.)Instruction etc. providing the real time information directly perceived with regard to just tracked personnel to wearer.This exists wherein It can be highly useful for existing in the region of tracked personnel in the scene of more than one personnel.If in the zone only One personnel recognizes that then the incarnation of the personnel or the personnel can be with other people in the region not with being personalized It is presented together.
The environment 2300 of Figure 23 diagram mD scannings.MD radars can with scanning circumstance to attempt environment-identification in object. In this embodiment, the environment of mD scannings represents two vehicle 2302a and 2302b, enemy fighter 2309, Liang Ge friendly troops soldiers 2308a and 2308b and shooting track 2318.Each in these objects is recognized or known by type in which can be personalized Not.For example, vehicle 2302a and 2302b can be identified as tank and heavy truck car by mD features.Enemy fighter 2309 can be by It is identified as a type(For example, enemy fighter)Or recognized by more individualized(For example, by name).Friendly troop soldier can To be identified as a type(For example, friendly troop soldier)Or recognized by more individualized(For example, by name).Shooting rail Mark 2318 can be characterized for example, by weapon type or projectile type for projectile.
Figure 23 a illustrate two single FOV Display Techniques of HWC 102 of principle of the invention.FOV 2312 is illustrated The map view 2310 that the environment of wherein mD scannings is presented.Herein, wearer is by the region of mapping to having visual angle, because He will appreciate that all tracked target in this region this.This allows wearer to pass through in the case where target is understood The region.The diagrams of FOV 2312 are used for being provided close to the flat of the augmented reality style view of the environment of wearer to wearer Depending on(head-up)View.
One aspect of the present invention is related to the suppression of exterior light or veiling glare.As discussed elsewhere herein, Eyes aura and facial aura are from artifact as two kinds that such light developed.Eyes aura and facial aura can Caused by the image light escaped from optical device module.When user is actively watching bright display image with HWC, effusion light is then It is visible, it is visible particularly in dark surrounds.It is visible to be used as eyes aura by the light of the anterior effusion of HWC, because The light is visible in the region of the eyes of user.The little version of the display image that eyes aura can watched with user This form occurs.The illumination escaped from the bottom of HWC be mapped to user on the face, on cheek or chest so that user These parts seem to give out light.Both eyes aura and facial aura can increase the visual of user and emphasize HWC Use, this may negatively be treated by user.Like this, it is favourable to reduce eyes aura and facial aura.In fighting scene (For example, the mD tracks being described herein are presented scene)And in some game scenes, the suppression of exterior light or veiling glare is It is very important.
The disclosure for being related to Fig. 6 shows an example, and wherein image light partially passes through combiner 602 so that the light It is irradiated to user on the face, thus a part for the face of lighting consumer, this generally referred herein to as facial aura.By illuminating Any part of the light from HWC of the face of user causes facial aura.
The width being associated with the image light incided on combiner 602 is can come from for the example of the light source of facial aura Cone angle light.Wherein combiner can include holographic mirror or trap reflecting mirror, and the arrowband of wherein highly reflective is matched In the wavelength of the light produced by light source.It is corresponding with the visual field provided by HWC with the wide cone angle that image light is associated.Typical case The reflexive of ground, holographic mirror and trap reflecting mirror is reduced as the cone angle of incident illumination is added to more than 8 degree. As a result, the visual field for 30 degree, most image light through combiner and can cause facial aura.
Figure 24 is shown for the diagram of the ligh trap 2410 of the light of facial aura.In this embodiment, the exterior shield of HWC Extending in for lens be coated with certain area light absorbing material, and the converging light of facial aura is caused in this region in light Absorbed in trap 2410.Light absorbing material can be black, or it can be configured to only absorb by HWC(It is many It is individual)The light filter of the light of the specific wavelength that light source is provided.Additionally, the surface of ligh trap 2410 can be veined or fibroids Further improving the absorption.
Figure 25 diagrams are directed to the optics of the HWC of the outside absorption polarizers 2520 for including the light for stopping facial aura System.In this embodiment, image light is polarized, and as a result, the light for causing facial aura is similarly polarized. Absorption polarizers are orientated with regard to the axis of homology, so that the light of facial aura is absorbed and is not transmitted.In this situation Under, image light that the remainder of the imaging system in HWC can be polarized and image light can combiner it Polarized at front any.In embodiment, the axis of homology of absorption polarizers 2520 is vertically oriented, so that from water Outside dazzle(S-polarization light)Absorbed, and correspondingly, the polarization of image light is selected as level(S-polarization).Therefore, wear The image light crossed combiner 602 and be then incident in absorption polarizers 2520 is absorbed.In fig. 25, absorbability polarization Device 2520 is illustrated in shielding lens outside, and alternatively, the absorption polarizers 2520 can be positioned in shielding lens Side.
Figure 26 diagrams are directed to the optical system of the HWC for including the film with absorbability notch filter 2620.In this feelings Under condition, absorbability notch filter absorbs narrow band light, and it is chosen so as to match the light provided by the light source of optical system.As knot Really, absorbability notch filter is relative to the just opaque of facial aura and for including wavelength in the visible spectrum Remainder be transparent so that user has clear view to surrounding.It is suitable to the ternary trap of this scheme Light filter is obtained from the Yi Rui electricity Spectra-Tech, Inc. (US) 652 Glenbrook Road, P.O. Box 2190 Stamford, Connecticut in Ottawa(Iridian Spectral Technologies, Ottawa), ON:http://www.ilphotonics.com/cdv2/Iridian-Interference%20Filters/ New%20filters/Triple%20Notch%20Filter.pdf。
In embodiment, combiner 602 can include trap mirror coating to be reflected in image light in wavelength light, And the highly reflective that notch filter 2620 can be provided with the light of the wavelength provided by light source and by trap reflecting mirror Arrowband is accordingly selecting.By this way, the image light not reflected by trap reflecting mirror is absorbed by notch filter 2620. In an embodiment of the present invention, light source a kind of narrow band light can be provided for forming monochrome image or provide three kinds of narrow band lights with In full color imaging.Then trap reflecting mirror and associated notch filter each will respectively provide highly reflective with absorption A kind of arrowband or three kinds of arrowbands.
Figure 27 includes micro- louver film 2750 of the light for stopping facial aura.Micro- louver film is sold by 3M Such as ALCF-P, and typically serve as the privacy filter for computer.Referring to http://multimedia.3m.com/ mws/mediawebservermwsId=SSSSSuH8gc7nZxtUoYxlYeevUqel7z HvTSevTSeSSSSSS--&fn= ALCF-P ABR2 Control Film DS.pdf.Micro- louver film transmitted light within a certain narrow angle(For example, normal 30 degree and absorb light more than 30 degree of normal).In figure 27, micro- louver film 2750 is located such that facial brightness The light 2758 of light incides micro- louver film 2750 more than 30 degree from normal, and has an X-rayed light 2755 and enter within 30 degree of normal It is mapped to micro- louver film 2750.Like this, the light 2758 of facial aura is absorbed by micro- louver film, and has an X-rayed the quilt of light 2755 Transmission is so that user has the bright see-through view of surrounding.
We turn now back to the description of eye imaging technology.Each aspect of the present invention is related to the people to wearing HWC 102 The various methods of the eye imaging of member.It is following detailed description of for using being related to "Off" state and " nothing in embodiment The optical path of electricity " state is described to the technology of eye imaging.In embodiment, for be not related to reflect eye image from Open the optical arrangement of DLP reflecting mirrors to be described the technology of eye imaging.In embodiment, non-structured light, structuring Light or controlled illumination condition be used to predict the position of eyes based on the light being reflect off from the ocular region of wearer Put.In embodiment, being reflected in when it leaves from the eye reflections of wearer for the digital images of content of presentation is captured, and The image of reflection can be processed to determine the quality of presented image(For example, acutance).In embodiment, image then can To be adjusted(For example, it is differently focused)To reflect the quality of the image for improving presented based on image.
Figure 28 a, 28b and 28c illustrate the diagram of the various positions of DLP reflecting mirrors.Figure 28 a are illustrated in " unlatching " state DLP reflecting mirrors in 2815.In the case where reflecting mirror is in " unlatching " state 2815, illumination light 2810 is along extending to bottom Optical axis 2820 in optical module 204 is reflected.Figure 28 b illustrate the DLP reflecting mirrors in "Off" state 2825.In reflection In the case that mirror is in "Off" state 2825, illumination light 2810 is along substantially in the quilt of optical axis 2830 of the side of optical axis 2820 Reflection so that "Off" state light towards as herein elsewhere described in half-light trap be directed.Figure 28 c are illustrated and are in DLP reflecting mirrors in 3rd position, this occurs when DLP is applied to without electric power.This " without electricity " state with " open Open " and "Off" state difference be mirror edge not with substrate contact and relatively inaccurately positioned like this.Figure 28c is illustrated in all DLP reflecting mirrors " without electricity " in state 2835." without electricity " state is by " opening for DLP reflecting mirrors Opening " voltage is simultaneously set to zero by contact with " closing " contact, as a result, reflecting mirror returns to stress free position, at that In DLP reflecting mirrors in DLP platforms plane in, as illustrated in Figure 28 c.Although generally not carrying out, also may be used Energy will state be applied to each DLP reflecting mirror " without electricity ".When DLP reflecting mirrors are in the state " without electricity ", their not contribution plot pictures Content.But, as illustrated in Figure 28 c, when DLP reflecting mirrors be in the state " without electricity " when, illumination light 2810 along Optical axis 2840 between the optical axis 2820 and 2830 being associated with " unlatching " and "Off" state respectively is reflected, and like this this Plant light and shown image is contributed to not as bright pixel or dark pixel.But this light being capable of portion's optical module 204 downwards The light of middle contribution scattering, and as a result, shown picture contrast can be reduced or detract the puppet of picture material As being created in the picture.Therefore, in embodiment it typically would be desirable to, the time that will be associated with " without electricity " state limit Be made as the time being not displayed when image, or reduce with there is the DLP reflecting mirrors being in " without electricity " in state to be associated when Between, so that the impact of the light of scattering is reduced.
Figure 29 illustrates embodiments of the invention, its can be used in HWC 102 wearer's display digit content images simultaneously And the image of the eyes of capture wearer.In this embodiment, the light from eyes 2971 is passed back through in lower module 204 Optical device module, solid correction wedge 2966, at least a portion in light pass through partially reflecting layer 2960, solid state lighting Wedge 2964 and reflected by the multiple DLP reflecting mirrors in " without electricity " state on DLP 2955.The light of reflection is then Pass back through illumination wedge 2964 and at least a portion in light is partially reflected 2960 reflection of layer and light is by camera 2980 are captured.
In order to compare, it is also shown as just being partially reflected layer 2960 from the illuminating ray 2973 of light source 2958 and is reflected. The angle of wherein illumination light 2973 is such:It causes DLP reflecting mirrors indirect illumination light 2973 when in " unlatching " state To form image light 2969, the image light 2969 substantially shares the light identical optical axis with the eyes 2971 from wearer. By this way, the image of the eyes of wearer is caught in the visual field overlapping with the visual field for shown picture material Obtain.By contrast, the light for being in the DLP reflecting mirrors reflection of "Off" state forms half-light 2975, and it is substantially directed into The side of image light 2969 and the light from eyes 2971.Half-light 2975 is directed towards ligh trap 2962, and the ligh trap 2962 is inhaled Half-light is received to improve the contrast of shown image, as describing in this manual more than.
In embodiment, partially reflecting layer 2960 is reflective polarizer.Then can enter from the light of the reflection of eyes 2971 Penetrate correction wedge 2966 before so that from eyes 2971 reflection light can substantially by reflective polarizer transmit relative to The polarization orientation of reflective polarizer is being polarized(For example, using the absorbability between upper module 202 and lower module 204 Polariser).Then quarter-wave retarder layer 2957 is adjacent to DLP 2955 and is included(As disclosed in previously in fig 3b Like that), so that passing through four before the reflection of multiple DLP reflecting mirrors of " without electricity " state is in from the light of the reflection of eyes 2971 / mono- ripple retarder layer 2957 once, and and then is passed through for the second time after being reflected.By prolonging through quarter-wave Late device layer 2957 twice, from the polarization state of the light of eyes 2971 be reversed so that when its incidence on the reflective polarizer when, Then light from eyes 2971 reflected generally toward camera 2980.By using partially reflecting layer 2960(It is reflection Polariser)And the light from eyes 2971 was polarized before incident correction wedge 2964, reduce by partially reflecting layer 2960 losses for causing.
Figure 28 c illustrate wherein DLP reflecting mirrors while in the situation of the state " without electricity ", this operator scheme is in HWC 102 Can be useful especially when being applied to for the first time on the head of wearer.The head of wearer is applied to when the first times of HWC 102 When in portion, need not also display image.As a result, DLP can for all DLP reflecting mirrors all in " without electricity " state and The image of the eyes of wearer can be captured.Then can be using iris recognition technology or other eyes pattern technology of identification The image for being captured of the eyes of wearer and data base are compared to determine into the identity of such as wearer.
In the further embodiment illustrated by Figure 29, a part of all DLP reflecting mirrors in frame time(For example, pin To the frame time of shown digital images of content 50%)The capture for being inside put into " without electricity " state and eye image is same Step is occur and the generation within the identical persistent period in same time.By reducing the DLP reflections in the state " without electricity " The time of mirror, wherein light be in " without electricity " state DLP reflecting mirrors scattering time be reduced so that wearer does not feel Know the change in shown picture quality.This is possible, because DLP reflecting mirrors have the response time of musec order, and It it is about 0.016 second for the typical frame time of shown image.The method of the image of the eyes of this capture wearer Can be used periodically to capture the multiimage of the eyes of wearer.For example, eye image can be shown to per 10 It is captured in the 50% of the frame time of the frame of wearer.In another example, eye image can be shown to wearer at each Frame frame time 10% in be captured.
Alternatively, " without electricity ", state can be applied to the subset of DLP reflecting mirrors(For example, the 10% of DLP reflecting mirrors), and Another subset is busy with generating is used for content by the image light of shown content.This can be realized to wearer's display digit Capture during content(It is multiple)Eye image.DLP reflecting mirrors for eye imaging for example can at random divide across the region of DLP Cloth, so that the impact for aligning the quality of the digital content for being displayed to wearer is minimized.For example, felt by wearer to improve The shown image known, can be such as each DLP reflecting mirror for capturing each eye image into the state " without electricity " Changed over random pattern.In yet another embodiment, enter " without electricity " state for eye imaging DLP reflecting mirrors Can be with so that " without electricity " reflecting mirror be from the removed such mode in part and digital content of the image for needing less resolution Coordinate.
In the embodiments of the invention as shown in Fig. 9 and 29, in both cases by DLP reflecting mirrors provide it is anti- Reflective surface does not retain the wavefront of the light of the eyes from wearer, so that the picture quality of the image for being captured of eyes exists Limited in a way.In certain embodiments this may remain useful, but it is limited to a certain extent.This It is because DLP reflecting mirrors are not confined on same level.In the embodiment for illustrating in fig .9, DLP reflecting mirrors are inclined Tiltedly so that they form the row of the DLP reflecting mirrors of shared common plane.In the embodiment illustrated in Figure 29, each DLP is anti- Penetrate mirror not being accurately positioned in the identical plane because they not with substrate contact.The reality being associated with Figure 29 Applying the example of the advantage of example is:First, camera 2980 can be positioned between DLP 2955 and lighting source 2958 to provide Greater compactness of upper module 202.Second, the polarization state from the light of the reflection of eyes 2971 can be with the polarization shape of image light 2969 State is identical, so that the optical path of image light and the light from eye reflections can be identical in lower module 204.
Figure 30 is illustrated for wearer's display image and while capturing the embodiment of the image of the eyes of wearer Diagram, wherein the light from eyes 2971 is partially reflected layer 2960 and reflects towards camera 3080.Partially reflecting layer 2960 can It is optically flat layer so that the wavefront from the light of eyes 2971 is retained, and as a result, can capture wearer's eye The higher quality image of eyeball.Further, since do not include DLP 2955 being directed in the optical path of the light of eyes 2971, and And the eye imaging process that figure 30 illustrates does not disturb shown image, it is possible to independently(For example, independently of with In the case of sequential in image light, the impact to resolution or pixel counts)From the eye of shown image capturing wearer The image of eyeball.
In the embodiment for illustrating in fig. 30, partially reflecting layer 2960 is reflective polarizer, and illumination light 2973 is polarized, and is come Polarized from the light of eyes 2971 and camera 3080 is located at behind polariser 3085.The polarization axle of illumination light 2973 and from eye The polarization axle of the light of eyeball is orientated with the transmission axes perpendicular ground of reflective polarizer, so that they are all substantially anti-by reflective polarizer Penetrate.Illumination light 2973 passes through quarter-wave layer 2957 before the DLP reflecting mirrors reflection in by DLP 2955.The light of reflection is worn Quarter-wave layer 2957 is crossed, so that the polarization state of image light 2969 and half-light 2975 is anti-compared with illumination light 2973 Turn.Like this, image light 2969 and half-light 2975 are substantially transmitted by reflective polarizer.DLP wherein in " unlatching " state is anti- Penetrate mirror and provide image light 2969 along the optical axis extended in lower optical module 204, with to wearer's display image.Identical Time, the DLP reflecting mirrors in "Off" state provide dark along the optical axis of the side for extending to top optical device module 202 Light 2975.Wherein half-light 2975 is incident on the region of the correction wedge 2966 on the side of top optical device module 202 In, absorption polarizers 3085 are positioned, wherein its axis of homology it is vertical with the polarization axle of half-light and with the light from eyes Polarization axle it is parallel so that half-light 2975 is absorbed and the light from eyes 2971 is transmitted to camera 3080.
Figure 31 is illustrated for display image and while is captured another enforcement of the system of the image of the eyes of wearer The diagram of example, it is similar to the diagram that figure 30 illustrates.Difference in the system that figure 31 illustrates is from eyes 2971 light underwent multiple reflections before being captured by camera 3180.In order to realize multiple reflections, reflecting mirror 3187 is carried For behind absorption polarizers 3185.Therefore, the light from eyes 2971 is with regard to the incident correction wedge 2966 of polarization axle Polarized before, the transmission axes perpendicular of the polarization axle and the reflective polarizer including partially reflecting layer 2960.By this way, From eyes 2971 light before being captured by camera 3180 by reflective polarizer first reflection, by second of reflecting mirror 3187 Reflect and reflected by reflective polarizer third time.Although the light from eyes 2971 passes through absorption polarizers 3185 twice, Because the polarization axle of the light from eyes 2971 is orientated parallel to the polarization axle of the light from eyes 2971, it substantially by Absorption polarizers 3185 are transmitted.As the system described with reference to Figure 30, the system that figure 31 illustrates includes optically flat Partially reflecting layer 2960, its retain from eyes 2971 light wavefront, so as to capture the higher of the eyes of wearer Quality image.Be additionally, since does not include DLP 2955 in the optical path for the light from the reflection of eyes 2971, and in figure The eye imaging process illustrated in 31 does not disturb the image of display, it is possible to independently from shown image capturing wearer Eyes image.
Figure 32 illustrate for display image and while capture the image of the eyes of wearer including beam-splitting board 3212 The diagram of system, the beam-splitting board 3212 includes being maintained in the air between light source 2958, DLP 2955 and camera 3280 Reflective polarizer.Illumination light 2973 and from eyes 2971 both light all with regard to the transmission axes perpendicular of reflective polarizer Polarization axle is polarized.As a result, both illumination light 2973 and the light from eyes 2971 are substantially reflected by the reflective polarizer. Illumination light 2873 is reflected by the reflective polarizer towards DLP 2955, and is respectively at " unlatching " depending on each DLP reflecting mirror State or "Off" state and illumination light 2873 is divided into into image light 2969 and half-light 3275.By through quarter-wave layer 2957 twice, and the polarization state of illumination light 2973 is compared with the polarization state of half-light 3275 with image light 2969 and inverted.As As a result, then image light 2969 and half-light 3275 are substantially transmitted by reflective polarizer.Absorption at the side of beam-splitting board 3212 Property polariser 3285 have it is vertical with the polarization axle of half-light 3275 and parallel with the polarization axle of the light from eyes 2971 saturating Axle is penetrated, so that half-light 3275 is absorbed and the light from eyes 2971 is transmitted to camera 3280.As shown in Figure 30 In system, the system that figure 31 illustrates includes optically flat beam-splitting board 3212, and it retains the ripple of the light from eyes 2971 Before, so as to capture the higher quality image of the eyes of wearer.It is additionally, since in the light for the light from eyes 2971 Do not include DLP 2955 in ways for education footpath, and the eye imaging process that figure 31 illustrates does not disturb shown image, so Can independently from the image of the eyes of shown image capturing wearer.
Polarization state wherein from the light of eyes 2971 need eyes contrary with the polarization state of image light 2969 into As system(As illustrated in Figure 30,31 and 32)The bottom for needing and including the combiner by two kinds of polarization states are reflected Module is used together.Like this, these upper modules 202 are most preferably suitable for including combiner(It is reflexive, and with polarization State is unrelated)Lower module 204 use, the example of these lower modules is illustrated in Fig. 6,8a, 8b, 8c and 24-27.
In the further embodiment that figure 33 illustrates, partially reflecting layer 3360 is by the side of facing illumination light 2973 On reflective polarizer and towards the short reduction of fractions to a common denominator Look mirror on the side of the light from eyes 3371 and camera 3080(short pass dichroic mirror)Composition.Wherein short reduction of fractions to a common denominator Look mirror is the electrolyte reflection for transmiting visible ray and reflecting infrared light Mirror coating.Partially reflecting layer 3360 can be by the reflective polarizer of the inner surface for being joined to illumination wedge 2964 and in correction wedge Short energization dielectric mirror coating composition in the opposed inner surfaces of shape thing 2966, wherein illumination wedge 2964 and correction wedge shape Then thing 2966 is optically bonded together.Alternatively, partially reflecting layer 3360 can be by with the reflection for being joined to side The thin substrate of polariser and short reduction of fractions to a common denominator Look mirror coating on another side are constituted, and then which part reflecting layer 3360 is engaged with Between illumination wedge 2964 and correction wedge 2966.In this embodiment, infrared light is included to shine eyes It is bright, so that being substantially made up of infrared light from the light of eyes and the image for being captured of eyes.The wavelength of infrared light is then The reflection wavelength of the wavelength and short reduction of fractions to a common denominator Look mirror of being capable of capture images with camera is matched, for example, can use 800nm wavelength.With this The light of the mode of kind, short reduction of fractions to a common denominator Look mirror transmission image light and reflection from eyes.Camera 3080 is then positioned in absorption ligh trap At the side of the correction wedge 2966 in 3382 region, the absorption ligh trap 3382 is provided as absorbing half-light 2975.It is logical Positioning camera 3080 in the depression crossed in ligh trap 3382 is absorbed, the scattering of the half-light 2975 carried out by camera 3080 can be subtracted Less so that more high-contrast image can be displayed to wearer.The advantage of this embodiment be from eyes light need not Polarized, this can simplify optical system and improve the efficiency of eye imaging system.
In another embodiment illustrated in Figure 32 a, beam-splitting board 3222 is by the side of facing illumination light 2973 Reflective polarizer and towards on the side of the light from eyes 3271 and camera 3280 short reduction of fractions to a common denominator Look mirror constitute.Sorbent surface 3295 are provided to capture half-light 3275 and camera 3280 and are positioned in the opening of sorbent surface 3295.By this way, The system that Figure 32 can be made works in the case of from the unpolarized light of eyes 3271.
In the embodiment of the image of the eyes for being related to capture wearer, for the light being illuminated to the eyes of wearer Can be provided by several different sources, the source includes:From the light of shown image(That is, image light);Through combination The light from environment of device or other optics;Light provided by special eyes light etc..Figure 34 and 34a illustrate special eyes The diagram of illumination light 3420.Figure 34 illustrates the diagram from side view, and wherein dedicated illumination eyes light 3420 is positioned in combination The corner of device 3410, so that it does not disturb image light 3415.When wearer is actively watching the display provided by image light 3415 During image, special eyes illumination light 3420 is oriented to so that the eyes frame that is located to eyes 3430 of eye illumination light 3425 3427 are illuminated.Figure 34 a illustrate the diagram at the visual angle of the eyes from wearer, to illustrate how special eyes illumination light 3420 corners for being positioned at combiner 3410.Although special eyes illumination light 3420 is shown in the left upper of combiner 3410 Go out, but along in the edge of combiner 3410 other positions or other opticses or mechanical part be also can Can.In other embodiments, the more than one special eyes light 3420 with diverse location can be used.In embodiment, Special eyes light 3420 is infrared light, and it is that wearer is sightless(Such as 800 nm), so that eye illumination light 3425 is not Disturb the display image perceived by wearer.
Figure 35 illustrates a series of diagrams of captured eye image, and the eye image for being captured is illustrated by special eyes light The eyes flash of light of generation(That is, the light being reflect off from front of eyes).In this embodiment in accordance with the invention, the eye of wearer The image for being captured of eyeball is analyzed to determine the iris 3550, pupil or other parts of eyes and eyes flash of light 3560 Relative position.Eyes flash of light is the reflected image of the special eyes light 3420 when using dedicated optical.Figure 35 diagrams are directed to various eyes The eyes flash of light 3560 of eyeball position and the relative position of iris 3550.By being substantially spherical with human eye or at least Be reliably repeatable shape the fact in combination with special eyes light 3420 is provided in fixed position, within display image Or around within the see-through view of environment, eyes flash of light provides fixed reference point, and position determined by iris can Where watched with determining wearer compared with reference with the fixation.By the way that special eyes light 3420 is positioned at into combination The corner of device 3410, eyes flash of light 3560 is formed in captured image away from iris 3550.As a result, can be The position of iris and eyes flash of light is easier and more accurately determined during the captured image of analysis, because they are each other not Interference.In a further embodiment, combiner includes associated cut-off filter, and it prevents the infrared light from environment from entering Penetrate HWC and camera is infrared camera, so that eyes flash of light is only provided by the light from special eyes light.For example, combiner Can include making visible ray to include absorbing visible ray simultaneously through the optical low-pass filter for absorbing infrared light simultaneously, and camera Make the high-pass filters that infrared light passes through.
In the embodiment of eye imaging system, for camera lens be designed to consider with upper module 202 and The associated optics of lower module 204.This by by camera design be include optics in upper module 202 and Optics in lower module 204 realizing, so as to the height of the eyes that produce wearer at imageing sensor in the camera MTF images.In another embodiment, camera lens are provided with the big depth of field to eliminate for following demand:Focus on camera So that the sharp image of the eyes to be captured can be realized.The wherein big depth of field is generally by high f/# lens(For example, f/#>5)To provide. In this case, by compensating the light collection of the reduction be associated with high f/# lens including special eyes light, with can be real The bright image of the eyes now to be captured.Further, the brightness of special eyes light can be modulated and with eye image Capture is synchronous, so that special eyes light has the dutycycle for reducing and reduces the bright of the infrared light on the eyes of wearer Degree.
In a further embodiment, Figure 36 a illustrate the diagram of the eye image of the wearer for being used for recognizing HWC. In this case, the image of the eyes 3611 of wearer is captured and analyzed for the pattern 3612 of discernible feature.Then The pattern is compared with the data base of eye image to determine the identity of wearer.Examine wearer identity it Afterwards, can operator scheme to adjust and control HWC consistent with the wearer's identity for determining and to be shown image, apply with And the type of information.It is confirmed as whom being whether including the adjustment example of operator scheme according to wearer:Make different behaviour Operation mode or characteristic set can use, shut down or send messages to external network, allow operation guest(guest)Feature and application, Etc..
In the diagram using another embodiment of eye imaging, wherein based on by the ocular surface from wearer Eyes produced by the reflection of display image glisten to determine the acutance of display image.By the eyes 3611 of capture wearer Image, eyes flash of light 3622(It is the little version of display image)Being capable of and analysis captured for acutance.If showing figure It is sharp keen as being determined not to be, then for the adjust automatically of the focusing of HWC optics can be performed to improve acutance. This ability of the measurement of the acutance of display image is performed at the surface of the eyes of wearer can provide very accurate image The measurement of quality.With measurement and the ability of focusing of adjust automatically display image is very useful in terms of augmented reality imaging , change in the method that wherein focusing distance of display image can be used in response to the change in environment or by wearer and Change.
One aspect of the present invention is related to control HWC 102 by interpreting eyes image.In embodiment, eye imaging Technology(It is all as described in this article those)Be used to capture the series of eye image or eye image for processing.(It is many It is individual)Image can be processed to determine the predetermined reaction of the action of user view, HWC or other actions.For example, image can be by It is interpreted as the user's control action of the affirmative for the application on HWC 102.Or, image can for example cause HWC 102 In a predetermined manner reaction is so that HWC 102 always safely, intuitively etc. is operated.
Figure 37 illustrates eyes ghosting procedure, and it is related to the wearers' of HWC 102(It is multiple)Eye imaging and(For example, By eye imaging technology as described in this article)Process image to determine that eyes are seen relative to its neutral position or forward direction See position and/or FOV 3,708 3702 in where.The process can be related to calibration steps, and wherein user is by HWC In 102 FOV provide guidance and be command by watching in a certain direction, enable to carry out eye position relative to FOV Region more accurately prediction.If the eyes of wearer are confirmed as towards the right side of FOV 3708 watching(Such as in Figure 37 In it is illustrated as, user outwards watches from paper), then can be established may be just to project wearer for virtual target line Towards what viewing in environment or what just in viewing environment.Virtual target line can with by HWC 102 The image of camera capture is used in combination, and the camera is imaged to the surrounding in front of wearer.In embodiment, catch Obtain the camera of surrounding visual field matching or can be by(For example, digitally)FOV 3708 is matched, so that being compared It is clearer.For example, in the case where camera captures the image of surrounding with the angle for matching FOV 3708, can pass through Any surrounding object projected and be aligned with virtual target line(For example, depending on the process of camera image ability and/or image And with 2d or 3d)Process dummy line.If there are multiple objects along virtual target line, each in object is can correspond to Focal plane is set up, so that digital content can be placed on and be aligned with virtual target line and fall in Jiao of object interested In the region in FOV 3708 at plane.User is then when on the object in the environment that he is focused in identical focal plane Can see that digital content.In embodiment, by relatively setting up and virtual target compared with the map information of surrounding The object of line being aligned.
In embodiment, can be not displayed in FOV with the digital content of virtual target line being aligned, until eyes position Put in correct position.This can be predetermined process.For example, system can be established as causing the particular segment of digital content (For example, advertisement, tutorial message, object information etc.)In will appear in wearer's viewing environment(Some)The situation of certain object Under.Can develop in the eyes of wearer and environment(It is multiple)Object(For example, building, part, the architectural mark of building Note, GPS location etc.)Virtually connect(It is multiple)Virtual target line, and virtual target line can depend on(For example, as led to Cross the determinations such as GPS, electronic compass, IMU)The position of the position of wearer and view direction and object and by continuously more Newly.When the pupil of virtual target line hint wearer is substantially aligned with virtual target line or will be aligned with virtual target line When, digital content can be displayed in FOV 3704.
In embodiment, the especially partially viewed time spent in along virtual target line and/or FOV 3708 can be with Indicate that to the object in the environment and/or just shown digital content of wearer is interested.If cost is seen in one direction There is no display digit content at the time of the predetermined amount of time seen, then digital content can be presented in the region of FOV 3708. Spending in the time of viewing object can be interpreted as example to show the order of the information with regard to the object.In other realities In applying example, due to the relatively sluggish instruction of personnel, content can be not related to the object and can be presented.In embodiment In, digital content can be positioned close to virtual target line, but not with its being aligned so that the surrounding of wearer is regarded Figure is not blocked, but information can strengthen the surrounding view of wearer.In embodiment, along in shown numeral It can be instruction interested in digital content that score on the direction of content is watched the spent time.This can be used Make the change event in advertisement.For example, if the shown advertisement of wearer's viewing of HWC 102 reaches certain period of time, extensively Accusing business can pay more for advertisement putting.Like this, in embodiment, by the way that eye position and content are thrown in, score or The time that the viewing advertisement that other appropriate positions compare assessed is spent may be used to determine whether the conversion for presenting Rate or other compensation amount dues.
One aspect of the present invention be related to when the wearer of HWC 102 substantially wants clearly to watch surrounding from The FOV of HWC 102 removes content.Figure 38 diagram wherein eyes image hint eyes quickly moved or quickly moving because The scene that digital content 3804 in this FOV 3808 is removed from FOV 3808.In this illustration, wearer can be quick Viewing side, so as to indicate there is something on the side in the environment, it has caused the attention of wearer.Can pass through(Example Such as, as described in this article)Eye imaging technology capture eyes movement 3802, and if the predetermined movement of shifted matching (For example, speed, speed, pattern etc.)Then the content can be removed with view.In embodiment, eyes movement is used as an input And by other sensors(For example, the IMU in HWC)The HWC movements of instruction can serve as another instruction.These various biographies Sensor movement can be used together to plan the event that cause the change in the content shown just in FOV.
Another aspect of the present invention is related to the eyes based on wearer and assembles determination focal plane.Eyes typically slightly can Coalescence and more assemble when personnel are close proximity focused on something.This is commonly referred to as assembled.In embodiment, meeting It is poly- to be calibrated for wearer.I.e., it is possible to pass through certain focal plane move(exercise)Instruct wearer and worn with determining The eyes of person assemble how many in various focal planes and with various viewing angles.Aggregate information can be then stored in data It is used for reference later in storehouse.In embodiment, form of general use can be used in without calibration steps or personnel's skip calibrations step In the case of.Two eyes can and then be periodically imaged to determine convergence, so as to sound out wearer focus on it is assorted On focal plane.In embodiment, eyes can be imaged with determine virtual target line and and then the convergence of eyes can be by It is determined that the focusing to set up wearer, and digital content can shown or change based on this.
Within Figure 39 diagrams wherein one or two in FOV 3908 and 3910 of digital content mobile 3902 with it is logical Cross the scene of the convergence alignment of eyes determined by pupil movement 3904.In embodiment, maintained by mobile digital content Alignment, the overlapping property of content is maintained, therefore object appears to be suitable for wearer.This shows wherein 3D contents Can be important in scene.
One aspect of the present invention is related to control HWC 102 based on the event detected by eye imaging.Wearer Moving his eyes, blink, flicker etc. with a certain pattern can for example control the application of HWC 102.(For example, as herein Description)Eye imaging can be used for monitoring wearer's(It is multiple)Eyes and can send out if predetermined pattern is detected Dynamic application control order.
One aspect of the present invention is related to by monitoring wearer's(It is multiple)Eyes wear the personnel of HWC 102 to monitor Health.Can be calibrated to record(document)The eyes of wearer are in various conditions(For example, illumination bar Part, image optical condition etc.)Under Normal appearances.Then the eyes of wearer can pass through for the change in their performance (For example, as described in sheet)Eye imaging is monitored.Change in performance can indicate health concerns(For example, brain Concussion, brain injury, apoplexy, lose blood).If detecting the data for indicating change or event, it can be passed from HWC 102 Send.
One aspect of the present invention is related to examine the computer asset of determination by eye image(For example, HWC itself and phase The computer system of pass)Safety and access.As discussed elsewhere herein, eyes image can be with known people Eyes image compares to confirm the identity of personnel.Eyes image can be also used for being linked together or shared text in permission personnel Before part, stream, information etc., the identity of the personnel of HWC 102 is worn in confirmation.
It is possible based on the technology being described herein for the various service conditions of eye imaging.One of the present invention Aspect is related to the sequential of eye image capture.The frequency energy of the capture of the sequential of the capture of eye image and the multiple images of eyes It is enough to be changed according to the service condition for being directed to the information collected from eye image.For example, capture eye image to recognize the use of HWC Family can only when HWC has been turned on or be required when HWC determines that HWC is applied on the head of wearer with control HWC with And it is shown to the safety of the associated information of user.Wherein, the ear angle of HWC(earhorn)Position(Or other portions of HWC Point), stress, mobile pattern or orientation can be used in determination personnel and HWC be applied to into they in the case of the intention using HWC Head on.Those identical parameters can be monitored and when unloaded HWC from the head of user with trying hard to understand.This can Realize what the capture for being wherein used for the eye image for recognizing wearer only can be done when the change in situation is worn in identification Scene.In comparative examples, capture eye image may be needed periodically with the health for monitoring wearer(For example, every several seconds, Per several clocks, per a few houres, per several days etc.)Capture images.For example, when image is just being used in the mobile instruction wearer for detecting just Take exercise when monitor wearer it is healthy when can by minute interval obtain eye image.In other comparative examples, capture Eye image only needs monthly to capture eye image with the health that wearer is monitored for long-term effect.Embodiments of the invention are related to And with associated by eye image in selected use scene accordingly select capture eye image speed and sequential.This It is a little to select to be automatically performed, with wherein move indicate to take exercise more than temper example as, or these select can be manual Arrange.In a further embodiment, depending on HWC operation pattern and adjust automatically eye image capture speed and when The selection of sequence.The speed of eye image capture and the input characteristics for being selected to further be associated in wearer of sequential (Including age and health status)Or the physical state of the sensing of wearer(Including heart rate, the chemical composition of blood and eyes Flicker speed)Consistently select.
The speed positioning that Figure 40 diagrams are wherein being moved based on wearer is presented on the digital content in the FOV of perspective Embodiment.When personnel do not move, as by HWC 102(It is multiple)Sensor(For example, chasing after based on IMU, GPS Track etc.)As measured, digital content can be present at static personnel's location of content 4004.Location of content 4004 is referred to It is shown as in the middle of the FOV of perspective;But this is intended to illustrate digital content it typically would be desirable to knowing what wearer was not moving Place is positioned within the FOV of perspective, and like this surrounding's see-through view of wearer can be blocked to a certain extent. Therefore, static personnel's location of content or neutral position can not be centered on the FOV having an X-rayed;It can be positioned in perspective FOV In be considered desired somewhere and sensor feedback can make digital content from neutral displacement.For quick mobile people The movement of the digital content of member also figure 40 illustrates, wherein as their head is turned to side by the personnel, in numeral Hold from perspective FOV and move to location of content 4008, and their head is gone back to then as personnel and is moved back to and.For Slow mobile personnel, head movement may more complicated and the digital content outside perspective FOV like this movement can abide by Follow following paths:Path such as shown in location of content 4010.
In embodiment, the sensor for assessing the movement of wearer can be GPS sensor, IMU, accelerometer etc..It is interior Holding position can be with propulsion increase from neutral displacement to the position of the lateral edges towards visual field.Location of content can To increase with propulsion from neutral displacement to the top towards visual field or the position of feather edge.Location of content can be with base Shift in the threshold velocity of the motion of assessment.Location of content can be based on propulsion speed and linear displacement.Content position Put can be based on propulsion speed and non-linear shift.Location of content can be displaced to outside visual field.In embodiment, if Mobile speed exceedes predetermined threshold then no longer display content and will display content again once propulsion is slack-off.
In embodiment, location of content may be generally referred to as displacement;It should be understood that as term displacement is covered Process:For wearer is wherein within perspective FOV or in the outer movements from a position to another position of FOV 's(For example, content seems slow or quick movement and user perceives movement itself), or from a position to another The movement of position can be invisible for wearer(For example, content seems to be disappeared with the jump of discontinuous form or content And and then reappear in new position).
Another aspect of the present invention is related to remove content from visual field or content is displaced to into the position within visual field, this Increase the environmental views of wearer when sensor causes alert command to be published.In embodiment, alarm can be by Cause higher than the sensor or sensor combinations of the condition of threshold value in sensing.For example, if audio sensor detection is a certain Pitch(pitch)Loud sound, then the content in visual field can be removed or shift to provide surrounding for wearer Understand view.In addition to the displacement to content, in embodiment, the instruction why content is shifted can be present in and regard Wearer is supplied in or by audible feedback.For example, if carbon monoxide transducer detects in the zone high concentration, Then the content in visual field can be displaced to the side of visual field or remove from visual field, and there is high concentration in this region The instruction of carbon monoxide can be provided to wearer.This fresh information can be according to wearer's when being present in visual field Translational speed and similarly shifted within visual field or outside visual field.
How content can be displaced to alarm position 4108 by Figure 41 diagrams from neutral position 4104.In this embodiment In, content is shifted outside perspective FOV 4102.In other embodiments, content can be moved like that as described in this article Position.
Another aspect of the present invention is related to recognize the various vector directions related to HWC 102(heading)And Sensor is input into, and content is positioned in visual field with determining how.In embodiment, the translational speed of wearer is detected simultaneously And as the input for location of content, and according to the speed, content can be with regard to mobile vector or direction(That is, it is mobile Direction)Or visual field vector or direction(That is, the direction in the visual field direction of wearer)To position.For example, if wearer just Move very fast, then content can be positioned within visual field with regard to mobile vector because wearer only will periodically and Side in short time period towards himself is watched.Used as another example, if wearer slowly moves, content can With with regard to the visual field towards being positioned because his view just more freely may be displaced to opposite side by user from side.
Figure 42 diagrams wherein mobile vector can affect two examples that content is positioned.Mobile vector A 4202 is than mobile arrow B 4210 is shorter for amount, so as to indicate the pace of the movement of personnel and/or the acceleration that are associated with mobile vector A 4202 Than lower with the personnel that mobile vector B 4210 is associated.Each personnel is also indicated as with visual field vector or towards 4208 Hes 4212.Visual field vector A 4208 and B 4210 are identical from the point of view of relative perspective.In the black triangle of each person there Interior white portion indicates that each personnel may spend and how long is not looking up with the side of mobile vector being aligned.Leave Angle A viewing the spent time 4204 was indicated as more than the time 4214 for leaving angle B viewing cost.This is possibly due to Mobile vector speed A is less than mobile vector speed B.Typically, personnel's forward movement is faster, then personnel are more likely in advance side Look up.How FOV A 4218 and B 4222 diagrams are can be according to mobile vector 4202 and 4210 and the He of visual field vector 4208 4212 by content alignment.FOV A 4218 are illustrated as that the content with visual field vector being aligned 4220 is presented.This can be due to moving The relatively low velocity of dynamic vector A 4202 and cause.This can also be due to leaving the bigger time quantum 4204 that angle A viewing spends Predict and cause.FOV B 4222 are illustrated as that the content with mobile vector being aligned 4224 is presented.This can be due to mobile arrow Measure the fair speed of B 4210 and cause.This can also watch the prediction of the shorter time amount 4214 for spending due to leaving angle B And cause.
Another aspect of the present invention is related to weaken the speed that the location of content within visual field changes.As shown in Figure 43 As, visual field vector can experience quick change 4304.This quick change can be isolated event or it can be It is made at time when other visual field vectors just occurring and changing or nearby.The head of wearer can come for some reason Back rotation.In embodiment, the quick continuous change in the vector of the visual field can cause the location of content within FOV 4302 to change Decrease speed 4308.For example, content can be with regard to visual field vector positioning, as described in this article like that, and in the visual field Quick change in vector can generally cause quick location of content to change;However, because visual field vector just continuously changes, institute Can be weakened with regard to the speed of the position change of visual field vector, it is slack-off or stop.Position speed changes can be based on the visual field Meansigma methodss that the change speed of vector, visual field vector change and be modified, or be otherwise modified.
Another aspect of the present invention is related to more than one content while being presented on the perspective optical system of HWC 102 In visual field and position with visual field direction a content and with a content being moved towards.Figure 44 illustrates two FOV A 4414 and B 4420, it corresponds respectively to the visual field vector A 4402 and B 4404 of two identification.Figure 44 is also shown in relatively The object being in the position of visual field vector A 4402 and B 4404 in environment 4408.When personnel are along visual field vector A During 4402 viewing, environmental objects 4408 can be seen at position 4412 by visual field A 4414.As illustrated, visual field court The TEXT close to environmental objects 4412 is rendered as to the content of alignment(Text).Meanwhile, other guide 4418 with movement It is present in visual field A 4414 at the position of the consistent alignment of vector.As translational speed increases, content 4418 can such as exist Shift as described herein.When the visual field vector of personnel is visual field vector B 4404, environmental objects 4408 are in visual field B It is not visible in 4420.As a result, the content 4410 of visual field alignment is not present in visual field B 4420;However, movement is right Accurate content 4418 is presented and still depends on the speed of motion.
Figure 45 be shown for 0 degree be moved towards start and with 114 degree be moved towards terminate path on shifting The sample data set of the dynamic personnel by environment, during the time, translational speed changes from 0 m/ seconds to 20 m/ seconds.Energy Enough see the visual field towards watching from side to opposite side with personnel and enterprising in the every side being moved towards while move Row change.There is big change of the visual field towards in when translational speed is 0 m/sec when personnel just stand still, afterwards It is the step change in being moved towards.
Embodiment provide for determine show direction process, its consider user movement boat by way of environment and Offer makes user be easily found the display direction of display information, while being additionally in response to different mobile, translational speeds or being just shown Information different type and the unencumbered see-through view of environment is provided.
Figure 46 illustrates visible see-through view when using HWC, and wherein information is by the see-through view of superimposition to environment On.Tree and building are practically in environment and text is shown on the see-through display so that it seems superimposition in environment On.Except text message(Such as instruct and Weather information)Outside, some augmented reality information are illustrated, and it is related to environment In neighbouring object.
In embodiment, determined based on mobile speed and show direction.Under the low speed, show towards can substantially with regard It is wild towards identical, and show at high speeds towards can substantially be moved towards it is identical.In embodiment, as long as user keeps Static, display information is just directly rendered the front in user and HWC.However, as translational speed increases(For example, higher than threshold Value or continuously increase, etc.), the direction watched regardless of user, show towards become substantially be moved towards It is identical, so that when user looks up in mobile side, display information is directly in the front of user and HMD and works as user Display information is invisible when watching to side.
The visual field towards in quick change can after be show direction in slow change, to provide head rotation The response of decrease.Alternatively, show towards being substantially time averaging visual field direction, so that display information is presented At a series of direction of the centre of the visual field directions in certain period of time.In this embodiment, if user stops Their head mobile, then show that direction gradually becomes to be moved in user and HMD towards identical and display information with the visual field Front display visual field in.In embodiment, when there is the visual field towards the two-forty for changing, the process lag time average The visual field towards to show direction impact.By this way, quick head movement is reduced to showing the impact of direction, and In the positioning for showing the display information within visual field by lateral stability.
In another embodiment, determined based on translational speed and show direction, wherein at high speeds, shown towards substantially Be moved towards it is identical.At moderate speed, show towards substantially with the time averaging visual field towards identical so that quick head Rotation is gradually weakened(damp out)And show towards the centre in the movement of head back and forth.
In yet another embodiment, it is determined that during how display information, including the type of just shown information.To The augmented reality information of the object being connected in environment gives the display direction for substantially matching visual field direction.With this side Formula, as user rotates their head, augmented reality information enters into related to the object in the see-through view of environment View in.Meanwhile, to being not linked to environment in object information give as described in previously in this manual based on Mobile type shows direction with determined by mobile speed.
In yet another embodiment, when translational speed is confirmed as higher than threshold value, shown information is showing visual field In move down so that the upper part for showing visual field has less information or without the information for showing, to carry to user For the unencumbered see-through view of environment.
Figure 47 and 48 illustrates the diagram of the see-through view of the display information including superimposition.Figure 47 illustrate immediately preceding from figure See-through view after quick change of the visual field direction that the see-through view illustrated in 46 is associated in the visual field towards on, wherein regarding The wild change towards in is from head rotation.In this case, display direction is delayed.Figure 48 illustrate how after a while when Between show towards catching up with visual field direction.Augmented reality information is maintained in the position shown within visual field, wherein can be by user Easily make and being associated with object in environment.
Figure 49 illustrates the diagram of the see-through view example of the display information including superimposition, and the display information of the superimposition exists Show that displacement downwards in the upper part of see-through view to provide unencumbered see-through view in visual field.Meanwhile, strengthen existing Real label is maintained in the position shown within visual field, therefore they easily can be associated with the object in environment.
In a further embodiment, in operator scheme(Such as when user just moves in the environment), digital content It is present at the side of the perspective FOV of user and enables a user to only watch in numeral by rotating their head Hold.In this case, when user just go ahead viewing when, such as when be moved towards match the visual field towards when, see-through view FOV does not include digital content.User is then digital then by the way that their head rotation is accessed into digital content to the side Content is moved laterally in perspective FOV of user.In another embodiment, digital content is ready to present and if receives To the instruction presented for digital content, then the digital content will be presented.For example, information can be ready to present and if Reach precalculated position or the visual field direction of HWC 102, then then can be with presentation content.Wearer can see to the side and interior Appearance can be presented.In another embodiment, user can be by watching in one direction predetermined amount of time, flashing, blink Eye or display can pass through eye imaging technology(For example, as herein in description elsewhere)What is captured is a certain Other patterns are moved in the region in visual field making content.
In yet another embodiment, there is provided operator scheme, wherein user can limit visual field direction, wherein associated is saturating Include digital content depending on FOV or do not include digital content.In this example, this operator scheme can be used in working environment, There when user is actively watching wall, digital content is provided within FOV, and when user watches towards corridor, FOV does not have Have and hindered by digital content.In another example, when user's level is watched, digital content is provided within FOV, but When user watches downwards(For example, desktop or cell phone are watched), digital content is removed from FOV.
Another aspect of the present invention is related to collect and using eye position and visual field orientation information.With motion direction, regard Wild direction, and/or eye position prediction(Sometimes it is referred to herein as " eyes direction ")Carry out wear-type calculating can be used for The wearer of identification HWC 102 can be captured and use to what obvious interested and information.In embodiment, can be with The characterization information in viewing information, because information is substantially related to what wearer watching.Viewing information can be used for exploitation For the personal profiles of wearer, it can indicate that wearer tends to that what is watched.From several perhaps multiple HWC 102 Viewing information can be captured so that group or crowd viewing tendency can be established.For example, if being moved towards and regarding It is wild towards being learned, then what prediction wearer watching and can be made and for generating the part of crowd's profile Or personal profiles.In another embodiment, if eyes direction and position, the visual field towards and/or be moved towards being learned, Can predict and watch what prediction.What can be related to understand close to wearer for prediction and this can be by establishing The position of wearer(For example, by GPS or other location technologies)And establish that known what mapping object in the zone comes Solution.Prediction can be related to interpret by the image of the other sensors or camera capture being associated with HWC 102.For example, if phase The image of machine capture mark, and camera and the visual field are towards being aligned, then predict that can be related to assessment wearer is watching institute State the probability of mark.Prediction can be related to capture images or other sensory informations, and and then perform object recognition analysis with It is determined that what is being watched.For example, wearer may be just walked in the street, and the camera in HWC 102 can be captured Image, and it is airborne in HWC's 102 or away from HWC 102 processor can distinguish face, object, labelling, image etc. and Can determine that wearer may always watch it or watch towards it.
The cross section of the eyeball of the wearer of Figure 50 HWCs of the diagram with focus point, the focus point can be with the present invention Eye imaging system be associated.Eyeball 5010 includes iris 5012 and retina 5014.Because the eye imaging system of the present invention System provides coaxial eye imaging with display system, it is possible to from where watching in eyes dead ahead and with wearer The visual angle of being aligned captures the image of eyes.In an embodiment of the present invention, eye imaging system can focus on wearer's At iris 5012 and/or retina 5014, with capture the eyes for including retina 5014 interior section or iris 5012 outward The image on surface.Figure 50 illustrate respectively with the light 5020 that is associated of image of capture iris 5012 or retina 5014 and 5025, wherein the optics being associated with eye imaging system is focused on respectively at iris 5012 or retina 5014.Illumination Light can also be provided in eye imaging system to illuminate iris 5012 or retina 5014.Figure 51 is illustrated including iris 5130 and sclera 5125 eyes diagram.In embodiment, eye imaging system can be used in capture includes the He of iris 5130 The image of part sclera 5125.Then image can be analyzed to determine color, shape and the pattern being associated with user.Entering In the embodiment of one step, the focusing of eye imaging system is adjusted the figure for enabling to capture iris 5012 or retina 5014 Picture.Illumination light can also be adjusted the pupil to illuminate iris 5012 or through eyes and retina 5014 is illuminated.Illumination luminous energy Enough it is that visible ray enables to capture the color of retina 5014 or iris 5012, or illumination light can be ultraviolet light(Example Such as, 340nm), near infrared light(For example, 850nm)Or medium-wave infrared light(For example, 5000nm)Enable to capture eyes Bloom spectral property.
Figure 53 diagrams include the display system of eye imaging system.Display system include polarized light source 2958, DLP 2955, Quarter-wave film 2957 and beam-splitting board 5345.Eye imaging system includes camera 3280, illumination light 5355 and beam-splitting board 5345. Wherein beam-splitting board 5345 can be towards the reflective polarizer on the side of polarized light source 2958 and towards camera 3280 Side on hot mirror.Wherein hot mirror reflects infrared light(For example, wavelength 700 is to 2000nm)And transmit visible ray (For example, wavelength 400 is to 670nm).Beam-splitting board 5345 can be by the film of multiple stackings, the cated substrate film of tool or in either side The rigid transparent substrate with film is constituted on face.By providing reflective polarizer on a side, from polarized light source 2958 Light reflect towards DLP 2955, wherein light by quarter-wave film 2957 once, with the image for just being shown by DLP 2955 Content is consistently reflected by DLP reflecting mirrors, and and then passes back through quarter-wave film 2957.In doing so, from The polarization state of the light of polarized light source is varied so that the light is transmitted and image by the reflective polarizer on beam-splitting board 5345 Light 2971 is delivered in lower optical device blocks 204, and there image is displayed to user.Meanwhile, from illumination light 5355 Infrared light 5357 by hot mirror reflect so that the infrared light is delivered in lower optical device blocks 204, there Eye illumination of the infrared light to user.The part of infrared light 2969 by user eye reflections, and the light passes back through Lower optical device blocks 204, capture by the hot mirror reflection on beam-splitting board 5345 and by camera 3280.In this enforcement In example, image light 2971 is polarized, and infrared light 5357 and 2969 can not polarized.In embodiment, illumination light 5355 is carried Captured in pairs for two kinds of different infrared wavelengths and eye image, wherein paired eye image is analyzed together to improve Accuracy based on the user's identification of iris analysis.
Figure 54 illustrates the diagram of the further embodiment of the display system with eye imaging system.Except the feature of Figure 53 Outside, this system includes second camera 5460.Wherein second camera 5460 is provided to capture eyes figure in visible wavelength Picture.The illumination of eyes can be provided by display image or by the perspective light from environment.Can such as by increasing display figure The brightness of picture or the part in increasing the white portion in display image to change display image are with will be by when the image of eyes The improvement illumination of the eyes of user is provided during capture.Further, for the purpose of capture eye image, the display image of modification Can briefly be presented, and the display of the image changed can be synchronous with the capture of eye image.Such as figure 54 illustrates As, it is seen that light 5467 is polarized when it is captured by second camera 5460, because it passes through beam splitter 5445 and beam splitting Device 5445 is towards the reflective polarizer on the side of second camera 5460.In this eye imaging system, it is seen that light eye Eyeball image can be captured while infrared eye image is captured by camera 3280 by second camera 5460.Wherein, camera 3280 Can be in terms of resolution and capture speed not with the characteristic of second camera 5460 and the associated respective image for being captured Together.
Figure 52 a and 52b illustrate captured eye image, wherein with structurized smooth pattern to eye illumination.In Figure 52 a In, eyes 5220 are shown with the structured light pattern 5230 of projection, wherein light pattern is the grid of line.Such as 5230 light pattern Can be provided by change light 5357 including diffraction device or refraction equipment by the light source 5355 that figure 53 illustrates, such as by As those of skill in the art are known.Visible light source can also be directed to the second camera 5460 and quilt that figure 54 illustrates Including it can include diffraction or refraction to change light 5467 so as to provide light pattern.Figure 52 b diagrams are when the eyes 5225 of user When watching to side, how 5230 structured light pattern is distorted into 5235.This distortion comes from following facts:Mankind's eye Eyeball be not in shape it is spherical, but iris from eyeball slightly project with form iris region in projection.As a result, When the image of eyes is captured from fixed position, the associated shape root of the shape of eyes and the structured light pattern of reflection Which direction is pointed to according to eyes and different.Changing in structured light pattern can be subsequently analyzed in the eye image of capture To determine the direction that eyes are being watched.
Eye imaging system can also be used to the assessment in terms of the health of user.In this case, from analysis iris The information that the image of 5012 capture is obtained is different from the information obtained from the image of the capture of analysis retina 5014.Its Used in illumination include retina 5014 eyes interior section light 5357 capturing the image of retina 5014.Light 5357 Can be visible ray, but in embodiment, light 5357 is infrared light(For example, 1 to 5 micron of wavelength), and camera 3280 is Infrared light transducer[sensor(For example, InGaAs sensors)Or low resolution infrared image sensor, it is used to determine by eyes The relative quantity of interior section absorption, reflection or the light 5357 for scattering.Wherein, the great majority in the light for being absorbed, reflected or being scattered The material that can be attributed in the interior section in the eyes including retina, wherein there are the tight clusters with thin-walled Blood vessel, to be made up of the material of blood the absorption, reflection and scattering are caused.When user just wears HWC, can be with rule It is spaced, carries out these measurements automatically after the event for being recognized or when being pointed out by PERCOM peripheral communication.In preferred embodiment In, illumination light is near infrared or mid-infrared(For example, 0.7 to 5 micron wave length)To reduce the heat waste of the eyes to wearer The chance of wound.In another embodiment, polariser 3285 by anti-reflective coating coated with reduce from this surface from light 5357, light 2969 or any reflection of light 3275, and thus increase the sensitivity of camera 3280.In a further embodiment, light source 5355 and camera 3280 together include spectrogrph, wherein by eye reflections light relative intensity in the ripple provided by light source 5355 It is analyzed to determine on a series of narrow wavelength within the scope of length by the spectrum of properties of eyes absorption, reflection or the light for scattering.Example Such as, light source 5355 can provide the infrared light of wide scope with to eye illumination, and camera 3280 can include:Grating, is used for By from the reflected light lateral dispersion of eyes into a series of narrow wavelength band captured by linear photoconductor detector, so as to press ripple Long measurement relative intensity, and the characteristic absorption spectrum for eyes can be determined in wide infra-red range.Further showing In example, light source 5355 can provide light(Ultraviolet light, visible or infrared light)A series of narrow wavelength with to eyes sequentially according to It is bright, and camera 3280 includes photoelectric detector, and it is selected as measuring a series of narrow wavelength in a series of proceeding measurements A series of relative intensity, proceeding measurements can be used in determining the spectrum of properties of eyes together.Determined by spectrum of properties it is right Constituted with the material for determining eyes compared with the known features spectrum for different materials afterwards.In yet another embodiment, shine Mingguang City 5357 is focused on retina 5014 and the spectrum of properties of retina 5014 is determined, and by the spectrum and pin The known spectra of the material in being likely to be present in the blood of user compares.For example, in visible wavelength, 540nm for Detection hemoglobin is useful and 660nm is useful for HbO2 Oxyhemoglobins are distinguished.In further example, in infrared ray In, various materials(Including:Glucose, carbamide, ethanol and controlled substance)Can be identified, such as by art technology As personnel are known.Figure 55 is shown with a series of examples for various controlled substances of the form measurement of infrared spectroscopy Spectrum(By written by C. Petty, B. Garland and Mesa Police Department Forensic Laboratory ThermoScientific Application Note 51242, it is incorporated in herein accordingly by reference).Figure 56 It is shown for the infrared absorption spectroscopy of glucose(Hewlett-Packard(Hewlett Packard Company )1999, G. Hopkins、G. Mauze;“In-vivo NIR Diffuse-reflectance Tissue Spectroscopy of Human Subjects ", it is incorporated in herein accordingly by reference).United States Patent (USP) 6675030(It is accordingly by reference It is incorporated in herein)Offer includes body part(Such as foot)Infrared scan near-infrared blood-glucose monitoring system. United States Patent (USP) discloses 2006/0183986(It is incorporated in herein accordingly by reference)Offer includes the photo measure of retina Blood-glucose monitoring system.Embodiments of the invention provide a kind of method, and it is used for by with one or more narrow wavelength In the iris of the eyes for illuminating wearer and measure by the relative intensity of the light of eye reflections recognizing relative absorbance spectrum And the absorption spectrum of measurement is relatively come in the blood of automatic measurement user compared with the known absorbing spectrum for certain material Certain material, such as be illuminated to determine the levels for being present in hemoglobin in the blood of user with 540 and 660nm.
Another aspect of the present invention is related to collect and using eye position and visual field orientation information.With motion direction, regard Wild direction, and/or eye position prediction(Sometimes it is referred to herein as " eyes direction ")Carry out wear-type calculating can be used for The wearer of identification HWC 102 can be captured and use to what obvious interested and described information.In embodiment, can With the characterization information in viewing information, because information is substantially related to what wearer watching.Viewing information can be used for out Personal profiles of the hairpin to wearer, it can indicate that wearer tends to that what is watched.From several perhaps multiple HWC 102 viewing information can be captured so that group or crowd's viewing tendency can be established.For example, if be moved towards and Towards being learned, then what prediction wearer watching and can be made and for generating one of crowd's profile in the visual field Divide or personal profiles.In another embodiment, if eyes direction and position, the visual field towards and/or be moved towards being learned, Can then predict and watch what prediction.What can be related to understand close to wearer for prediction and this can be by true The position of vertical wearer(For example, by GPS or other location technologies)And establish that known what mapping object in the zone comes Understand.Prediction can be related to interpret by the image of the other sensors or camera capture being associated with HWC 102.For example, if The image of camera capture mark, and camera and the visual field are towards being aligned, then predict that can be related to assessment wearer watches The probability of the mark.Prediction can be related to capture images or other sensory informations, and and then execution object recognition analysis To determine what is being watched.For example, wearer may be just walked in the street, and the camera in HWC 102 can catch Obtain image, and airborne can distinguish face, object, labelling, image etc. simultaneously in HWC's 102 or away from the processor of HWC 102 And can determine that wearer may always watch it or watch towards it.
In a further embodiment, there is provided a kind of method, its be used for by measure eyes flicker size in change come Change in the focusing distance that identification is associated with the eyes of user.Wherein when using provide be being used surrounding it is saturating Depending on view HMD when, the ability of the change in the focusing distance of identifying user eyes for determine user around in environment just It can be useful that what look at.Change in the focusing distance of identifying user eyes is selected for automatic display pattern(For example Shown image is selected to be bright or dimness)Can also be useful, this is by determining that user is just to look at institute The picture material of display(Wherein the focusing distance of eyes of user matches with the focusing distance of shown image)Or user Just look at surrounding(Wherein the focusing distance of eyes of user is different from the focusing distance of shown image)Come carry out.
Eye lens in human eye change radius of sphericity to provide adjustment or the change in focusing distance(Referring to S. Plainis, W. Charman, I. Pallikaris, “The Physiologic Mechanism of Accomodation ", Cataract Refractive Surgery Today Europe, in April, 2014, pp 23- 29).Figure 56 e show the eyes of the people of 29 years old in 0 to the 6 diopter adjustment scope measured by front and rear spheroid The chart of radius, as presented in the written papers of Plainis.This change in adjustment is corresponding to based on ocular lens What the diopter in the focal length of body changed changes from infinity to approximate 0.16 meter of focusing distance, wherein in lenticular focal length Relation and diopter between is given in below equation 1.
FL = 1/δ。
Wherein FL is the lenticular focal length in units of rice, and δ is lenticular diopter grading.Eye lens Front surface covered by cornea and iris so that the surface of eye lens is not exposed to environment, but the ball of eye lens Change in body radius is with the change in the radius of sphericity of the outer surface of cornea.These changes in the radius of sphericity of cornea The size that the eyes for being reflected that impact can be seen on the surface of eyes flash.As the radius of sphericity of eye lens subtracts It is little to provide higher levels of adjustment, the outside radius of sphericity of cornea also reduces, and this causes the size that reflected eyes flash Reduce.Similarly, as the radius of sphericity increase of eye lens is to provide lower level adjustment, the outside spheroid of cornea is partly Footpath increases, and this causes the size increase that reflected eyes flash.Thus, the measurement of the size of eyes flicker can be used for identification Change in the focusing distance of eyes of user.The measurement of the wherein size of eyes flicker can be from the use captured by eyes camera The image of the eyes at family is providing.
In order to provide the reliable detection of eyes flicker size, the light source of constant size should be provided, it is subsequently by cornea Outer surface is reflected in the form of eyes flicker.Figure 56 a and 56b show from the example eyes produced by indirect illumination source and flash 5612 and 5614, all LED in this way in the indirect illumination source, it is used for the eyes of lighting consumer for eye imaging, for The purpose of such as eye tracks or iris identification etc.In this case, LED is circular illumination source, therefore eyes flicker is also Circular.Figure 56 a show the larger-diameter eyes flicker 5612 in the image of eyes 5610, and it is corresponded to than by Figure 56 b Shown in small diameter eyes flicker 5614 indicated by the bigger focusing distance of focusing distance.LED illumination source can be carried The illumination for eye imaging is flashed and provides to provide eyes for light visible wavelengths or infrared wavelength light, as long as in HMD Eyes camera can capture the image of the eyes including the wavelength provided by light source(For example, as institute herein is public Described in the eye imaging opened and eye illumination system).Figure 56 c and 56d show the another of eyes flicker 5616 and 5618 One example, wherein light source are shown images so that eyes flicker 5616 and 5618 is in shape rectangle.Figure 56 c The eyes flicker 5616 bigger than the eyes flicker 5618 shown in Figure 56 d is shown, it indicates the eyes 5610 in Figure 56 c Focusing distance of the focusing distance more than the eyes 5610 shown in Figure 56 c.In embodiment, it is launched with from the light of eye reflections Can be with known pattern, therefore the change in pattern can with it is assessed for focus on change.
The measurement of the size flashed to eyes from known light source is to utilize(For example, as disclosed herein)In HMD Eyes camera easily realize.The resolution of the size of eyes flicker is by the pixel in the eye image from eyes camera Angular dimension(The horizontal number of such as pixel in eyes viewing field of camera/eye image)To determine.As such, it is advantageous to Eyes it is magazine compared with small field of view have more pixels.Change in the focusing distance that identification is associated with the eyes of user This method can be used together with any kind of optics for HMD, for example:Including diffractive optical devices, reflection Optics, hologram optical device, beam splitting optic device, waveguide optical devices, grating optics or multiple reflection device optics Device, as long as the optics includes the eyes camera for being imaged to the eyes of user.
In a further embodiment, there is provided the light source of the eyes flicker of reflection can be structurized with pattern to provide Light.The size of pattern or interval and then the change that can be used in identification focusing distance.
In another embodiment, the change for being recognized in the focusing distance of eyes of user is used for identification for shown Image focusing distance.Offer is directed to the focusing distance matched with the focusing distance of eyes of user of shown image and gathers Defocus distance is displayed for the image nervously watched, such as film.Conversely, for shown image and eyes of user The different focusing distance of focusing distance and focusing distance may be used to provide the display image nervously do not watched, such as electricity Pond designator, directional information, assembling are indicated or augmented reality object.
In embodiment, flicker size and placement measurement can be with other technologies(Such as convergence measurement)Combine using with Determine the focusing distance of user.
Figure 57 diagram scenes that wherein personnel walk with the HWC 102 on his head.In this scene, By GPS sensor(It can be another alignment system)Know the geospatial location 5704 of personnel, and his movement Direction, the visual field are known towards 5702 and can be recorded towards 5714 and eyes(For example, by being described herein System).There are object and personnel in the scene.Personnel 5712 can be by the system identifications of HWC 102 of wearer, and personnel can be with It is mapped(For example, the GPS location of personnel can be learned or distinguish), or otherwise know.Personnel may just wear Recognizable clothing(garment)Or equipment.For example, clothing can have a certain style and HWC can distinguish the style simultaneously And record it and watch.Scene also includes the object 5718 and the object 5720 for distinguishing of mapping.As wearer is moved through The scene, visual field direction and/or eyes direction can be recorded and transmit from HWC 102.In embodiment, visual field direction And/or eyes can be recorded towards the time for maintaining ad-hoc location.For example, if personnel seem in predetermined amount of time(Example Such as, 2 seconds or longer)Interior to watch object or personnel, then information can be transmitted as watching persistent information attentively, may be right as personnel The instruction of the subject interests.
In embodiment, visual field direction can be used in combination with eyes direction, or eyes direction and/or visual field direction can To be used alone.The visual field towards can carry out prediction wearer what direction watched because many times eyes with regard Open country is watched forward towards in identical general direction.In other scenes, the eyes possibly more desirable tolerance of direction, because eye What eyeball and visual field direction were not always in alignment with.In embodiment herein, example can be provided with term " eyes/visual field " court To it indicates that any one of eyes direction and the visual field towards in or both can be used in the example.
Figure 58 illustrate for receive, develop and use from(It is multiple)Being moved towards of HWC 102, the visual field are towards, eyes The system of direction and/or persistent information.Server 5804 can receive towards or watch attentively persistent information(It is regarded as persistent information 5802)For processing and/or using.Towards and/or watch persistent information attentively and can be used for generating personal profiles 5808 and/or group Group profile 5810.Person document 5718 can reflect the general viewing tendency and interest of wearer.Group profile 5810 can be The direction of different wearers and the set of persistent information are creating the impression to general group viewing tendency and interest.Group profile 5810 can be based on other information(Sex, like, do not like, bio information etc.)It is divided into different groups, so that Some groups can distinguish with other groups.This advertise when can be it is useful because advertiser may to male into Year sporter(It is relative with young woman)What is typically actively watching interested.Profile 5808 and 5810 and original direction and continue Information can be used by retailer 5814, advertiser 5818, trainer etc..For example, advertiser can make advertisement putting in environment In and may be to knowing that how many people watch the advertisement, they how long watch advertisement and where they feel after it is watched Interest.The information can serve as the value for assessing the advertisement and therefore for the conversion of the advertisement payment to be received is believed Breath.
In embodiment, the process is related to from the multiple Wearing-on-head type computers collection eye for being able to be close to the object in environment Eyeball and/or visual field orientation information.For example, many people may just walk region, and everyone may be just worn with following the trail of (It is multiple)The position of the eyes of wearer and possibly the wear-type meter of the visual field of tracking wearer and the ability being moved towards Calculation machine.Various HWC wear individuality and can then walk, ride or otherwise be able to be close to a certain object in environment (For example, shop, mark, personnel, vehicle, box, bag etc.).When each personnel passes through or otherwise walks close to object, eye Eyeball imaging system can determine whether personnel watch towards object.All of eyes/visual field orientation information can be collected And for forming the impression how crowd is reacted the object.Shop can just be sold and therefore shop can release Indicate the mark of this point.Storekeeper and manager are watching their mark and are feeling very much emerging possibly for knowing whether anyone Interest.Mark can be configured so that object interested in the zone, and when people navigates near the mark(May be by him GPS location determine), eyes/visual field can record the information relative to environment and mark towards determination system.Once eye Eyeball/visual field orientation information is collected and is determined towards associating between mark in eyes, or when eyes/visual field direction Information is collected and when eyes are determined towards associating between mark, feedback can back be sent to storekeeper, pipe How attracting reason person, advertiser etc. are used as the instruction of their mark.In embodiment, such as referred to by eyes/visual field direction Show, indicate that the effect in attracting attention is considered conversion and measures and affect one or more marks to throw in Economic worth.
In embodiment, can be by when the people in crowd is in object(For example, indicate)During the navigation of side, by mapping people The position and movement path of the people in group is generating the map of the environment with the object.What is be layered on this map can be each Plant the instruction of eyes/visual field direction.This indicate wearer can be with object related fields when they watch their object It is useful.Map can also have various positions of the people from environment how long to watch the object and they see object it Instruction where afterwards.
In embodiment, the process is related to collect multiple eyes/visual field directions, plurality of eye from Wearing-on-head type computer Each of eyeball/visual field towards in is associated from different predetermined objects in the environment.The technology is determined for different objects In which attract personnel attention it is more.For example, if there is three objects placed in the environment, and personnel enter ring Border, by environment, one or more and his eyes/visual field that he can be watched in object is towards can be on his road of navigating It is more long than continuing on other objects on one or more objects.This can be used for making or refining the personal attention letter of personnel Shelves, and/or it can be used in combination to determine group or people with the data of other the such people with regard to same or similar object The impression how group is reacted the object.By this way test advertisements can provide the good feedback of effect of advertising.
In embodiment, once in the eyes/visual field towards the alignment for existing and object interested between substantially, process Just can be related to capture eyes/visual field direction.For example, once the personnel with HWC may just navigate by environment and HWC is examined Measure the eyes/visual field towards and substantial registration between object interested or substantial registration on the horizon institute The generation of planning, the generation and/or persistence just can be recorded for using.
In embodiment, process can be related to collect eyes/visual field orientation information from Wearing-on-head type computer, and from wearing Formula computer collects the image of capture, and it is substantially captured while being obtained in eyes/visual field orientation information.This in information Two sections can be used in combination to obtain the understanding what watched to wearer and may be interested in what.The process can With further to by eyes/visual field orientation information and object, personnel or other thing phases for finding in the image for being captured Association.This can be related to process captured image so as to find object or pattern.In embodiment, fixation time or persistence Can be with measured and be used in combination with image procossing.The process still can be related to object and/or pattern is distinguished, but it Can be related to attempt identification personnel by more specifically recognizing the part in image with reference to image procossing to watch attentively within the time period What.
In embodiment, process can be related to according to predetermined geographic locus arrange predetermined eyes/visual field towards and Use them as triggering thing.In the eye that Wearing-on-head type computer enters geospatial location and is associated with Wearing-on-head type computer Eyeball/the visual field towards with predetermined eyes/visual field towards in the case of be directed at, system can collect presence substantially alignment the fact with/ Or system can record the identification eyes/visual field towards being kept substantially with predetermined eyes/visual field towards being directed at information how long, To form persistence statistics.This can eliminate or reduce the needs to image procossing, because triggering thing can be need not be to region Used in the case of imaging.In other embodiments, image capturing and process are performed with reference to triggering thing.In embodiment, touch Stimulating food can be a series of geospatial locations with correspondence eyes/visual field direction so that many places can serve as triggering When thing, its instruction personnel enter close to the region of object interested and/or the personnel in practice it appears that seeing See object.
In embodiment, eye imaging can be used for the image of two eyes for capturing wearer to determine the convergence of eyes Amount(For example, the technology by describing elsewhere herein), to obtain what focal plane wearer is just being absorbed on Understand.For example, if convergence measurement implies focal plane within 15 feet of wearer, even if eyes/visual field direction can To be aligned with the object more than 15 feet aways, it is also possible to determine that wearer is not watching object.If object is at 15 feet Within the focal plane of hint, then what was certain was that wearer is watching object.Figure 59 illustrates the position 5902 of instruction personnel Environment position locking digital content 5912.In the disclosure, term " blue army(BlueForce)" be generally used for indicating It is member that is known and being used or Team Member for its geospatial location.In embodiment, " blue portion Team " is used to refer to show that tactics equip with arms team(For example, police force, special service corps, security army, military forces, Ministry of State Security Team, intelligence corps etc.)Member term.In many embodiments herein, a member can be referred to as primary blueness Army member or the first blue army member, and exactly the member is just wearing HWC in the embodiment of many descriptions.Should manage Solution, the term is used to help reader and contributes to clearly appearing from for various scenes, and other members of blue army Or other people can have HWC 102 and with similar ability.In this embodiment, the first personnel are just worn with saturating Depending on visual field(“FOV”)5914 Wearing-on-head type computer 102.First personnel can have an X-rayed the FOV with ring around watching by FOV Border, and digital content can also be present in FOV, so that the first personnel can be strengthened in view by FOV in numeral The actual surrounding of viewing.The position of other blue army personnels is position known and in the building put at 5902 Place is instructed to.The position is in three dimensions(Longitude, latitude and height)Aspect be it is known, this can via GPS together with The associated altitude meter of other blue army personnels is determining.Similarly, the position for wearing first personnel of HWC 102 is also Know, a little 5908 are such as indicated as in Figure 59.In this embodiment, the compass of the first personnel is also known towards 5910 's.In the case of known to compass towards 5910, can estimate that the first personnel are watching the angle residing for surrounding. Virtual target line between one personnel positions 5908 and the position 5902 of other staff can be established in three dimensions and Close FOV 5914 is released from HWC 102.Then the virtual target line of 3 D tropism can be used in that ring is presented in FOV 5914 The digital content of border position locking, it indicates the position 5902 of other staff.The digital content 5902 of environment position locking can It is positioned within FOV 5914 so that content 5902 is perceived as the first personnel for just wearing HWC 102 position in environment The position 5902 of locked and labelling other staff in putting.
The virtual target line of three-dimensional localization can be by periodically(For example, per millisecond, it is per second, per minute etc.)Recalculate Holding and virtual target line being aligned are repositioned to the content 5912 for locking environment position.This can result in content 5912 Position 5908 independently of the first personnel for wearing HWC 102 and independently of HWC 102 compass towards and with other people The illusion being positioned in environment is stopped at the associated point in the position 5902 of member.
In embodiment, environment locking digital content 5912 can with the first member position 5908 and other people Target 5904 between the position 5902 of member is positioning.Virtual target line can be before the position 5902 with other staff be intersected Intersect with object 5904.In embodiment, the digital content 5912 of environment locking can be associated with object joining 5904. In embodiment, intersected object 5904 can by by the position 5902 and 5908 of two personnel and on map recognize obstacle phase Relatively it is identified.In embodiment, intersected object 5904 can by process from the camera being associated with HWC 102 or its The image of his sensor capture and be identified.In embodiment, digital content 5912 has the position for indicating to be in other staff Put 5902, the outward appearance of position in intersected object 5904, to provide the position 5902 of the other staff in FOV 5914 Clearer instruction.
Figure 60 diagrams are based between the position 5902 for wearing the position 5908 of the first personnel of HWC 102 and other staff Virtual target line digital content can how and where be positioned within FOV 6008.Except in FOV 6008 Outside positioning content in the position of virtual target line being aligned, digital content can be presented that so that when the first personnel focus on The digital content is able to be focused on by first personnel when at a certain plane in the environment or distance.The object A for being presented 6018 is the content being digitally generated, and it is rendered as the image at location of content A 6012.Position 6012 is based on virtual mesh Graticule.The object A 6018 for being presented is presented not only along virtual target line and at focal plane B 6014 so that when When the eyes 6002 of one personnel are focused at the something in the surrounding at the distances of focal plane B 6014, in FOV 6008 Content at position A 6012 is able to be focused on by the first personnel.The focal plane for arranging presented content is provided in eyes 6002 Focus on the content for not being able to focus on before set focal plane.In embodiment, this allows the content at the A of position not have There is the compass in HWC to indicate that the first personnel are presented when the side of other staff 5902 looks up, but the content will only exist First personnel are focused on when focusing on the direction of other staff 5902 and focus on the focal plane of other staff 5902.
The object B 6020 for being presented different with presented object A 6018 is compared virtual target lines are aligned.Presented Object B 6020 be also present at the location of content B 6004 of location of content A 6012 different focal planes compared with.Institute Content B 6020 of presentation is present in other focal plane, and this indicates that other staff 5902 are physically in other distance Place.If focal plane is fully different, the content at the A of position will be gathered at the time different from the content at the B of position Jiao, because two focal planes need the difference from eyes 6002 to focus on.
Figure 61 diagrams have several the blue army members at the position of the various viewpoints at the first personnel visual angle. In embodiment, relative position, distance and obstacle are modified can the digital content of the position of instruction other staff.For example, such as Fruit other staff can be seen that then digital content can be in the position of other staff by the first personnel by the FOV of the first personnel Place locks and digital content can have the position for indicating other staff just by effectively labelling and the type followed the trail of.If its His personnel are in the nearness of relative close, but can not be seen by the first personnel, then digital content can be locked into phase The object of friendship or region, and digital content can indicate that the physical location of other staff can not be seen, but labelling one As following the trail of other staff's general position.If other staff are not within predetermined nearness or otherwise from The view of one personnel is significantly more covered, then digital content can typically indicate direction that other staff are located at and region simultaneously And digital content can indicate that the position of other staff is not closely recognized or followed the trail of by digital content, but at other staff In general area.
With continued reference to Figure 61, several blue army members are present in various within the region that the first personnel are located at At position.Primary blueness army member 6102(For illustrative purposes, also commonly referred to as the first personnel, or wherein with FOV The personnel of HWC)Being capable of the visible directly blue army member in open area 6104.In embodiment, in primary blueness portion The digital content provided in the FOV of team member can be based on virtual target line, and indicate the open area test site of blue army member Virtually locked in the environment position of position 6104.Digital content can also indicate that the position of open area blueness army member Put labeled and just tracked.If blue army member becomes from the vision of primary blue army member to cover or with it His mode is become unavailable for if direct viewing, and digital content can change form.
Blue army member 6108 is covered from 6102 views of primary blue army member by obstacle, the obstacle close proximity In obscured member 6108.As depicted, obscured member 6108 is proximate in front wall in building One.In this scene, the digital content provided in the FOV of primary member 6102 can indicate obscured member 6108 General position, although and digital content can indicate the position of another member by reasonably well labelling, its is obscured Therefore it is accurate not as the member in direct view.Additionally, digital content can by virtually position lock onto by The a certain feature on building outside at the member of coverage.This can make environment locking more stable and also offer personnel The unknown to a certain extent instruction in position.
Blue army member 6110 is covered by multiple obstacles.Member 6110 is in building and in the He of primary member 6102 There is another building 6112 between obscured member 6110.In this scene, in the numeral in the FOV of primary member Holding spatially will extremely lack actual obscured member, and like this digital content may need with indicate it is obscured into But member 6110 is in the reliable sources that general direction numeral mark are not the ad-hoc locations for obscured member 6110 Mode is presented.
Figure 62 illustrates another method for positioning digital content within the FOV of HWC, and wherein digital content refers to Show the position of another personnel.The embodiment is similar to herein in conjunction with the embodiment described by Figure 62.In this embodiment, Main additional elements are to examine the first personnel 5908(The personnel for wearing the HWC that the FOV digital contents with position are presented)With position Put the additional step of the distance between other staff at 5902.Herein, diastimeter can be included in HWC and with certain Angular surveying distance, the angle is represented by virtual target line.The object in the path for covering virtual target line is found in diastimeter In the case of, the digital content in FOV is presented and can indicate this point(For example, as described elsewhere herein). Diastimeter confirms in the case where the end of the angle and predetermined distance that are limited by virtual target line has personnel or object, counts The position that word content can represent suitable is labeled, as described elsewhere herein.
Another aspect of the present invention is related to predict the movement of blue army member to maintain to blue army membership location Suitable virtual tag.Figure 63 diagrams wherein primary blueness army member 6302 just chased after using HWC 102 by strengthening environment The scene of the position of track other blue army members, as described elsewhere herein(For example, the figures above is such as combined Described in).Primary blueness army member 6302 can have the knowledge of Tactical Mobile plan 6308.Tactical Mobile plan Can be local(For example, on HWC 102, wherein the shared plan between blue army member)Or it is long-range(For example, in service On device and be sent to HWC 102, or be sent to HWC 102 subset it is shared for HWC 102)Maintain.In this feelings Under condition, tactical planning is related to the blue group of army for typically moving up in the side of arrow 6308.Tactical planning may affect The presentation of the digital content in the FOV of the HWC 102 of primary blueness army member.For example, tactical planning can aid in predicting it The position of his blue army member and virtual target line can be adjusted accordingly.In embodiment, in Tactical Mobile plan In region can by plus shade or colouring, or otherwise with the digital content in FOV come labelling so that primary blue Army member can manage his activity with regard to tactical planning.For example, he can be aware of one or more blue armies into Member just moves towards tactics path 6308.The movement that he can also be aware of in tactics path do not seem with blue army into Member is associated.
The inside IMU sensors that Figure 63 is also illustrated in the HWC worn by blue army member can provide the shifting to member Dynamic guidance 6304.This when GPS location should be updated and therefore update FOV in virtual tag position when known Aspect is not helpful to.This can also be helpful in terms of the effectiveness of assessment GPS location.For example, if GPS location Without renewal, but there is significant IMU sensor activities, then system can suspect the accuracy of recognized position.IMU believes Cease for the position for helping follow the trail of member in the case of GPS information is disabled can also be useful.For example, if GPS letters Number lose, then can use dead reckoning(dead reckoning), and the virtual tag in FOV can indicate team into Movement and indicating positions identification indicated by two of member is not preferable.Current tactical planning 6308 can be by periodically What the plan for updating and being updated also further refines and is present in the FOV of HWC 102.
Figure 64 illustrates blue army's tracing system of principle of the invention.In embodiment, blue army HWC 102 There can be directional aerial, its transmitting relative low-power direction RF signal, so that within the scope of relative low-power signal Other blue army members can receive and intensity and change intensity based on signal come the direction of assessment signal and/or away from From.In embodiment, the virtual tag of the personnel positions that such RF signals can be used in changing in the FOV of HWC 102 is followed the trail of Presentation.
Another aspect of the present invention is related to monitor the health of blue army member.Can be for health and pressure events certainly It is dynamic to monitor each blue army member.For example, member can have as it is herein elsewhere described in watchband or other can Wear biometric supervision equipment, and the equipment can continuously monitor biometric information and predict health concerns or Pressure events.Used as another example, the eye imaging system for describing elsewhere herein can be used for monitoring and normal shape The pupil dilation that condition compares is predicting head trauma(head trama).Each eye can be imaged to be expanded with checking in pupil Difference in is for instruction head trauma.Used as another example, the IMU in HWC 102 can be with monitoring personnel walking To door to find pattern in change, this can be head or the instruction of other wounds.For example, indicate what health or pressure were worried Can be uploaded to server from the biometric feedback of member can be with this for or information shared with other members Ground member shares.Once being shared, the digital content in FOV of the instruction with health or the position of the personnel of pressure events can With including the instruction of health event.
The wherein primary blueness army member 6502 of Figure 65 diagrams just monitoring have health event and make healthiness alarm from The scene of the position of the blue army member 6504 that HWC 102 sends.It is primary blue as described elsewhere herein The FOV of the HWC 102 of army member can include the position instruction of the blue army member 6504 with health concerns.In FOV Digital content can also include the instruction of the health status being associated with position instruction.In embodiment, non-biometric is passed Sensor(For example, IMU, camera, diastimeter, accelerometer, altitude meter etc.)May be used to provide health status and/or scene situation To blue team of army or other Local or Remote personnel interested in the information.For example, if in blue army member One is detected as from standing place quickly contacting to earth, then can send the alarm as following instructions:Fall down, personnel are in trouble And have to drop to the ground, be hit etc..
Another aspect of the present invention is related to the various prior actions of virtually labelling and event.For example, such as retouch in Figure 66 As painting, the technology for describing elsewhere herein can be used for constructing the virtual previous mobile route of blue army member 6604.Virtual route can use the method for describing elsewhere herein to be shown as primary blueness army member's 6602 Digital content in FOV.When blue army member moves along path 6604, he may virtually place event flag 6608, so that when another member watches the position, labelling can be shown as digital content.For example, blue army into Member can check and remove region, and and then indicate that the region is eliminated using external user interface or posture, and And and then the position will share by virtually labelling and with blue army member.Then, it is when someone wants to know about the position When no examined, he is capable of the information of viewing location.As indicated by herein elsewhere, if position is for member Be it is visible, then digital content can to indicate the ad-hoc location in the way of be shown, and if position is from the visual angle of personnel It is sightless, then digital content can be different to a certain extent, because it can not specifically labelling position.
Return to optical arrangement, another aspect of the present invention is related to optical arrangement, its provide numerical monitor content to Wear(For example, as in HWC 102)The eyes of the personnel of head mounted display, and allow personnel's see-through display So that digital content is that the see-through view to surrounding strengthens by person sensitive.Optical arrangement can have variable Optical element is penetrated, its see-through view being aligned with personnel so that the transmission of see-through view can be increased or reduce.This is at it Middle personnel want or will be preferably provided with highly transmissive see-through view and when in identical HWC 102 personnel want or will be by It is helpful in scene when being preferably provided with less perspective transmission.Lower perspective transmission can be used in bright conditions And/or be wherein expected in the condition of the more high-contrast of the content of numeral presentation.Optical system can also have camera, its By receive leave the light reflected from surrounding with the optical element of the surrounding see-through view being aligned of personnel and to week Collarette border is imaged.In embodiment, camera further can be aligned in half-light trap so that be not captured by a camera in camera The light for reflecting on direction and/or transmiting is captured to reduce veiling glare.
In embodiment, there is provided include the HWC 102 of the coaxillay aligned camera in direction watched with user.Figure 67 shows Go out the diagram of the optical system 6715 including absorption polarizers 6737 and camera 6739.Image source 6710 can include light source, Display and reflecting surface and one or more lens 6720.Image light 6750 is provided by image source 6710, wherein image light 6750 part is partially reflected combiner 6735 and reflects towards the eyes 6730 of user.Meanwhile, one of image light 6750 Dividing can be transmitted by combiner 6735 so that image light is incident in absorption polarizers 6737.In this embodiment, image Light 6750 is polarized light, and wherein the polarization state of image light 6750 is orientated relative to the axis of homology of absorption polarizers 6737, So that the absorbability polariser 6737 of incident image light 6750 absorbs.By this way, the face for being produced by effusion image light 6750 Portion's aura is reduced.In embodiment, absorption polarizers 6737 include ARC to reduce from absorption polarizers The reflection on 6737 surface.
Figure 67 further illustrates camera 6739, and it is used to capture the image of the environment on the direction that user is watching. Camera 6739 is positioned in absorption polarizers 6737 below and is positioned at below combiner 6735 so that from the light of environment 6770 part is reflected by combiner 6735 towards camera 6739.Light 6770 from environment can not polarized, so that A part for the light 6770 from environment reflected by combiner 6735 passes through absorption polarizers 6737 and exactly the light quilt Camera 6739 is captured.As a result, the light being captured by a camera is by with the polarization shape contrary with the polarization state of image light 6750 State.Additionally, camera 6739 is aligned relative to combiner 6735 so that the visual field that is associated with camera 6739 with by image light 6750 The display visual field of offer is coaxial.Meanwhile, transmit to provide ring from a part for the scene light 6760 of environment the device 6735 that is combined Eyes 6730 of the see-through view in border to user.Wherein, the display visual field being associated with image light 6750 typically with scene light 6760 it is associated in perspective visual field overlap, and thus the visual field of camera 6739 and perspective visual field are at least partly coaxial.Pass through Camera 6739 is attached to into the low portion of optical system 6715, camera 6739 by shown by the light 6770 from environment is regarded Field is moved as user moves their head, so that what the image captured by camera 6739 was being watched corresponding to user The region of environment.By making viewing field of camera with shown image and the scene view coaxial alignment of user, using the teaching of the invention it is possible to provide have The augmented reality image being aligned with the improvement of object in scene.This is because the image for being captured from camera 6739 provides use The accurate expression of the scene view at the visual angle at family.As an example, when the object that user is seen in scene is located at the see-through view of HWC Centre when, the object will be located at the centre of the image captured by camera, and any enhancing being associated with the object be showed Real image can be located at the centre of shown image.When user moves their head, see in perspective scene view The relative position of object will change, and the position of augmented reality image can in a corresponding way in shown image It is changed.When each in the eyes for user provides only camera 6739, it is also possible to which the accurate expression of 3D scene views is provided. This is important advantage provided by the present invention, because by the framework of HWC(For example, between eyes or in corner Place)Camera capture image of the image capturing with the scene visual angle lateral shift of user, and as a result, it is difficult to will increase Object in the scene that strong real world images are seen with the visual angle from user is aligned.
In optical system 6715 shown in Figure 67, absorption polarizers 6737 play the effect of following items simultaneously: For escape image light 6750 ligh trap, for camera 6739 image light 6750 light blocker(blocker)And be directed to Light 6770 from environment arrives the window of camera 6739.This is possible, because the polarization state and absorbability of image light 6750 The transmission axes perpendicular of polariser 6737, and the light 6770 from environment is not polarized, so that in the light 6770 of environment A part(It is the polarization state contrary with image light)Absorbability polariser 6737 is transmitted.Combiner 6735 can be any Partially reflecting surface, including simple partially reflecting mirror, trap reflecting mirror and holographic mirror.The reflectance energy of combiner 6735 Enough it is selected as more than 50%(For example, 55% reflectance and 45% absorbance on visible wavelength spectrum band), thus image Great majority in light 6750 will reflect towards the eyes 6730 of user and great majority in the light 6770 of environment are by direction Camera 6739 reflects, and this system will provide brighter display image, brighter capture images, with the dark of environment See-through view.Alternatively, the reflectance of combiner 6735 can be selected to be less than 50%(For example, in visible wavelength spectrum band Upper 20% reflectance and 80% absorbance), thus the device 6735 that will be combined of the great majority in image light 6750 is transmitted, and is come Great majority from the light 6770 of environment will be transmitted to the eyes 6730 of user, and this system will provide the brighter of environment See-through view, while providing dark display image and dark capture images.Like this, system can be designed to facilitate by with Use expected from family.
In embodiment, combiner 6735 is plane, with being sufficient to realize sharp keen display image and sharp keen The optical flatness of capture images, 20 light waves in all such as less than visible wavelengths(wave of light)Flatness.So And, in embodiment, combiner 6735 can be bending, and in said case display image and capture images all will distort, And this distortion will must carry out digital correction by associated image processing system.In the case of display image, with by Digital distortion is carried out to image on the contrary direction of distortion that the combiner of bending causes by image processing system, therefore two kinds abnormal Change cancels each other out and as a result user sees the display image not distorted.In the case of capture images, capture images exist By numeral distortion to offset the distortion caused by the combiner for bending after capture, so that image has been seen after image processing Not distort.
In embodiment, combiner 6735 is adjustable part reflecting mirror, and wherein reflectance can be changed or oneself by user It is dynamic to change preferably to be worked within varying environment condition or different service conditions.Adjustable part reflecting mirror can be electric Controllable mirrors, the e-Transflector that such as can be obtained from Kent Optronics(Electronics transflective reflector) (http://www.kentoptronics.com/mirror.html), wherein reflection can be adjusted based on applied voltage Rate.Adjustable part reflecting mirror can also be quick changeable reflecting mirror(For example, the switching time less than 0.03 second), wherein being felt The transparency known is obtained from the dutycycle that the reflecting mirror between reflective condition and transmissive state is switched fast.In embodiment, The image captured by camera 6739 can be by synchronization to occur when quick changeable reflecting mirror is in reflective condition, so as in figure As providing the light quantity of increase to camera 6739 during capture.Like this, adjustable part reflecting mirror allows the absorbance of partially reflecting mirror Accordingly change with environmental condition, such as absorbance can be low and saturating when environment is dim when environment is bright The rate of penetrating can be high.
In a further embodiment, combiner 6735 includes being coated in towards the heat reflection on the side of camera 6739 Mirror, wherein visible wavelength light are substantially transmitted and the spectral wavelength band of infrared light is substantially reflected and camera 6739 is caught Image is obtained, it includes at least a portion of infrared wavelength light.In these embodiments, image light 6750 includes visible wavelength light And a part for visible wavelength light the device 6735 that is combined is transmitted, wherein the light and then absorbability polariser 6737 are inhaled Receive.A part for scene light 6760 is made up of visible wavelength light and its device 6735 that is also combined transmits to provide the user with ring The see-through view in border.Light 6770 from environment is made up of visible wavelength light and infrared wavelength light.The one of visible wavelength light Part is combined device 6735 together with the essentially all infrared wavelength light within the spectral wavelength band being associated with hot mirror Reflect towards camera 6739, there through absorption polarizers 6737.In embodiment, camera 6739 is selected as including to light The sensitive imageing sensor of infrared wavelength, and absorption polarizers 6737 are selected as substantially transmiting two kinds of polarization states Light infrared wavelength(For example, ITOS XP44 polarisers, its transmission has two kinds of polarization shapes of the light of the wavelength higher than 750nm State:Referring to http://www.itos. de/english/polarisatoren/linear/linear.php), so that red The % of the increase of outer light is captured by camera 6739.In these embodiments, absorption polarizers 6737 are played for effusion image light The effect of 6750 ligh trap, and thus stop the image light 6750 in visible wavelength from camera 6739, and while Serve as the window of the infrared wavelength light 6770 from environment for camera 6739.
By the scene view coaxial alignment for making viewing field of camera and display image and user, using the teaching of the invention it is possible to provide with scene in The augmented reality image of the improvement alignment of object.This is because the scene from the visual angle of the capture images offer user of camera is regarded The accurate expression of figure.In embodiment, with the image that the coaxillay aligned camera of the view of user captures scene, processor and then knowledge , for the field positions to picture, it can be with shown visual field relevant position phase for object and identification not in capture images Compare, therefore then digital content is shown relative to the position of object.
Another aspect of the present invention is directed to use with the optical module of reflective display, wherein illuminating reflection using front light Display, the front light be arranged to with effective reflecting surface of reflective display in about 90 degree of angle guiding photograph It is bright.In embodiment, optical arrangement is light weight, little and produce high quality graphic in wear-type see-through display.
Figure 68 provides the cross section diagram of the compact optical display module for HWC 102 of principle of the invention, And for illustrating how light passes through the illustrative light rays of the component.Display module is by top optics and lower optical device Composition.Top optics includes reflectogram image source 6810, quarter-wave film 6815, field lenses 6820, reflective polarizer 6830 and polarized light source 6850.Illumination light 6837 is converted into image light 6835 by top optics.Lower optical device includes Beam-splitting board 6870 and rotoflector partially reflecting mirror 6860.Image light is delivered to and wear HWC 102 by lower optical device User.Compact optical display subass embly provides the user with the image light 6835 for passing on display image and the perspective for providing environment The scene light 6865 of view, so that user sees display image of the superimposition to the view of environment.
In the optics of top, linearly polarized photon is provided by polarized light source 6850.Wherein polarized light source 6850 can be wrapped Include one or more lamps, LED, QLED, laser diode, fluorescent lamp etc..Polarized light source 6850 can also be included with light The backlight assembly of scattering surface or bubbler across the output area of polarized light source equably extending light.Light control film is light-operated Structure processed can also be included to the distribution of the light for controlling to be provided by polarized light source 6850(Also referred to as cone angle).Photocontrol Film can include such as bubbler, oval bubbler, prism film and lenticular lens array.Photocontrol structure can include prism battle array The angular distribution of row, biconvex lens, cylindrical lenses, Fresnel lens, refractor, diffraction lenss or control illumination light 6837 Other structures.The output surface of polarized light source 6850 is for guaranteeing to be supplied to the illumination light 6837 of top optics linear The polarizer film of polarization.
The illumination light 6837 provided by polarized light source 6850 is reflected by reflective polarizer 6830.Wherein reflective polarizer 6830 It is oriented such that their the corresponding axis of homology is perpendicular to one another with the polariser on the output surface of polarized light source 6850.As knot Really, most of in the illumination light 6837 for being provided by polarized light source 6850 are reflected by reflective polarizer 6830.Additionally, polarization by reflection Device 6830 illuminates reflectogram image source at an angle so that the orienting reflex image source 6810 of illumination light 6837 reflects, thus 6810, as shown in Figure 68.
Illumination light 6837 is through field lenses 6820 and is then incident on reflectogram image source 6810.Illumination light 6837 is then By reflectogram image source(It is referred to as reflective display elsewhere also in this context)6810 reflections.Wherein, reflectogram image source 6810 Liquid crystal over silicon can be included(LCOS)Display, ferroelectric liquid crystal on silicon(FLCSO)Display, reflection liquid crystal display, cholesterol Liquid crystal display, bistable nematic liquid crystal displays or other such reflective displays.Display can be red with order Mono-color reflective display that color/green/blue illumination light 6837 is used together is used together with white illumination light 6837 Full-color display.Reflectogram image source 6810 is with the picture material pixel-by-pixel shown by reflectogram image source 6810 accordingly local Change the polarization state of illumination light 6837, be consequently formed image light 6835.If wherein reflectogram image source 6810 is that Chang Baise shows Show device, then the region of corresponding with the bright area of picture material image light 6835 is with contrary with the polarization state of illumination light inclined The state of shaking terminates, and the dark areas of image light 6835 with the identical polarization state of illumination light 6837 terminating(It should be noted that It is that the present invention can be used together with the normal black display for providing the polarization in image light adverse effect).Like this, initially The image light 6835 reflected by reflectogram image source 6810 has pixel-by-pixel the polarization state of mixing.Then image light 6835 passes through field Lens 6820, the distribution of its modification image light 6835 retains wavefront to match the requirement of lower optical device simultaneously(Such as, for example Amplify and focus on).When image light 6835 passes through reflective polarizer 6830, with the polarization state contrary with illumination light 6837 The bright area of image light 6835 is transmitted through reflective polarizer 6830, and has the figure of same state of polarization with illumination light 6837 As the dark areas of light 6835 reflect back towards polarized light source 6850, as a result, scheming after through reflective polarizer 6830 As light 6835 is linearly polarized in all pixels of image with single polarization state, but have pixel-by-pixel now different strong Degree.Therefore, reflective polarizer 6830 serves as first the reflector for illumination light 6837, and and then again acts as image The analysis polarizer of light 6835(analyzer polarizer).
Like this, the optical axis of illumination light 6837 and the image light between reflective polarizer 6830 and reflectogram image source 6810 6835 optical axis coincidence.Both illumination light 6837 and image light 6835 all pass through field lenses 6820, but wear in the opposite direction Cross.Wherein field lenses work and carry out spread illumination light 6837, therefore its whole effective coverage to reflectogram image source 6810 is carried out Illumination, and also expanded images light 6835, therefore it fills eyes frame 6882 after through compact optical display system.Pass through The compact optical for making the part in the compact optical display module being associated with illumination light 6837 and being associated with image light 6835 Part in display module overlaps, and reduces the size of population of compact optical display module.In view of related to field lenses 6820 The focal length of connection needs some spaces in compact optical display module, reflective polarizer 6830 and polarized light source 6850 to be located at otherwise In will being no space, therefore the size of population of display module is compacter.
Reflective polarizer 6830 can be the film of relative thin(For example, 80 microns)Or thin plate(For example, 0.2mm), such as exist As illustrating in Figure 68.Reflective polarizer 6830 can be the Asahi Kasei such as from WGF under one's name(Asahi Chemical Industry's strain formula meeting Society)Available wire-grid polarizer, or the available multi-layer dielectric film polarisers of the 3M such as from DBEF under one's name.As previously As description, reflective polarizer 6830 has two functions.First, reflective polarizer 6830 reflects and is carried by polarized light source 6850 For illumination light 6837 and orienting reflex image source 6810 illumination light 6837 is redirected.Second, reflective polarizer 6830 fills When the analysis polarizer of image light 6835, thus by 6835 turns of the image light of the mixed polarized state of the top of reflective polarizer 6830 Change the linearly polarized photon with single polarization state of the lower section of reflective polarizer 6830 into.It is being incident on reflective polarizer 6830 Illumination light 6837 when being incident on the relatively small part of reflective polarizer 6830, image light 6835 is incident on reflective polarizer On great majority in 6830 region.Therefore, reflective polarizer 6830 extends simultaneously at least across the Zone Full of field lenses 6820 And can extend across the Zone Full between field lenses 6820 and beam splitter 6870 such as shown in Figure 68.Additionally, reflection Polariser 6830 is at least in the incident part of illumination light 6837 at an angle with by the orienting reflex image of illumination light 6837 Source 6810 redirects.However, in a preferred embodiment, due to reflective polarizer(Such as, wire-grid polarizer)Can be to incidence Angle relative insensitivity, so reflective polarizer 6830 is flat surfaces, its at an angle with by illumination light 6837 towards anti- Penetrate image source 6810 to redirect, wherein the flat surfaces are substantially across complete between field lenses 6820 and beam splitter 6870 Portion region extends to make manufacturing easier in a continuous flat surfaces.The thin film or thin plate of reflective polarizer 6870 can be by Edge is retained in, to position to it with desired angle and makes surface flat.
Have many advantages herein with respect to the system and method for the descriptions of Figure 68 to 71.By avoiding the He of illumination light 6837 Glancing angle at all surface of the image light 6835 in compact optical display module, the scattering of light in component is reduced, and And as a result, the contrast of the image of the eyes 6880 for being made to present to user with more black black is higher.Additionally, reflected image Source 6810 can include compensation retarders film 6815, such as it is known to those skilled in the art that so that reflectogram image source 6810 can provide the more high-contrast image with the evenly contrast on the region of display image.Further, lead to Cross and the optical display subass embly being mainly made up of air is provided, the weight of compact optical display module is greatly decreased.By using pin Coincidence optical axis to the illumination light 6837 and image light 6835 and major part for optical display subass embly makes the He of illumination light 6837 Image light 6835 is overlapped, and reduces the size of population of compact optical display module.Wherein by making illumination light 6837 and image light 6835 pass through in the opposite direction field lenses 6820 to provide coincidence optical axis.In order to maintain the even polarization for illumination light 6837 State, field lenses 6820 are by low birefringence material(Such as glass or plastics(Such as can obtain from Osaka Gas Chemicals The 0KP4 for arriving))Make.By positioning polarized light source 6850 and associated illumination light 6837 below field lenses 6820, and By both optical paths of the image light 6835 at the illumination light 6837 and beam splitter 6870 at folding mirror polariser 6830, Greatly reduce the overall height of compact optical display module.For example, the overall height of compact optical display module can be less than 24mm, as measured by the bottom margin from the reflectogram image source 6810 for display to rotoflector partially reflecting mirror 6860 Like that, the display provides 30 degree of diagonal linear fields with 6 × 10mm eyes frame.
In the preferred case, the photocontrol structure in polarized light source 6850 includes plus lens, and such as positive Fresnel is saturating Mirror, positive diffraction lenss or positive refraction lens.Wherein positive Fresnel lens or positive diffraction lenss are preferably as they can be with non- It is often thin.Thus illumination light 6837 is focused to form less region or pupil at reflective polarizer 6830, its with optics The region of the eyes frame 6882 at the other end of device has direct relation, and image light 6835 is provided to use in the other end The eyes 6880 at family, as shown in Figure 68.Wherein plus lens will be from polarization in intensity and the aspect of angular distribution two The illumination light 6837 of light source 6850 is concentrated, with the etendue of matching optics system(etendue), and thus use image light 6835 filling eyes frames.Assembled by using plus lens be supplied to reflective polarizer 6830 from polarized light source 6850 Light, and and then come the effective coverage that spread illumination light 6837 illuminates reflectogram image source 6810 using field lenses 6820 because Illumination light 6837 is delivered substantially only in needing to be formed where image light 6835, so improve efficiency.Further, exist Illumination light 6837 outside pupil can be controlled by plus lens and pruned by the edge of sheltering of plus lens.By focus illumination light 6837 and to pupil outside light prune, it is adjacent with glancing angle impact to prevent illumination light 6837 in compact optical display module Near surface improves the figure of the eyes 6880 for being supplied to user to reduce scattering of light from there through more black black is provided Contrast as in.
It should be noted that, although Figure 68,69 and 70 are shown in which from rotoflector partially reflecting mirror 6860 to be provided behind shining The optical layout of Mingguang City 6837, but other optical layouts are also possible within the present invention.The position of polarized light source 6850 Can be changed at the side for instance in rotatable sweep reflecting mirror 6860, wherein reflective polarizer 6830 is oriented It is to receive illumination light 6837 from the side.And orienting reflex image source 6810 reflects the illumination light(It is not shown).
In a further embodiment, the part of the image light 6835 for back reflecting towards polarized light source 6850 is in polarized light It is recycled to improve the efficiency of polarized light source 6850 in source 6850.In this case, bubbler and reflecting surface are provided Behind polarized light source 6850, thus light polarization multilated and orienting reflex polariser 6830 back reflect.
In yet another embodiment, another reflective polarizer is provided in polarized light source 6850 and previously discloses Linear polarization behind.The corresponding axis of homology of wherein reflective polarizer and linear polarization is parallel to each other.Other polarization by reflections Then device is lighted back in backlight, and the backlight has the polarization state by device transmission is not linearly polarized.Reflect back into Light in backlight polarization state multilated and is gone out again through the bubbler that is associated with polarized light source 6850, there Penetrate, thus make light recirculation and improve efficiency.
In another embodiment, the system of principle of the invention includes eye imaging system.Figure 69 is compact light The diagram of display module is learned, it includes the eye imaging camera 6992 of the image of the eyes 6880 for capturing user, the user's Eyes 6880 are coaxial with the display image for being supplied to user, so as to reliably capture the full images of the iris of user.Eye Eyeball image camera 6992 is reflexed in lower optical device by reflective polarizer 6930, the reflective polarizer 6930 include towards The trap mirror coating of eye imaging camera 6992, the wavelength of the light that its reflection is captured by eye imaging camera 6992(For example, Near-infrared wavelength), while the wavelength that transmission is associated with image light 6835(For example, it is seen that optical wavelength).Shown in Figure 69 How the visual field that the diagram of eyes light 6995 is associated with eye imaging camera 6992 is the visual field of opposite, narrow, because under it passes through Portion's optics is by multipath reflection capturing the image of the eyes 6880 of user.However, in order that the energy of eye imaging camera 6992 Enough focus on the eyes 6880 of user, eye imaging camera 6992 needs have very near focusing distance(For example, 35mm). Additionally, the visual field of eye imaging camera and focusing distance must account for reducing what is provided by rotoflector partially reflecting mirror 6860 The effect of refractive power.In order to improve the efficiency that captures the light reflected from the eyes 6880 of user and brighter thus, it is possible to realize The image of eyes, rotoflector partially reflecting mirror 6860 can be coated with partially reflecting mirror coating, its serve as by eyes into As the completely reflecting mirror in the wavelength of the capture of camera 6992, such as coating can reflect the visible ray that is associated with image light 50% and be associated with eyes light 6995 the 90% of near infrared light.Wherein reflect similar with the associated change in polarization state In those being associated with image light 6835, but in contrary order, this is because eyes light 6995 is from user's Eyes 6880.LED or other midget lamps are provided as the eyes 6880 of proximal subscribers, are illuminated with the eyes 6880 to user, its In the wavelength that is associated with LED or other midget lamps be different from the wavelength that is associated with image light 6835, such as near-infrared Wavelength(For example, 850nm, 940nm or 1050nm).Alternatively, image light 6835 be used to illuminating the eyes 6880 of user and Low extinction ratio in reflection(For example, reflected extinction ratio< 15)Reflective polarizer 6930 used so that eyes light Some in line reflect towards eye imaging camera 6992.
In alternative embodiments, reflection and partially reflecting surface can extend transverse to the area for display image to user The side in domain.In this case, eye imaging camera can be located at neighbouring field lenses and point to a direction, with from The eyes of user are imaged after the beam splitter illustrated in Figure 70 and the reflection of rotoflector partially reflecting mirror.Wherein Figure 70 is Illustrate that eye imaging camera 7092 is positioned to the diagram of the side of field lenses 6820 and reflective polarizer 6830.Eye imaging phase Machine 7092 is oriented to so that the visual field captured by eye imaging camera 7092 includes the eyes 6880 of user, such as by eyes light As 7095 is illustrated.Quarter-wave film 6890 is also extending transversely the phase being changed with the polarization state according to image light Change the polarization state of eyes light 7095 with mode, so that through beam splitter 6870 and the eyes light of quarter-wave 6890 By the reflection of the part of rotoflector partially reflecting mirror 6860 and and then reflected and and then by eye imaging phase by beam splitter 6870 Machine 7092 is captured.By the side that eye imaging camera 7092 is navigated to field lenses 6820 and reflective polarizer 6830, reduce With the complexity that displays to the user that the optics that image is associated.Additionally, increased can for eye imaging camera 7092 Space, this is because reducing the interference with display optics.By the way that eye imaging camera 7092 is adjacent to into display Optics is positioned, and almost coaxially captures eye image with display image.
In yet another embodiment, the system of principle of the invention includes the field lenses with internal reflection polariser With one or more surfaces with refractive power.Figure 71 is to include that the field being made up of top prism 7122 and lower prism 7123 is saturating The diagram of the top optics of mirror 7121.Top prism 7122 and lower prism 7123 can be molded shaping or be ground and Polishing.Reflective polarizer 7124 is inserted on the flat surfaces between top prism 7122 and lower prism 7123.Reflection is inclined The device 7124 that shakes can be wire-grid polarizer film as mentioned previously or multi-layer dielectric polariser.Reflective polarizer 7124 can be used Transparent UV solidification binding agent is engaged in place, and transparent UV solidifications binding agent has and top prism 7122 or lower prism 7123 Identical refractive index.Typically, top prism 7122 and lower prism 7123 will be with identical refractive indexs.Its middle and upper part prism 7122 include the angled surface for illumination light 6837, and the illumination light will be provided as illuminating reflectogram image source 6810.By Including lamp as has been described earlier(Such as LED), backlight 7151, the light source of bubbler 7152 and polariser 7153 illumination is provided Light.Lower prism 7123 includes that curved surface is fed to the image light of lower optical device for control on exit surface 6835 wavefront.Top prism can also include curved surface being close on the upper surface of reflectogram image source 6810, such as in figure As illustrating in 71, for manipulating the chief ray angle of the light at the surface of reflectogram image source 6810.Illumination light 6837 Polarized by polariser 7153 before incident top prism 7122.The axis of homology of polariser 7153 and reflective polarizer 7124 is each other Vertically so that illumination light 6837 is reflected by reflective polarizer 7124 so that illumination light orienting reflex image source 6810 is reset To.Then the polarization state of illumination light 6837 is accordingly changed with the picture material to be shown by reflectogram image source 6810, As previously described, and the image light 6835 that obtains then passes through reflective polarizer 7124 to form and be displayed to use The associated bright area of the image of the eyes 6880 at family and dark areas.
In another embodiment, the field lenses 7121 of Figure 71 include polarization beam splitter cube, and it includes two prisms, That is top prism 7122 and lower prism 7123.In this case, reflective polarizer 7124 is substituted by Polarization-Sensitive coating, So that a kind of light of polarization state(Typically, such as S-polarization light)By reflection, the light of another kind of polarization state is transmitted.According to Mingguang City 6837 is then provided with the polarization state reflected by the coating, and image light be provided with by the coating transmit it is inclined Shake state.As shown in Figure 71, beam splitter cube is included in top prism 7122 or lower prism 7123 One or more curved surfaces.Beam splitter cube can also include wherein supplying one or more angled tables of illumination light Face.Angled surface can include photocontrol structure(Such as microlens array)To improve the uniformity of illumination light 6837, or Person's lenticular lens array is with collimated illumination light 6837.
In yet another embodiment, illustrate in Figure 71(It is multiple)Curved surface or(It is multiple)Angled surface can It is molded onto on the beam splitter cube of rectangle shaping by following steps:By UV curing materials(For example, UV curing acrylics) It is casted on the flat surfaces of beam splitter cube;Flat table will be placed into the transparent mould with the cavity for expecting bending Expect to bend to force UV curing materials to become on face;And using UV light with UV curing curing materials.Beam splitter cube energy It is enough by with making with the material of the identical or different refractive index of UV curing materials.
In a further embodiment, Polarization-Sensitive reflectance coating(Such as dielectric portion mirror coating)Can replace As reflective polarizer or beam splitter shown in Figure 68 and used.In this case, including the He of reflective polarizer 6830 The reflectance coating and plate of beam splitter 6870 includes Polarization-Sensitive coating, and it is substantially reflected with a polarization state(For example, S is inclined Shake)Light, and substantially transmit with another polarization state(For example, P polarization)Light.Because lighting source includes polariser 7153, it is not important that illumination light 6837 is the polarization state sensitivity in the 7124 pairs of reflections of a kind of polarization state and reflective polarizer , polarization state only needs to be maintained and is equably presented on the surface of reflectogram image source 6810.It is important, however, that Polarization state in 7124 pairs of transmissions of reflective polarizer is extremely sensitive(For example, extinction ratio>200)To become effectively polarization analyzing Device and the offer high-contrast image of eyes 6880 to give user(For example, contrast ratio>200).
In a further embodiment, field lenses 7121 shown in Figure 71 can be included with curved surface(Do not show Go out)Rather than the reflective polarizer 7124 of flat surfaces, and wherein reflective polarizer 7124 is not film but Polarization-Sensitive painting Layer, printing wire-grid polarizer or molding wiregrating pattern(Then it be metallized).In this case, top prism 7122 is with The matching that portion's prism 7123 is made as the curved surface with pairing is right, and the curved surface forms together the table of reflective polarizer Face.Wherein, Polarization-Sensitive coating, printing wiregrating or molding wiregrating pattern are applied to and top prism 7122 or lower prism 7123 associated pairing curved surfaces, and clear binder is applied to other mating faces with by the He of top prism 7122 Lower prism 7123 is bonded together, to form the field lenses 7121 with internal bending reflective polarizer 7121.
Another aspect of the present invention is related to manufacture and provide the optics unit used in for perspective computer display system Part.In embodiment, the optical element of light weight, low cost and high optical quality.
In head mounted display, beam splitter can be used in being directed towards reflectogram image source(Such as LCOS or DLP) Guide the illumination light from light source.The beam splitter of the low weight with flat reflecting surface is wherein desired to have, to provide Good picture quality.Flat reflecting surface is provided for eye imaging in eyes camera(It utilizes flat anti- Reflective surface comes towards the eyes of user to guide the visual field of eyes camera)When be particular importance.
System and method provide the light weight beam splitter being made up of the plastic components and inner panel element that mold, flat to provide Partially reflecting surface.Meanwhile, these parts form the triplet beam splitting optic device for including two molded elements and panel element.It is logical The panel element provided inside beam splitter is crossed, the match surface of molded element needs not to be optically flat, but panel element is provided Flat surfaces and index-matching material are used to that panel element to be bonded together with molded element.All three element can be Plastic components are reducing the weight and cost of light weight beam splitter.In order to provide refraction effect evenly, molded element and plate unit Part is preferably made up of the plastic material with similar refraction rate and with low birefringence.
Figure 72 illustrates the diagram of two molded elements 7210 and 7220.These molded elements are molded with relatively uniform thickness With in molding(Injection molding, compression molding or casting)Period provides the Uniform Flow of plastic material, and thus, it is possible to realize The low birefringence in the component for being molded.In order to further reduce the birefringence in molded element for being molded, tool The material for having low viscosity and low stress optical coefficient be it is preferred, including:From Osaka Gas(Osaka gas)Company 0KP4;From Zeonex F52R, K26R or 350R of Zeon Chemical;From Teijin(Supreme Being people is melted into)PanLite SP3810。
Molded element 7210 and 7220 can include flat surfaces and the surface with refractive power, wherein with refractive power Surface can include spherical or non-spherical deflection surface, Difraction surface or Fresnel surface.Flat surfaces, Difraction surface or luxuriant and rich with fragrance alunite Ear surface is for being preferred, and flat surfaces, spherical surface or aspheric surface with the surface that is associated of light of illumination image source Surface is preferred for the surface being associated with image light.Molded element 7210 is shown having spherical or non-spherical surface 7215 and molded element 7220 is shown having flat surfaces 7225, however shown any surface can be molded to it is flat Smooth surface or the surface with refractive power.
After molding, molded element 7210 and 7220 is machined to provide the angled surface of matching.Molding Element 7210 is illustrated in Figure 73, and wherein milling cutter 7328 is illustrated the angled surface 7329 of machining.Figure 74 shows The mould gone out after molded element 7210 and 7220 is machined to provide beamsplitter element 7430 and 7440 The diagram of modeling element 7210 and 7220, the beamsplitter element 7430 and 7440 is prism.Beamsplitter element 7430 and 7440 Angled surface is machined with machining angle.Alternatively, beamsplitter element 7430 and 7440 can by from Sheet material or molded disc(puck)Machining.By the angled table on the angled surface of machining or molding Under the either case that face is used in beamsplitter element, surface will not be optically flat.
Figure 75 illustrates the diagram of the triplet beam splitting optic device of assembling, wherein beamsplitter element 7430 and 7440 by It is assembled with part and reflects panel element 7560 to form beam splitter cube.Wherein beamsplitter element 7430 with 7440 by identical material Or with closely similar refractive index(For example, within mutual 0.05)Different materials make.Index-matching material quilt Interface between beamsplitter element and panel element.Index-matching material can be fluid, Photocurable adhesive, wet solid Change binding agent or hot setting adhesive.Index-matching material should have closely similar with the refractive index of beamsplitter element(Example Such as, within 0.1)Refractive index.
Part reflection panel element 7560 can be the lamella lucida with partially reflecting layer, and the partially reflecting layer is part reflection Coating or the part reflectance coating of stacking.Lamella lucida is preferably cast tablets(The such as casting of the unit with low birefringence propylene Acid), or low birefringence material(Such as 0KP4, Zeonex F52R, Zeonex K26R, Zeonex 350R or PanLite SP3810)Molded plaque(plaque).Additionally, lamella lucida should be optically flat(For example, on the surface within 20 microns And with the surface smoothness less than 15 nanometers), but optically flat surface is easily in sheet stock(sheet stock)In Arrive.Refractive index match material is used by the interface between beamsplitter element 7430 and 7440 and part reflection panel element 7560 Material, the shortage of the optical flatness on the surface of beamsplitter element 7430 and 7440 can be filled by index-matching material, with So that the flatness of reflecting surface is determined by the flatness of the part reflection panel element 7560 for easily obtaining, system is thus provided Make advantage.Partially reflecting layer can be partially reflecting mirror, reflective polarizer or wire-grid polarizer, and wherein reflective polarizer can be Coating or film and wire-grid polarizer can be the molded structures or film for being partially coated with conductive layer.Wherein suitable polarization by reflection Device film can be obtained from the available 3M under the trade (brand) name of DBEFQ, and wire-grid polarizer film can be under the trade (brand) name of WGF Available Asahi-Kasei is obtained.In a preferred embodiment, the lamella lucida of part reflection panel element 7560 has and beam splitter The refractive index of element 7430 and 7440 is closely similar(For example, within 0.1)Refractive index.
Figure 76 is shown for the diagram of the optical system of head-mounted display system.The system is made including reflective display For image source 7667, light source 7665, the light source 7665 can be the forsequential color light source or white as appropriate for image source 7665 Light source.Wherein light source 7665 provides illumination light 7674, as long as quarter-wave layer and image source 7667 or part reflection panel element 7560 are associated, and the illumination light 7674 can be polarized light, so that the polarization of illumination light 7674 is becoming image light 7672 It is changed before.Illumination light 7674 be partially reflected panel element 7560 surface reflection, and and then reflected by image source 7667, Then thus it become image light 7672 through part reflection panel element 7560.Then image light 7672 is partially reflected combination Device 7682 reflects so that image light is directed with display image to user towards the eyes 7680 of user, and while providing environment See-through view.In optical system, index-matching material can be used in image source 7665 and beamsplitter element 7440 it Between interface so that the surface of beamsplitter element 7440 needs not to be flat.By the present invention it is contemplated that the optical system The supplementary lens that has been not shown and other optical textures can be included with improve picture quality or change the shape of optical system because Son.
In another embodiment, beamsplitter element 7430 and 7440 is using injection molding or casts directly to be molded as Shape.Then the beamsplitter element of molding is assembled as shown in Figure 75, as being previously described herein.
In a further embodiment, the surface of beamsplitter element is molded or machining is with additional structure, with Further feature is just provided.Figure 77 is illustrated including the part reflection panel element 7760 for extending and the beamsplitter element 7740 for extending Light weight beam splitter 7750 diagram, which part reflecting surface is extended to provide additional areas to will be towards image source 7665 The illumination light 7674 of reflection.Wherein there is the partially reflecting surface for extending to be DLP and illumination light 7665 must in image source 7665 It is useful especially when must be delivered with angle of inclination.Figure 78 is illustrated including the light of the incidence surface 7840 for illumination light 7674 Amount beam splitter 7850, at an angle, therefore illumination light 7674 is substantially perpendicular through incidence surface for the illumination light 7674 7840。
In another embodiment, from single molded element machining beamsplitter element 7430 and 7440.Wherein single mould Modeling element is designed to provide desired optical surface.For example, can use as molded element 7210 shown in Figure 72 has In both surfaces of surface 7215 and 7225.Then a series of molded elements 7210 can be molded and some will be used for system Make the beamsplitter element 7430 of machining and some are used for beamsplitter element 7440.Then will be bonded using refractive index match Agent engages part reflection panel element 7560 with beamsplitter element 7430 and 7440, as being previously described herein.Replace Dai Di, single molded element 7210 can be designed with and reflect panel element 7560 by the extra of the dimension being added across part Thickness, so that single molded element 7210 will be sawn into, and be machined into or be laser-cut into the and of beamsplitter element 7430 7440。
In another embodiment, the first mold optical elements are in the geometry that can realize improved optical characteristics It is molded, the optical characteristics include:Low birefringence;The optical surface of mouldings is more accurately replicated(The focal power of reduction And irregular variation).First mold optical elements are then cut into different shape, and wherein cutting process leaves optically roughness table Face fineness.Then the second optical element with optics smooth surface is engaged to the first mould using refractive index matched adhesive The optically roughness surface of modeling optical element, to provide the optical element of combination.Refractive index matched adhesive filling first molds light The optically roughness surface on element is learned, so that optically roughness surface is no longer visible, and optics smooth surface is by the second optics Element is provided in combined optical element.Compared with the direct mold optical elements of the geometry with combined optical element, Improve the optical characteristics of combined optical element.Cutting surfaces can be flat or bending, as long as the first molding optical is first The cutting surfaces of part are essentially similar with the composition surface of the second optical element.Additionally, the first mold optical elements and the second light Learning both elements can be provided with Individual optical feature(Such as refractive power, wedge, diffraction, grating, dispersion, optical filtering and reflection) Optical surface.For example, optically flat surface is likely difficult to be molded on plastic lens.Lens can be molded spherical to provide Curved surface and another surface, another surface is substantially milled away flat with rough surface finish to provide Surface.Then the engagement of optically flat sheet material can be provided with optics to the surface of milling using refractive index matched adhesive The combined optical element of flat surfaces.
In another embodiment, the surface of beamsplitter element includes the structure being molded or machined into to illumination light 7674 Or image light 7672 is collimated, is assembled, is dissipated, is spread, is partially absorbed, redirected or polarized.By this way, reduce The quantity of the part in light weight beam splitter and reduce manufacture complexity and cost.
Multi-piece type light weight Solid–state Opticses device is described with reference to some embodiments;It should be understood that multi-piece type is light Amount Solid–state Opticses device can be with other optical arrangements(For example, other perspective wear-types for describing elsewhere herein show Device optical arrangement)It is used in combination.
In embodiment, the present invention is provided to the method for being directed at image, and the display for controlling to be associated with HMD Light within the optics of component is preventing from scattering and also capture the light of excess thus to improve the image for being supplied to user The method and apparatus of quality.
Figure 79 a are the schematic illustrations of the cross section of the display module for HMD.Wherein, display module includes top light Device 795 and lower optical device 797 are learned, it is operated together with display image to user while the perspective for providing environment is regarded Figure.The each side of top optics 795 will come into question in more detail herein.Lower optical device 797 can include using Thus image light 7940 come the image light 7940 manipulated from top optics 795 and is presented to the eyes 799 of user Optical element.Lower optical device 797 can include one or more lens 7950 and combiner 793.Combiner 793 will scheme As light 7940 present to the eyes 799 of user and while allow light 791 from environment through to reach the eyes 799 of user, So that user sees display image of the superimposition to the view of environment.
Figure 79 is the schematic depiction of the cross section of the top optics 795 for HMD.Including be light source 7910, Partially reflecting layer 7930, reflectogram image source 7935 and lens 7950.Light source 7910 provides illumination light 7920 to HMD.Illumination light 7920 pass through partially reflective layer 7930 is redirected to illuminate reflectogram image source 7935.Illumination light 7920 then with display image in Picture material accordingly reflected by reflectogram image source 7935 so that it is through partially reflecting layer 7930 and being consequently formed Image light 7940.By other optical elements in lens 7950 and lower optical device 797(It is not shown)Optically to manipulate figure As light 7940, so that display image is provided to the eyes 799 of user.Meanwhile, light source 7910, partially reflecting layer 7930 and Reflectogram image source 7935 forms the image source that front light shines.Wherein, reflectogram image source 7935 can include LCOS, FLCOS, DLP Or other reflective displays.Figure 79,80,82 and 83 are shown having illumination light 7920, and the illumination light 7920 is provided as making Obtain it to be incident on reflectogram image source 7935, as required for for DLP with angle of inclination.Figure 84 c, 84d, 85,86, 87th, 88 and 89 the illumination light 7920 vertically provided with reflectogram image source 8535 is shown having, as LCOS or FLCOS institutes As needs.The principle of the invention being described herein is applied to any kind of reflectogram for wherein needing veiling glare to reduce Image source.Light source 7910 can include light source(Such as LED, laser diode or other light sources(For example, as described in this article Like that))And various light control elements, including:Bubbler, prism film, biconvex lens film, Fresnel lens, refractor and Polariser.The polariser being included in light source 7910 makes the light polarization from the outgoing of light source 7910, so that illumination light 7920 is inclined Shake.Partially reflecting layer 7930 can be the partially reflecting mirror coating on substrate, or it can be reflective polarizer film, such as The wiregrating film supplied by Asahi-Kasei under one's name in WGF or the multilayer polarizer film supplied by 3M under one's name in DBEF.When partly anti- When to penetrate layer 7930 be reflective polarizer, illumination light 7920 is supplied as polarized light, wherein the polarization axle of illumination light 7920 relative to The polarization axle orientation of reflective polarizer, so that illumination light 7920 is substantially reflected.Then reflectogram image source 7935 includes four / mono- ripple delayer(For example, quarter-wave film), so that the polarization state of illumination light 7920 is by reflectogram image source Inverted during 79345 reflections.This makes the illumination light 7920 of reflection and then substantially can be transmitted by reflective polarizer. Through after partially reflecting layer 7930, light becomes image light 7940.Image light 7940 is then passed in lens 7950, the lens Lens 7950 are lower optical devices 797 or manipulate light to provide the one of display optics of the display image to the eyes of user Part.Although partially reflecting layer 7930 is illustrated as flat surface, inventor it had been anticipated that surface can be bent, into Shape, with simple or complicated angle etc., and such surface configuration is covered by the principle of the present invention.
In HMD of the image to two eyes of user is provided, expect to provide image so that they are aligned with each other.This Image by viewing be the image alignment for being perceived wherein seen with each eye be crucial for depth perception is realized It is particular importance during stereo-picture.In order to provide accurate image alignment, effective alignment of optics can be in optics device Part is performed after being assembled in the rigid frame of HMD.Wherein effectively alignment includes the part by mobile display component And it is aligned with each other that the image of each eye will be directed in the position for being attached to relative to each other by the part.For this purpose, figure 79 illustrate space 7952, and it extends around reflectogram image source 7935 so that reflectogram image source 7935 can laterally and rotation Ground is mobile.Light source 7910 and partially reflecting layer 7930 are arranged to illumination includes reflectogram image source 7935 and proximity space 7952 The region of a part.As a result, reflectogram image source 7935 can be moved during effective alignment procedures within space 7952 And do not lose illumination or make the brightness of display image degrade.Wherein movement of the reflectogram image source 7935 during effectively alignment can Including be supplied to the image of an eyes relative to the level of the image of the another eyes for being supplied to user, vertical and rotation The corresponding movement of mobile phase.When reflectogram image source 7935 is in size approximate 5 × 8.5mm, movement in size being capable of example 0.5mm in this way(This equates approximate the 10% of reflected image Source size)And like this space 7952 can be 0.5mm width or more It is wide.
However, by illumination region include space 7952, due to from the edge of reflectogram image source 7935 or from It is adjacent to the light that structure reflected or scattered in space 7952 and visible artifact can occurs.Therefore it provides mask 8055, its Extend across space 7952 from the edge of the effective coverage of reflectogram image source 7935 with cover the structure that is adjacent to space 7952 and The edge of reflectogram image source 7935, as shown in Figure 80.Mask 8055 is black and non-reflective, to be absorbed into Penetrate illumination light 7920.Additionally, mask 8055 is designed to not disturb the reflectogram image source 7935 of generation during effectively alignment It is mobile.For this purpose, mask 8055 can be rigid(For example, black plastic or the metal of black coating)And it is designed in neighbour Nearly structure(Such as light source 7910), partially reflecting layer 7930 edge and the side lower slider of the shell comprising front light.Substitute Ground, mask 8055 can be flexible(For example, black plastic film or black rubber film or band), so that mask 8055 connects at it Deform during tactile proximity structure.The figure of reflectogram image source 7935, light source 7910 and space 7952 when Figure 81 a illustrate viewed from above Show.Such as the image Feed Discovery typically with regard to all kinds, exist and be applied to image source around effective coverage 8165 Surface mask 8168, but the mask 8168 does not cover space 7952.Figure 81 b illustrate the system that illustrates in Figure 81 a Further illustrate, wherein mask 8055 is applied to reflectogram image source 7935 so that it is to cover space 7952 and not stop The mode of effective coverage 8165 is attached within mask 8168.
In another embodiment, the image for being produced by image source does not use all effective display area domains of image source, because There is the space for being used for making image shift in x and/or y visual angles within effective display area domain for alignment content in this.Example Such as, if it is observed that misalignment(As indicated above), replace physically mobile image source or except mobile image source it Outward, in the x and/or y direction numerical shift is aligned with creating more preferable combined arrangement to make image.It is initial invalid around content Viewing area can be referred to as content displacement relief area.
In for making the further embodiment of image alignment in the HMD with perspective, using with Figure 79 a or Figure 85 In the similar display module of the display module that illustrates the first image comprising feature is supplied to the eyes of user.Comprising Second image of the feature in same position is provided to the another eyes of user.The position of at least one of image source is right Move so that the first image and the second image alignment, are such as seen by the eyes of user within the space for being provided for adjusting afterwards Like that.This image alignment can also be completed using the eyes of camera replacement user.
In the case that wherein the first and second images are less than the effective coverage of reflectogram image source in size, thus stay Under be adjacent to the digital space of image, the digital space can be used in the numerical shift to image for further alignment Adjustment.This adjustment can be applied in combination so that the first image and the second image alignment with the movement of the physics of reflectogram image source.
Figure 82 is the diagram of top optics 825, and it includes the additional finishing polariser of element of top optics 795 8260.Wherein, the polarization axle for repairing polariser 8260 is oriented such that image light 7940 is transmitted to lower optical device(Not Illustrate).Light with contrary polarization state compared with image light 7940 is trimmed polariser 8260 and absorbs.Like this, typically With mixed polarized state from surface(The such as wall of shell 8262)The light of scattering will be trimmed polariser 8260 and partially absorb. As long as finishing polariser 8260 is located at after lens 7950, repairing polariser 8260 can also absorb by double in lens 7950 A part for the colored light that refrangibility causes.In this case, repair polariser 8260 and absorb and caused by birefringence The light with inverted polarized state and transmit with polarization state of the image light 7940 before lens 7950 light.One In the case of a little, it is advantageous to change the polarization state of image light 7940 to improve image light 7940 from the reflection of combiner 793, So that also needing to half-wave ratarder in addition to repairing polariser 8260.For the operation being adapted to, half-wave ratarder is positioned, its In its fast axle with the axis of homology of finishing polariser 8260 in 45 degree being orientated.In this case it is advantageous to, in finishing The lower section of polariser 8260 positioning half-wave ratarder(It is not shown), so that before being worked to image light by half-wave ratarder, Finishing polariser can absorb any elliptical polarization existed because of the birefringence in lens 7950.With this side Formula, any change in terms of the retardance of wavelength that may reside in half-wave ratarder will not work to increase ellipse Color artifact in polarizing or working to increase the image light 7940 caused by the birefringence in lens 7950.In example In, finishing polariser can be the polarizer film for being laminated to half-wave ratarder film, and ARC can be applied to it is outer Surface.
In Figure 83, partially reflecting layer 8330 is by the reflective polarizer film 8332 for being laminated to absorption polarizers film 8331 Many polarizer films of the stacking of composition.Wherein, reflective polarizer film 8332 is only sufficiently large with indirect illumination reflectogram image source 7935 Effective coverage 8165 illumination light 7920.Absorption polarizers film 8331 is more than reflective polarizer film 8332 and across anti- The whole apertures penetrated between image source 7935 and lens 7950 are extended, so that the side without absorption polarizers film 8331 Edge is visible, and all light from the reflection of reflectogram image source 7935 pass through absorption polarizers 8331.For working as reflectogram Situation when image source 7935 is LCOS, absorption polarizers 8331 are served as only allowing what the polarization state of image light was transmitted Analysis polarizer.Like this, reflective polarizer film 8332 only covers a part for absorption polarizers film 8331.Reflective polarizer film 8332 and the polarization axle of absorption polarizers film 8331 be aligned to so that the polarized light transmitted by reflective polarizer film 8332 Absorbability polarizer film 8331 is transmitted.By contrast, the polarized light absorbability for being reflected by reflective polarizer film 8332 is polarized Device film 8331 absorbs.Thus, the orienting reflex image source 7935 of illumination light 7920 incided in reflective polarizer film 8332 reflects, Wherein polarization state be inverted such that illumination light when it is changed into image light 7940 by reflective polarizer film 8332 and absorb Property polarizer film 8331 is transmitted.Meanwhile, incide in the absorption polarizers film in the region of reflective polarizer film 8332 The absorbability polarizer film 8331 of illumination light 7920 on 8331 absorbs.Reflectogram image source 7935 will not be illuminated by the way that absorption is this Effective coverage 8165 excessive illumination light 7920, veiling glare is reduced in display module and presentation is increased as a result To the contrast in the image of the eyes of user.By being directed at the inclined of reflective polarizer film 8332 and absorption polarizers film 8331 Shake axle, compared with the region of absorption polarizers film 8331 is only included, is polarizing including reflective polarizer film 8332 and absorbability Transmission in both regions of device film 8331 only reduces approximate 12%.In view of position of the partially reflecting layer 8330 in optical system Put and its away from reflectogram image source 7935 the fact, with the partially reflecting layer 8330 being made up of the multiple polariser being laminated On transmission in local difference the brightness uniformity in being supplied to the image of the eyes of user is had into very little impact. Additionally, the fact that partially reflecting layer 8330 is away from reflectogram image source 8330 make the edge of reflective polarizer film 8332 be it is fuzzy, As seen by user.
Figure 84 a and 84b are illustrated and are made up of the reflective polarizer film 8430 and 8431 for being laminated to absorption polarizers film 8432 Partially reflecting layer 8330 example diagram.Reflective polarizer film 8430 and 8431 is cut into the shape for only covering following regions Shape, illumination light 7920 will be reflected to illuminate the effective coverage 8165 of reflectogram image source 7935 at the region.Reflective polarizer Shape required for film will change depending on the type of front light.For which part reflecting layer 8330 is proximally located at reflectogram The front light illustrated in Figure 83 at image source 7935, the shape of reflective polarizer film 8431 will be rectangle or ellipse, such as As illustrating in Figure 84 b.Partially reflecting layer 8530 and reflectogram image source 8535 are located at for lens 8550 are included therein Between Figure 85 in front light in the display module that illustrates, illumination light 8520 changed from light source through the impact of lens 8550 The distribution of the illumination light 8520 required for 8510.As a result, illumination light 8520 can cover the one of only partially reflecting layer 8530 The use of part and the multiple polariser being laminated is favourable.In embodiment, in the partially reflecting layer of stacking, reflection is inclined The device film that shakes can cover 80% of the region less than absorption polarizers film.In a further embodiment, it is anti-in the part of stacking In penetrating layer, reflective polarizer film can cover 50% of the region less than absorption polarizers film.In this case, part is anti- Penetrate the reflective polarizer film 8430 that layer 8530 can include having the shape similar to the shape illustrated in Figure 84 a.Any In the case of, with front light in optical element and HMD display module associated by display optics in concert with selecting The shape of reflective polarizer film.
Figure 84 c are shown for the example illustration of the front light of the display module similar to the display module illustrated in Figure 85, The multiple polarizer film 8436 being wherein laminated is shown having the curved shape of complexity, its similar to central flat portion and The S of crooked end.The multiple polariser 8436 of stacking includes reflective polarizer film 8438 and absorption polarizers film 8437.Illumination Light 8520 includes the ray 8522 being incident in reflective polarizer film 8438 and is incident on penetrating on absorption polarizers film 8437 Line 8521.Due to the polarization and the polarization axle of reflective polarizer film 8438 and absorption polarizers film 8437 of illumination light 8520 Alignment(As being previously described herein), ray 8522 is reflected by reflective polarizer film 8438 and ray 8521 is inhaled The property received polarizer film 8437 absorbs.By this way, prevent ray 8521 from contributing veiling glare.Absorb ray 8521 be it is beneficial, This be because they can not contribute image light 8540, because if their stacked multiple polarisers 8436 reflect then they By on the reflectogram image source 8535 being incident on outside effective coverage 8165, and if their stacked multiple polarisers 8436 are saturating Penetrate, then they will be incident upon on side wall of outer shell 8262.Therefore, by absorbing ray 8521, the multiple polariser 8436 of stacking Reduce veiling glare and thus improve the contrast being shown in the image of user.
Figure 84 d are shown for the further example of the front light of the display module similar to display module shown in Figure 79 Diagram, which part reflecting layer 7930 includes the multiple polarizer film of the stacking with curved surface.The polariser of stacking includes Absorption polarizers film 8442 and the reflective polarizer film 8441 of stacking.Reflective polarizer film 8441 is positioned in and wherein illuminates In the core of the absorption polarizers film 8442 that the orienting reflex image source 7935 of light 7920 is reflected.Reflective polarizer film 8441 and absorption polarizers film 8442 polarization axle it is parallel to each other alignment and with the illumination light provided by polarized light source 7910 7920 polarization axle is vertical.The ray of the illumination light 7920 being incident on the partially reflecting layer 7930 outside reflective polarizer film 8441 8421 absorbability polarizer films 8442 absorb.Reflection source 8535 includes quarter-wave layer 8443 so that illumination light 7920 Polarization axle be changed during the process reflected from reflectogram image source 8535.As a result, the illumination light 7920 of reflection is anti- Penetrate polarizer film 8441 and absorption polarizers film 8442 is transmitted, thus become image light 7940.By incident in ray 8421 In outer surface(Such as shell wall)Or them are absorbed before other optical surfaces, veiling glare is reduced, and increase as a result The contrast being supplied in the image of the eyes of user is added.Although it should be noted that Figure 84 c and 84d illustrate polarization by reflection Device film is oriented to the veiling glare on the left side and right side for reducing to illustrate in figure freely, but reflective polarizer can similarly by It is positioned to reduce the veiling glare on the direction in the paper as shown in figure and outside paper.Figure 84 a and 84b are illustrated and are positioned at absorbability Reflective polarizer film 8430 and 8431 in the center of polariser 8432, so as to reduce in all directions spuious Light.The importance of the present invention is to obtain this in the case of the brightness without the image for reducing the eyes for being supplied to user Veiling glare is reduced, because anti-on Zone Full of the reflective polarizer film 8430 and 8431 required for reflectogram image source is illuminated completely Penetrate illumination light.
Figure 85 is shown for the schematic illustration of the display module of HMD, wherein the optical element of front light and display optics device Part is overlapped, because lens 8550 are located between partially reflecting layer 8530 and reflectogram image source 8535.Display module is then by top light Learn device and lower optical device composition.Top optics includes reflectogram image source 8535, lens 8550, partially reflecting layer 8530 and light source 8510.Illumination light 8520 is converted into image light 8540 by top optics.As shown, lower optical Device includes beam-splitting board 8580, quarter-wave film 8575 and rotoflector partially reflecting mirror 8570(With illustrate in Figure 79 a Those similar lower optical devices are also possible).Image light 8540 is delivered to lower optical device the eyes of user 8582.Such as previously herein statement, display module provide the user with the image light 8540 of passing on display image and The scene light 8583 of the see-through view of environment is provided, so that user sees display image of the superimposition to the view of environment.
Figure 85 illustrates display module, and which part reflecting layer 8530 is single planar film.However, using such as in Figure 86 The part charge reflecting layer 8630 for illustrating can be favourable.By this way, the core 8631 of partially reflecting layer 8630 Angle can be chosen so as to differently positioned light source 8610, so as to reduce be associated by lens 8550 or with display module Pruning of the other parts of support structure to illumination light 8620, and thus improve the display image seen by the eyes 8582 of user In brightness uniformity.For this purpose, the comparison of Figure 85 and Figure 86 illustrates the angle of the core by changing section reflectance coating, light The position in source 8610 moves down and illumination light 8620 is increased relative to the gap of lens 8550.
Part charge reflecting layer can be used together with various geometries and composition.Figure 86 is illustrated including with three The part charge reflecting layer 8630 of the Z-shaped shape of folding of planar section.Figure 87 illustrates part charge reflecting layer, and it includes and is scheming The similar S-shaped shape with the end and central flat section 8731 being bent of the shape that illustrates in 84c.Part charge reflecting layer Single part reflecting layer can be included(Such as reflective polarizer film or partially reflecting mirror film).Additionally, illumination light 8620 can be only Reflect from central flat section or it can be from central flat section plus in other sections in part charge reflecting layer One or more reflections.Alternatively, partially reflecting layer 8630 can include multiple polarizer film with optionally anti-only in part That penetrates layer is actually needed to come reflected image light with offer part reflection on the part for equably illuminating reflectogram image source 7935 Layer, as being previously described herein.Figure 88 illustrates display module, and which part reflecting layer 8830 is by with core The multiple polarizer film composition of 8831 stacking, the multiple polarizer film of the stacking includes reflective polarizer film and its residue Part is absorption polarizers, as being previously described herein.The segmented shape in which part reflecting layer 8830 with The shape illustrated in Figure 86 is similar.Figure 89 illustrates display module, and which part reflecting layer 8930 is by with core 8931 The multiple polarizer film composition of stacking, the multiple polarizer film of the stacking includes reflective polarizer film and its remainder is Absorption polarizers, as being previously described herein.The segmented shape in which part reflecting layer 8930 with Figure 87 The shape for illustrating is similar.Although Figure 88 and 89 is shown as reflective polarizer film only to occupy the He of part charge reflecting layer 8830 respectively 8930 flat central section, but reflective polarizer can be extended adjacent on demand in section with anti-according to equably illuminating The pattern penetrated required for image source 8535 carrys out indirect illumination light 8620.Alternatively, when reflective polarizer part is similar in Figure 84 a It is related to part charge reflecting layer 8830 and 8930 when being shaped to keep the part of reflective polarizer 8430 flat as illustrating The section of connection can have 3D shape.
In a further embodiment, reflective polarizer film is laminated on flexible transparent support film to increase flexibility, and And absorption polarizers film is single layer.Figure 90 is illustrated by the reflective polarizer film for being laminated to flexible transparent support film 9043 The partially reflecting layer 9030 of 8441 compositions.Wherein flexible transparent support film 9043 not indirect illumination light 7920 or change illumination light 7920 polarization state, and as a result, ray 8421 passes through flexible transparent support film 9043.The mesh of flexible transparent support film Be supporting reflex polarizer film 8441, while allow partially reflecting layer 9030 basically as only reflective polarizer film 8441 It is flexible like that.Absorption polarizers film 9042 is then provided with to be adjacent to the single layer of the positioning of partially reflecting layer 9030.Though So absorption polarizers film 9042 can be on demand flat or be curved to be matched with free space, but preferred Embodiment in, absorption polarizers film 9042 is bent preferably to be positioned, with absorb be incident on reflective polarizer film The ray 8421 on partially reflecting layer 9030 outside 8441, as illustrated in Figure 90.
In yet another embodiment, the part that reflective polarizer film is modified to make illumination light incident is transparent and non-anti- Penetrate, it is not necessary to which the illumination light incidence is illuminating the effective coverage of reflectogram image source, and individually absorption polarizers quilt It is provided as absorbing the light for being transmitted through non-reflective portion.The figure of the partially reflecting layer 9130 that Figure 91 is made up of reflective polarizer film Show, which part 9143 is modified to transparent and non-reflective, and part 9141 is reflective polarizer.Like this, polarization illumination Light 7920 is reflected by reflective polarizer part 9141 and is transmitted by the part 9143 changed.The quilt of absorption polarizers 9042 It is provided as being adjacent to the individual course of partially reflecting layer 9130, so that the ray 8421 of illumination light 7920 is by the part 9143 changed Transmit and absorbed by absorption polarizers.The wherein axis of homology and absorption polarizers of reflective polarizer part 9141 9042 axis of homology parallel alignment.Can by etching reflective polarizer film when reflective polarizer film is wire-grid polarizer, and And the plain conductor of wiregrating in the part of modification is thus removed realizing the modification of reflective polarizer film.Alternatively, wiregrating is inclined Shake device can during metal deposition step the masked shaped portion to provide wire-grid polarizer during manufacture.By modification Reflective polarizer film provides the advantage of the flexibility of partially reflecting layer 9130 and is not substantially changed by described, and As a result, partially reflecting layer 9130 is in the part 9143 and reflective polarizer part 9141 of modification, and both middle holdings are uniform soft Property.The another advantage provided by using the reflective polarizer film of modification is from the part 9143 of modification to polarization by reflection The transition of device part 9141 does not include sharpened edge, and the sharpened edge by edge because of being scattered or from thickness Change the change in optical density (OD) and cause the visible artifact being supplied in the image of the eyes of user.Such embodiment Other kinds of display module can also be applied to, the display module for such as illustrating in Figure 85.
In yet another embodiment, partially reflecting layer includes being laminated to the reflective polarizer film of absorption polarizers, and Partially reflecting layer includes flat and sweep.Figure 92 is shown for similar to the display module illustrated in Figure 79 a Show the diagram of the partially reflecting layer 9230 of the additional stacking of front light of component, it is to be laminated to suction that the partially reflecting layer 9230 of stacking has The part of the reflective polarizer of the property received polariser 9230.Which part reflecting layer 9230 is divided with planar section and curved section Section.By including planar section in the part of the partially reflecting layer 9230 for being reflective polarizer 9241, improve and be reflected to The uniformity of the illumination light 7920 on reflectogram image source 7935, because the greater part of light source 7910 is mapped to image, such as exists In Figure 92 it can be seen that as.Wherein when using small-scale light source and associated light control film(Such as bubbler)When, reflect The major part of source region is penetrated to avoid being by the darker or brighter line across image of the dim spot on light source and bright spot generation Important.Including that planar section is decreased in partially reflecting layer 9230 is supplied to the local in the image of the eyes of user abnormal Become, the local distortion be the optical path length that caused by the change in the surface angle due to being exposed in light or Local in local refraction changes caused.Such embodiment can also be applied to other kinds of display module, such as The display module for for example illustrating in Figure 85.
In the head mounted display of the display image on superimposition to the transmission views of environment is provided, with high perspective Transmission be it is favourable, therefore user can preferably with environmental interaction, and cause environment in people it can be seen that the eye of user Therefore they feel to contact with more with user eyeball.It is further advantageous that with low clearance thin optical device module so that Head mounted display is more compact and thus more attractive.
Figure 93 illustrate provide the user with display image and while providing the diagram of the optical device module of high perspective transmission.With This mode, user is provided with display image of the superimposition to clearly environmental view.Optical device module includes combiner 9320, it can have great majority of the transmission in the available light of environment(Visible transmission more than 50%)Part reflection Mirror coating, wherein the transmission higher than 70% is preferred.For example, combiner 9320 can have wideband portions reflecting mirror, its reflection In whole visible wavelength bands less than 30% and transmit more than 70%.Alternatively, combiner 9320 can reflect with trap Mirror coating, the zone of reflections of wherein trap mirror coating is matched with the wavelength band provided by light source 9340, wherein light source 9340 Narrow wavelength band can be respectively provided with including each(For example, 50nm broadbands or less, full width at half maximum (FWHM))One or more LED, QLED, Diode laser or other light sources.Trap mirror coating can provide for example big in the wavelength band provided by light source 9340 In 20% reflectance(For example, 50% reflectance), while providing in the remaining wavelength band in visible ray more than 80% transmission.For The full-colour image to be provided by optical device module, needs at least three kinds LED with complementary color(Such as, red, green and indigo plant Coloured light, or aeruginouss, magenta and sodium yellow).In a preferred embodiment, combiner 9320 reflects with trichroism trap Mirror, the light within wavelength band that its reflection is provided by light source 9340 more than 50%, and transmit across whole visible wavelength bands The meansigma methodss more than 80%.By this way, trichroism trap mirror coating is compared with previously described partially reflecting mirror coating There is provided the efficiency for improving.In this example, if combiner transmits offer from the 75% of the visible ray 9362 of environment, portion Divide mirror coating by the 25% of only reflected image light 9360, so that the 75% of image light will be transmitted through combiner and incite somebody to action The not brightness to being supplied to the image of the eyes 9310 of user is contributed.By contrast, trichroism trap mirror coating can be used Image light 9360 on the wavelength of light that reflection is provided by the LED in light source 9340 more than 50%, while transmission be not by The remaining wavelength of the visible ray that LED is provided more than 90% so that the average transmission on whole visible-range is more than 75%. Therefore, in terms of the ability towards the reflected image light 9360 of eyes 9310 of user, trichroism trap reflecting mirror is partially reflecting mirror Twice it is efficient like that.
In order that optical device module can be operated together with the combiner 9320 as shown in Figure 93, by image light 9360 are supplied to lens 9330, and it focuses on image light 9360 at the eyes 9310 of user.Wherein for sake of simplicity, lens 9330 Single lens element is shown as, but multiple lens elements are also possible.Carry from the illumination light 9364 from light source 9340 For image light 9360.Wherein, illumination light 9364 is reflected by the orienting reflex image source 9350 of beam splitter 9352.Image source 9350 can It is liquid crystal on silicon display(LCOS), ferroelectric liquid Crystal(FLCOS)Or other such reflective displays.Polariser 9342 Can be associated to provide polarization illumination light 9364 with light source 9340.Beam splitter 9352 can be then to be oriented as substantially reflecting The reflective polarizer of polarization illumination light 9364.When light is reflected by image source 9350, image source 9350 changes illumination light 9364 Polarization state has the image light 9360 of the polarization state contrary with the polarization state of illumination light 9364 to be formed.By illuminating The polarization state of light 9364 changes into the polarization state of image light 9360, and image light 9360 then can be by the anti-of beam splitter 9352 Penetrate polarizer transmission.It is important to note that, image light 9360 is polarized that folded illuminating system, rather than because group can be realized Clutch 9320 needs polarized light.In fact, the transmission more than 50% in order to provide the light 9362 from environment, combiner 9320 Polariser can not be included.
Figure 94 is the diagram of optical device module, and the optical device module includes multiple folding optics to reduce light Learn the overall height of device blocks.In this case, illumination light 9464 is transmitted so that it is towards image by beam splitter 9452 Source 9450 is directly transmitted, and wherein beam splitter 9452 is that reflective polarizer and light source 9340 include polariser 9342, and it is oriented To cause the axis of homology of the polariser 9342 parallel with the axis of homology of beam splitter 9452.Illumination light 9464 is then by image source 9450 reflect and change polarization state, so that the image light 9360 with its polarization state for changing is by the court of beam splitter 9452 Reflect to lens 9330.If as by comparing Figure 93 and Figure 94 and seeing, being greatly reduced what is illustrated in Figure 94 The overall height of optical device module.
However, the orientation of the additional fold in the optical path of the image light 9360 in the optical device module of Figure 94 increases The thickness of optical device module, wherein thickness be defined as from the eyes from user nearest optical device modules it is nearest after Surface is to a distance from the farthest front surface of the farthest optical device module of the eyes from user.Figure 95 and 96 illustrates optical module Diagram, the folding added wherein in the optical path of image light 9360 is oriented as vertical with the folding illustrated in Figure 94. In this case, but the optical device module that illustrates in Figure 94 of the optical device module ratio in Figure 95 and 96 is wider thinner. Figure 95 illustrates optical device module from side, and Figure 96 illustrates optical device module from the position of the eyes 9310 of user.According to This, in the multiple folding optics illustrated in Figure 95 and 96, the optical axis 935 that is associated with illumination light 9464 with image light 9360 pass through the optical axis 934 being associated with image light 9360 during lens 9330 and in image light 9360 towards the use in eyes frame Both are vertical for the optical axis 933 being associated with image light 9360 when the eyes 9310 at family are continued on.In head mounted display In the case of, can be with extremely important, because thick optical device module may cause head-mounted with thin optical device module Display is protruding from the forehead of user, and this is probably uncomfortable and unattractive.Therefore, in Figure 95 and 96 In the optical device module that illustrates in Figure 93 of the multiple folding optical device module ratio that illustrates it is shorter and thinner.In Figure 95 and 96 In the optical device module that illustrates in Figure 93 of the optical device module ratio that illustrates it is wider, but in head mounted display In glasses configuration, broader optical device module can be preferably included in spectacle-frame than higher or thicker optical device module In frame.
By further advantage is that the optical device module including multiple folding optics is provided, can fold Introduce at surface and reverse to change the different piece of optical device module orientation relative to each other.This can be when following Important:When optical device module needs to be coupled in thin bending frame, protective eye lens or the helmet, wherein with multiple folding The width of the associated increase of the upper part of folded optical device module can make its be more difficult to be coupled to it is not parallel with combiner Structure in.In this case, for example(Based on Figure 96)Including light source 9340, polariser 9342, beam splitter 9452 and image The upper part in source 9450 can be twisted relative to the low portion including lens 9330 and combiner 9320.Wherein in order to Avoid the pattern distortion caused due to the compound angle between fold surface, upper part must be with regard to the torsion of axle 934 Low portion reverses combined with regard to the correspondence of axle 933.By this way, when the structure for making optical device module be coupled to bending (Such as frame, goggles frame or helmet structure)When middle, the width of the increase of the upper part of multiple folding optics The effect of degree can be reduced.
Figure 99 illustrates that wherein lens 9930 include Difraction surface 9931 to realize having the more compact of the aberration for reducing And the further embodiment of shorter optical design.Wherein Difraction surface 9931 can be by such as in Fresnel lens Diffraction lenss bending a series of little ring-type section composition.Difraction surface 9931 can be flat as illustrated in Figure 99 It is smooth, or it can have basis bending to provide addition power.Difraction surface 9931 can be single-order diffraction or multistage Diffraction.In order to reduce the scattering of the wide angle illumination light 9964 that can be incident on Difraction surface 9931, absorption polarizers 9932 are provided and are oriented, wherein the transmission axes perpendicular of the reflective polarizer of its axis of homology and beam splitter 9452.With this The mode of kind, by beam splitter 9452 in the illumination light that will be transmitted on the direction for making illumination light 9964 be incident on Difraction surface 9931 9964 can be absorbed before scattering of diffracted surface 9931 at it by absorption polarizers 9932.Meanwhile, image light 9360 has Have the polarization state contrary with the polarization state of illumination light 9964 so that image light 9360 by beam splitter 9452 reflect and Absorbability polariser 9932 is transmitted when it is delivered in lens 9930.
Figure 100 illustrates the diagram of optical device module, and it includes the angle reduced between beam splitter 9452 and lens 9930 Spend to reduce the overall height of optical device module.The folding angles of image light 9360(Deflection angle between 934 and 1005 Degree)Then it is more than 90 degree, and as a result, thus the top edge of beam splitter provides optical device module closer to lens 9330 Reduction overall height.
Figure 100 also illustrates that the compact planar light source 10040 being made up of the backlight of thin edge-lit, its with for being directed to The backlight provided in the display of the display of mobile device as similar cell phone is similar.Compact planar light source 10040 It is positioned in the dead astern of beam splitter 9452 to reduce the size of population of optical device module.Compact planar light source can include photoconduction Film or optical plate, it has the lamp of the reflector on the side contrary with beam splitter 9452 and edge-lit(Such as one or Multiple LED).Compact planar light source can include polariser, therefore the quilt as being previously described herein of illumination light 10064 Polarization., to obtain the efficiency of raising, rotate film 10043 and be positioned in tightly in order to towards the guiding illumination light 10064 of image source 9450 Gather between planar light source 10040 and beam splitter 9452.Luminit 103C that can for example from DTF under one's name(Torrance, CA) Obtain 20 degree of prisms and rotate film.In order to obtain bigger degree of rotation, such as 40 degree, multilamellar rotates film 10043 and can be stacked Together, as long as they are oriented such that turning effect is addition property.Bubbler can be used in addition to rotating film 10043 Layer(It is not shown)It is all if the line being associated with prism structure to reduce the artifact being typically associated with rotation film 10043 Property shade.Figure 101 illustrated shown in the optical device module seen such as the position of the eyes from user, its with Figure 100 The diagram for illustrating is similar, but vertical orientated to reduce optical device module in image light 10164 with being folded in for addition Thickness, as being previously described herein.As in the optical device module illustrated in Figure 95 and 96, in figure The multiple folding optics illustrated in 101 has the optical axis 1005 that is associated with illumination light 10164, its with image light 9360 Through the optical axis 934 being associated with image light 9360 during lens 9330 and in image light 9360 towards the user's in eyes frame Both are vertical for the optical axis 933 being associated with image light 9360 when eyes 9310 are continued on.As a result, the optics in Figure 101 Optical device module of the device blocks than Figure 93 is thinner and shorter.Figure 101 also includes field lenses 10130 to improve optics mould The optical property of block.This second lens element addition because folded orientation in change but it is possible so that field is saturating Mirror 10130 does not increase the thickness of optical device module, but the length from the optical path of the addition of field lenses 10130 occurs in it Middle space is easier in head mounted display in the width of available optical device module.
Figure 102 illustrates the diagram of the optical device module similar to the optical device module illustrated in Figure 99, but has There is the different orientation of the upper part of optical device module relative to combiner so that combiner 10220 can be more vertical. Element within optical device module it is this rearrange for realize head mounted display is good fit to use Family can be on the face important.By making combiner 10220 more vertical, can make optical device module that there is the cheek to user The less interference of bone.
Figure 103,103a and 103b illustrate shown in the optical device module seen such as the position of the eyes from user that it is wrapped Include multiple folding optics and Digital light projector(DLP)Image source 10350.In this case, such as by DLP in it is micro- anti- Penetrate as required for mirror and provide illumination light 10364 to image source 10350 with angle of inclination, with along the optical axis of lens 9930 934 reflected image lights 9360.Wherein, the eye in the case of DLP image sources 10350, with the user that be shown in eyes frame Accordingly, image light 9360 is by micro- anti-by the opening in DLP image sources 10350 for pixel intensity in the image of eyeball 9310 Penetrate mirror to constitute along the opening light that optical axis 934 reflects.Micro-reflector in DLP image sources 10350 also with dark picture material Light of shut-off state 10371 is accordingly reflexed to the side of optical device module, and as a result, ligh trap 10372 is carried For in optical device module with absorbing light 10371.Ligh trap 10372 can be black absorbing surface or veined black table Face.The purpose of ligh trap 10372 is to absorb incident illumination 10371 and thus reduce veiling glare, and subsequently raising is shown to user Eyes 9310 image contrast.As described in other embodiment previously herein, multiple folding light is used Light source 10340 is supplied to the side of optical device module to reduce the general thickness and height of optical device module by ways for education footpath Degree.Figure 103 provides DLP image sources 10350 at the top of optical device module, so that image light 9360 is along optical axis 934 Continue on always, through lens 9930 and continue to combiner 9320, there image light is towards being located at eyes frame In the eyes 9310 of user reflect.Polariser 10341 is provided with light source 10340 so that polarization illumination light 10364 is divided Beam device 9452 reflects to illuminate DLP image sources 10350.Wherein, beam splitter 9452 is reflective polarizer in the case of this, its It is aligned so that polarization illumination light 10364 is reflected by beam splitter 9452 and image light 9360 is by beam splitter with polariser 10341 9452 transmissions.Quarter-wave film 10351 be located at the surface of neighbouring DLP image sources 10350 so that image light 9360 it is inclined State of shaking is contrary with the polarization state of illumination light 10364 after being reflected by DLP image sources 10350.Light source 10340 and reflection are inclined The device 9452 that shakes angularly is arranged so that illumination light 10364 and is incided DLP image sources 10350 with required angle of inclination On so that image light 9360 when in by DLP image sources 10350 opening pixel reflect when along lens 9930 optical axis 934 continue on.Field lenses(It is similar to 10130 as shown in Figure 101)Or other lenses element can be included in figure But in 103 optics not shown, in said case, illumination light 10364 and image light 9360 can be in the opposite direction On through field lenses or other lenses element.
Figure 103 a be include DLP image sources 10350 and from shown in the position of the eyes of user with multiple folding The diagram of another optical device module of optical path.Light source 10340 be provided to the side of optical device module again with Just the thickness of optical device module is reduced.In this case, light source 10340 is provided at lens 9930 and combiner 9320 On the identical side of DLP image sources 10350.Lens 9930 can alternatively include one or more Difraction surfaces 9931.Light The direct lighting DLP image sources 10350 of source 10340, wherein illumination light 10364 is incident on DLP image sources 10350 with angle of inclination On, so that along the optical axis for folding after opening micro-reflector reflection of the image light 9360 in by DLP image sources 10350 934 continue on.Also provide at least one ligh trap 10372 to absorb the light of the closed mode micro-reflector reflection from DLP 10371, and thus improve the contrast of the display image such as seen by user.Field lenses 10332 are provided at DLP image sources Between 10350 and folding mirror 10352.Illumination light L64 can be in this case the then folding mirror not by polarized light Mirror 10352 can be by the completely reflecting mirror coating on substrate(For example, the coating of whole visible light is reflected)Composition.Field lenses 10332 can be the single lens element as shown in Figure 103 a, or it can on demand include multiple lens elements. Lens 10332 are designed to provide the bigger the air gap between field lenses 10352 and DLP image sources 10350, so that Obtaining illumination light 10364 can be introduced in optical device module, so as to direct lighting and having that DLP image sources 10350 are associated Effect region.By using unpolarized illumination light 10364, the optical device module ratio illustrated in Figure 103 a in Figure 103 and The optical device module with DLP image sources 10350 illustrated in 103b has the efficiency for improving.
Figure 103 b are that positions that include DLP image sources 10350 and eyes 9310 from the user in eyes frame show The diagram of another optical device module with multiple folding optical path for going out.Optics as shown in Figure 103 and 103a In device blocks like that, the optical device module of Figure 103 b there is the light source 10340 that is positioned at optical device module side with Reduce the height and thickness of optical device module.DLP image sources 10350 are reversed in position with light source 10340, but in this reality Apply their shared optical axises in example.Illumination light 10364 passes through beam splitter 10352, the beam splitter 10352 in this case can Enough it is the first reflective polarizer.Second reflective polarizer 10332 is adjacent to lens 9930 to be positioned so that the court of illumination light 10364 Reflect to DLP image sources 10350.For indirect illumination light 10364, the first reflective polarizer(Beam splitter 10352)It is anti-with second Polariser 10332 is penetrated with normal transmission axle to be oriented.Quarter-wave film 10351(Or four on DLP cover cover glasses/ One ripple coating)It is adjacent to DLP image sources 10350 to provide, so that the polarization state of illumination light 10364 is becoming figure with it It is changed when reflecting from DLP image sources 10350 as light 9360.As a result, the polarization of illumination light 10364 and image light 9360 Polarization it is contrary.Therefore, illumination light 10364 is transmitted and reflected by the second reflective polarizer 10332 by beam splitter 10352, and Image light 9360 is reflected and transmitted by the second reflective polarizer 10332 by beam splitter 10352.Light source 10340 is relative to second Reflective polarizer 10332 is orientated, so that light source 10340 relative to the angle of inclination of DLP image sources 10350 to be reflected, such as For the institute of image light 9360 that the opening micro-reflector reflection from DLP image sources 10350 is provided along folding optical axis 934 As needs.Second reflective polarizer 10332 can extend beyond lens 9930 to provide for illuminating DLP image sources completely Angle of inclination required for 10350, as illustrated in Figure 103 b.Because it is reflective polarizer that light source 10340 is located at Behind beam splitter 10352, light source 10340 does not affect image light 9360, and as a result, light source 10340 can be and beam splitting The different size of device 10352 and orientation.One or more ligh traps 10372 are provided to absorb the pass from DLP image sources 10350 The light 10371 of closed state micro-reflector reflection and the thus contrast of raising display image.In this case, ligh trap 10372 can be positioned under the second reflective polarizer 10332, because the polarization state of light 10371 is such that it Reflected and transmitted by the second reflective polarizer 10332 by beam splitter 10352.Light source 10340, beam splitter 10352 and DLP images The combination orientation in source 10350 provides optical device module, and the optical device module is positioned in wherein image source or light source Optical device module above folding mirror or beam splitter(For example, the optical device module for such as illustrating in Figure 103)Phase Than being relative thin and relatively short.
But Figure 97 and 98 illustrate to illustrate in Figure 94 in those optical device modules it is similar additional in validity period Between capture user eyes 9310 image eye imaging camera 979 optical device module diagram.In these cases, Light source 9340 and image source 9450 is opposite each other is positioned so that eye imaging camera 979 and can be positioned in lens 9340 just to go up Side, so that optical axis 934 is shared between optical device module and eye imaging camera 979.By sharing common optical axis, eyes Image camera 979 can capture the image of the eyes 9310 of user, and it has the visual angle of the dead ahead of eyes 9310 from user. Then image light 9360 can be used in the eyes 9310 of the lighting consumer during image capturing.Reflect from the eyes 9310 of user The part of light(It can not polarized)Beam splitter 9452 was passed through before being captured by eye imaging camera 979.Because eyes into As camera 979 is located at the top of beam splitter 9452, if so beam splitter 9452 is reflective polarizer, the polarization of image light 9360 State will be contrary with the polarization state of the light 978 captured by eye imaging camera 979.Eye imaging camera 979 can be used in catching Obtain rest image or video.Wherein video image can be used in following the trail of the eyes of user in viewing display image or in viewing environment Transmission views when movement.Rest image can be used in the image of the eyes 9310 for capturing user for based on iris The purpose of pattern identifying user.In view of the small size of available camera model, eye imaging camera 979 can be to optics The size of population of module have have little effect in the case of be added to optical device module.Additional optical photograph can be adjacent to combination Device 9320 is provided to the eyes of lighting consumer.Additional optical photograph can be infrared, therefore user can watch with visible simultaneously The image that light shows.If according to being infrared, eyes camera 979 allows for the infrared wavelength to match to capture figure additional optical Picture.The image of the eyes of user is captured by the visual angle of the eyes dead ahead from user, can be in the movement of the eyes of wide scope Obtain the non-fault image of the eyes of user.
Figure 120 illustrates another reality for the eye imaging camera being associated with the optical device module illustrated in Figure 101 The diagram of example is applied, but the eye imaging camera can be similarly included in optical device module(Such as Figure 99,100, 103rd, those optical device modules for illustrating in 103b)In.These optical device modules include absorption polarizers 9932 to subtract Few veiling glare, as previously disclosed herein.These optical device modules can also include Difraction surface, but diffraction Surface 9931 is not required for the operation of eye imaging camera 979.In this embodiment, the polarization shape of image light 9360 State is identical with the polarization state of the light captured by the eye reflections of user and by eye imaging camera 979, because they all wear Cross absorption polarizers 9932.In this embodiment, eye imaging camera 979 is adjacent to beam splitter 9452 and compact planar light Source 10040 and between beam splitter and field lenses 10130 position.By eye reflections light optical axis 12034 then in certain journey On degree relative to image light 9360 optical axis 934 at an angle so that the eyes 9310 of associated eyes frame and user Center in eye imaging camera 979 visual field within.By this way, eyes of the eye imaging camera 979 from user 9310 almost dead ahead and only slightly to user eyes 9310 side capturing the image of the eyes of user, such as in figure As shown in 120.Although Figure 120 illustrates the eye imaging camera 979 of the end positioning for being adjacent to beam splitter 9452, The side that beam splitter 9452 may be adjacent to positions eye imaging camera 979.The advantage of this embodiment is eye imaging phase Machine 979 is provided with simple optical path, so that high image quality is can in the capture images of the eyes 9310 of user Can.It should be noted that the optics being associated with eye imaging camera must account for the effect of lens 9930, because Lens 9930 are passed through by the light reflected by the eyes 9310 of user that eye imaging camera is captured.And, eye imaging camera 979 Addition substantially do not increase the volume of optical device module, if as by comparing Figure 120 and Figure 101 and seeing.
Figure 121 illustrates the diagram of the further embodiment of the optical device module including eye imaging camera 979.With figure The embodiment illustrated in 120 is similar, and this optical device module also includes the absorption polarizers 9932 for reducing veiling glare, And can be included what is be still not required with Difraction surface 9931.In this embodiment, the quilt of eye imaging camera 979 It is positioned between beam splitter 9452 and field lenses 10130 and points to beam splitter 9452.By this way, by the eyes of user The light of 9310 reflections be combined device 9320 reflect upwards, through lens 9930 and absorption polarizers 9932, and and then divided Beam device 9452 laterally reflects towards eye imaging camera 979.Thus the light captured by eye imaging camera 979 be and image light 9360 identical polarization states, so that the light for being captured is reflected by beam splitter 9452 and absorbability polariser 9932 is saturating Penetrate.The light reflected by the eyes 9310 of user can not polarized as initially being reflected by the eyes 9310 of user, but Through after absorption polarizers 9932, light with the identical polarization state of image light 9360 and become polarize.This enforcement The advantage of example is that it is even more compacter than the embodiment illustrated in Figure 120.This of eye imaging camera 979 is arranged in It is also possible in the optical device module illustrated in Figure 99,100,103,103a and 103b.
In the embodiment illustrated in Figure 120 and 121, the eyes 9310 of user and associated eyes frame can be by images Light 9360 is illuminated, or additional source of light can be provided for example by LED that combiner 9320 positions is adjacent to.Wherein LED can Visible or infrared light is provided, as long as eye imaging camera can capture at least a portion for the optical wavelength provided by LED.
In the alternate embodiment of the optical device module illustrated in for Figure 103 a, light source 10340 provides polarization illumination Light 10364, and fold reflectors 10352 are reflective polarizer plates, so that eyes camera(It is not shown)Can fold instead Penetrate the top of mirror 10352 and position for capturing the image of the eyes 9310 of user along optical axis 934, and in Figure 97 and 98 It is similar as illustrating.Eyes camera and optical device module and then shared common optical axis 934, so that the eyes 9310 of user Image capture from the dead ahead of eyes.In this arrangement, the polarization state of image light 9360 with captured by eyes camera The polarization state of light is conversely, because image light 9360 is folded the light quilt that reflecting mirror 10352 reflects and captured by eyes camera Folding mirror 10352 is transmitted.
Figure 104 illustrates the diagram of the optical device module of Figure 95 of the add ons with controllable light blocking components, and this can The add ons of control light blocking components are to the contrast in the part for improving display image and also to improve display object (Such as augmented reality object)In opaque outward appearance.Wherein controllable light blocking components can be by absorbing incident illumination or scattering Incident illumination (as example passed through the incident illumination that provided of electric driven color-changing part, polymer stabilized nematic liquid crystals or ferroelectric liquid crystals) is being grasped Make.The example of suitable light blocking components includes:From the 3G switchable films of Scienstry (Richardson, TX);From The changeable reflecting mirror or changeable glass of Kent Optronics (Hopewell Junction, NY).Controllable light blocking unit Part 10420 is illustrated as being attached to the lower surface of combiner 9320 in Figure 104, so that controllable light blocking components 10420 are not done Display image is disturbed, while stopping the perspective light 9362 from environment.As long as combiner is flat, it is adjacent to combiner 9320 and adds Plus controllable light blocking components 10420 be by be directly attached to combiner or be attached to the side wall of optical device module shell and It is easily accomplished.Controllable light blocking components 10420 can have single region, and it can be used in stopping the perspective light from environment Selectable portion on the region of whole combiner 9320, thus, it is possible to realize selectable optical density (OD).Alternatively, controllable light Barrier element 10420 can provide area array 10520, and as illustrated in Figure 105, it can individually selectively It is controlled to stop the part in the region of combiner 9320, the display that the part is located at corresponding to the high-contrast area of image Region in image.Figure 105 illustrates the diagram of the array 10520 of individually controllable light blocking components.Figure 106 a, 106b and 106c are How the diagram of the array 10520 of individually controllable light blocking components is used.Figure 106 a are illustrated how can will be individually controllable The array 10520 of light blocking components puts in stop pattern and in region 10623 in region 10622 and puts into non-blocking pattern In.Wherein stop the region that mode region 10622 will be shown corresponding to wherein information or object, such as in the diagram of Figure 106 b In corresponding region in illustrate as.Figure 106 c are illustrated when using in photoresistance gear pattern 10622 and non-blocking pattern 10623 The thing that the array 10520 of the controllable light blocking components for using is seen come user during the image for showing Figure 106 b.Then user sees See display information or object of the superimposition to the transmission views of environment, but show wherein in the region of the information of object, Transmission views are blocked the contrast to improve display information or object and provide thick and heavy sense to display information or object.
Additionally, Figure 104 illustrates rear optical element 10490, it can be protection board or correction optics.Protection board can Side wall or other structures element are connected to so that the positioning of combiner 9320 is more solid and to prevent dust and dirt from entering To in the inner surface of combiner 9320.Correction optics can include standardization optics, and it is included at the ophthalmology of user Side(For example, refractive power and astigmatism)To improve viewing experience.
Head mounted display provides the user with the freedom that their head is moved when display information is watched.Perspective head Portion's installing type display also provides the user with the see-through view of environment, and then display information is by superimposition.Although head-mounted shows Show that device can include various types of image sources, but be to provide the image source that sequential color shows and be typically relative to display image In pixel quantity and higher perceived resolution is provided because each pixel provides picture material for each in color, and And the image of the full-colour image frame shown by being perceived by a user as is actually a series of sequential color subframe of quick displays With.For example, image source can sequentially provide by be all obtained from the red image of single panchromatic two field picture, green image and Followed by the sub-frame images that blue image is constituted.In this case, full-colour image is with including a series of at least three orders The image frame rate of coloured subframe is shown, and the subframe is shown with the Sub-frame rate for being at least 3 times of image frame rate.It is suitable Sequence color diagram image source includes reflectogram image source, such as LCOS and DLP.
Color division occurs as sequential color shows and occurs, because providing the user with the difference of panchromatic two field picture together Color sub-frame image is shown in different time.It was recognized by the inventor that being shown using the sequential color in head mounted display Show, when the movement or user that there is head mounted display eyes it is mobile when so that the eyes of user not with show figure As synchronizing moving, position the regarding in user for being perceived of each under such moving state in sequential color image subframes It is different within.This can move his head in user and the eyes of user are not followed and head mounted display Occur during identical track, this is likely due to the eyes of the user when eyes suspend the object in the see-through view of viewing environment Move in unstable track and cause.This another mode that can occur is if object passes through the perspective of environment The eyes of view and user are followed if the movement of object.Due to the difference in perceived position within the visual field of user, User sees the sequential color image being slightly separated in the edge of object.This color separated in the edge of object is claimed For color division.Color division can easily be perceived during some movements, because sequential color is not handed over each other at them By distinct colouring in folded region.User moves that their head is faster or eyes of user are moved more across showing visual field Hurry up, then color division becomes more apparent from, because different colours sub-frame images are by the bigger distance separation in visual field.Color point Split is especially with perspective head mounted display it will be apparent that because user is it can be seen that environment and in user rotate him Head when user eyes tendency hang out on the object seen in the environment.Even if therefore user can be with stable rotation Speed rotates his head, and the eyes movement of user is intended to jiggly and this generation wherein it was observed that what color divided Condition.Like this, exist and be inclined to two kinds of different conditions being associated with color division:Quick head movement and Rapid Eye movement.
Point out to the following is important:Do not have when user is not moving his head and head mounted display When just moving on the head of user, color division will not be observed, because sub-frame images are provided in the visual field of user At same position.And, if user will move his head and user and his eyes of head movement synchronizing moving, will Color division is not observed.Therefore the mobile instruction of head mounted display can result in the condition of color division and also refer to Show the degree of the color division that can occur if the eyes that user moves him relative to head mounted display.Color point Split the problem in the case of it there is no head mounted display to the perspective of environment less because only display image content for User is visible and the mobile synchronizing moving of display image content and head mounted display.If using monochromater(I.e., not There is sequential color subframe, but only exist single color frame)To show monochrome image, then color divides nor problem, this is Because all display images are made up of identical color.Therefore, color divides the head installation in the see-through view for providing environment It is most obvious problem in the case of formula display.
The system and method for principle of the invention reduce color and divide and hence improve when user just moves By the viewing experience provided by the head mounted display with perspective during environment.
In embodiment, there is provided system and method, wherein head mounted display detects head mounted display Translational speed, and used as response, the resolution of image is reduced or the locating depth of image is reduced, and image is shown used Image frame rate and associated Sub-frame rate be correspondingly increased.By this way, the bandwidth being associated with the display of image Can be maintained it is constant, although frame rate is increased.Wherein, by increasing the frame rate being associated with the display of image, every Time between the display of individual sequential color sub-frame images is reduced, and as a result, regarding between sequential color image Feel that the separation for perceiving is reduced.Similarly, image frame rate can be reduced and is shown for each picture frame while passing through to increase Subframe quantity increasing Sub-frame rate.
In a further embodiment, there is provided system and method, wherein sequential color sub-frame images laterally relative to each other or Vertically shift a number of pixel corresponding with the mobile phase for being detected of head mounted display.By this way, Color sequences sub-frame images are displayed to user so that they show visual field in visually each other superimposition on top. Separation and thus reduction color division between this compensation subframe.
In yet another embodiment, there is provided system and method, wherein the eye imaging phase in head mounted display Machine is used for the movement of the eyes for following the trail of user.The movement of head mounted display can be simultaneously measured.Then presented In adaptation with reduce color division.For example, with the movement of the eyes of user and the movement of head mounted display in difference Not accordingly, thus it is possible to vary the resolution and frame rate of image can reduce image frame rate increase subframe speed simultaneously Rate.As another example, between the eyes and head mounted display of user in movement determined by difference Accordingly, subframe can be shifted to be directed at subframe.As further example, it is possible to reduce the color saturation of content is subtracting The sensation of the color division for causing due to the fact that less:Although color is divided in position as perceived by user From, but whether as separating in the colour space.In another example, content can be converted into monochromatic image, its The mobile period detected is shown as single color image(For example, white)So that color division is invisible.
Figure 107 illustrates the example of the full-colour image 10700 including pel array, and the pel array includes red, green With the part of blue pixel.For sequential color shows, create only by a kind of color(It is such as only red, only green or only blue Color)Three sub-frame images of composition.It would be recognized by those skilled in the art that providing the order face of perceived full-colour image together Color image also can be made up of the subframe of aeruginouss, magenta and yellow.These sub-frame images are aobvious in head-mounted in order Show and be quickly shown on device user, so that user perceives the full-colour image of combination all three color.Using reflective display Device(Such as LCOS or DLP), by following sub-frame images are shown:Change reflective display to provide and specific sub-frame image phase The respective image content of association, and and then be reflected to son with associated color optical illumination reflective display, therefore light Two field picture is supplied to the optics of head mounted display and is supplied to the eyes of user from it.
If sub-frame images are accurately aligned with each other, the full-colour image perceived by user all will be until the edge of image It is panchromatic and will divide without color.This is when head mounted display is static on the head of user and user does not have The thing typically seen by the user of head mounted display when moving his eyes.If however, user moves Move his head or head mounted display(Such as, due to vibration)Move on the head of user and user eyes Without as one man moving with display image, then user is perceived as sub-frame images laterally relative to each other(Or it is vertical)Skew, such as By as shown by the diagram 10802 and 10804 in Figure 108 A and 108B.Perceived between shown sub-frame images The translational speed and the time between the display of order sub-frame images of horizontal offset and head mounted display(Its also by Referred to as subframe time or 1/ Sub-frame rate)It is relevant.The transverse shift between sub-frame images perceived by user is color division, And color division is perceived as the color stripe at target edges.When user quickly moves his head(Or eyes)And When Sub-frame rate is slow, color division can be as substantially as shown in 108A.If user slowly moves his Head or Sub-frame rate are higher, then color division is less, as shown in 108B.If in digital image, The color division in transverse shift is less than a pixel, then perception there will be no color division by user.
Frame rate of display in head mounted display is typically by processor and the band of associated electronic equipment Power wide or by required for driving processor and associated electronic equipment(It changes into battery life)To limit.To give Bandwidth required for fixed frame rate display image is with the quantity of shown frame in certain period of time and in each frame figure The quantity of the pixel as in is relevant.Like this, frame rate is simply increased to reduce color division not always good solution, Because it needs the more high bandwidth that processor or associated electronic equipment may not support and power use will increase, Thus battery life is reduced.Alternatively, the system and method for principle of the invention provide a kind of method of display, wherein subtracting Lacked the pixel in each sub-frame images quantity thereby reduce show each sub-frame images required for bandwidth and while Sub-frame rate is increased into corresponding amount to maintain bandwidth to reduce color division simultaneously.The embodiment is suitable for wherein sub-frame images energy Enough it is provided with the scene of different pixel quantity and different frame rate.For example, its will be suitable for wherein contact conditionss can It is varied to provide with more low resolution(Then it can be shown with faster Sub-frame rate)The camera of image and aobvious Show system.Still image(Such as text or diagram)Can show to reduce with lower frame rate and faster Sub-frame rate Color divides, and this is because picture material is without quick change.Alternatively, image can be modified in order to faster frame rate Or Sub-frame rate is in more low resolution(Less pixel)It is lower shown, to reduce color division.
Figure 109 illustrates the diagram of the sequential of sequential color image, and the sequential is by the red sub-frame image in repetitive process It is that green sub-frame image 10904 is constituted followed by the order display of blue subframes image 10908 after 10902.As long as sub Frame is shown together with the full-colour image frame rate more than approximate 24 frames/second, so that sequential color subframe is with more than 72 subframes/second Sub-frame rate showing, human eye will just perceive the panchromatic mobile image without vibration.The condition is suitable for when head is pacified Dress formula display is static or shows video image in the case where dividing without color when will be relatively slowly move.So And, if user moves his head so that head mounted display is quickly moved, color division will occur.Generation is this Color division is because that quick head movement is typically reaction of the user to there is something in the environment(For example, it is big to make an uproar Sound), so that the eyes of user during the movement of quick head just in search environment, this causes jiggly eyes to move and real The color division of matter.
The movement of head mounted display can be detected that the Inertial Measurement Unit can include adding by Inertial Measurement Unit Velometer, gyro sensor, magnetometer, inclination sensor, vibrating sensor etc..Wherein only show visual field plane it Interior movement(For example, x and y movements are without z movements)It is important for detection may wherein occur the condition of color division. If in embodiment, head mounted display is detected as being in more than the predetermined threshold that prediction color division occurs (For example, more than 9 degrees seconds)It is mobile, then can reduce the resolution of image(Thus reduce pixel in the picture quantity and Each pixel is effectively set to show bigger within visual field)And can correspondingly increase Sub-frame rate.Noticing to pass through The quantity of the subframe that increase is shown sequentially does not change picture frame to increase Sub-frame rate, for example, for each picture frame energy Six subframes are enough shown, wherein sequential color sub-frame images are shown twice.By increasing for each picture frame shows The quantity of subframe, Sub-frame rate can be increased without increasing image frame rate, and image frame rate may be more difficult to change, because Typically provided by the source of the picture material such as in film by image frame rate.Figure 110 illustrates faster Sub-frame rate Diagram, wherein for the display time of each subframe 11002,11004 and 11008 is reduced and in the aobvious of each order subframe Time between showing also is reduced.Figure 110 illustrate be approximately the Sub-frame rate illustrated in Figure 109 the like that fast subframe speed of twice Rate.Compared with Figure 109, associated image frame rate can be that twice is fast like that in Figure 111 0, wherein image frame rate and son Both frame rate is doubled.Alternatively, as previously described, image frame rate can be between Figure 109 and Figure 110 not It is changed, wherein only Sub-frame rate is doubled to reduce color division.In order that the display with the image illustrated in Figure 110 Approximately associated with the display of the sub-frame images illustrated in Figure 109 bandwidth of associated bandwidth is identical, resolution(Per height The quantity of the pixel in two field picture)Reduce to original approximate 1/2nd.
Although the resolution for accordingly reducing shown sub-frame images with the increase in Sub-frame rate may seem to make The image quality degradation perceived by user, but when there is essence and being mobile, human eye can not perceive high-resolution.Like this, When eyes are moved, color division is more visible than the reduction in the resolution of image.Therefore, system of the invention and side The image resolution ratio that method is reduced exchanges the image frame rate of increase for subtract in the case of without perceptible resolution loss Few color division, and thus maintain bandwidth.For example can be reduced using this technology color split into it is low until original 1/16, the resolution of wherein display image be reduced to the 1/16 of original resolution and the frame rate of display image increase to originally 16 times.
In another embodiment of the present invention, when detect head mounted display it is mobile when, with panchromatic frame figure As associated sub-frame images on the direction contrary with the moving direction for being detected relative to each other by numerical shift and with Corresponding to the translational speed for being detected amount by numerical shift.This has effectively compensated for causing, and color divides in shown son The skew for being perceived between two field picture.Numerical shift is applied only to together including the subframe of panchromatic two field picture.This is different from Typical digital image stabilization, wherein panchromatic two field picture is relative to each other by numerical shift to compensate movement, such as example in U.S. State's patent is disclosed described in 2008/0165280.By moving to the subframe Applied Digital for constituting single panchromatic two field picture Position, even if the amount that the numerical shift required for color division is reduced when the translational speed for being detected is higher is also typically only very Few pixel, this is contrasted with typical digital image stabilization, and the quick movement in typical digital image stabilization is led The accumulation displacement of two field picture is caused, so that image is effectively showing that the numeral that can apply is moved or limited outside visual field is steady The amount of fixedization.Figure 111 a and 111b illustrate this embodiment.Figure 111 a are illustrated when there is essence and being mobile, the son that order shows How two field picture 11102,11104 and 11108 will be perceived by the user, wherein the different colours being associated with subframe are along object edges Edge is separately visible, and the visual field on moving direction is evenly spaced.By contrast, Figure 111 b are illustrated when subframe is by numerical shift To compensate detected movement and thus reduce in the separation between the subframe of visual field, how to change the visible of subframe Property, and as a result, user perceives a series of panchromatic two field picture 11120 with the color division for reducing.Such as in figure As illustrating in 111b, panchromatic two field picture is not in response in the movement for being detected by numerical shift or stabilized image.
In embodiment, the display of the moving direction and speed of head mounted display immediately preceding each panchromatic two field picture Detected by IMU sensors before.If translational speed is higher than predetermined threshold, the order being associated with each panchromatic frame shows Color sub-frame relative to each other by numerical shift so that they show visual field in alignment positions in be shown.Displacement Value corresponding to detected movement speed and shift direction it is contrary with the moving direction for being detected.
In this example, the movement of head mounted display is immediately preceding the aobvious of the first subframe being associated with panchromatic two field picture It is detected before showing.Then the first subframe being associated with panchromatic two field picture can be shown in the case of without displacement.The Two subframes can be shifted a certain amount and direction and and then it is shown, the amount and directional compensation occur sub first and second Movement between the display of frame.3rd subframe can be shifted a certain amount and direction and and then shown, the amount and direction The movement that compensation occurs between the display of the first subframe and the 3rd subframe.The movement of head mounted display is then by again Detect to determine the displacement that be applied to the subframe being associated with next panchromatic two field picture.Alternatively, subframe can be shifted A certain amount, a part for the movement that the amount compensation occurs across the sub-frames.
In other example, the direction of the movement of head mounted display and speed are immediately preceding the display with reference to subframe It is detected before.Then subsequent subframe is shifted shown in the time and subsequent subframe being shown with reference to subframe to compensate Time between occur movement.Wherein, the time being shown with reference to the subframe and subsequent subframe shown time can be reached To 5 frame times.
By the advantage for checking effective frame rate of the fuzzy correlation connection with color division and image to illustrate the embodiment. If showing full-colour image with the image frame rate of 60 frames/second, typically will be shown with the Sub-frame rate of 180 frames/second Subframe, to provide three subframes as each picture frame.Described system and method effectively shift subframe, so that they It is positioned on top of each other, therefore color division is reduced to the amount corresponding to 180 frames/second.Meanwhile, by user in image What is perceived between frame is fuzzy corresponding to 60 frames/second, and this is because each in subframe is obtained from the panchromatic two field picture of identical.
In a further embodiment, detected movement was based on before the display of each panchromatic two field picture to subframe Numerical shift can be combined with the digital image stabilization being used between panchromatic two field picture.
In yet another embodiment, the method for the numerical shift of subframe reduces image resolution ratio simultaneously with frame rate is increased Method is combined.The two methods of color division are reduced with regard to being associated with the display image in head mounted display The different aspect of image procossing is operated, and like this they can independently be applied with any one order and are being associated with processor Image processing system in.
In other another embodiment, head mounted display is included for detecting user relative to head-mounted The eyes movement of the movement of display(For example, as described in this article like that)Camera.Eyes camera can be used in measurement The speed of eyes movement and the direction of eyes movement.In embodiment, the resolution of eyes camera can be relatively low(Example Such as, QVGA or VGA)So that frame rate can be relatively high(For example, 120 frames/second), and do not introduce bandwidth restriction.Relative to The eyes movement for being detected of head mounted display can be used in determining when the method using color division is reduced, the party Method includes for example increasing frame rate and making subframe numerical shift, as being previously described herein.For example, if examined The eyes movement of survey is higher than predetermined angular velocity, then the resolution of shown image can be reduced and Sub-frame rate can be with It is increased.In another example, the eyes movement for being detected can be used in determination and be applied to image before the display of subframe The amount of the numerical shift of the subframe of frame in and direction.In another example, measured eyes movement can be installed with head The mobile phase for being detected of formula display is used in combination to determine the subframe that image frame in was applied to before the display of subframe The amount of numerical shift and direction.The amount and direction for being applied to the numerical shift of subframe can be with the institute in head mounted display Difference between the movement of detection and the eyes movement for being detected of user is corresponding.Wherein, the eyes of user are just a side Move up and the detection of condition that head mounted display is just being moved in the opposite direction is represented and wherein can occur outstanding The scene of its bad color division.In this case, the combined method for reducing color division is favourable.
In other another embodiment, when the movement or eyes movement of head mounted display are detected as higher than pre- When determining threshold value, image is changed into into monochrome image from the full-colour image that color sequences show.The monochrome image can by from The combination image content of each composition in the associated color sequences subframe of each full-colour image frame.Wherein monochrome image energy Enough it is gray scale image or luminance picture, wherein for the brightness code value of each pixel(Y)Can be calculated, such as it is such as following As being given in formula 1, such as obtain from following network address:http://en.wikipedia.org/wiki/Grayscale and such as It is referenced for the standards of CIE 1931 of digital photography:
Y=0.2126R+0.7152G+0.0722B equatioies 1.
Wherein R is the red code value for pixel, and it for the green code value and B of pixel is blueness for pixel that G is Code value.Alternatively, monochrome image can be by single color image(Such as green sub-frame image)Constitute, and this image can be used Single color shows or preferably applies at the same time all sequential colors(For example, red, green and blueness)In the case of carry out Show, so that the illumination being applied on reflectogram image source is white light, and as a result, display image looks like gray-scale figure Picture.
Some multiple specific examples presented below.
Example 1:
26 degree are shown to visual field and 1280 pixel level width images, a pixel occupies 0.020 degree in display visual field.Such as The frame rate of fruit full-colour image is 60 Hz, and in the case of three kinds of color sequences sub-frame images, subframe time is 0.006 second.Produce The rotary speed of the head mounted display required for the color division of a raw pixel is then 3.6 degrees seconds.If shown The quantity of the horizontal pixel in visual field is reduced to 640 pixels and while the frame rate of full-colour image increases to 120 Hz, three In the case of planting color sequences sub-frame images, subframe time is reduced to 0.003, and the size of pixel increases to 0.041 degree and uses Rotary speed to produce the color division of a pixel is 14.6 degrees seconds.
Example 2:
26 degree are shown to visual field and 1280 pixel level width images, a pixel is showing that in visual field be 0.020 degree.If User is a pixel wide for the minimal size that color division can be detected, then before color division is detected by user Require more than the rotary speed of 3.6 degrees seconds(If Sub-frame rate is 180 Hz).Although color division is mimic effect, But the eyes of user do not have the resolution of the color stripe for being used for detecting the presence of mobile period below the speed.Cause This, less than the rotary speed, it is not necessary to color division management.
Example 3:
26 degree are shown to visual field and 1280 pixel level width images, a pixel is showing that in visual field be 0.020 degree.If User can detect little color division as a pixel wide, then the rotary speed of 3.6 degrees seconds will need subframe relative In a pixel displaced from one another(If Sub-frame rate is 180 Hz), to be directed at subframe so that color divides for user It is invisible.If user rotates their head with 15 degrees seconds, subframe will need to be displaced relative to each other 4 pixels, with right Quasi- subframe is so that color division is sightless.If picture frame is started with the display of red sub-frame image, for redness Sub-frame images do not need numerical shift.For green sub-frame image needs 4 pixel shifts.Also, for blue subframes image Need 8 pixel shifts.The next red sub-frame being associated with next picture frame will be then within visual field relative to elder generation Front red sub-frame actually shifts 12 pixels.
Each in the color division reduction technology being described herein can divide in reduction technologies with other colors Each is applied in combination.
It is a kind of challenge that inventor understands and perspective computer display is coupled in some wear-type form factors, i.e., Make to be when being reduced in size as described in this article.By the optics mould including multiple folding optics What block was provided further advantage is that the different portions that can be introduced at fold surface in reversing to change optical device module Split-phase is for mutual orientation.This can be important when following:When optical device module needs to be coupled to thin bending eye When in cell mount, protective eye lens or the helmet, wherein the width of the increase being associated with the upper part of multiple folding optical device module Degree can make its be more difficult to be fitted on in the uneven structure of combiner.Like this, another aspect of the present invention is related to reverse saturating Depending on some opticses in computer display so that the opticses preferably coordinate some form factors(For example, eye Mirror), also continue to be performed as high quality graphic display.In embodiment, there is provided with for folding the double of optical path The light optic system of mirror system(For example, the optical system being described herein with regard to Fig. 6 and 93 to 106)So that bag Include the image generating module of the first image light reflective surface(For example, upper module)With regard to leading to lower module from upper module Primary optic axis and it is rotated on the direction for making upper module more compactly be coupled in the framework of Wearing-on-head type computer.Together When, in order to avoid making the pattern distortion of the eyes for being supplied to user, including the image delivering optics of the second image light reflective surface Device(For example, lower module)With regard to towards user eyes the second optical axis and on the rightabout relative to image quilt Rotate, thus introduce the compound angle between the first image light reflective surface and the second image light reflective surface.As long as the first He Second optical axis is perpendicular to one another in non-twisted state, then the distortion in the image being associated with the torsion with regard to first axle by with regard to The torsion of the equal angular value of the second axle compensating so that the image for presenting to the eyes of user is not abnormal by torsion Become.
Figure 112 illustrates the Wearing-on-head type computer with see-through display of principle of the invention.Wearing-on-head type computer With framework 11202, optical device module is housed/is maintained in the position in front of eyes of user by it.As shown in Figure 112 As, framework 11202 keep two groups of optical modules 11204 and 11208, it is therein each there is upper and lower optics Module.Optical device module 11204 be non-twisted and be presented with diagram non-twisted version is coupled in the framework It is difficult.It is noted that the dotted line frame for representing the external boundary of optical device module 11204 is not matched with the side of framework 11202 Within boundary.Optical device module 11204 is coupled in framework 11202 will generally need framework 11202 to become from front to back more Thickness, this will cause more skews of the shape of glasses factor from the face of user, and this is less desirably and less compact.Compare it Under, optical device module 11208 is to reverse optical device module, and wherein upper module is twisted(Or rotation)Preferably to coordinate To in the boundary of framework 11202, as illustrated in Figure 112.Figure 113 illustrates multiple in optical device module 11208 The more detailed diagram of the torsion given within folded optics.Upper module 11214 relative to lower module 11218 along During optical axis 934 is reversed to be preferably coupled to framework 11202, the exactly torsion enables optical device module 11208 more preferably to match somebody with somebody Within framework 11202, as illustrated in Figure 112, and if as a result, framework 11202 can be than using It is thinner and more compact in the case of non-twisted optical device module.In order to avoid making to be supplied to the pattern distortion of user, the is needed Two reverse the in the first reflecting surface 11225 to be introduced in upper module 11214 and lower optical device blocks 11218 Compound angle between two reflecting surfaces 11226.With regard to optical axis 933 and relative to the torsion in upper module 11214 Second is reversed on the contrary direction of image for turning gives the second reflecting surface.By this way, when optical device module is matched somebody with somebody Close warp architecture(Such as frame, goggles frame or helmet structure)When middle, the top portion of multiple folding optics The effect of the width of the increase for dividing can be reduced.Wherein, preferably but not necessarily, optical axis 934 it is vertical with optical axis 933 so that The value that the angle torsion of the first reflecting surface 11225 must be given can be identical with the torsion for giving the second reflecting surface 11226, So as to the eyes for giving user are provided without the image distorted due to torsion.
Another aspect of the present invention is related to the configuration of the optics in wear-type framework and electronic equipment, so that Framework maintains the minimum shape factor to be similar to Standard spectacles.In embodiment, for provide reduction thickness with multiple folding The perspective optical display of folded optics(For example, as described in this article like that)Can be mounted in the frame.In reality In applying example, multiple folding optical arrangement can be twisted at fold surface(For example, as described in this article like that)With more Optics is coupled in framework well.In embodiment.The electronics of operation display, processor, memorizer, sensor etc. Equipment is positioned between optical module, top, lower section, side are first-class and be oriented as providing the thickness that reduces in framework with The thickness of matching optics device.Plate is carried out being orientated may be in the big part of the width of plate including restriction plate)Such as process Device chip)When be particular importance.For example, the part on electron plate and electron plate can be between optical module and/or top It is vertical orientated installing, to reduce thickness of the electron plate when being installed in framework.In another configuration, plate can be with It is installed between optical module in the height of the near top of optical module, so that the minimized height of frame.Again In one configuration, plate can be installed such that it extends the minimizing thickness so that framework on optical module.Entering one In step embodiment, plate can be installed with angled configuration so that the thickness and height of framework can be by while reduce.In reality In applying example, electronic equipment can be divided between multiple plates.For example, longer plate is on shorter plate, wherein in optics Space between module is used for lower panel.Some spaces between eyes are used for some electronic equipments by this configuration.
Figure 114 diagram include optical module 11208, the top view of electronic equipment plate 11402 and heat sink 11404 configuration and Front view.Plate 11402 is with the vertical orientated thin framework part for being mounted to and maintaining to be located across the brows of user.As shown that Sample, optical module 11208 is included in second reflecting surface 11226 and upper module 11214 of the drawing axis of user.Upper mould Block can have flat reflective surface and top 11214 can rotate or reverse with regard to the second reflecting surface 11226, such as at this Described in text.Second reflecting surface 11226 can be partially reflecting mirror, notch filter, holographic filter etc., incite somebody to action At least a portion of image light reflexes to the eyes of user, while allowing scene light transmission by eyes.
Figure 115 diagrams include the front view of the configuration of optics illustrated in Figure 114;However, electronic equipment plate 11402 are installed in the space between optical module with the highly similar height to optical module.Such configuration reduces The overall height of framework.
Figure 116 diagrams include the front view of the configuration of optics illustrated in Figure 114 and 115.In this configuration Electronic equipment layout completed with multiple plates 11402,11602 and 11604.Many plate configurations allow the plate from front to back more It is thin, thus enable the brows section of framework thinner.Heat sink 11404(Not shown in Figure 116)Optical mode can be installed in On before between block.This configuration also makes heat be pumped on the direction away from user's head.It is electronics in embodiment The processor for being mainly thermally generated device in equipment is mounted vertically(For example, on plate 11604)And heat sink 11404 can be with Front is installed in so that it contacts processor.In this configuration, heat sink 11404 heat is made to spread away from the head of user To the front of equipment.In other embodiments, processor is mounted horizontally(For example, on plate 11602 or 11402). In embodiment,(It is multiple)Plate can be inclined from front to back(For example, 20 degree)To create even more thin brows section.
Another aspect of the present invention is related to hide optical module so that the personnel of viewing user will not be seen clearly that light Learn module, electronic equipment or plate.For example, in the configuration being described herein, optical module includes being suspended on headset equipment frame The lens of the over top of the brows section of frame and(It is multiple)Electronic equipment plate also hangs downwards, to be partially blocked by perspective View.In order to hide these features and the outward appearance of conventional eyeglass thus be provided to Wearing-on-head type computer, outer lens can be by It is included in frame so that outer lens cover a part for the framework comprising optical module or electronic equipment, and outward Portion's lens can include progressive color and luster from top to bottom.In embodiment, the color and luster can have less saturating at top Penetrate for hiding framework including optical module or the part of electron plate, and below hidden place have higher transmission so as to Maintain high perspective transmission.
One aspect of the present invention provide be used for reduce optical device module thickness multiple folding optics and For reduce electronic equipment installation thickness vertical orientated or angled electronic equipment and for hide optics or The outer lens of the progressive coloring of a part for electronic equipment.By this way, Wearing-on-head type computer is provided with thinner shape The outward appearance of the shape factor and conventional eyeglass.
Another aspect of the present invention is related to the intuitive user interface being arranged on HWC 102, and wherein user interface includes To instruction of the touch feedback of user to provide the user with engagement and change.In embodiment, user interface is in HWC 102 Rotate element on the temple section of the shape of glasses factor.Rotate element can include section so that rotate element is with some The positive engagement of predetermined angular.This facilitate the touch feedback to user.When user rotates rotate element, rotate element ' click ' Shown user interface content is changed by its pre- fixed step size or angle and each step-length.For example, user can be with Cycle through one group of menu item or selectable application.In embodiment, rotate element also includes selection element, such as user's energy Enough press the pressure sensitive section to make a choice.
Figure 117 illustrates the human head for wearing the Wearing-on-head type computer in the shape of glasses factor.Glasses have the sun Cave section 11702 and Rotating user interface element 11704.User can rotate the rotate element 11704 It is now the option of the content in the see-through display of glasses.Figure 118 diagram different rotary user interface element 11704a, Several examples of 11704b and 11704c.Rotate element 11704a is installed at temporal front end and with using The significant side of family interaction and top exposure.Rotate element 11704b is further mounted backward and also has significant sudden and violent Dew(For example, 270 degree of touch).Rotate element 11704c has less exposure and is exposed at temporal top On interaction.Other embodiment can expose with side or bottom.
As discussed above, the lens of particular design can be used for hiding optical device module and/or electronic equipment The part of module.Figure 119 illustrates the embodiment of such lens 11902.Two lens 11902 are illustrated as having 6 bases Piece(Base 6)With 1.3mm thickness, but can use other geometries, such as with the geometry of different curvature and thickness Structure.Lens 11902 are shaped as and look like the conventional eyeglass with feature, and the feature includes the part of lens 11902 In special coloring and magnetic install attachment, wherein opaque structure(Such as electronic equipment)Behind lens.
Lens 11902 are included for installing magnetic attachment system(It is not shown)Blind hole 11904.Magnetic attachment system can be with Including magnet, magnetic material, double magnets, opposite polarizations magnet etc., so that lens 11902 can be from Wearing-on-head type computer(Example Such as, HWC 102)Remove and reinstall to the Wearing-on-head type computer.In magnetic attachment system, lens 11902 are by magnetic Power is fixed in the framework of HWC.Magnet can be inserted in blind hole 11904 or be inserted in corresponding matched position In the framework of HWC.As long as the matched position on the framework of lens 11902 or HWC includes magnet and another location has size Similar one section of magnetic material or another magnet, it is oriented as attracting lens 11902 and is fixed in the framework of HWC In.For this purpose, the framework of HWC can be provided instructs feature with the front positioning lens 11902 of the optical device module in HWC. Spine or flange that feature can be that lens are located therein, therefore lens 11902 are wherein instructed by magnetic attachment system Can not transverse shifting when in position.By this way, the function of magnetic attachment system is only to fix lens 11902 just Position, and instruct feature location lens 11902.Feature is instructed steadily to be made.With when dropping or or even by magnetic The power that attachment system is provided is relatively low(So that lens 11902 can be removed easily for cleaning or replacing by user)When It is when being subjected to impact that lens 11902 are in position.Wherein, easily replacing makes have different optical signatures(For example, polarize , photochromic, different optical density (OD)s)Or different outward appearances(For example, color, level, the mirror coating of coloring)It is various Lens can be made a change by user by expecting.
Figure 119 also illustrates lens 11902 and how can be colored with and hides or hide at least in part some opticses (For example, non-perspective part or non-transparent parts)(Such as electronic equipment, electronic equipment plate, aiding sensors(Such as infrared phase Machine)And/or miscellaneous part)Example.As illustrated, blind hole 11904 can also be hidden or at least portion by coloring Ground is divided to hide.As shown in Figure 119, top section 11908(Approximate 15mm as illustrated)Can be by more heavily Coloring(For example, 0 to 30% transmission)Or be mirrored, with the non-perspective partial for preferably hiding optics and miscellaneous part. The lower section of top section 11908, lens 11902 can have gradient zones 11909, and wherein coloring level gradually changes simultaneously from the top bottom of to And be incorporated in lower region 11910.Lower region 11910 mainly watches the region of the surrounding of perspective including wherein user, and And this area can be colored with adaptation viewing application.For example, if using needing high perspective, lower region 11910 can be It is colored between 90% and 100% transmission.If using needing a certain perspective color and luster, lower area can more heavily be coloured or Mirror-polishing(For example, 20% to 90%).In embodiment, lower area 11910 can be photochromatic layer, electrochromic layer, can Control reflecting mirror or other variable transmission layers.In embodiment, whole lens or part thereof can have variable transmission layer, such as light Mutagens chromatograph, electrochromic layer or controllable mirrors etc..Any or whole lens 11902 in embodiment, in the region Polarization can be included.
Another aspect of the present invention is related to cool down internal part by using micropore, and the size of the micropore is decided to be So that micropore is sufficiently large to allow gas to escape, but it is sufficiently small not allowing water to pass through(For example, 25 μm, 0.2mm, 0.3mm Deng).Micropore for example can be included in it is heat sink in.Heat sink or other regions can be filled with hundreds of or thousands of such micro- Hole.Micropore can be such as cut or CNC holes, and its is sufficiently small to keep that big water droplet is maintained at outside equipment, but allows Air is swapped by heat sink.In addition to increasing heat sink surface region, they also have on the downside of framework Distribution is cooled down with realizing convection current, and wherein cold air rises in heat from top(As chimney)When be inhaled into from bottom, And like this, heat sink with micropore is preferably placed on the top of the framework of HWC or side.In embodiment, micropore is by warm It is aligned in the groove that fin on heavy top is formed.At this moment the air for leaving is flowed by groove, is thereby increased from fin Heat transfer.In embodiment, micropore can at an angle so that the length in the hole in heat sink material is increased and empty Air-flow can be directed away from the head of user.Additionally, micropore can have causes air stream when air stream passes through micropore In turbulent flow size.Wherein, turbulent flow is significantly increased and the heat transfer being associated by heat sink air stream.In embodiment, The heat management system of HWC 102 is passive, not including Active Cooling System, such as fan or other energized machinery coolings System is forcing air over micropore.In other embodiments, heat management system includes energized machinery cooling(Such as fan Or multiple fans or other systems)To compel to move the air through HWC and micropore.
Another aspect of the present invention be related to based on the similarity of the item for being recognized to find surrounding in project. Augmented reality Jing is often including what and how use is strictly limited, there is provided more flexible interface will be it is favourable, because This people can do anything that they want it to do using augmented reality.Example is to use HWC cameras, graphical analyses The project to be found is specified with showing.Figure 122 illustrates the diagram of the image 12210 of the scene comprising object, and user wishes HWC When user is moved through environment, auxiliary finds the object.In this illustration, user has irised out the object just found 12220, wherein this pair as if cat in this case.Then HWC irises out region for shape, pattern and color analysis image To recognize the target to be searched for.Then HWC captures the image of scene when user walks about using camera.HWC analysis of the image is simultaneously And compare the shape in captured scene image, pattern and color and the shape by them with target, pattern and color phase Relatively.When there is a match, HWC alerts potential discovery to user.Warning can be vibration, sound or the figure shown in HWC Visual cues as in, such as corresponding with the position of the potential discovery in scene circle, flash of light or indicant.The method is carried For general and flexible augmented reality system, wherein project be visually described and " it was found that of this sort something " life Order is given HWC.For recognizing that the example of the mode of the object for wanting searched includes:In the previous capture being stored on HWC Project is irised out in image(As illustrated in Figure 122);Sensing is maintained in the physical image in front of the camera in HWC Project;Project in the live image for pointing to by the camera offer in HWC and watching in the see-through display of HWC, etc.. Alternatively, it is possible to use " it was found that of this sort word "(Such as project in street sign indicator or shop)Order by text Originally HWC is input to, and then HWC can search for the text when user is moved through environment.In another example, user Color can be indicated with the order of " it was found that of this sort color ".Can even is that in HWC for search terms purpose camera EO-1 hyperion camera, thus to strengthen the ongoing visual search of user come the project of searching for using infrared light or ultraviolet light.This The method of kind can be extended to any pattern that user can be HWC identifications, sound, vibration, movement etc., and HWC is right Any sensor being included in HWC can be used afterwards to search for the pattern for being recognized as target.Like this, carried by the present invention For discovery system be it is very flexible and can to being made a response by any pattern of the sensor identification in HWC, What all users must do is to provide the example of the pattern for being used as goal seeking.By this way, it is found that system supplymentary is used Family, and user can do other things when HWC finds target.It was found that system can be provided the operator scheme in HWC, Wherein user selects the pattern, and and then input will be by the HWC patterns that be search for target.Project that can be searched is shown Example includes:Home object, animal, plant, street sign indicator, weather activity(For example, Yun Ti), people, sound, song, bird cry, it is specific Sound, spoken words, temperature, as by sound of the wind relative to compass towards recognized wind direction displacement, vibration, to be bought object, The face of the label in the project in trade (brand) name, warehouse, the bar code on object or numeral and the object to be matched in shop Color.In a further embodiment, the speed of search can be selected by user(For example, how long once analyzed), or Person's speed can be automatically selected by the change speed in response to the condition relevant with target by HWC.In another embodiment In, the sensor in HWC includes diastimeter or camera, and it can generate depth map to measure the image that camera is captured In object distance.HWC then can analysis of the image and distance determining the size of object.User then can be by object Size be input to discovery system as the characteristic of target patterns so that HWC can more accurately recognize potential discovery.
Another aspect of the present invention is related to paraprofessional personnel and reads with entity form(Such as book, magazine)It is presented on computer Text on screen or call screen etc..In embodiment, the camera on HWC can be imaged and the process in HWC to the page Device is capable of identify that the word on the page.Line, frame or other designators can be presented in HWC to indicate which word is just being captured and knowledge Not.Then user will always indicate which word watches the page of word by see-through display in the case of being identified.Known Then other word can convert from text or change, and then it be presented to user in see-through display.Alternatively, recognized Word can be transformed into voice from text, itself then present to user by headset speakers, earphone, visual displayss etc.. This gives being best understood from for pair accuracy being associated with the text identification relative to conversion text or converting speech for user.
In further aspect of the invention, magnetic attachment structure is provided for combiner so that combiner can be removable 's.In the optics being associated with HWC 102(Such as the optics that figure 6 illustrates)In, it is important that combination Device 602 is accurately positioned and is rigidly held in the framework of HWC and the lower section of top optical module 202 in framework.Together When, combiner 602 may become to damage, so that it needs to be replaced or it may need to be periodically cleaned so as to favourable It is moveable in combiner.Figure 123 illustrates the diagram of the cross section of the single combiner 12360 with magnetic attachment structure, Such as it is illustrated that the angle of combiner 12360 is shown from side.Figure 124 illustrates the diagram of two combiners 12360, wherein magnetic Combiner 12360 is attached to attachment structure the framework of HWC 12350, as illustrated from front of HWC.Combiner 12360 have two or more pins 12365, and it is attached to combiner 12360 so that pin has parallel axes.Pin 12365 are illustrated as being inserted in the hole for drilling through combiner 12365 and using binding agent(Such as UV solidifies binding agent)Attachment is just Position.Pin 12365 is by magnetic material(Such as rustless steel)Make.Pin 12365 is extended in the framework of HWC 12350 In horizontal bore, so that combiner 12360 is regularly held in place relative to the framework of HWC 12350.Pin 12365 Attachment and bending establish the angle between the optics in the framework of combiner 12360 and HWC 12350.Magnet 12370 are engaged in the framework of HWC 12350, so that pin 12365 is attracted and thus pin by magnet 12370 12365 and attached combiner 12360 be held in place relative to the framework of HWC 12350.Magnet 12370 is chosen to The power that is applied on pin 12365 by magnet 12370 is sufficiently strong with being normally during use held in place combiner 12360, But it is weak enough so that it is possible to remove combiner 12350 by user.Put down by making pin 12365 and associated drilling OK, combiner 12350 can be removed for cleaning, or is replaced(If corrupted).To provide More firm shape and repeatable connection between the framework of combiner 12360 and HWC 12350, pin can be coupled to HWC In the tight drilling of the extension in 12350 framework.Additionally, pin 12365 can include flange as shown, it is located To the framework of framework 12350 associated flat surfaces or magnet 12370 flat surfaces on further establishing combiner 12360 upright position and the angle of combiner 12360.In a preferred embodiment, magnet 12370 is toroidal magnet and sells Nail 12365 is through the center of toroidal magnet.Magnet 12370 can also be included in insert(It is not shown)In, the insert enters One step includes the drill precise holes for being accurately aligned with and guiding pin 12365.Insert can be by hardened material(Such as make pottery Porcelain)Make to provide drilling to pin 12365, the drilling is resistance to during the repetition of combiner 12360 is removed and reinstalled Abrasion.Pin can be accurately positioned within combiner by using the fixture for keeping pin and combiner.For group The hole of the pin in clutch and then it is made into bigger than pin, therefore there is space to allow combiner and pin completely by fixture Positioning.Binding agent(Such as UV solidifies binding agent)It is then introduced into hole and is cured in place with the position established by fixture It is middle by pin fastener to combiner.In a further embodiment, the combinative structure of pin 12365 and combiner 12350 is set It is calculated as being ruptured in the case where high impact forces are subjected to, thus to protect users from damaging.Wherein pin 12365 or combiner quilt It is designed as being ruptured under the impulsive force for previously selecting, the impulsive force of the previous selection is less than the frame fractures for making HWC 12350 Required impulsive force, so that the combiner 12350 with attachment pin 12365 can be replaced simply when being damaged Change.In another embodiment, by providing the method for easily replacing combiner 12360, different types of combiner can also User is enough provided to, such as:Polarization combiner, the combiner with different color and lusters, the combiner with different spectral properties, The combiner of the physical attribute with varying level, the combiner with different shape or size, be partially reflecting mirror combination The combiner of device or trap reflecting mirror, the combiner with the feature for being used for stopping facial aura, such as herein previously As description.
In typical calculator display organization, auto brightness control is one-dimensional control parameter;When ambient brightness is high, show Show that brightness or light source increase, when ambient brightness is low, display brightness or light source are reduced.Inventor is had found when using perspective meter During calculation machine display, the one-dimensional pattern has significant restriction.The aspect of the present invention is related to improve wear-type meter by following The performance of calculation machine:It is also knows about the phase of the content for presenting in addition to understanding the brightness of surrounding by making Wearing-on-head type computer To brightness, and the two factors are then based on adjusting the brightness of content, to produce the viewing body with appropriate visibility Test.
An aspect of of the present present invention is related to the visibility of the content for improving shown in perspective head mounted display.It is considerable The property seen is related to Multiple factors.It was found by the inventors that in addition to image resolution ratio, contrast, acutance etc., showing in perspective The visibility of the image presented in device is affected by the following:(1)Surrounding's scene of the background for image is formed, and (2)The relative or apparent brightness of shown image.If user is for example just being seen to bright scene, then if show arrange without The visibility of content that change is then presented may be washed out or be difficult to see, relatively low in terms of the brightness in content sheet In the case of(For example content has wherein many dark-coloured or black regions), then it continue to be washed out, except non-content is also changed. In this case, the brightness of display can be increased must be even above the usual brightness for needing in dark situation to compensate figure The dark content of picture.Used as additional example, if user is just being seen to dark scene, the content for being presented may perceived as It is bright and wash out scene, or make it difficult to be interacted with scene(If not changing and showing setting).In addition, if content sheet Body is relatively bright(For example, the region of mainly light or white content), then may to need other change appropriate to obtain for content Visibility.In this case, if display brightness may be further compared with it is dependent only on environmental lighting conditions It is lowered so that the visibility of content is appropriate.In embodiment, Wearing-on-head type computer is adapted to measurement and is formed for being in The scene of the background of existing content, the relative luminance for understanding the content itself that will be presented(I.e. intrinsic content brightness)And and then The presentation of content is adjusted based on scene brightness and intrinsic content brightness, so as to realize desired content visibility.
Although the embodiment herein term used in the situation of changed content visibility " content brightness " and " display Brightness " it should be appreciated that arrive, the step of content and/or change in display is carried out in response to meeting visibility needs Can include causing system interference image content and not increase the light-source brightness of display, using available light and by using Display driver increases the digital brightness of picture material to adjust the parameter of whole display, adjusts in just shown reality Hold, etc..Visibility is adjusted can be by being carried out as follows:Adjust the illumination system for illuminating reflective display(For example change Become the pulse width modulated duty cycle of LED, change and be delivered to power of illumination system etc.), change the bright of emission display Degree is arranged, and changes how display is presented all the elements this aspect, Huo Zhetong by the setting in regulation display driver Cross the image procossing of all the elements(For example change brightness, tone, saturation, colour(Such as redness, green, blueness, cyan, Huang Color, carmetta etc.)Exposure, contrast, saturation, color and luster etc.), content selection area,(Can illustrate simultaneously still exist Observability aspect is unrelated with position with intrinsic difference)The type of content is changing content itself this aspect, etc..
In order to improve when the viewing experience of the user when content is watched in having an X-rayed head mounted display, it is necessary to which consideration is showing Visual interactive between the image for showing and the see-through view of environment.The visibility of given display image is highly dependent upon various Attribute, such as its size, color, contrast and brightness and such as the perceived brightness by seen by user.Wherein shown image Color and brightness can pass through digital picture in pixel code value(Such as mean pixel code)To determine.Alternatively, show The brightness of the image for showing can be according to the illumination of shown image(luma)To determine(Referring to " Brightness Calculation in Digital Image Processing ", Sergey Bezryadin et al., Technologies for Digital Fulfillment 2007, Las Vegas, NV).Other attributes of shown image can be similar to Brightness and be based on the distribution of the code value in image calculating.Showing depending on operator scheme, the movable type of user's participation and just The perceived brightness of the image for showing, it may be important that making the see-through view and the perspective of environment of shown images match environment View is contrasted or is mixed in the see-through view of environment.In addition to the scene that will form the background for being directed to content, content Adjusting can be based on the user's request for perceiving.Embodiment provides method and system for example to automatically adjust depending on the following The visibility of image:
1. the percentage ratio of the display visual field for being covered by shown content,(It is shown wherein in perspective head mounted display Image be the part of black is counted as the part without display content, and instead, user is provided with the portion The see-through view of environment);
2. the brightness metric of the image shown by(Such as tone, saturation, color, single distribution of color(For example it is red interior Appearance, blue content, green content), mean flow rate, maximum brightness, minimum brightness, the brightness that statistically calculates(Such as average, in Value, pattern, scope, distributed density)Etc.);
3. instruction user uses the sensor feedback of scene(For example, surveyed by the sensor in the IMU in head mounted display The amount of the motion of amount be used to determining user be static, walking, run, in car etc.);
4. the operator scheme of head mounted display(It can be based on such as environmental condition, GPS location, time or date, indication User's scene show or determination is being selected by user or be automatically selected by head mounted display).
5. the type of content(Such as static picture(For example, high or low contrast, monochromatic or colored, such as icon or Labelling), mobile picture(Such as high or low contrast, monochromatic or colored, the rolling icon such as in our launcher Or the labelling of bounce), video content(For example wherein the position of pixel and intensity change always, the such as labelling of bounce and flicker, The video content of other normal types, such as Hollywood movie, study course progressively or recorded on your glasses you on one It is secondary to be travel downwardly along ski slope), text(It is for example little, big, monochromatic, by Outline, flicker etc.)Etc.;And/or
6. user uses scene(For example based on sensor feedback, based on operation application, the prediction scene arranged based on user), Such as still it is sitting in safe position(Such as your parlor)In and watch film(For example wherein may not be needed to defeat ring Border), everywhere walk and be notified or alternately view direction(For example, wherein it is likely to be dependent on capped display Amount still may best matched environment), drive in car and erase blind spot(Such as vertical pillar(For example wherein may need Want matched environment)), drive in car and attempt showing HUD data by exterior lighting(For example wherein may need to defeat ring Border), obtain with regard to maintenance and engine instruction(For example, some of which region needs to defeat environment, such as in service manual The page, and some need matching such as to strengthen superimposition, and wherein you remain a need for seeing the content that you are busy with)Etc..
For example, with the night vision pattern of the use camera of the live feed of head mounted display, and wear The associated sensor instruction user of formula display is just with certain speed movement and with moving up and down that instruction is jolted.Knot Really, head mounted display can automatically determine shown image and should be provided with following brightness:The brightness provides good Viewing and independent of the see-through view of surrounding because too dark so that the perspective that cannot see that environment is regarded for a user Figure.In addition, shown image can be switched to monochrome image by head mounted display from panchromatic, such as green, wherein human eye It is more sensitive and human eye is responded more quickly.
In another example of pattern, when just in eye tracks used in user interface, the brightness of shown image It is increased relative to the see-through view of surrounding.In this embodiment, the type of the user interface for just using determine relative to The brightness of the shown image of the brightness of the see-through view of surrounding.In this way so that see-through view is than shown figure As darker, so that for a user see-through view is less noticeable.By making see-through view for a user less Noticeable, user can more easily move his eyes to control user interface, and not by the see-through view of surrounding Divert one's attention.The approach reduces nervous eyes movement, and the nervous eyes movement is equally providing the user ring Generally it is encountered during eye tracks used in the head mounted display of the see-through view in border.Figure 126 is a kind of chart, its illustrate by The brightness that human eye is perceived(L*)Relative to the brightness measured by scene(Illumination).In the chart, it can easily be seen that:Human eye With the nonlinear response to illumination, wherein eyes are more sensitive to the difference at reduced levels and to the difference at higher level It is less sensitive.In embodiment, when using the pattern of eye tracks control for including user interface, shown image can be with It is provided with such mean flow rate:The mean flow rate is perceived as 2 times compared with the mean flow rate of the see-through view of environment Or it is brighter(That is, the L* of shown image is 2 times of the L* of see-through view).
Additionally, shown image can be in response to the average color of the environment around user, tone or spatial frequency It is changed.In this case, the camera in head mounted display can be used for the image of capturing ambient, and it is included as by user institute A part for the perspective visual field seen.Then the attribute of the captured images of environment can digitally be analyzed(As herein As being previously described)To calculate the attribute of shown image.In this case, the attribute of the captured images of environment can be with Mean flow rate, distribution of color or spatial frequency including the see-through view of environment.The attribute for being calculated of environment then can phase The attribute of the image for just showing is compared, to determine see-through view will be how distracting contrast is just shown The type of display image.Then the attribute of shown image can be modified to change in terms of color, tone or spatial frequency The kind visibility having in the head mounted display of perspective.Picture material compares and to display figure with this of see-through view The associated modification of picture can be employed or in the visual field block of little localization in big visual field block(Each is only by several pixels Composition, such as certain type of augmented reality object is probably what is needed)Inside it is employed.Wherein(It is provided for calculating To at least one of attribute of the see-through view of the environment of user)The captured images of environment are needed not to be and shown figure As identical resolution.In a further embodiment, luminance sensor included in head mounted display or color are sensed Mean flow rate or average color that device can be used in a part for the perspective visual field of measuring environment.By using for measuring bright The sensor special of degree or color, the calculating of the attribute in the see-through view of environment can be provided with little processing power, Thus reduce power demand and increase calculating speed.
Be frequently considered that color is very subjective and there are some reasons to this, including item be such as:To environment The dependency of ambient lighting, the nearness of other colors and you just using one or two eyes.In order to compensate these Effect, head mounted display can utilize optical sensor or the intensity of color balance and ambient light is measured using camera, so as to How the color for inferring the object in environment would look like, and then the color of shown image is modified to improve with saturating Depending on head mounted display in visibility.In the case of augmented reality object, can be by rendering augmented reality object To improve visibility so that strengthen and show that object is preferably contrasted with the environment for being for example directed to labelling, or cause to increase It is strong to show that object is for example mixed in environment when BUILDINGS MODELS is watched.For this purpose, optical sensor can be provided to determine with Family front or other directions from environment(Such as above user)Ambient lighting brightness and color balance.Furthermore it is possible to Generally there is the object of Standard Colors in environment-identification(Such as stopping mark is red)And these colors can caught It is measured determining ambient lighting color balance in the image for obtaining.
The color-aware of human eye becomes even more complicated under very bright and very dark extreme case, because human eye non-thread Responded to property.For example, under direct daylight, color starts to wash out, because the nerve in brain starts saturation and loses The ability of the Subtle differences in detection color.On the other hand, when environment is very dim, the contrast perceived by human eye is reduced.Cause And, when bright conditions are detected, color can be strengthened in the displayed image.It is shown when dim condition is detected Image in contrast can be enhanced to provide the user more preferable viewing experience.Wherein can be by such as getting off to strengthen right Degree of ratio:Sharpen with making image digitization, increase code value difference in digital picture between adjacent area or by shown right The narrow line that the perimeter addition of elephant is made up of complementary color.
In dim condition, the color sensitivity of human eye also presses color change so that blueness seems brighter than redness.Knot Really, in dim viewing condition, the color of object is to blue change.Therefore, when shown image is provided as dim figure During picture, when using head mounted display such as under dim illumination(Wherein shown image and see-through view two The visibility of person is important), the color balance of image can be shifted into redder to provide the shown figure perceived by user The more accurately color rendering of picture.If image is shown as very dim image, image can further be changed to It is monochromatic red, preferably to retain the night vision of user.
In embodiment, head mounted display determines the brightness of surrounding using sensor or camera.It is then determined that The operator scheme of type and head mounted display by the type of the image of display and with image accordingly adjusts image Brightness.It is determined that combined brightness, it is made up of the brightness of see-through view with reference to the brightness of shown image.Be then based on group The brightness of conjunction and the known sensitivity of human eye determining the running area of human eye, as shown in Figure 125.The attribute of image(For example Color balance, contrast, the color of object, the size of text)Then area, the type of image and operator scheme are operated with determined by Accordingly it is adjusted to improve visibility.
Figure 125 shows the chart of the sensitivity to specific luminance of human eye, such as by Gonzalez, R.C. and Woods, R.E. written book " Digital Image Processing Second Edition "(Copyright 2002, Prentice Hall Inc ISBN 0-201-18075-8 and also in http://users.dcc.uchile.cl/~jsaavedr/ It is obtained at libros/dip_gw.pdf)In provided in 2.1 chapters page 38.As can be seen, sensitivity is quite non- Linear.In order that it is this it is non-linear be easier to understand, chart has been broken down into four areas.
Area 1:The top of photoptic vision(Dazzle is limited), the relative different wherein in brightness is less noticeable and color Shift into redness.But dazzle of the acutance of focusing in the case of the pupil for shrinking in good eyes starts to obscure details.
In order to improve visibility, shown image is modified to increase contrast and increase green and/or blueness.
Area 2:The critical field of color vision, the wherein cone account for leading in human eye.Color-aware is substantially uniform And brightness is perceived and follows standard gamma curve.Due to little pupil and manageable luminance level, maximum sharpness is possible. In the case of normal brightness and color, visibility is good.
Area 3:For the transition region from the cone to rhabodoids of primary colors sensitivity.Color-aware becomes nonlinear, because Compare with green with blueness, red cone faster loses sensitivity.Due to the planarization response to changing in brightness, contrast sense Know reduction.In the case of larger pupil, particularly in the older eyes that less can freely adapt to, sharpnes of focusing Start to reduce.By increase font and object size for readability and reduce blue and green and while increase it is red and Increase contrast to improve visibility.
Area 4:The bottom of scotopic vision, wherein rhabodoids account for leading and motion ratio content and become apparent from for sensitivity.Pass through Change shown image to eliminate high spatial frequency(Such as small text)And graphic record is instead provided(iconography) And using motion or flash to increase the visibility of key project to improve visibility.
In a further embodiment, it is considered to the change in operator scheme.If so that user change operator scheme, with mould Formula changes and environmental condition accordingly changes shown image to improve visibility.This can be temporary transient state, because For the change being associated in the new operator scheme of the eyes adaptation of user and viewing condition.For example, if showing that setting is base Detected darker environmental condition when waking up than head mounted display, the then brightness of shown image is modified to With environmental condition, so as to avoid the eyes of harm users.In another example, image using entertainment mode and shown Brightness the water of the optimal visibility for the video with saturated color and high sharpness is slowly increase until from environmental condition It is flat(Area 2).In another example, if the white on the icon or black text of shown image including confined area with In night viewing, then the brightness for brightness being reduced before photo or the white background page is illustrated in terms of and being increased is perceived.
In other another embodiment, eyes camera is used to determine user just directly look at which portion of shown image Divide and accordingly adjust with the brightness of the part of shown image the attribute of shown image.In this way, with The eyes positive reaction of user in the part of image accordingly adjust the attribute of image.The approach recognizes that human eye is very quick The local that ground is adapted in the brightness in the region that eyes just look at changes.When brightness quickly increases, such as when in dark room In when turning on light, pupil diameter can reduce 30% in 0.4 second, as shown in the research in Pamplona(Pamplona, V.F., Oliveira, M.M. and Baranoski, G.V.G. 2009, Photorealistic models for pupil light reflex and iridal pattern deformation, ACM Trans. Graph. 28, 4, Articles 106 (in August, 2009), page 12).As a result, move his eyes to look at shown image with user The different piece of the see-through view of different piece or surrounding, the local that the eyes of user can be rapidly adapted in brightness changes Become.In order to provide more consistent perceived brightness for the different piece of shown image, the system of principle of the invention or Method is bright with the local of the part of the see-through view that the local luminance of the part of shown image or the eyes of user just look at Degree accordingly adjusts the overall brightness of shown image.In this way, the change in terms of the size of the pupil of eyes of user The more consistent Luminance Distribution for being reduced and then providing a user with shown image.The eyes of wherein user just look at The part of see-through view or the eyes of user that captured via eyes camera by analysis of the part of shown image Image is being determined.Eyes camera can be used in video mode continuously capturing the image of eyes of user and being captured Then image is continuously analyzed with the position of time-tracking eyes of user.The eyes of user in eye image for being captured Position is interrelated with the part of the part of the see-through view that user just look at or shown image.Shown image it is total Body brightness is bright in the local of the part that can be the see-through view that just look at the eyes of user or the part of shown image Degree is accordingly conditioned.The regulation rate of the overall brightness of shown image can further with measured by user's pupil Diameter it is interrelated or with as according to in the diameter of user's pupil determined by the analysis of the image for being captured of eyes of user Measured change it is interrelated.
In other another embodiment, the regulation to the attribute of overview image can be based on following and carry out:The eye of user The local attribute of the part of the part of the see-through view that eyeball just look at or shown image.Shown image is conditioned Attribute can include:Color, color balance, contrast, acutance, spatial frequency and resolution.Wherein eyes camera is used to capture and uses The image of family eyes, the part of the see-through view that its eye for being then analyzed to determine user just look at or shown image Part.Then the part of the part of the see-through view that the eyes of user just look at or shown image is analyzed to determine category The relative intensity of property.The local strength of the attribute in the region that then just look at the eyes of user is accordingly to overall display Image is adjusted, to improve visibility.Camera wherein in head mounted display can be used for capturing the figure of surrounding Picture, it corresponds at least partially to be provided to the see-through view of eyes of user.
In embodiment, the camera that Wearing-on-head type computer has facing external is wearing Wearing-on-head type computer to capture The scene of person there.For determining the week that will be considered for brightness and/or color during shown content is adjusted Enclosing the camera and image procossing in the region in scene can take many forms.For example:
Camera be oriented to capture face forward scene --- brightness metric will consider captured scene and determine Associated luminance and/or color.For example, it may be considered that whole scene average color/brightness, it may be considered that bright or color saturation Part, it may be considered that dark areas, etc.;
The camera of face forward can have the visual field bigger than the visual field of see-through display and image procossing can be used for Assessment overlapping region so that the brightness of image for being captured and/or color can represent field luminance and/or the face of see-through display Color;
The camera of face forward can have the visual field similar with the visual field of see-through display so that the brightness of image for being captured And/or color can represent field luminance and/or the color of see-through display;
The camera of face forward can have narrow visual field preferably the scene in user's dead ahead to be set to target;
The camera of face forward can be mechanically moveable camera, and it follows eye position(For example, as by as herein Determined by described eye imaging)To capture the scene for following eyes of user;
The camera of face forward can have wide visual field to capture scene.Once capturing image, the section of image just can be with Be identified as user just seeing to segmentation(For example according to eye imaging information), in can be consider the segmentation in brightness And/or color;
Object in the scene image for being captured can be identified(For example, determine as determined based on eye imaging and position 's)And the object can be considered;And
Object in the scene image for being captured can be identified as shown content by referent(For example will be with business The associated advertisement in shop)And brightness and/or the color of the object can be considered.
In a further embodiment, the invention provides a kind of method, it is used to improve shown image and surrounding ring The alignment of the see-through view in border.Methods described can be also used for by eye tracks and the user around see-through view of environment just It is interrelated where look at.When the local attribute in adjusting the part for being the see-through view that just look at based on user, this is For the key character being adjusted to the attribute in shown image.Regulation process is used for head mounted display Each user improving the viewing experience of Different Individual and compensate in nose shape between individuals or eye position Change.Alternatively, when user uses head mounted display, regulation process can be used for the single individual sight of fine tuning Experience is seen, is being positioned with the difference in account with compensating head mounted display.Methods described is for improving augmented reality object Can also be important for the accuracy of positioning.Methods described is included in the camera of facing external used in head mounted display To capture the image of surrounding, the image includes at least a portion of the user visual field of the see-through view of surrounding.It can be seen that Labelling(Such as cross)It is provided in the corner of captured image to provide first object image.First object figure As being then displayed in user, therefore first object image of the user from by the see-through view of superimposition to surrounding simultaneously See the shown image of surrounding.User look at witness marking, and and then will be shown using eye tracks control The image for showing moves to such position:At the position it is adjacent with witness marking shown by image part and environment Object alignment in see-through view.Wherein eye tracks control include eyes camera with determine eyes of user movement and one Or the blink of two eyes(Head movement can be used in combination with the eyes control in user interface), it connects in user It is used to be input into control input in mouthful.Second image of surrounding and then captured and witness marking be provided in the corner with The second target image is provided, wherein the witness marking in the second target image is positioned in and the visible mark in first object image In the relative corner of note.Second target image is then displayed to user.Then user look at the witness marking in the second target And shown image is moved using eyes control, so as to will be adjacent in the second target image the object of witness marking with Object alignment in the see-through view of environment.It is important during the period of the first and second target images is actively watching as user It is user and moves its head not with respect to environment.Shown image then with order to by the part of shown image and week The corresponding part of the see-through view in collarette border is aligned and the relative quantity that the first and second target images are moved must be made relative It is conditioned with answering.
Figure 127 shows the example of the diagram of the see-through view of surrounding, and wherein profile shows display visual field 12723 Less than typical perspective visual field 12722.
Figure 128 shows the diagram of the captured images of surrounding, and the captured images can compared with shown image Being substantially bigger visual field so that the version that cuts of the captured images of environment can be used for alignment procedures.
Figure 129 a show the diagram of first object image 12928, and Figure 129 b show the second target image 12929 Diagram, wherein target image 12928 and 12929 includes witness marking 12926 and 12927 in relative corresponding corner.
Figure 130 is shown by the diagram of the first object image 12928 in superimposition to see-through view, wherein first object figure As 12928 be moved to be aligned relative to the corresponding objects in see-through view by using eye tracks control with can See the part of the adjacent first object image of labelling 12926.It is noted that before alignment is adjusted to improve, shown figure As in object be shown as in Figure 130 it is less in terms of size of population compared with see-through view, but it is likewise possible that Size of population can be bigger before regulation.
Figure 131 is shown by the diagram of the second target image 12929 in superimposition to see-through view, wherein the second target figure Moved by using eye tracks control as 12929, be aligned relative to the corresponding objects in see-through view with The part of the second adjacent target image of witness marking 12927.The movement needs to be directed at first object image 12928, and Second target image 12929 is subsequently used for determining for the regulation of shown image so that shown image f iotaeld-of-view 12723 It is improved with the accuracy of the alignment of perspective visual field 12722.Regulation determined by wherein for shown image can be with Be included in the regulation in terms of size of population, image cut and shown image is in shown image f iotaeld-of-view 12723 Vertically and horizontally position.By to target image addition at least many witness markings and using at least many steps again again Suddenly carry out to be positioned relative to the see-through view of environment target image, it may be determined that rotation adjusts further to improve shown figure As the alignment with the see-through view of environment.The shown figure of the see-through view for being sized and being aligned to match surrounding is shown The single figure of the diagram of picture is not illustrated, because it will appear to similar Figure 127.Determined by adjust then can be used for Improve the alignment of other display images and the see-through view of surrounding so that the region in shown image can be with mapped To in see-through view when being watched in head mounted display by positioned at the corresponding region at shown image rear.Determined Regulation can be also used for that the movement of eyes of user is mapped to such as institute in the camera from the facing external around image of environment Region in the see-through view of the environment of capture so that can determine that where user just look in environment around.Additionally, passing through The image for being captured of analysis environments, it may be determined that what user just look in environment around.
In other another embodiment, eye tracks control be used by a user in the size of the image for adjusting shown and Adjust the position of shown image to match the see-through view of surrounding.In this method, by head mounted display Facing external camera capturing the image of surrounding.The image of surrounding is then in shown image f iotaeld-of-view User is displayed in 12723, therefore user is seen by the surrounding in the see-through view of superimposition to surrounding simultaneously Shown image.Then user is performed two to shown image using eye tracks control and is adjusted, with around improving The alignment of the shown image of environment and the see-through view of surrounding.First regulation is to regard relative to the perspective of surrounding The size of figure is adjusting the size of the shown image of surrounding.The regulation can be performed by user, such as by eyes Long blink starting to adjust, be followed by eyes slip it is mobile come increase or image shown by reducing size.Another length is blinked Eye terminates to reset size process.Second regulation is to position shown image to improve shown image and the week of surrounding The alignment of the see-through view in collarette border.The regulation can be performed by user, for example, start to adjust by the long blink of eyes, after Movement is indicated with the movement of the glide direction of eyes, so as to by the see-through view of shown image alignment to environment.Should Regulation process can be performed once for an eyes so that can be by independently for the image shown by left eye and right eye Position the viewing of the improvement for stereo-picture.Determined by adjust then be used together with other display images, with improve Other display images are aligned and determine such as the image rear in head mounted display as shown in the see-through view of environment The mapping of the see-through view seen.Determined by adjust and can be also used for that the movement of eyes of user is mapped to such as from facing out Region in the see-through view of the environment that the camera in portion is captured in the image of environment around so that can determine user in week Where just look in collarette border.Additionally, by analyzing captured ambient image, it may be determined that user is just seen in environment around What.
Although describing in above example for display content control and regulation already in connection with eye tracks are input into Some it should be appreciated that arrive, external user interface with reference to eye tracks control or can replace eye tracks control and quilt Use.For example, when shown content is present in the visual field of head mounted display, touch pad, stick, pushbutton unit Etc. can be used for being directed at content with surrounding.
In embodiment, shown content can be depended on positioned at the feelings at displayed content rear in perspective shows Scape background and carry out color adaptation, to compensate the color of scene background so that shown content look like appropriate ground colour put down Weighing apparatus.For example, if scene background(Shown content by superimposition thereon)It is red(Such as red brick wall), then institute The content of display can be conditioned to reduce its content of red because some in the content of red of scene will transmit through it is shown Content and be seen, and therefore contribute to the content of red in shown content.
In embodiment, shown content can be conditioned as described herein(For example, it is aobvious with by perspective Show that the scene that device is watched is distinguished or mixed), this is carried out by following:Adjust by being adapted to illumination reflective display The color and/or intensity of the light produced by illumination system, adjusted by software image process picture material, adjust transmitting show Intensity of one or more colors of device, etc..
In embodiment, have an X-rayed scene brightness and/or color can be based on it is as that display is watched or with other in passed through The average perspective brightness of the scene of the close head mounted display of mode and/or color, substantially by the view of see-through display In object brightness and/or color, eyes direction(Eye position based on eye imaging as described herein), compass court To, etc..
Inventor has found:In the head mounted display including multiple folding optics, can it is advantageous to Improve image quality with the solid prisms with included fold surface and enable greater compactness of form factor real It is existing.They have also been discovered that:Solid prisms are manufactured by molding may be challenging to due to shrink mark, and the shrink mark leads to Often occur on a planar surface.In addition, provide illumination light with required angle special consideration is needed in solid prisms.With The imaging of family eyes can be used for user's identification and the key character as user interface in head mounted display.Herein In provide eye imaging devices for various head mounted displays.
An aspect of of the present present invention is related to a kind of solid prisms, and the solid prisms have the manufacturability and design for improving Modification, it is described to be related to modification and enable illumination light and be efficiently supplied in solid prisms enter image source with required angle Row illumination.
An aspect of of the present present invention is related to a kind of solid prisms, and the solid prisms have fold surface platform, wherein optics Flat fold surface is installed on the fold surface platform of prism so that fold surface maintains high optical flatness, its Minimize the deviation in the fold surface platform of prism.
An aspect of of the present present invention is related to provide additional optical signature in solid prisms, and it is used for using eye imaging phase Machine is capturing the image of eyes of user.
An aspect of of the present present invention is related to solid prisms and provides fold surface, and wherein solid prisms include the input of shaping And/or output surface, it serves as refractive power and produces optical system.
An aspect of of the present present invention is related to a kind of solid prisms, and there is the solid prisms refractive power to produce surface and have Secondary power lens above combiner so that the physics size of the power lens above combiner is reduced, so as to subtract The size of population of little optical system.
An aspect of of the present present invention is related to a kind of solid prisms, figure of the solid prisms in the optical path from display As having the surface with refractive power at optical receiving end, wherein the additional field lenses with refractive power are positioned in display and band is bent Further increasing the refractive power of optical system between the surface of luminous power.
An aspect of of the present present invention is related to a kind of solid prisms, and the solid prisms have fold surface, the fold surface Including the input with refractive power and/or output surface and it is being suitable to reduce lateral chromatic aberration and thus improve be provided to user Image quality relevant optical material in the middle of material select.
An aspect of of the present present invention is related to a kind of angled backlight assembly, its by including prism film by illumination light direction Image source is redirected, and wherein prism is positioned on the side of backlight so that prism serves as Fresnel wedge.
An aspect of of the present present invention is related to spuious light management system, and it is adapted to management by used in back light system Veiling glare produced by prism film, wherein prism film cause significant veiling glare and analysis polarizer film is positioned in image light With veiling glare as absorbing in optical path.
An aspect of of the present present invention is related to launch display system, and image light is projected the solid prisms with fold surface by it In, for image light to be delivered to the eyes of user.
An aspect of of the present present invention is related to the part by display optics and towards combiner surface projecting photograph Mingguang City, wherein illumination light are reflect off and are directly toward the eye reflections of user from combiner surface, so as to carry out to eyes Illumination is for eye imaging.In embodiment, display optics include solid prisms, and light source is installed in solid rib The fold surface top of mirror.
An aspect of of the present present invention is related to directly capture eye image from combiner, and wherein eye imaging camera is installed in group Clutch top.In embodiment, eyes light is positioned at the top of combiner, therefore eyes are by direct lighting.
An aspect of of the present present invention is related to be applied to the surface of combiner, wherein the surface is used in see-through display Visual field outside and be adapted to reduce veiling glare reflection be reflect off from combiner and towards the eye reflections of user.
An aspect of of the present present invention is related to be applied to the surface of combiner, wherein the surface is adapted to reflect infrared light And pass through visible ray so as to be minimized towards the visible veiling glare reflection of eyes of user, and cause from infrared light Eye reflections of the infrared light in source towards user.Then infrared external reflection can be used for eye imaging.
An aspect of of the present present invention is related to carry out eye imaging by waveguide optical devices, and the waveguide optical devices are adapted It is perspective into transmission image light and for the User of surrounding, wherein eye imaging camera is oriented to lead to Cross waveguide optical devices to receive eye image so that the position capture images from front of eyes of user.
An aspect of of the present present invention is related to carry out eye by capturing the reflected light left from the outer surface of waveguide optical devices Eyeball is imaged, and the waveguide optical devices are adapted to transmission image light and are perspectives for the User of surrounding 's.
Figure 132 shows the diagram of the multiple folding optics for head mounted display, the multiple folding optics Device includes solid prisms 13250.Wherein solid prisms 13250 include plane surface 13254(That is the first fold surface), it is described Plane surface 13254 be it is reflexive with image light 13230 is redirected and thus to optical axis 13235 provide the first folding It is folded, so that multiple folding optics can be compacter than the optics for not including the folding.As shown in Figure 132, Second folding of optical axis 13235 is provided in the low portion of multiple folding optics, and wherein image light 13230 is by combining Device 13210(That is the second fold surface)Reflection, therefore image light 13230 is directed into the eyes frame that the eyes of user are located at In 13220, as previously having been described above herein.Plane surface 13254 can be completely reflecting mirror so that all of image light 13230 are reflected, and wherein image source 13260 must be self-luminous image source(Such as OLED)Or backlight image source (such as LCD), So that directly image light 13230 is provided by image source 13260.If however, image source 13260 is reflectogram image source(Such as LCOS, FLCOS or DLP), then illumination light must be supplied, then the illumination light is reflected by image source 13260, to provide image Light 13230.In the case of wherein reflectogram image source is LCOS or FLCOS, wherein illumination light is needed with high angle of incidence, flat table Face 13254 can be part mirror so that can be from positioned at the rear of plane surface 13254 and pointing to the light source of image source 13260 Illumination light is provided.In the case that wherein reflectogram image source is DLP, wherein illumination light is needed in matching with mirror angle Angle, can extend plane surface 13254, or can provide additional surface so that can from positioned at plane surface 13254 or The light source at additional surface rear provides light.In embodiment, the first advantage that solid prisms 13250 are provided is image light 13230 cone angle is reduced in solid prisms 13250, thus extends optical path length so that folding can be provided To optical axis 13235, the greater compactness of size thus, it is possible to realize multiple folding optics.The second of solid prisms 13250 is excellent Point is that plane surface 13254 provides internal reflection so that dust can not be assembled in reflective surface.The of solid prisms 13250 Three advantages are the outer surface blackening by making not need transmitted light, and veiling glare is more easily controlled.
In addition to by being reflected off coming from plane surface 13254 folding optical axis 13235, solid prisms 13250 are also Refractive power can be provided, because input and output surface 13252 can be bendings.Figure 132 shows with refractive power two Individual surface 13252.By providing some in the refractive power wanted needed for multiple folding optics, power lens 13240 Refractive power as much need not be provided, and as a result, power lens 13240 are thinner and multiple folding optics Thus size of population is reduced.Field lenses 13270 can also be provided to be combined with solid prisms 13250 and power lens 13240 Work.By material by field lenses 13270, solid prisms 13250 and power lens 13240 select be in refractive index and Abbe numbers aspect is different(Flint and crown glass property are combined, as is known to persons skilled in the art), it is being provided to Lateral chromatic aberration in the image light 13230 of eyes frame 13220 can be considerably reduced, and thus improve particularly in image The acutance of the image perceived by user in corner.
In multiple folding optics, the surface of optical axis 13235 is folded(13254 and 13210)It is preferably optically flat 's(For example flatness is better than 10 microns), to maintain the wavefront of image light 13230 and thus be supplied to the image of high-quality User.These surfaces can be inclined with the upper part of complementary optics relative to optical axis 13235(Prolong from image source 13260 Reach the basal surface of solid prisms)Relative to the low portion of optics(Eyes frame is extended to from power lens)Torsion, As previously having been described above in the text.
It is probably difficult that plastic solidification prism 13250 is manufactured by molding, because solid prisms 13250 have inequality Even thickness and it potentially includes curved surface and flat surfaces.The injection molding of curved surface needs and molds for injecting Flat surfaces required for process different processes be set arrange.Especially, when the uneven thickness of the plastics under flat surfaces When even(When in this way for solid prisms 13250), optically flat surface may be very difficult in the case of without shrink mark Injection molding.In order to overcome the difficulty, this disclosure provides individually reflecting plate 13275, it is used to set up the flat of improvement Smooth surface 13254.Reflecting plate 13275 can be manufactured by using sheet manufacturing processes, to provide the optics of high level Flatness.In a preferred embodiment, reflecting plate 13275 is to be coated to provide reflexive glass plate.If wherein Image source 13260 is self-emitting display, then coating can be completely reflecting mirror, or is shown if image source 13260 is reflexive Show device, then coating can be partially reflecting mirror.In a further preferred embodiment, reflecting plate 13275 includes having reflection inclined Shake device(Such as Moxtek(Orem, UT)Proflux wire-grid polarizers)Glass plate so that the light quilt of a polarization state The light of reflection and inverted polarized state is transmitted.
Reflecting plate 13275 can be engaged to the plane surface of solid prisms 13250 by using clear binder 13254, the clear binder has very similar with the refractive index of solid prisms material(For example in +/- 0.05)Refractive index (Also referred to as refractive index match).By by the refractive index match of the refractive index of binding agent and solid prisms 13250, in solid prisms It is invisible that interface between material and binding agent becomes optics.In this way, binding agent can be filled in reflecting plate 13275 and consolidate Other of the plane surface by shrink mark, cut, groove or solid prisms between the plane surface 13254 of body prism 13250 are non-flat Any space caused by the degree of face.The flatness of the plane surface molded on solid prisms 13250 is then for multiple folding It is unimportant for the optical property of optics, and instead, the flatness of reflecting plate 13275 determines have what is improved to put down The new flat surfaces 13254 of face degree.In this way, the manufacture of solid prisms 13250 becomes easier to and less expensive, because Molding is needed not to be for plane surface 13254(Or otherwise manufacture)Optically flat surface, and for making solid The manufacture process of prism 13250 can be optimised for the surface 13252 with refractive power.In addition, by by reflecting plate 13275 Reflecting surface be joined to plane surface 13254, protect optics during the further assembling process of multiple folding optics Flat reflecting surface is without damage.
Figure 133 a, 133b and 133c to show and engage the step that solid prisms 13250 are associated with by reflecting plate 13275 Diagram.As shown in Figure 133 a, solid prisms 13250 are installed to serve engagement so that the approximate water of plane surface 13254 It is flat.With respect to low viscosity(Such as 200 centipoises)The drop 13377 of clear binder be applied to flat surfaces 13254.Its Middle binding agent is chosen to have the refractive index very similar with the material of solid prisms 13250 so that binding agent and solid rib Mirror is refractive index match.Then reflecting plate 13275 is made to contact with the drop 13377, as shown in Figure 133 b.Then allow viscous Mixture by capillarity and across(wick across)Interface between reflecting plate 13275 and plane surface 13254, until Till whole interface is covered by adhesive, as shown in Figure 133 c.Importantly, in embodiment, during engaging process, do not have Pressure is applied to reflecting plate 13275 so that reflecting plate 13275 is indeformable and optical flatness of reflecting plate 13275 is tieed up Hold.The drop 13377 for being used is relatively small, therefore interface is capped, oozes out at edge without binding agent.Binding agent is right Afterwards by waiting the time of suitable length, applying heat or applying UV light(As appropriate for binding agent)And consolidated Change.In a preferred embodiment, UV solidifications binding agent is used to provide quickly solidification.Reflecting plate 13275 is engaged into solid rib The advantage of mirror 13250 is that binding agent can fill any shrink mark being likely to be present on the plane surface of prism so that reflecting plate Plane surface 13254 is set up on 13275 surface, and the plane surface 13254 is with the flatness and aspiration level for improving Reflectance carrys out reflected image light 13230.Because the material of binding agent and solid prisms 13250 is refractive index match, so figure As light 13230 is delivered to the surface of reflecting plate 13275 from solid prisms 13250 through adhesive phase, and image light is not upset 13230 wavefront so that high image quality is maintained.
Figure 134 shows the diagram of the multiple folding optics for reflectogram image source, the multiple folding optics device Part has the backlight assembly for being positioned in the rear of reflecting plate 13275.Wherein, as shown in Figure 134, reflecting plate 13275 is part Reflecting mirror, at least a portion in its transmission light from a backlight to image source 13260 to be illuminated, and and then reflectogram As at least a portion of light 13230.In a preferred embodiment, reflecting plate 13275 is reflective polarizer, one polarization of its transmission State and reflect contrary polarization state.In this case, illumination light 13432 is provided with the first polarization state(For example P is inclined Shake)And image light 13230 is the second polarization state(Such as S-polarization).If image source 13260 is such as Chang Baise LCOS, When illumination light 13432 is reflected by image source 13260, there is the bright area in shown image in this change in polarization state In.As a result, the image light 13230 in the bright area of shown image by reflecting plate 13275 reflective polarizer reflect and Image light in the dark areas of shown image is transmitted by reflective polarizer so that the image light of only the second polarization state is delivered to In lens 13240.Backlight assembly includes prism film 13477, by the illumination light 13432 provided by photoconduction 13480 at least A part is deflected towards image source 13260.Wherein prism film 13477 can rotate film, such as Luminit companies(Tuo Lunsi, CA)The DTF of offer, or alternatively prism film can be brightness enhancement film, such as 3M(Sao Paulo, MN)The Vikuiti of offer BEF4-GT-90.Diffuser film 13478 is also included in backlight assembly providing the expectation cone of the light in illumination light 13432 Angle.Light source 13479 is also included in backlight assembly so that light is provided to photoconduction 13480, and wherein light source 13479 can be one Or multiple LED.Light source 13479 can provide white light or sequential color illumination(For example, red and then blue and then green illumination, Or the repetitive sequence of cyan and then fuchsin and then yellow illuminant), this depends on whether reflectogram image source includes color filter array.
In solid prisms 13250, the angle at illumination light 13432 can be provided solid prisms are entered by light The refraction effect of 13250 interface is limited.As an example, it then follows for across the snell law of the refraction at interface:
n1 sinθ1 = n2 sinθ2
In order in solid prisms with the interface normal shown in Figure 134 in approximate 30 degree angles offer illumination light 13432, such as Fruit prism material has 1.5 refractive index, and the light from backlight assembly must be provided to interface with approximate 50 degree.Wherein n1 It is the refractive index of the first medium that light is come from, θ 1 is angle of the light relative to the surface normal in first medium, and n2 is light The refractive index of the second medium gone to, and θ 2 is angle of the light relative to the surface normal in second medium.With with backlight group It is probably difficult that part provides illumination light 13432 in 50 degree of angles, because the rotation film of deflect light is by such wide-angle Unavailable.In order to reduce refraction effect, prism film 13477 is used as Fresnel wedge, and wherein smooth side is engaged to Reflecting plate 13275 and prism structure sensing backlight assembly.Figure 135 shows the prism film for being engaged to reflecting plate 13275 13477 diagram, the prism film 13477 shown in it is brightness enhancement film, and the linear prism surface that it has is oriented as place In with interface be in approximate 45 degree(It is consequently formed the linear prism with 90 degree of angles)And the clear binding agent 13578 of optics (Such as from 3M(Sao Paulo, MN)Available 8142KCL)Be used to for prism film 13477 to engage reflecting plate 13275.Should It is noted that wherein prism structure points to this orientation of light source and is generally used for brightness enhancement film(It is commonly used in a backlight Light is collimated)Orientation it is contrary.Instead, in the case of the orientation shown in Figure 135, it then follows as herein previously The light of entrance is split into two light cones by described snell law, 45 degree of surfaces of brightness enhancement film(Schemed in Figure 135 a It is shown as light 13532 and 13533), described two light cones have and are shone relative to the incidence from bubbler in the inner side of prism film 13477 Mingguang City is in approximate +/- 17 degree corresponding deflection angle, plane and reflecting plate of the incident illumination light approximately perpendicular to photoconduction 13480 13275 plane.Importantly, prism film provides the light quantity being greatly decreased between two light cones.Wherein in each light cone The cone angle of light is determined by the cone angle of bubbler 13478.The deflection angle of illumination light 13432 can be by the top of prism film Addition rotates film(It is not shown)To be changed, wherein rotating the angle that membrane change is provided to the illumination light of prism film 13477.Allusion quotation The rotation film of type(Such as from Luminit(Tuo Lunsi, CA)Available DTF films)20 degree of deflections of light are provided.Illumination light is then It is incident on 65 degree on a surface of prism film and with 25 degree and is incident on another surface of prism film.Prism film inner side Two illumination cones there are the deflection angles of+28 and -8 degree relative to the incident illumination light from bubbler, it is described incident to shine Mingguang City is approximately perpendicular to the plane of photoconduction 13480 and the plane of reflecting plate 13275.Because prism film 13477 is engaged to reflection Plate 13275 and reflecting plate is engaged to solid prisms 13250, thus the inner side of prism film 13477 light angle substantially In being maintained to solid prisms 13250, as long as the refractive index of prism film 13477, reflecting plate 13275 and solid prisms 13250 is closed Reason it is similar to.In this way, system enters horizontal deflection with following directions to the illumination light 13432 provided by backlight assembly:Institute State direction to guide illumination light 13432 towards image source 13260.Thus image source 13260 is shone by photoconduction 13480 in the following manner It is bright:The mode allows multiple folding optics to have such as the greater compactness of shape provided by the multiple folding of optical axis 13235 The shape factor.In the mill, prism film 13477 can be before or after reflecting plate 13275 be incorporated into solid prisms 13250 It is engaged to reflecting plate 13275.
Figure 135 a show the diagram of multiple folding optics, illustrated therein is two provided by prism film 13477 Individual illumination cone 13532 and 13533.When illumination light D32 is illuminated to image source 13260, illumination light 13533 is multiple A form of veiling glare in folded optics, it must be controlled to be supplied to the image light 13230 of high-contrast Eyes frame 13220 so that the image of Consumer's Experience high-contrast.Provided the advantage that by prism film 13477:It is approximately half Illumination light(13532)It is deflected towards image source 13260, and while second half illumination light(13533)It is inclined with following directions Turn:In the direction veiling glare can be controlled and wherein control veiling glare it is more difficult 13532 and 13533 between carry For little light.Figure 135 a include analysis polarizer 13582 to absorb being not used for image source of light from a backlight 13533 13260 parts being illuminated.Analysis polarizer 13582 be shown as being positioned at power lens 13240 and combiner 13210 it Between, however, analysis polarizer 13582 can also be positioned in the gap between solid prisms 13250 and power lens 13240 In.Analysis polarizer 13582 is orientated with its axis of homology so that the light of the polarization state of the bright area with image light is saturating Penetrate, and the light with illumination light 13533 and the polarization state of the dark areas of image light is absorbed.Thus, analysis polarizer leads to Cross veiling glare being associated with illumination light 13533 in the dark areas for reducing image and being associated with image light to provide dual mesh 's.
In the multiple folding optics with solid prisms, for eye tracks in user interface or for safe mesh Eye recognition purpose, additional optics can be added to for being imaged to eyes of user.Figure 136,137 and 138 show the different embodiments for being included in solid prisms the additional optics for being imaged to eyes of user Diagram.Figure 136 and 137 shows the side for being attached to solid prisms 13250 so that eyes camera 13610 can be to eye The diagram of the various views of the optical element 13612 that the eyes of user in eyeball frame 13220 is imaged.The quilt of optical element 13612 Be shown as single lens surface, the single lens surface relative to optical axis 13235 at an angle to provide visual field, it is described to regard Field includes the light 13613 reflected from the eyes of user.In this way, from eyes of user reflection light 13613 with image light 13230 similar modes are by multiple folding.However, optical element 13612 can include more than one lens surface and more than one Individual lens element is improving the resolution of eye imaging.Figure 137 shows how optical element 13612 can be positioned adjacent to Surface 13252 on solid prisms 13250.In the feelings of the optical element 13612 positioned as shown in Figure 136 and 137 Under condition, eyes camera 13610 is provided with the visual field including the light 13613 reflected by eyes, and with optical element 13612 Tend to extend to the upper part of eyes of user in associated visual field.Wherein the eyes of user can be by image light 13230 Passive illumination, or by being adjacent to eyes frame 13220 or be adjacent to the additional light of optical element 13612(It is not shown)Come actively Illumination.Additional light can be infrared light, as long as eyes camera 13610 can capture the infrared image of eyes of user.Figure 138 shows The diagram of another solid prisms 13250 with optical element 13812 is gone out, the optical element 13812 is positioned adjacent to In the top of solid prisms 13250 so that eyes camera 13814 can be imaged to eyes frame 13220.In this case, Optical element 13812 is attached to solid prisms 132450 and is designed to provide including the light reflected from eyes of user 13813 visual field.Light 13613 is reflected by eyes of user and follows single lap path to capture by eyes camera 13814.Wherein Tend to extend to the side of eyes of user in the visual field being associated with the optical element 13812 positioned as shown in Figure 138. It is directed in Figure 136,137 and 138 in two embodiments shown in eye imaging, optical element 13612 and 13812 is designed to In view of following facts:The light for being reflected by eyes of user passes through power lens 13240 and at least one of solid prisms 13250.From the point of view of manufacture visual angle, optical element 13612 and 13812 can be made as the attachment of solid prisms 13250, or Person is formed into the ingredient of solid prisms 13250, other surfaces of the ingredient together with solid prisms 13250 It is molded.
In a further embodiment, eye imaging is included for the multiple folding optics shown in Figure 132.Figure 139 diagrams for showing the eye imaging system for multiple folding optics, wherein image source are self-emitting displays, all Such as such as OLED or backlight LCD.In this case, reflecting plate 13275 is partially reflecting mirror, and it is joined to solid prisms 13250 Plane surface 13254, as described in previously herein.Alternatively, partially reflecting mirror coating can be applied directly to flat Face surface 13254, as long as plane surface 13254 is optically flat.The image light of partially reflecting mirror and then a reflection part 13230, so as to it be redirected towards lens 13240 and combiner 13210, in this place image light 13230 is by second of reflection And thus redirect image to be provided to eyes frame 13220 towards eyes of user.Meanwhile, the light reflected by eyes of user 13923 part is partially reflected mirror transmission and is captured by eyes camera 13922.Wherein, the eyes of user can be by scheming As light 13230 is passively illuminated, and additional active illumination light 13913 can be provided with to user's eye by eyes light 13912 Eyeball is illuminated.In a preferred embodiment, eyes light 13912 provides infrared illumination 13913 and 13922 pairs, eyes camera Infrared photaesthesia, in this way, illumination light 13913 does not disturb the image that user is shown to by image light 13230.Further excellent In the embodiment of choosing, partially reflecting mirror is cold reflector, its most visible ray of reflection(80% visible ray is greater than, 400-700nm)And transmit most infrared light(It is greater than 80% infrared light 800-1000nm).Another excellent in addition In selecting embodiment, combiner is at least partially coated with hot mirror coating, and it reflects infrared light and transmits visible ray.Its In for example, hot mirror coating can reflect the infrared light that provided by eyes light more than 80% and transmit and surrounding The associated visible ray of see-through view more than 50%.By connecting including cold reflector on reflecting plate 13275 or plane surface With the hot mirror on combiner 13210, the loss of the light 13923 reflected by eyes of user can be reduced, so that energy The bright image of eyes of user is enough captured, and is reduced needed for for active illumination is carried out to eyes of user by eyes light 13912 Power.
Figure 140 a and 140b show the diagram of the folded optics with combiner 14010, the combiner 14010 Image light 13230 to providing via top optics 1406 is redirected, and the top optics 1406 includes Image source and associated optics.Camera 14022 be provided for when eyes frame 13220 is positioned adjacent to Family eyes 1408 are imaged.There is provided eyes light 14012 to provide illumination light 14013, the illumination light 14013 is combined device 14010 reflections and thus it is directed toward the eyes 1408 of user.Wherein, camera 14022 is positioned to top optics 1406 side so that the light 14023 reflected by the eyes of user device 14010 that is combined reflects and captured by camera 14022. As described in previously herein, eyes light 14012 can provide infrared illumination 14013(Such as 850nm)And combiner 13220 can include hot mirror coating to reflect most infrared illumination 14013, and while providing the saturating of surrounding Depending on view.Eyes light 14012 can be positioned to the side of top optics 1406 and preferably eyes light 14012 is determined Position is into being adjacent to camera 14022 so that illumination light 14013 makes light 14023 reflect from eyes of user, with can efficiently by The distribution of the capture of camera 14022.For example, eyes light 14012 can be positioned in the sides adjacent of top optics 1406, such as In Figure 140 a and 140b like that, wherein eyes light 14012 is shown as being positioned on the dorsal part of top optics 1406, therefore The illumination light device that is combined reflects back towards eyes of user 140b, and camera 14022 is shown as in top optics On 1406 left side, but other arrangements are also possible.In a preferred embodiment, eyes light 14012 is compact LED, It is installed in the lower front edge of top optics 1406 and directly points back to eyes of user 1408.
In embodiment, combiner 14010 includes preventing the surface of the visible reflectance outside visual field.The surface can be with Including ARC and it can be only used in outside visual field.This is arranged in prevents eyes of the environment veiling glare to user Middle reflection aspect can be useful.In the case of without such surface, the light from environment can be from combiner surface It is reflect off and enters in eyes of user.
Figure 141 a and 141b show the diagram of the folded optics including waveguide 14132, and the waveguide 14132 has Angled partially reflecting surface 14135 and the reflecting surface with refractive power 14136.Wherein image source 14153 provides image light 14130, described image light 14130 is reflected by reflecting plate 14175 so that it is anti-that image light 14130 is sent to part by waveguide 14132 Reflective surface 14135, there locates image light and is transmitted to the reflecting surface 14136 with refractive power, there locates image light and is gathered Light and reflect back towards partially reflecting surface 14135.Then partially reflecting surface reflects and redirects image light so that Image light 14130 is provided to the eyes 1408 of user.In embodiment shown in Figure 141 a, eyes light 14112 is positioned Into the one end for being adjacent to waveguide 14132 so that illumination light 14113 points to the eyes 1408 of user.Camera 14122 is positioned in instead Penetrate the rear of plate 14175, wherein at least a portion of baffle reflection image light 14130 and transmit by the institute of eyes 1408 of user At least a portion of the light 14123 of reflection.Wherein reflecting plate 14175 can be partially reflecting mirror, reflective polarizer or preferred Embodiment in reflecting plate 14175 be cold reflector, cold reflector reflection visible ray and transmitted infrared light(For example, it is cold Reflecting mirror reflects greater than 80% visible ray, and 400 arrive 700nm, and transmit the infrared light provided by eyes light more than 80%, 800 arrive 1000nm).It will be noted that, in some cases, reflecting plate can be by coating(It is applied directly to waveguide 14132 Underlying plane surface)Replaced, as long as plane surface is optically flat.As described in previously herein, eyes light 14112 can provide infrared illumination 14113, as long as camera 14122 is sensitive to infrared light.By the way that camera 14122 is determined The light 14123 that position is reflected in the rear of angled reflecting plate 14175, image light 14130 and by the eyes 1408 of user can be with It is coaxial so that the image of the eyes of user 1408 for being captured is from the visual angle of user's dead ahead.Figure 141 b show separately One embodiment, wherein eyes light 14112 are positioned adjacent to camera 14122 so that illumination light 14113 with image light 14130 similar modes are transmitted and transmitted by waveguide 14132 by reflecting plates 14175, so that illumination light 14113 is towards user Eyes 1408 redirect.
Figure 142 a and 142b show the diagram of the folded optics for head mounted display, the folding optics device Part includes waveguide 14232 and the image source 14253 with least one holographic optical elements (HOE) 14242.In this embodiment, image Image light 14230 is provided waveguide 14232 by source 14253(It is not shown)So that holographic optical elements (HOE) 14242 can be with approximate 90 Degree redirects image light 14230 towards the eyes 1408 of user.There is provided camera 14222 to capture the figure of eyes of user 1408 Picture.Illumination light 14213 is provided eyes light 14212 eyes 1408 of user.Light 14223 is reflected simultaneously by the eyes 1408 of user And captured by camera 14222.As shown in Figure 142 a, eyes light 14212 is positioned to the side of waveguide 14232 and is adjacent to Camera 14222.Hot mirror coating(Wherein its reflectance spectrum is matched with the infrared spectrum provided by eyes light 14212)Quilt It is applied at least a portion 14224 of waveguide 14232 so that most light 14223 is reflected toward camera 14222, and The bright see-through view of surrounding is provided simultaneously.Figure 142 b show the similar folded optics for head mounted display Diagram, wherein waveguide 14232 with eyes of user 1408 being positioned to provide at an angle folded optics to user Head closer to cooperation.In this case, holographic optical elements (HOE) 14242 be designed to with waveguide in approximate 110 degree simultaneously And towards the eyes 1408 of user redirecting image light 14230.Camera 14222 be then positioned in waveguide 14232 with figure Relative one end of image source 14253, so that the angle between the light 14223 and illumination light 14213 reflected from eyes of user 1408 Degree can be reduced.In this way, it is possible to capture the image with the evenly eyes of user 1408 of brightness by camera 14222. As described in previously herein, at least a portion 14224 of waveguide 14232 can be hot mirror, with to by eyes of user The major part of 1408 light 14223 for being reflected is reflected, and while providing the bright see-through view of surrounding.
Figure 143 shows the diagram of the folded optics for head mounted display, and wherein illumination light is injected into ripple Redirect in leading and by holographic optical elements (HOE) so that the eyes of user are illuminated.Eyes light 14312 is positioned in waveguide 14232 one end so that illumination light 14313 can be injected in waveguide 14232 and be passed together with image light 14230 It is sent to holographic optical elements (HOE) 14242.Holographic optical elements (HOE) 14242 is then by image light 14230 and illumination light 14313 towards user Eyes 1408 redirect.Then holographic optical elements (HOE) 14242 allows for redirecting image light 14230 and illumination light 14313 The two, wherein image light 14230 is visible ray and illumination light 14313 can be infrared light.Reflected by the eyes of user Then light 14223 capture by waveguide surface reflection and by camera 14222.Hot mirror coating(Its reflectance spectrum with by eyes The infrared spectrum matching that light 14212 is provided)It is applied at least a portion 14224 of waveguide 14232 so that most light 14223 reflect towards camera 14222 and while provide the bright see-through view of surrounding.The advantage of this design can be to make Must include that the illumination illumination system of eyes light 14312 is compacter.Figure 144 shows the folding optics for head mounted display The diagram of device, the folded optics are similar to the system shown in Figure 143, wherein a series of angled parts are reflected Mirror 14442 is included in the waveguide, rather than holographic optical elements (HOE).In this case, illumination light 14413 is together with by image source 14253 image lights 14230 for being provided are injected into together in waveguide 14432.Illumination light 14413 and image light 14230 are by ripple Lead 14432 and be sent to a series of angled partially reflecting mirrors 14442, the angled part mirror is by illumination light 144134 and image light 14230 redirect towards the eyes 1408 of user.The light 14223 that eyes of user 1408 is reflected is by least The hot mirror coating for being applied to a part 14224 for waveguide 14432 is reflected, wherein the reflectance spectrum of hot mirror with by eye The infrared spectrum matching of the illumination light 144134 that eyeball light 14212 is provided.It is tight that the advantage of this design is illumination illumination system It is gathering and can easily make a series of angled partially reflecting mirrors in visual picture light 14230 and infrared illumination Upper operation both 14413.
When augmented reality application is used for using head mounted display, particularly when head mounted display provides surrounding See-through view when, it may be important that the depth of focus that shown image is presented in can be changed.It is also important that appropriate Vergence distance at present stereo-picture, the depth perception being intended to is supplied to into user.Wherein focusing distance is following Distance:The eyes of user must focus at the distance to watch sharp image, and vergence distance is two of user Get up to watch the distance of image or the identical point in real object.In stereo-picture, it is intended that be perceived as in different depth The object rendered transverse shift that is presented between the relative position of the object in left image and right image, this is claimed For parallax.Most of parallax for pointing to object that renders of the typical stereo imagery watched such as in theater or on TV is mapped to produce Raw 3D effect, because focusing distance is limited to theatre screen or TV(Referring to paper " Nonlinear disparity mapping for stereoscopic 3D”, M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, M. Gross, ACM Transactions on Graphics (factors of influence: 3.73). 07/2010; 29. DOI: 10.1145/1833349.1778812).In order that stereos copic viewing experience is more comfortable for a user, strengthen with viewing The associated vergence distance of real-world object should the focusing distance that is associated with identical augmented reality object of tight fit, thus Enable augmented reality object more closely similar to the real object seen by the user of head mounted display.According to this The system and method for the principle of invention are provided with the side of the real object in the see-through view for more closely matching surrounding Formula come the enhancing that changes with watched in head mounted display show focusing distance that object and image be associated and vergence away from From method.
The focusing distance of shown image is in the optics by head mounted display in any head mounted display Element determining.Can pass through change optics in element or by change optics in some elements it is relative Position to change the focusing distance of image.The vergence distance being associated with stereo-picture is by the left eye of user and regarding for right eye The located lateral of the image in is determining.Vergence distance can be by making the left image and right image phase in the visual field of user For laterally shifting to change, the transverse shift is by carrying out resetting a little thus to left optics and right optics Set up different convergent point between left optics and right optics or by digitally shifting showing in visual field Shown image is carrying out.In order to provide more closely similar in appearance to the augmented reality of the viewing experience being associated with real object The stereos copic viewing experience of object, it is important that focusing distance matches shown in head mounted display in the restriction of eyes of user Stereo-picture in augmented reality object vergence distance.Stereo-picture is often positioned in view of augmented reality object Jing At interior different distance and because different augmented reality activities is carried out at different distances, inventor has discovered that to be needed Want method to change focusing distance with the corresponding change in vergence distance in all types of head mounted displays.
Figure 145 shows the diagram of the optical module based on beam splitter for head mounted display(From side and from Eye position is illustrated), the optical module based on beam splitter includes top optics 14510 and combiner 14520.Wherein Top optics 14510 includes image source, light source and one or more lens elements.Combiner 14520 is beam splitter, its By a part for the image light being associated with shown image towards user eye reflections, and while also allowing from surrounding The light of environment is transmitted so that user is seen by the shown image in the see-through view of superimposition to surrounding.Figure 146 is illustrated For the diagram of the optical module of head mounted display(Also illustrate from side and from eye position), the optical module is Jing is modified to focus on shift component 14625 to change focusing distance by addition.It is have wherein to focus on shift component 14625 The thin lenss of refractive power.For example, need to the focusing shift component 14625 needed for 1 meter from infinitely great change for by focusing distance - 1 dioptric refractive power is provided.Thus, it can be refractor to focus on shift component 14625, the one of such as ophthalmic lens Part, it is 1 to 1.5mm thick.Alternatively, it can be Fresnel lens to focus on shift component 14625, and it can be more saturating than reflecting Mirror is thinner.The top of combiner 14520 is positioned at by the way that shift component 14625 will be focused on, the refractive power of shift component 14625 is focused on Act only on shown image and do not change the see-through view of surrounding.The method can be used for wear-type Any kind of optics of display(For example there are the projection optics of perspective combiner, with perspective combiner Hologram image grenade instrumentation, with perspective waveguide, the perspective optics of TIR waveguides, etc.)In, wherein space can be used for by Focusing shift component with refractive power is inserted in optical path so that focusing distance is changed and does not change see-through view. In the case where top optics 14510 utilizes polarization image light, polarization control component 14515 can be included to modification figure As the polarization state of light.Wherein polarization control component can include it is following in one or more:Remove undesired polarization shape The polariser of state, image light is changed over into circularly polarized delayer(Such as quarter-wave film)Or the half of change polarization state Ripple film.
When the eyes of wherein user can not be focused at the focusing distance being associated with shown image, Correcting lens element may be provided in optical device module rear to improve the acutance of the shown image perceived by user. In this case, correcting lens element is based on the prescription of user and correcting lens element improves surrounding for user The view of both see-through view and shown image.Figure 146 a show the optics mould including correcting lens element 14624 The diagram of the side view of block.Correcting lens element 14624 can have positive refractive power or negative refractive power, such as by user for viewing As required for shown image at focusing distance.In addition, correcting lens element can also include astigmatism and wedge, such as It is included in the prescription of user.Correcting lens element 14624 for left eye and right eye can be connected to each other to carry For correcting unit, the correcting unit is attached and is aligned with the framework of optical device module or head mounted display, wherein having Have between built-in pupil and be spaced between interval or flexible pupil.Alternatively, left and right correcting lens element 14624 can be point From and individually with the framework of optical device module or head mounted display be attached and be aligned.For example, for wherein showing The image for showing is presented with 0.6 meter of focusing distance and vergence distance so that augmented reality object or information can be provided For at brachium perform task application, focus on shift component 14625 can have -1.6 dioptric refractive powers and Refractive power can be only provided, and correcting lens element 14624 can have+2 dioptric refractive powers and also according to user Prescription correction for astigmatism and wedge is provided.Wherein+2 diopter correction lens elements 14624 will be for greatly The fairly typical prescription of the reading spectacles of the people of about 55 years old, and thus this people will be enabled clearly to watch and be positioned Object and image at brachium.Correcting lens element 14624 shown in Figure 146 a is refractor, but other kinds of Lens are also possible, such as Fresnel lens.
Although the lens with fixed optical power are shown for focusing on shift component 14625 and correcting lens element 14624, it is also possible to using the lens with adjustable diopter power.Using slip lens element(Referring to United States Patent (USP) 3,305, 294)Or the adjustable lens of liquid injection can be obtained for example from the Adlens positioned at England Oxford:https:// www.adlens.com/.The adjustable lens of electricity are also used as correcting lens, such as:From LensVector(Sen Niweier, CA) Available liquid crystal lens or from Varioptic(Lyons, France)Available liquid lens.
In addition, optical module can be installed in the framework of head mounted display so that they are slightly towards each other( Referred to as introversion(toe-in))To provide focusing distance.Thus, the knot that focusing distance passes through the optics in head mounted display Structure arranges to establish, and vergence distance can pass through the horizontal numeral of the similar portions of the left image and right image being shown Shift to be adjusted to produce the parallax of the part for image.Focusing distance and then establish by user for not regarding The baseline vergence distance that the stereo-picture rendered in the case of difference is perceived.In order to the stereos copic viewing for providing improvement is experienced, with The associated focusing distance of the structure setting of optics must render what is be associated with the shown object in stereo-picture It is considered during parallax.This have matched focusing distance and vergence distance for the augmented reality object in stereo-picture wherein Wear-type display system in be particular importance.Thus, initially it is rendered the wash with watercolours of the stereo-picture for watching in theater Dye may need the viewing of the improvement being adjusted in head mounted display.If stereo-picture is in the feelings without parallax If being rendered under condition, focusing distance can be also used for establishing the perceived distance with whole image, and this is for such as wear-type meter The application of calculation machine etc can be it is useful, wherein the desktop screen being associated with computer be perceived as in by assemble away from The place with a distance from being established.However, focusing distance can not be too near to user, because left image and right image will experience contrary version Trapezoidal distortion.For example, if the eyes of user have separated approximate 63.5mm, can be by pressing 0.75 degree by optics mould Block points to each other to provide 2.4 meters of focusing distance.Inventor has found:0.75 degree of introversion causes the ladder of negligible level Shape distortion.Closer to focusing distance need the introversion of greater angle, it is and thus trapezoidal between left image and right image Distortion makes the acutance for being perceived in the corner of stereo-picture degrade.The trapezoidal distortion can be by using matching and opposite horizontal Trapezoidal predistortion and render left image and right image being compensated.
Figure 147 shows the left optical device module and right optical device module being joined together in casing 14727 Diagram, wherein the rear of casing 14727 that will be in from the eyes of user illustrates diagram.Casing 14727 allows optics Module is built as single unit, and the single unit is assembled in head mounted display.Existed by making casing 14727 It is rigid in structure, when necessary, before being assembled in head mounted display, optical device module can be relative to that This is physically aligned and focusing distance and focusing distance can be examined and adjust, so as to the manufacture for providing additional is flexible Property.
Figure 147 also show be connected focus on shift component in 14731 for left optical device module and right light Learn the focusing shift component 14625 of device blocks.Linked together by the way that shift component 14625 will be focused on, for different distance When required for the augmented reality imaging at place, it is easier to add a pair of focusing shift components.Shift component is focused on in 14731 Focus on shift component 14625 between connection can be rigid, as shown in Figure 147, or can be flexible so that The different interval that shift component can be adjusted between left optical device module and right optical device module to 14731 must be focused on, Wherein the casing with different in width is used for the user with the different interval between its eye.Wherein there are various refractive powers Focus on shift component 14625 be used for provide different focusing distances for needing image to be displayed on for shown image Augmented reality activity at different operating distances.Focusing on shift component 14625 can be to be not for left eye and right eye With, with the focusing distance different with right eye offer as left eye.Focusing on shift component 14625 can be with the feelings without refractive power It is provided under condition so that they play a part of the protection window for top optics 14510.
In the most simple form, the pattern being associated with change focusing distance and vergence distance changes and can be led to by user Cross user interface(Such as button or graphical user interface)Input information and select an option to realize.The confirmation that pattern is changed Then can be in the image for showing(Such as show visual field perimeter coloured frame or statement " for brachium shows The message of the pattern change of initiation ")On be supplied to user.In the pattern of more automatization changes, sensor can be provided 14730, its sensing focuses on shift component to 14731 so that image automatically can be presented in the case of transverse shift, institute State transverse shift and the different vergence distances matched from the focusing distance provided by focusing shift component 14625 are provided.Sensing Device 14730 can simply sense focusing shift component and whether there is to 14731.Alternatively, sensor 14730 can be detected Corresponding with the focusing distance or refractive power that are provided by focusing shift component 14625 shift component that focuses on is on 14731 Code(Such as bar code)So that shown image can by automatically digital transverse shift with provide the vergence of matching away from From.Sensor may be located at center, and as shown in Figure 147, but other positions are also possible, such as positioned at side.Code Can be on one of optical surface or on the edge for focusing on shift component 14625, and sensor 14730 can be with corresponding Mode is being orientated to read code.If focusing on shift component 14625 is not connected focusing shift component in 14731, Then two sensors 14730 can be provided with a sensor 14731 on every side.When focusing on, shift component 14625 is tested When measuring, shown image can be in response to the behaviour that implied by the presence of detected focusing shift component 14625 Change in operation mode and be automatically changed.Except such as the transverse shift of previously herein the change vergence distance for discussing Outside, when there is focusing shift component, other changes can be made to the presentation of shown image, including:Size, amplification Rate, form(Such as 4:3 replace 16:9), color, contrast, dynamic range or resolution.Wherein make and these of image are changed Become, to improve the viewing body for user when such as operating at different display distance in augmented reality activity Test.Change in amplification and form is particular importance in the case of the change of this pattern, because changing vergence distance Image transverse shift cause it is available show visual field certain prune and with focus on dioptric that shift component 14625 is associated Power changes the overall refractive power of display optics.
Figure 148 and 149 shows how shown image can be being shown in visual field by digital transverse shift to change The vergence distance seen by user.Figure 148 shows left image and right image, respectively 14841 and 14843, it is provided In left display visual field and right display visual field(Respectively 14840 and 14842)At interior nominal vergence distance.It is wherein nominal poly- scattered Spend by the alignment relative to each other of optical device module in head mounted display to be established.Nominal vergence distance can be with example It is infinitely great in this way, wherein the optical axis of left display visual field and right display visual field will be parallel to each other.In a preferred embodiment, left display Visual field and right display visual field(14840 and 14842)Optical axis each by approximate 0.75 degree and introversion so that for having in its eye For the typical user being spaced between the pupil between eyeball being 63.5mm, nominal vergence distance is established at approximate 2.4 meters.Figure 149 show left image 14941 and right image 14943 how respectively in left display visual field 14940 and right display visual field 14942 It is essentially displaced laterally toward each other, to provide shorter vergence distance.By by left image 14941 and the direction of right image 14943 Displaced from one another, the eyes of user must be pointed to somewhat each other, to watch a left side as the solid pair with shorter vergence distance Image 14941 and right image 14943.For the comfort level of the improvement in viewing solid pair, focusing distance should be with vergence Distance matching.In transverse shift left image 14941 and right image 14943, left display visual field and right display visual field(It is illustrated as 14945 and 14946)Part become unavailable for three-dimensional imaging because those regions do not overlap in the visual field of user.Cause And, when head mounted display is with different from the vergence distance of nominal vergence distance to use, left display visual field 40 and the right side The available size for showing visual field 14942 is contracted by.Carry out the numerical shift of left image 14941 and right image 14943 to provide not Advantage with vergence distance is:Being switched to different vergence distances from nominal vergence distance can need not change head The physics of the optical device module in head mounted displays is carried out in the case of arranging.In order to reduce the pruning for showing visual field, in figure Extra pixel, the extra pixel can be used on image source to be grasped with the pattern for wherein needing the transverse shift of image As when be generally not used for display image.For example, the image source with 1310 × 768 pixels is commonly used for display to be had The image of 1280 × 720 pixels so that perimeter additional pixels only in shown image by numerical shift changing Vergence apart from when used.Due to halation, using perimeter pixel shown by display image part it is bright Degree may need to increase.
As mentioned by previously herein, the change in focusing distance can also be by some units in change optics The relative localization of part is being provided.Figure 150 a and 150b show a kind of mechanism, and it is used for relative to top optics 14510 In one or more lens elements 15012 come mobile image source 15040 with changing in the focusing distance for providing shown image Become.Wherein as shown in Figure 150 b typically move up image source 15040 by focusing distance it is mobile further from and it is anti- It is as the same.Shown mechanism includes upper wedge thing 15042 and lower wedge thing 15043, and is respectively acting on core 15037 Solenoid 15035 and 15036 with 15038.Wherein core 15037 and 15038 is made and is attached to down by ferromagnetic material Portion's wedge 15043.Solenoid 15035 and 15036 includes the cylindrical winding of conducting wire so that when electric current is applied to line Thus Lu Shi, the lower wedge thing that corresponding core 15037 or 15038 is attracted in solenoid and is attached is moved to one Side or opposite side.Solenoid is fixed in the position relative to the shell of top optics 14510.With lower wedge thing 15043 transverse shiftings, upper wedge thing 15042 is together with being attached to the image source of upper wedge thing 15042 about 15040 It is mobile.Therefore, when electric current is applied to solenoid 15035, lower wedge thing 15043 is moved to the left, such as institute in Figure 150 b Show, and as a result, upper wedge thing 15042 is moved upward together with image source 15040, and focusing distance is increased Greatly.Similarly, when electric current is applied to solenoid 15036, lower wedge thing 15043 is moved rightwards, such as institute in Figure 150 a Show, upper wedge thing 15042 is moved downward together with image source 15040, and focusing distance is reduced.By using tool There is relatively shallow wedge shape object angle(Such as 5 to 15 degree)Upper wedge thing 15042 and lower wedge thing 15043, when going to helical When the electric current of pipe is diverted O150, wedge tends to stay in original position.Relative permanent magnet(It is not shown)Can be added to Wedge 15042 and 15043 is going to solenoidal electric current quilt to increase the friction between wedge, and thereby assist in Wedge is kept in situ when turning to O150.In this way, for operation solenoid(15035 and 15036)For required work( Rate can be very little, even if needing relatively large electric current to generate enough power to move lower wedge thing 15043.By to spiral shell Spool 15035 and 15036 alternately applies electric current, and focusing distance can alternately between two focusing distances(Such as at 2.4 meters Between focusing distance and 0.6 meter of focusing distance)Switch over.It is this change focusing distance method can with optics Focal plane uses any optics of micro-display(Such as it is based on the optics of waveguide or based on beam splitter cube Optics)It is used together.The arrangement can be used together with applying electric current with the pulse to solenoid 15035 and 15038, with Cause the step-by-step movement in wedge shape object location to change and the associated step-by-step movement in focusing distance changes, it is across continuously Scope, multiple step-by-step movement scopes etc..In addition, for the guiding of the movement of image source 15040 can be carried by sliding pin For the pin is through upper wedge thing 15042 or associated structure(It is not shown), wherein pin allow vertical shift and Prevent transverse shifting.
Figure 151 a and 151b show the upper wedge thing 15042 and lower wedge thing from the position of image source 15040 15043 diagram.As indicated, wedge 15042 and 15043 includes rectangular configuration, wherein their center is removed, such as studies in the same school Frame is such so that illumination light and image light can pass through wedge(15042 and 15043)With being capable of display image.This is being moved The mechanism of image source 15040 is positioned in the lower section of image source 15040(Along the optical path of image light)When be important. Figure 151 a determine corresponding to the wedge positioning shown in Figure 150 a, and Figure 151 b corresponding to the wedge shown in Figure 150 b Position.The advantage of the layout shown in Figure 150 a and 150b is:Wedge 15042 and F43 and other parts in mechanism do not increase The overall height of top optics 14510.
In alternate embodiment(It is not shown)In, the mechanism for mobile image source 15040 is positioned in image source 15040 tops, and then wedge(15042 and 15043)Can be solid wedge shape thing or make core be removed so that Obtain wire and be connectable to image source 15040.Other parts of wedge and the mechanism are positioned at into the top of image source 15040 Advantage is that image source can be positioned closer to lens element 15012, and this is probably important in some optical designs.
In another embodiment, wedge(15042 and 15043)Can be transparent and can cover image source 15040 whole aperture.Transparent wedge(F15042 and 15043)Can operate as previously described with mobile image source 15040.In addition, with wedge transverse shifting, the optical thickness of the combination of two wedges is to cover image source 15040 The function of the opposite wedge object location in the region of zone of action.This is due to the fact that:I.e. transparent wedge has than it By the higher refractive index of air for replacing.Because wedge is matching on slope, so the area that wherein wedge is overlapped The combination optical thickness in domain is uniform.Thus, the change in the combination optical thickness of the wedge for overlapping contributes to focusing Change in distance.
In order to further improve the shifting of image source 15040 and upper wedge thing 15042 when bottom wedge 15043 is moved Dynamic repeatability, alligator clamp can be used for exerting a force to image source 15040 or upper wedge thing 15042, to guarantee in table Contact is maintained between face.Figure 152 shows the diagram of the alligator clamp 15250 and 15252 to the applying power of image source 15040, wherein Image source 15040 is attached to upper wedge thing 15042.Alligator clamp 15250 and 15252 is by using screw 15253, ultrasonic bond Connect, binding agent or other connection systems and be attached to the shell of top optics 14510.In order to reduce in lower wedge thing The transverse shifting of image source 15040 during 15043 movement, one or two in alligator clamp 15250 and 15252 may be coupled to figure Image source 15040 or upper wedge thing 15042.In this way, vertical shift(It is as directed)It is permitted for by flexural spring Folder 15250 and H52 is changing focusing distance, and transverse shifting is not allowed to, this be due to alligator clamp in a lateral direction compared with High rigidity, particularly when two alligator clamps 15250 and 15252 are connected to image source 15040 or upper wedge thing 15042 If.
In another embodiment, the movement of lower wedge thing 15043 is by motor and driving screw(Rather than solenoid)Come Control.Wherein motor is connected to the shell of optical device module, and driving screw or core are connected to lower wedge thing 15043.Motor can be conventional electric rotating motivation, linear motor, vibration piezoelectric motors, induction conductivity etc.. Motor can also be controlled to make lower wedge thing 15043 move different distances, so as to provide various focusing distances.It is electronic Machine can be stepping motor, and the number of wherein stepping determines mobile distance.Sensor can also be provided to detect bottom wedge The movement of shape thing, driving screw or core, so as to improve the associated accuracy that mobile accuracy and focusing distance change.
In another embodiment, the movement of lower wedge thing 15043 by manual operation knob(It is not shown)To provide.Rotation Button is connected to driving screw, and the driving screw is threaded in lower wedge thing 15043.User's turning knob is moving lower wedge thing And it is achieved in the change in focusing distance.This can be used for the acutance of image shown by fine tuning and poly- for changing Defocus distance, so as to matching given vergence distance or being matched with focusing distance true in the see-through view for reaching surrounding The distance of real object.
In a further embodiment, correcting lens element 14624 can include a kind of mechanism(It is not shown)So that correction Lens element 14624 upward sliding or can swing to side, with thus from show remove in visual field and while remaining attached to head Head mounted displays.In this way, correcting lens element 14624 can be readily available for being used for head mounted display.This can To be useful, because correction is while both see-through views of the image and surrounding shown by acting on.There may be this When sample:At that time user will want can according to he participate in activity and change shown by image focusing distance or change Become surrounding see-through view focusing, and with the correcting lens element 14624 being readily useable will make this point can Realize.Especially, at extreme focusing distance(Such as brachium or closer to or in infinite general goal)When being operated, Yong Huke Correcting lens can be needed.In embodiment, it is in place that correcting lens 14624 can be manually or automatically displacement.
In other another embodiment, eyes camera be included in left optical device module and right optical device module with The eyes for determining user just look at where relative direction.Then the information be determined for the shown figure that user just look at The part of picture.Then focusing distance can be adjusted to match the augmented reality object phase in the part with shown image The vergence distance of association.His eyes are moved to the different augmented reality objects in shown image then as user Or the different piece of augmented reality object, automatically adjust focusing distance.Alternatively, eyes camera is determined for user's eye The vergence of eyeball and thereby determine that the distance that user just look in the see-through view of environment around.Then can be with user just The distance that look at accordingly adjusts focusing distance or vergence distance.Wherein focusing distance or vergence distance can be automatic Adjust to match distance that user just look in the see-through view of environment around or be conditioned with different distances, Therefore shown image does not disturb the User of surrounding.
Figure 153 a, 153b and 154 diagrams for showing example display optics including eye imaging.Figure 153 a and 153b shows display optics, and the display optics include top optics 14510 and combiner 14520 to incite somebody to action Image light 15370 provides the eyes of the user when viewing is by shown image in the see-through view of superimposition to surrounding will The eyes frame 15366 that can be located in.Eyes camera 15364 is provided on the side of top optics 14510 and is in Certain angle is reflected towards combiner 14520 with the device 14520 that is combined for capturing the eyes of user in eyes frame 15366 Light 15368.One or more LED 15362 are adjacent to top optics 14510 and wear to provide and be oriented to work as Illumination light 15367 is provided the eyes of eyes frame 15366 and user when formula display is just used by a user(Directly provide Or reflect from the optical surface of such as combiner 14520 etc).Wherein LED 15362 can provide infrared light 15367, only Eyes camera 15364 is wanted to infrared photaesthesia.
Figure 154 shows the diagram of display optics seen from above, and the display optics include projection light Learn device 15410, waveguide 15415 and holographic optical elements (HOE) 15417 and 15413.Projection optics 15410 can include one Or multiple optical elements 15412 are to change when needed image light 15470, so as to image light 15470 is coupled to into holographic optics In element 15413 and it is coupled in waveguide 15415.Optical element 15412 can change the wavelength of image light 15470, change The form of image light 15470, the size for changing image light 15470 make when needed the predistortion of image light 15470, so that figure As the eyes 15466 that light 15470 can present to user with the desired format with the distortion for reducing.Optical element 15412 can To include:Refractor, diffraction lenss, lens ring, free form lens, grating or light filter.Wherein holographic optical elements (HOE) 15413 deflect into the image light 15470 for being provided via projection optics 15410 in waveguide 15415, there image Light is sent to holographic optical elements (HOE) 15417.Holographic optical elements (HOE) 15417 then by image light 15470 towards user eyes 15466 deflections, there shown image by the image in the see-through view of superimposition to surrounding used as being watched.Eye Eyeball camera 15464 is provided for being captured when head mounted display is just used by a user the user reflected by the surface of waveguide The image of eyes.One or more LED 15462 are adjacent to waveguide 15415 and are provided, with the eyes 15466 of lighting consumer(Directly Ground connection is reflected from the surface of waveguide), and thus increase the brightness of the captured images of the eyes 15466 of user.Its Middle LED 15362 can provide infrared light, as long as eyes camera 15364 is to infrared photaesthesia.
In order to improve the efficiency of the eye imaging system shown in Figure 153 a, 153b and 154, coating can be applied to table Face, the coating will reflect from the light of eyes towards eyes camera.Coating can be hot mirror coating, its reflection infrared light And transmit visible ray.In this way, eyes camera can capture the bright image of eyes of user, and while around providing a user with The bright see-through view of environment.
Eyes camera(15364 or 15464)Can include focusing on automatically with when the eyes of user in various positions when (Such as when head mounted display is differently positioned on a user's head or when different users is just using head mounted display When)The focusing for automatically adjusting eyes camera is arranged.The wherein relative position of autofocus adjustment lens element, or regulation and pass The refractive power that the tunable lens element being coupled in the optics of eyes camera is associated, with the image for providing eyes of user More high-contrast.In addition, in the presence of correcting lens 14624, focusing automatically can automatically adjust and focus on and thereby compensate for rectify Plus lens 14624.In this case, the metadata record for preserving together with the image of eyes of user eyes cameras(15364 or 15464)Relative focus arrange, and the change in metadata is determined for correcting lens 14624 and whether there is.If Correcting lens 14624 are present, then can make the regulation of the focusing distance to display optics, that takes into account correcting lens 14624 presence.
User's pupil that the image of eyes of user can be used in the visual field by determining eyes inframe or eyes camera 15364 The relative position in hole is determining the view direction that user just look at.According to this information, it may be determined that what left eye and right eye just look at Relative direction.The relative direction information can be used for which part that identifying user just look at shown image.By relatively more same When the image that captures in user left eye and the relative direction of right eye, the difference in relative direction between left eye and right eye And the interocular distance between the eyes of user is determined for the vergence viewing distance that user just look at.Vergence is seen See that distance is determined for required in the displayed image focusing distance and vergence distance, to provide the user The augmented reality object of the sharp focus in shown image.Determined by vergence viewing distance can be associated with use The vergence distance of the part of the shown image that family just look at compares, to determine that user just look at shown image still The see-through view of surrounding.The different piece of shown image can be directed to and tune is made to focusing distance and vergence distance Section, with the image that sharp focus are presented to user in the part of the image that just look in user, or for operator scheme or Service condition and when needing, broad image is presented to user in the part of the image that user just look at.The wherein part of image Numeral obscure and may be used to the part of image and seem with such focusing distance, its image than leaving sharp keen image Part closer to or further from.In addition, vergence viewing distance can be with the portion for being associated with the stereo-picture that user just look at The parallax for dividing compares.It is tuned locally at the part of the parallax of stereo-picture and then the image that can just look in user, or Person's scaled adjusted three-dimensional depth to present to user in whole image on whole stereo-picture.
Head mounted display can include Inertial Measurement Unit to determine position, movement and the side of watching attentively of head mounted display To.Wherein Inertial Measurement Unit can include:Position determination system, such as GPS, electronic compass(To true in compass heading Determine direction of gaze), accelerograph and gyroscope(To determine movement)And inclination sensor(To determine vertical direction of gaze). View direction determined by image from eyes of user is more permissible compared with the direction of gaze determined by Inertial Measurement Unit The direction that just look at for user is allowed to determine compass direction.The compass direction in the direction that the position by determined by just look at user The object being combined in the surrounding that identifying user can be allowed just to look at.This identification can further by it is following come Improve:By the vergence viewing distance and compass in the direction that just look at for user towards with surrounding it is known in rise from The distance of user and the object in direction are compared.Such determination is for augmented reality and relative to real object Augmented reality object display for be probably it is important.
In order that focusing distance can be conditioned as user moves around his eyes in visual field, viewing distance is focused on Must be quickly determined and need quick adjustment of focusing system.Vergence and parallax in stereo-picture must be watched with focusing on Change determined by distance and be accordingly conditioned.Generally need for the imaging modification in wear-type display system The response time of 0.033 second or less, is negatively affected, such as Consumer's Experience with the viewing experience for preventing user by the waiting time To nausea(Referring to paper " Tolerance of Temporal Delay in Virtual Environments " R. Allison, L. Harris, M. Jenkin, U, Jasiobedzka, J. Zacher, I149E Virtual Reality 2001, 3/2001, p247-254, ISBN 0-7695-0948-7).When people watch attentively from remote object change to During nearly object, human eye can rapidly change vergence viewing distance, while focus adjustment obtains slower.In order to realize this Point, needs fast frame rate(Such as 60 frames/second is bigger)To capture the image of eyes of user, and image needs have height right Determine the relative position of eyes of user so that rapid image analysis can be realized than degree.The view direction of user and focus on viewing away from From then can be determined to further determine that user just look at where and what.Then quick focusing distance regulating system is needed Focusing distance is adjusted come interior at 0.5 second or less during the eyes that him is moved in user.
Figure 153 a, 153b, 154 show display optics, and the display optics are included respectively on projection top Focusing distance adjustment module 15360 in optics 14510 and optics 15410.Wherein focusing distance adjustment module 15360 can provide quick mechanism comes for relative to the position in remaining lens element mobile image source, thus changing and showing The focusing distance of diagram picture.It is important to recognize that focus adjustment module can be used in any class for head mounted display In the display optics of type(Such as wedge-shaped waveguide, the waveguide with multipath reflection bar, holographic projection system,(Except laser is swept Retouch outside projection system, because they are not focused)), because coming mobile image source to adjust relative to other display optics Section focusing distance is basic for display optics, and thus focus adjustment module is wide in head mounted display It is general available.
Figure 155 a, 155b, 156a, 156b, 157a, 157b, 158a, 158b, 159a and 159b show have and can carry The diagram of the focus adjustment module 15360 of the mechanism adjusted for quick focusing distance.In order that quick in head mounted display Focusing distance adjusts efficient, focus adjustment module 15360 need be traveling quick, quiet, that approximate 0.5mm is provided, it is compact, There is provided guiding to maintain the alignment between image source 15040 and remaining optics without inclining, in focusing distance scope It is controllable, low cost and low weight.
In a preferred embodiment, in order to provide focusing distance in change and do not change the size of shown image, carry For display optics, it is telecentricity at image source.Wherein telecentricity display optics provide parallel light shafts so that By display optics imaging image source region keep it is constant, and with for change for shown image focusing away from From it is required between image source and remaining optics with a distance from change it is unrelated.In certain embodiments, image source It is reflexive, and can also is telecentricity by the illumination light that light source is provided.Wherein, telecentric light light can be by illuminating Providing, the light source is at least with image source formed objects and provides broader light cone, wherein the only telecentricity portion of cone in source Divide and reflected by image source.Thus, the telecentricity display optics at image source provide the improvement viewing body for augmented reality Test, particularly when moving around its eye and providing the quick change for focusing distance in visual field with user.Make at this With under situation scene, the display optics using non-telecentricity at image source will cause such shown augmented reality pair As:The augmented reality object slightly changes in size when user moves its eye and is likely to that evil will be produced The heart.Conversely, by using telecentricity display optics, when user moves around its eye in visual field, focusing distance can be even Continuous ground alteration in comfort.Figure 161 provide non-telecentricity display optics example diagram, wherein with image light 16150 from Image source 15040 is advanced towards the display optics of the prism 16140 included with refractive power, the beam of image light 16150 Assemble.As a result, if image source 15040 is mobile closer to the combiner 16150 in display optics, the and of lens 16145 Prism 16140 with refractive power, then when user watches from the position of eyes frame 16155, image seems to become less, and Vice versa.By contrast, Figure 162 shows the example telecentricity including the prism 16240 for example with refractive power and lens 16245 The diagram of optics, the beam of wherein image light 16250 is parallel to each other.Therefore, as image source 15040 is so mobile that more to lean on Closely or further from the prism 16140 with refractive power, image is maintained in the display image watched from eyes frame 16155 by user Formed objects.
Figure 155 a, 155b, 156a, 156b, 157a, 157b, 158a and 158b show be positioned in image source and remaining Actuator and guide mechanism between optics.Each in Figure 155,156,157 and 158 is illustrated in two states Different institutions.By contrast, Figure 159 a and 159b show and are positioned in image source 15040 and for focus adjustment module Actuator and guide mechanism between the top of 15360 shell.Any one in shown actuator and guide mechanism can be with With some modifications(It is not shown)Any position in used.The selection for where positioning actuator and guide mechanism is depended on Where is it space can use in display optics and for the shell of head mounted display.If for actuator and guiding The space of mechanism is limited in display optics, then actuator and guide mechanism are positioned in image source top, such as scheme Shown in 159a and 159b.However, by the way that actuator and guide mechanism are positioned at into image source top, the height of display optics Degree may significantly increase.Accordingly, in a preferred embodiment, multiple folding(Also referred to as complex wrapping)Display optics are wrapped Include, therefore actuator and guide mechanism can be positioned so that and be adjacent to image source, and as a result, the height of display optics Degree is reduced.Figure 160 shown shown in the example of the multiple folding optics as watched from eye position, wherein optical axis quilt The side in top optics 16010 is folded into, to reduce the height of top optics 16010.Image source 15040 is then It is positioned to side and the near normal of image source 15040 rather than the level of top optics 16010.Wherein in Figure 160 Shown in example folded optics include one or more lens 16012, folding mirror 16013, it is described fold it is anti- Penetrate mirror to redirect towards combiner 14520 from the image light 15370 of top optics 16010, the combiner 14520 Image light is redirected towards eyes frame 15366 and eyes of user.In folded optics shown in Figure 160, fold anti- It is reflective polarizer to penetrate mirror 16013 so that backlight 16014 can be positioned in the rear of folding mirror 16013 to provide P polarization Illumination light 16071, the reflectogram image source in its illumination focus adjustment module 15360, such as LCOS.To illumination light 16071 When being reflected, image source 15040 changes polarization state to S from P, thus provides S-polarization image light 15370, the S-polarization Image light 15370 is folded reflecting mirror 16013 and reflects.By using the optics of multiple folding, including actuator and guiding The focus adjustment module 15360 of mechanism can be positioned to the side of top optics 16010, wherein in head mounted display Framework in more spaces can use.Alternatively, folding mirror can be included in the prism, in such as Figure 161 and 162 Shown, the prism can also include the surface with refractive power further to reduce the size of display optics.As knot Really, multiple folding display optics provide advantages below:When display optics include focus adjustment module 15360, energy Enough realize greater compactness of head mounted display.
Figure 155 a and 155b show the focus adjustment mould including the one group of wedge 15042 and 15043 as actuator The diagram of block, the wherein transverse shifting of lower wedge thing 15043 are with vertically mobile image source 15040(As shown), to change Image source 15040 is relative to the position including lens element 15012 or remaining optics of lens element 15412.Spiral shell is provided Being respectively acting on ferromagnetic core 15037 and 15038, wherein core 15037 and 15038 is attached to spool 15035 and 15036 Lower wedge thing 15043.Because wedge 15042 and 15043 is positioned in remaining of image source 15040 and display optics Between optics, so wedge 15042 and 15043 is made with center window, as shown in Figure 151 a and 151b, Light is allowd to be delivered to image source 15040 from remaining optics.Applying electric current to solenoid 15035 will attract core 15037 and be moved to the left lower wedge thing 15043, thus make upper wedge thing 15042 and the image source 15040 of attachment to Lower movement, this reduces focusing distance, as shown in Figure 155 a.Similarly, applying electric current to solenoid 15036 will attract core 15038 and make lower wedge thing 15043 move right, thus make upper wedge thing 15042 and the image source 15040 of attachment to Upper movement, this increase focusing distance, as shown in Figure 155 b.Leaf spring 15570 has been provided with being directed to upper wedge thing 15042 Or the applying power of image source 15040 so that wedge be wedge move during alignment in it is helpful.Leaf spring can be with attached It is connected to the shell of focus adjustment module 15360 and is attached to image source 15040 or upper wedge thing 15042 to prevent image source In the transverse shifting of the mobile period of wedge, thus guiding is provided to image source during focus adjustment.
Figure 156 a and 156b show the diagram of focus adjustment module 15360, and the focus adjustment module includes a pair pairs Chip piezo-activator 15675 and M76 are with mobile image source 15040 for focus adjustment.Wherein bi-morph piezo-electric actuator Including two lamination bars of piezoelectric, it is arranged such that when voltage is applied to two bars, and the side of twin lamella is received Contract and the expansion of the opposite side of twin lamella, thus make actuator become bending from flat.Bi-morph piezo-electric actuator is in focusing Favourable for used in adjustment module 15360 because they be quick acting, it is compact and they cause with piezo-electric stack Dynamic device is compared can provide much more displacement.The He of bi-morph piezo-electric actuator 15675 shown in Figure 156 a and 156b In the case of 15676, one end is attached to the shell and the other end of focus adjustment module 15360 and is being attached to image source Promote on 15040 carrier 15677.Figure 156 a are shown for the flat condition of bi-morph piezo-electric actuator 15675 and 15676 State, and Figure 156 b are shown for the case of bending of bi-morph piezo-electric actuator 15675 and 15676.Wherein carrier 15677 is on side The core that image source 15040 and carrier are supported around edge is removed to form window so that including illumination light and image The light of light can be delivered to remaining optics from image source 15040, and the He of wedge 15042 had such as previously been directed to herein Described in 15043.When voltage is applied to two bi-morph piezo-electric actuator 15675 and 15676, two actuators 15675 and 15676 upsweep, and thus move up carrier 15677 and the image source 15040 of attachment, such as institute in Figure 156 b Show, and focusing distance then increases.If more voltages are applied in, bi-morph piezo-electric actuator 15675 and 15676 will Crimp more.When the voltage is removed, bi-morph piezo-electric actuator 15675 and 15676 returns to flat condition, such as Figure 156 a Shown in, and focusing distance reduction.Actuator is illustrated as being arranged to the relative corner of lifting carrier to provide vertical-lifting Power.If expected more rapidly in movement of the case of bending shown in Figure 156 b to the flat condition shown in Figure 156 a Response, then be applied to the voltage of bi-morph piezo-electric actuator can in short time period on symbol invert.If however, The voltage of reversion is applied with the sufficiently long time so that actuator 15675 and 15676 reaches steady statue, then actuator will Bend in the reverse direction, this will be such that carrier 15677 and the image source 15040 of attachment is somewhat lifted.In addition, such as Figure 156 a and Shown in 156b, there has been provided quadric chain 15679.Wherein quadric chain 15679 is attached to focus adjustment module The side wall of 15360 shell and four points being attached on carrier 15677.The function of quadric chain 15679 is to provide load The guiding of body 15677 and attached image source 15040 so that image source 15040 is horizontal not with respect to remaining optics Mobile or inclination, to maintain to be aligned in the mobile period being associated with focus adjustment.Four companies shown in Figure 156 a and 156b Linkage 15679 is thin metal or plastic construction, and it has flexible fingers, and the finger piece is extended to from side wall attachment Attachment point on carrier 15679.The flexibility of finger piece allows unimpeded vertical shift, and while preventing transverse shifting.Carry Body 15677 is designed to provide vertically spaced attachment point, as directed, thus makes the finger piece of quadric chain 15679 It is prevented from the inclination of carrier and attachment image source during vertical shift.Quadric chain 15679 may be designed to piece Spring so that slightly downward power is applied to carrier 15677 to guarantee that carrier 15677 keeps and twin lamella during focus adjustment Piezo-activator 15675 and 15676 is contacted.The advantage of this arrangement of bi-morph piezo-electric actuator is can to provide big displacement For bigger focus adjustment.In embodiment, linkage 15679 can be with the stop at upper position with more Stop the translation of carrier 15677 in upper position exactly.In embodiment, stop can otherwise be positioned to wound Build the upper bound for carrier.In a further embodiment, the voltage for being applied to bi-morph piezo-electric actuator can be anti- Turn, so that bi-morph piezo-electric actuator bends in the opposite direction(It is not shown)And thus extend for focus adjustment can Use displacement range.
Figure 157 a and 157b show the focus adjustment module 15360 including bi-morph piezo-electric actuator 15781 and 15782 Another version diagram.In this case, bottom bi-morph piezo-electric actuator 15781 is attached to focus adjustment mould in centre The lower surface of the shell of block 15360, and top bi-morph piezo-electric actuator 15782 is attached to carrier 15677 in centre Lower surface.The end of top bi-morph piezo-electric actuator 15782 and bottom bi-morph piezo-electric actuator 15781 is attached at one Rise.Figure 157 a show flat condition, and without voltage bi-morph piezo-electric actuator 15781 and 15782 is applied to.Work as electricity When pressure is applied to bi-morph piezo-electric actuator 15781 and 15782, both of which changes to case of bending, and this makes carrier 15677 and image source vertical shift, thus increase focusing distance.When more voltages are applied, actuator 15781 and 15782 The change that becomes significantly and in the movement and focusing distance of carrier 15677 of bending be increased.Bi-morph piezo-electric actuator The advantage of 15781 and 15782 this arrangement is can to provide bigger lifting force and faster movement, but displacement is more It is little.Therefore, bi-morph piezo-electric actuator 15781 and 15782 is arranged to back-to-back, thus upon application of a voltage they contrary Side upsweeps, and the displacement for thus making the carrier for given voltage is doubled.More than two bi-morph piezo-electric is used in a stack Actuator(Such as four bi-morph piezo-electric actuators)It is possible.As described in previously herein, there is provided quadric chain comes The movement of guiding carrier 15677 and the image source 15040 of attachment, to prevent the transverse shifting during focus adjustment or inclination.
Figure 158 a and 158b show that the focusing including one or more scissors jack actuator formula actuators 15883 is adjusted The diagram of section module 15360.Wherein scissors jack actuator includes the framework of warpage so that when central shaft 15885 shortens Upper point moves up farther.In this way, the framework of scissors jack actuator 15883 serves as displacement amplifier so that The movement of carrier 15677 is more than the change in the length of central shaft 15885.Figure 158 a are shown when central shaft 15885 is very long State, thus make upper point lower and make be located at scissors jack actuator 15883 on carrier 15677 it is lower, and As a result, focusing distance is closer to user.Figure 158 b show the state when central shaft 15885 is shorter, thus make Portion's point is higher and makes the carrier 15677 on scissors jack actuator 15883 also higher, and as a result, focuses on Distance is further from user.Central shaft 15885 may, for example, be between the end for effectively changing scissors jack actuator 15883 Distance various equipment, central shaft 15885 can be the piezo-electric stack actuator that utilizes applied voltage to be activated or By with handss rotation come screw activating manually or by motor electric actuation.In any situation, scissors jack is activated Device 15883 is promoted to lift image source 15040 on carrier 15677, thus increases focusing distance.Such as previous institute herein State, quadric chain 15679 can be provided to guide carrier during focus adjustment, to retain image source 15040 relative to upper The alignment of remaining optics in portion's optics 14510.Piezo-electric stack actuator can provide very fast and accurate shifting It is dynamic so that if piezo-electric stack is used as central shaft 15885, very fast and accurate focus adjustment can be by focus adjustment mould Block 15360(If it includes the piezo-electric stack actuator with scissors jack actuator 15883)To provide.
Figure 159 a and 159b show the focus adjustment module 15360 with voice loop motor actuator 15987 Diagram.As described in previously herein, in this case, image source 15040 is shown as being positioned at actuator and guide mechanism Lower section.Carrier 15977 is attached to image source 15040 to support image source 15040 and provide for quadric chain 15679 Attachment point.Wherein quadric chain 15679 is provided to carrier 15977 and appended in mobile period for being associated with focus adjustment The guiding of the image source 15040 for connecing.The exterior section of voice loop motor 15987 is attached to focus adjustment module 15360 Shell upper surface(As shown), and interior section is attached to carrier 15977.Figure 159 a show to work as do not have voltage quilt The relative position of part when being applied to voice loop motor 15987.As indicated, in Figure 159 a, voice loop motor 15987 interior section is extended so that thus carrier provides the focusing distance of reduction in relatively low position.Figure 159 b Show the relative position of the part when voltage is applied to voice loop motor 15987.As shown in Figure 159 b Under the conditions of these, the interior section of voice loop motor 15987 is retracted so that in position of the carrier in being lifted, thus The focusing distance of increase is provided.When more voltages are applied to voice loop motor 15987, voice loop motor Thus 15987 interior section provides the bigger change in focusing distance by further indentation.Spring(It is not shown)Can be by To be included in focus adjustment module 15360 reduce to exert a force to carrier to work as and remove electricity from voice loop motor 15987 Carrier moves back to the time of the position shown in Figure 159 a during pressure.Spring can also contribute to for carrier 15977 to be maintained at figure In position shown in 159a, setting is focused on to provide acquiescence when voice loop motor 15987 is applied to without power, Thus to provide low-power operating mode.
Position measurement apparatus(It is not shown)Can be added to Figure 155 a, 155b, 156a, 156b, 157a, 157b, Any focus adjustment module 15360 shown in 158a, 158b, 159a and 159b, to measure the relative position of image source.Position Put measuring apparatus then can provide can for focusing distance control system(It can be closed-loop control system)In make Measurement result, to improve the accuracy and repeatability of focusing distance regulation.
In other another embodiment, left optical device module and right optical device module can be adjusted in alignment procedures In image source 15040 position providing reliable focusing distance.Wherein alignment procedures include for casing C27 being positioned at fixture In, the fixture is with the target alignment being located in front of fixture and at desired focusing distance.The image and then quilt of matching Be displayed in image source 15040, and image source 15040 be moved to by it is shown with watched by optical device module Target alignment.The advantage of the position of regulation image source 15040 is in alignment procedures:Casing 14727, top optics 14510 and combiner 14520 size in the impact of change can be compensated in a manufacturing environment to provide reliable convergence Distance.
In another embodiment, one or more in elements below can be connected to provide removable component, bag Include:Focus on shift component, combiner and correcting lens element.This can provide easily interchangeable component, and it can damaged It is changed during bad generation, when service condition changes or user changes.Especially, it might be useful to when from the viewing of wherein vergence Distance changes to relatively short distance from relatively long distance(And vice versa)Service condition change when while change focus on displacement Element and correcting lens element.When in this service condition, one or the other in vergence viewing distance may exceed The content that the eyes of user can be focused on comfortably.For example, if user is near-sighted, then need when vergence viewing distance is longer Correct and need not correct when vergence viewing distance is shorter.
Inventor is had discovered that when the digital content of world's locking is from the wear-type perspective computer display of user When visual field shifts away, it is possible to create not as good as optimum experience.For example, as user by his head from wherein digital content quilt When point in the world of locking is turned on, lateral surface displacements of the digital content towards visual field.When his head is rotated even more by user When remote, content is shifted away from visual field and interrupted suddenly at the edge of visual field.Once head rotation enough to it is remote when outward appearance in Change sudden and content the final natural impression for losing the content for not producing fixed in real world completely. Normally, when the practical object in our environment is watched, object keeps visually to be present, even slightly existing, directly To we completely shift out our vision from object.It is displaced to the object of the side of our direct sight line vision May slightly obscure, this is due to the property of our vision(It is i.e. recessed(foviated)Vision), but it is to a certain extent Keep presence.In typical perspective head mounted display, visual field has limited region(Such as width and height).Typical case Ground, people can have an X-rayed the environment to outside visual field, therefore when content starts and finally disappears from the vision of user, when with When family still is able to see that content once existed and was locked in environment therein, it appears that be strange.
An aspect of of the present present invention is related to generate the augmented reality content of the world's locking shifted away from perspective visual field Seamlessly transit.In embodiment, the content of world's locking is modified in edge displacement of the content towards visual field for user For seem less obvious.This can take defocus, obfuscation, the reduction point when content is towards edge displacement to content Resolution, the form for reducing brightness, reducing acutance, reduction contrast etc..Content at its close edge can in appearance by Decrescence little so that when it is shifted through edge, its outward appearance is minimum or does not exist so that it seem from the visual field of user by Fade mistake.This can work particularly well in following system:Visual field that the system has it is sufficiently large to adapt to visual field in Between sharp keen content, but be large enough that user does not use edge more very much.For example, with 60 degree of horizontal field of view In system, 10 degree of the outside on both sides can serve as transitional region, and there the content of world's locking is managed with as it Reduce its outward appearance in the preparation disappeared from visual field.
For generate from perspective visual field in shift away the world locking augmented reality content seamlessly transit be In one embodiment of system, including perspective optical element(The perspective optical element is installed such that it has an X-rayed in wear-type The front of eyes of user is positioned in when display is worn by the user)Wear-type see-through display also include processor, it is described Processor is adapted to that digital content is presented in the visual field on perspective optical element.Digital content can have the position in visual field Put, it depends on the position in surrounding.Processor may be adapted to change interior at the edge of the close visual field of content The outward appearance of appearance so that content seems to disappear at the edge of content close visual field.Outward appearance modification can be in content brightness Change, the change in content acutance or the change in content resolution in change, content contrast.Processor can include aobvious Show driver or application processor.Processor may be adapted to generate auxiliary visual field(For example by attached as described herein Plus optical system), wherein user watches presented digital content and sees surrounding by the auxiliary visual field user, institute State processor to be further adapted to for content to be transitioned into auxiliary visual field from visual field.In the other adaptation, the content in auxiliary visual field Outward appearance can be weakened compared to the outward appearance of the content in visual field.In the other adaptation, auxiliary visual field can have than regarding The lower resolution of resolution, and can be generated by one below:Image light is reflexed on combiner(It is described Image light is conducted directly to the eyes of user or towards the guiding of ultimate partially reflecting mirror by combiner, and the ultimate part mirror will scheme As light is reflected towards the eyes of user), the OLED on combiner is projected light onto, the LED array on combiner is projected light onto, or Person projects light onto the edge-lit LCD on combiner.In the other adaptation, auxiliary visual field can be by the eye for being positioned at user Presenting, wherein perspective panel is installed on combiner and/or is vertically mounted the perspective panel of eyeball dead ahead.Perspective panel Can be OLED or edge-lit LCD.Processor may be adapted to predict when content by the edge of close visual field and Outward appearance transition is set to be based at least partially on the prediction.The prediction can be based at least partially on eye image.
In embodiment, prediction of the content by being close to and/or through the edge of visual field can be determined based on the following: Compass in Wearing-on-head type computer(For example monitor the compass direction compared with the position that the world for content locks), content exists Movement in visual field(For example monitor where of the content in visual field and monitor its direction and speed towards edge movement), eye Eyeball position(Eye position and movement are for example monitored, as the instruction how Wearing-on-head type computer can move.There are eyes in head When the anterior displacement of portion's rotation and eye migration can provide the instruction that content appearance should be managed)And/or these skills The combination of art.
In one embodiment of the system of the transition based on prediction of the content for world's locking, wear-type perspective is aobvious Show that device can include perspective optical element and processor, the perspective optical element is installed such that it is aobvious in wear-type perspective The front of eyes of user is positioned in when showing that device is worn by the user, the processor is adapted to regarding on perspective optical element Digital content is presented in, wherein digital content has the position in visual field, and it depends on the position in surrounding.Process Device may be adapted to predict when that digital content will be moved due to the position change of wear-type see-through display from visual field Position is gone out, and the outward appearance of content is changed at the edge of the close visual field of content so that interior at the edge of the close visual field of content Appearance seems to disappear.Prediction can be based on the compass direction that the direction of the face forward to wear-type see-through display is indicated Or the eyes of user movement followed the trail of, wherein the eyes movement instruction user followed the trail of will rotate the head of user.Outward appearance modification can Be content brightness in change, the change in the contrast of content, the acutance of content in change or content resolution In change.Processor can include display driver or application processor.Processor may be adapted to generate auxiliary visual field, Wherein user watches presented digital content and sees surrounding by the auxiliary visual field user, the processor also by It is adapted to for content to be transitioned into auxiliary visual field from visual field.In the other adaptation, the outward appearance of the content in auxiliary visual field can phase It is more reduced than the outward appearance of the content in visual field.In the other adaptation, auxiliary visual field can be with the resolution than visual field more Low resolution, and can be generated by one below:Image light is reflexed on combiner(The combiner is by image Light is conducted directly to the eyes of user or towards the guiding of ultimate partially reflecting mirror, and the ultimate part mirror is reflected towards image light to use The eyes at family), the OLED on combiner is projected light onto, the LED array on combiner is projected light onto, or project light onto Edge-lit LCD on combiner.In the other adaptation, auxiliary visual field can be by the saturating of the eyes dead ahead for being positioned at user Present depending on panel, wherein perspective panel is installed on combiner and/or is vertically mounted.Perspective panel can be OLED or Edge-lit LCD.Processor may be adapted to predict when content by the edge of close visual field and transit to outward appearance It is at least partly based on the prediction.The prediction can be based at least partially on eye image.
Figure 163 A illustrate the suddenly change in the visual field of see-through display in the outward appearance of content 16302.Figure 163 B are illustrated Management outward appearance system, wherein content are reduced in appearance when it is entered near the transition region 16304 of field of view edge.
An aspect of of the present present invention be related to mix perspective display system, wherein the display system of high-quality by content be presented to Visual field and another more inferior system centered on user's sight line directly forward is used for Existing content.Then content appearance transition partly can be managed in central vision and in the visual field for extending.Extend Visual field can also have more than one section so that image can be presented in proximal edge part and illumination is presented in farther place Effect.
In order to illustrate, front luminous reflective display, emission display, holographic display device(For example, as described herein)Can For the content that high-quality is presented in 40 degree of visual fields, and another display system can be used for the edge from 40 degree of points(Or Overlap or with gap)Out to certain other point(Such as 70 degree)The effect of presentation content or visual perception.In embodiment In, the outside visual field area of coverage(So-called " outside shows ")Can be operated by the optical system in upper module, connect Nearly main view field display system, and optical path can include folding(For example, such as general description herein).In other realities In applying example, it can be guiding system that outside shows, wherein such as image light or effect light are generated and channeled to combiner.Example Such as, display can be installed in combiner top and be arranged to and lighting effect is conducted directly to into combiner.
In embodiment, outside shows and can be included in main display.For example, the lens combination in upper module can be with It is adapted to more low-quality in the middle edge generation for generating high quality content still then towards bigger visual field.In the system In, there may be only one display(Such as LCoS, OLED, DLP etc.)And the content towards the edge of display can be with It is managed to realize outward appearance transition.
Figure 164 illustrates mixing visual field, and the mixing visual field includes visual field 16402 placed in the middle for sharp keen and mistake is presented The content crossed, and the visual field 16404 for extending, its be positioned in the edge of visual field placed in the middle 16402 or near the edge or With the imbricate, and it is adapted to provide relatively low appearance contents and/or lighting effect, it contributes to world's locking Transition of the content when it is shifted away from central vision 16402.
Figure 165 illustrates mixed display system, wherein visual field mainly, placed in the middle is by the optics device in upper module 16502 Part is generating(For example, as described in other places herein)And the visual field for extending is by installed in combiner top and in extension area There is provided the display system 16504 of picture material and/or lighting effect in domain to generate.In embodiment, the visual field of extension shows Device 16504 can include OLED, edge-lit LCD, LED or other display, and display can include lenticule, microspur Lens or other optics are rightly to light being aligned and be focused on.In embodiment, the visual field of extension can include list Individual lighting element(Such as LED), element row, element arrays etc..
In other other embodiment, the field of view of extension can be by the way that see-through display be arranged on combiner To create.For example, OLED display, edge-lit LCD etc. are had an X-rayed and can be installed in and extend in field of view and controlled Make to produce transfer image acquisition and/or lighting effect.
In embodiment, wear-type see-through display can be adapted to content transitions to the display resolution for reducing The extension FOV of rate.Wear-type see-through display can include perspective optical element and processor, the perspective optical element quilt It is installed so that it is positioned at the front of eyes of user when wear-type see-through display is worn by the user, the processor is fitted It is made in the main view field on perspective optical element and digital content is presented, user watches presented numeral in the main view field Content and surrounding is seen by the main view field user, the processor is further adapted to be presented in the visual field for extending Digital content, user watches presented digital content and the visual field user for passing through the extension in the visual field of the extension See surrounding.Main view field can have the higher resolution in the visual field than extending;And the processor is further adapted to The positioning digital content of world's locking is presented in main view field, and changes position so that world's locking in head mounted display Positioning digital content from the transition of main view field go out when, the presentation of the positioning digital content that the world is locked is transitioned into extension and regards .Processor can include display driver or application processor.The visual field of extension has such resolution:The resolution Generate compared with the content presented in main view field significantly fuzzy for content.The visual field of extension can be by such as getting off to be given birth to Into:By the way that image light is reflexed on combiner(Image light is conducted directly to the combiner eyes of user), by inciting somebody to action Image light is reflexed on combiner(The combiner guides image light towards ultimate partially reflecting mirror, the ultimate part mirror Image light is reflexed to into the eyes of user), by projecting light onto the OLED on combiner, by projecting light onto on combiner LED array, by projecting light onto the edge-lit LCD on combiner, or by being positioned at eyes of user dead ahead Perspective panel.Panel can be installed on combiner or be vertically mounted, and can be OLED or edge-lit LCD.Place Reason device may be adapted to predict when content by the edge of close visual field and make outward appearance transition be based at least partially on institute State prediction.The prediction can be based at least partially on eye image.
Figure 166 A-166D illustrate the display of extension or the picture material optics, the example of configuration that extend.As institute Diagram, the display configuration of extension can be adapted to around every side for showing at center, on many sides that center shows or The content and/or lighting effect of extension are produced on the side that center shows.
Figure 167 is illustrated using another optical system of hybrid optical system, and the hybrid optical system includes main display Optical system 16502 and extension visual field optical system 16504.In this embodiment, two optical systems are all by image light, extension Image light and/or lighting effect project combiner, the combiner reflect light to before to ultimate partially reflecting mirror, it is described The ultimate partially reflecting mirror of forward direction so by light towards wearer eye reflections.
In other another embodiment, the visual field of extension shows and can be shown by the perspective being positioned in front of eyes of user Device is providing so that user is directly watched by see-through display.For example, have an X-rayed OLED display or edge-lit is transparent LCD display can be positioned on the either side of combiner(It is illustrated in as schemed C and E), or be positioned in waveguide or its On the either side of his display system(For example, it is such as illustrated in Fig. 8 a, 8b, 8c, 141a, 141b, 142a, 142b, 143 and 144 's).
In embodiment, wear-type see-through display can be adapted to provide the FOV for extending for big content.Wear Formula see-through display can include perspective optical element and processor, and the perspective optical element is installed such that it in head The front of eyes of user is positioned in when the formula see-through display of wearing is worn by the user, the processor is adapted in perspective optics Digital content is presented in main view field on element, user watches presented digital content and by institute in the main view field State main view field user and see surrounding, the processor is adapted to that digital content is presented in the visual field for extending, described User watches presented digital content and sees surrounding by the visual field user of the extension in the visual field of extension.It is main Visual field can have the higher resolution in the visual field than extending.The processor may be adapted to that number is presented in main view field The Part I of word content and extend visual field in present digital content Part II.For example, when digital content is too big And when can not be suitable in main view field, processor can occur in the Part I of digital content and the visual field for extending in main view field In digital content Part II between soft transition so that it will not seem to interrupt suddenly in the edge of main view field. Processor can be adapted to generate the soft outward appearance towards main view field edge.Processor can change the pixel towards showing edge How rendering content.Head mounted display can also include display driver, and the display driver modification is aobvious towards wear-type Show the pixel how rendering content at the edge of device.Head mounted display can have and the core towards head mounted display The pixel differently edge towards head mounted display of rendering content pixel.Towards extrorse pixel and towards wear-type The pixel of the core of display is compared can have less gain.Can pass through interior towards the pixel at the edge of main view field Hold transition algorithm and digitally changed.The visual field of extension can be by generating as follows:By the way that image light is reflexed to into combination On device(Image light is conducted directly to the combiner eyes of user), by the way that image light is reflexed on combiner(It is described Combiner guides image light towards ultimate part mirror, and image light is reflexed to the ultimate part mirror eyes of user), pass through The OLED on combiner is projected light onto, by projecting light onto the LED array on combiner, by projecting light onto combiner On edge-lit LCD, or by being positioned at the perspective panel of eyes of user dead ahead.Panel can be installed on combiner Or be vertically mounted.Perspective panel can be OLED or edge-lit LCD.Processor may be adapted to predict when content By the edge of close visual field and outward appearance transition is set to be based at least partially on the prediction.The prediction can at least part of ground In eye image.
In embodiment, wear-type see-through display can be adapted to adjust FOV of the content for being transitioned into extension. Wear-type see-through display can include perspective optical element and processor, and the perspective optical element is installed such that it The front of eyes of user is positioned in when wear-type see-through display is worn by the user, the processor is adapted in main view Digital content is presented in, user watches presented digital content and by the main view field user in the main view field See surrounding.The processor may be adapted to that digital content is presented in the visual field for extending, in the extension User watches presented digital content and sees surrounding by the visual field user of the extension in visual field.Main view field can With with the higher resolution in the visual field than extending.Processor may be adapted in main view field present digital content and Reduce the outward appearance of content at the edge of the close main view field of content.Processor can also be further adapted to when content is presented Further reduce the outward appearance of content when in the visual field for extending.Content becomes close to extend the edge of visual field, and processor can be by It is tapered to subtract the outward appearance for extending the content in visual field.When content is when the edge of visual field is extended, content can be substantially unobvious. Outward appearance reduction can be that the reduction in the reduction in content brightness, the reduction in content contrast, content acutance or content are differentiated Reduction in rate.The visual field of extension can be by generating as follows:By the way that image light is reflexed on combiner(The combiner Image light is conducted directly to into the eyes of user), by the way that image light is reflexed on combiner(The combiner is by image light court To the guiding of ultimate partially reflecting mirror, image light is reflexed to the ultimate partially reflecting mirror eyes of user), by by light projection OLED on combiner, by projecting light onto the LED array on combiner, by projecting light onto the edge on combiner Luminous LCD, or by being positioned at the perspective panel of eyes of user dead ahead.Panel can be installed on combiner or vertically Install.Perspective panel can be OLED or edge-lit LCD.Processor may be adapted to predict when that content close will be regarded Edge and make outward appearance transition be based at least partially on the prediction.The prediction can be based at least partially on eyes figure Picture.
Figure 168 A-168E illustrate wherein perspective display floater 16802(For example, OLED, the transparent LCD of edge-lit show Show device)Be positioned in eyes of user dead ahead in Wearing-on-head type computer and extended with providing in combining display system and/or The various embodiments of overlapping visual field.Figure 168 A are illustrated wherein by combiner optics or installed in combiner System of the transparent display panel 16802 near optics to provide extension visual field.In this embodiment, display floater is had an X-rayed 16802 are arranged on the back of combiner or near the back of combiner, so that it does not disturb central display system Image light is reflect off combiner, directly reflexes to eyes of user by system, the central display system.Figure 168 B illustrate it Middle perspective extension visual field display floater 16802 is positioned to the combining display system perpendicular access to combiner.Figure 168 C are illustrated Wherein perspective extend visual field display floater 16802 be vertically mounted on it is mixed in front of the sweep reflecting mirror of main view field display Close display system.
Figure 168 D and 168E are illustrated and come from behind(That is, the visual field of user)Combining display system.Figure 168 D are illustrated Wherein perspective extends system of the visual field display floater 16802 around main view field see-through display.Figure 168 E are illustrated and wherein prolonged Stretch system of the visual field perspective display floater 16802 on the side of main view field display system.It should be understood that inventor predicts Extend visual field display floater can be configured in a number of different ways in the one side or the multi-lateral of main view field provide extend with And with balanced arrangement(That is, extending more than being similar on side)Or uneven configuration(That is, more or less prolong in one side or the multi-lateral Stretch)There is provided and extend.It will also be appreciated that inventor predict extend visual field can depend on situation concrete needs and and main view Field overlaps, seems to be adjacent to main view field, has gap, etc. between main view field and extension visual field.
Although having been described that the smooth of the content for creating that wherein the world locks herein in regard to the configuration for extending visual field description The system of transition, these configuration can be further used for in main view field show the additional lighting effect of content creating and/or Hatching effect.For example, extend wherein in the configuration that visual field see-through display and main view field overlap, extending field of view displays can be with Content for showing in main view field provides background(backdrop).Background may, for example, be lighting effect, and it is in content Providing situation to content below or near content.Background can be with right and wrong lighting effect, the wherein pixel of see-through display(Example Such as, the pixel of LCD is had an X-rayed)It is changed to opaque or less transparent with behind content or neighbouring content provides dark background (For example with the outward appearance of formation shade).In such embodiments, extending visual field system can be overlapping with main view field, and extends Visual field system can extend or can be not extended past the edge of main view field.
In embodiment, wear-type see-through display can be adapted to provide mixing many FOV display.On the one hand, head Wear the optical system of formula see-through display can include for produce center eyes picture material primary image content optics, For producing the extension picture material optics and combiner of off-center eye image content, the combiner is oriented to To user's presentation content and user by the combiner watch surrounding, wherein primary image content optics and extension Each in picture material optics is positioned to their respective image light projection to combiner, and the combiner is by phase Image light is answered to reflex to the eyes of user.Respective image light directly can be reflexed to the eyes of user by combiner.Combiner can With the eyes for indirectly respective image light being reflexed to user, wherein combiner can be corresponding towards the reflection of collimating part reflecting mirror Image light.Center eyes picture material and off-center eye image content can pass through optics before combiner is reflect off At least one of system is folded.Extending picture material optics can be installed in directly over combiner, so that deviateing Center eyes picture material is projected directly at combiner.Optical system can also include processor, its be adapted to content from The visual field of primary image content optics moves to the visual field of extension picture material optics and extends to picture material light Learn the edge of the visual field of device and coordinate the smooth disappearance transition of world's locked content.Extending picture material optics can be OLED, LCD display, LCD array, linear, two dimension or bending.Extending picture material optics can generate correspondence In the lighting effect of picture material.Extending picture material optics can include changing the lens combination of projection.Lens System can include microlens array.
In embodiment, wear-type see-through display can be the combining display with perspective panel.On the one hand, head The formula see-through display of wearing can include primary image content display, and it is adapted to produce image light and edge will be by perspective combiner The direction projects images light of reflection so that it reaches the eyes of user, and auxiliary picture material display, wherein in auxiliary image Hold display and be located at the eyes dead ahead of user and for strengthening the visual experience delivered by primary image content display Perspective panel.Auxiliary display can provide in the main view produced by master image display region outside the venue in perhaps effect. Outside region can be adjacent to main view field, around main view field or overlapping with main view field.Auxiliary display can with shown by master image Perhaps effect being provided in provide in the overlapping region in the main view field that device is produced.Auxiliary display may be mounted at be adapted to image light is anti- It is mapped on the combiner of the eyes of user, or can be vertically installed in the image light light ways for education set up by master image display Outside footpath.Head mounted display can also include processor, and it is adapted to follow the trail of the eye position of user, and the processor is also adapted to The position of the content being presented on into change in Auxiliary display.Modified position can substantially tie up when the eyes of user are moved Hold the alignment with auxiliary image display from master image display for the visual angle of user.Perspective panel can be that OLED or edge are sent out The LCD of light.
In embodiment, wear-type see-through display can be adapted to be mixed the type of content.On the one hand, head The formula see-through display of wearing can include visual field and the processor generated by image display, the wherein number in user's viewing visual field Word content and the visual field is had an X-rayed to watch surrounding, the processor is adapted to generate two kinds of content, wherein Two kinds of content is presented in visual field.The content of the first kind can be the content of the locking of the world with field positions, Where the field positions are depended in surrounding, wherein edge of the outward appearance of the content of the first kind in its close visual field When weaken.The content of Second Type can not be world's locking, wherein edge of the content of Second Type in its close visual field When maintain substantial constant outward appearance.The outward appearance of decrease can include by display driver adjustment, by application processor adjustment, Or by the modified pixel adjustment of the display for generating visual field resolution in terms of reduction, the reduction in terms of brightness, contrast Reduction in terms of degree.Head mounted display can also include the auxiliary visual field generated by image display, use in the auxiliary visual field Presented digital content is watched at family and user sees surrounding through the auxiliary visual field, and processor is also adapted to content Auxiliary visual field is transitioned into from visual field.Compared with the outward appearance of the content in visual field, the outward appearance of the content in auxiliary visual field is weakened.Auxiliary visual field There can be the resolution lower than the resolution of visual field.Auxiliary visual field can be generated by following:Image light is reflexed to into group In clutch(Image light is conducted directly to the combiner eyes of user), image light is reflexed on combiner(Described group Clutch guides image light towards ultimate partially reflecting mirror, and image light is reflexed to the ultimate part mirror eyes of user), will OLED in light projection to combiner, projects light onto the LED array on combiner, and the edge projected light onto on combiner is sent out Light LCD, or it is positioned at the perspective panel of eyes of user dead ahead.Panel can be installed on combiner or vertically pacify Dress.Perspective panel is OLED or edge-lit LCD.Processor may be adapted to predict when content by the side of close visual field Edge and outward appearance transition is set to be based at least partially on the prediction.The prediction can be based at least partially on eye image.
In embodiment, wear-type see-through display can be adapted to adjust FOV alignments.Wear-type see-through display can be with Including hybrid optical system, processor and eye position detection system, the hybrid optical system is adapted to produce to be used for height The main perspective visual field of resolution presentation content and for the auxiliary perspective visual field of low resolution presentation content, wherein main view field and Auxiliary visual field is close to and presents each other, and the processor is adapted to adjust the relative proximities of main view field and auxiliary visual field, the eyes Position detecting system is adapted to detect the position of eyes of user that wherein processor is based on the position of eyes of user and adjusts main view field With the relative proximities of auxiliary visual field.Can be positioned on the perspective oled panel of the dead ahead of eyes of user, be positioned at use The dead ahead of family eyes perspective edge-lit LCD on or be positioned at the perspective combiner of eyes of user dead ahead It is upper to produce auxiliary visual field.Relative proximities can be degree of being on close level or vertical proximity to degree.Relative proximities can define main view field The detached tolerance between overlapping tolerance or main view field and auxiliary visual field and auxiliary visual field between.Eye position detection system can With with including main view field region in leave perspective optics reflection, or with including auxiliary visual field region in Leave the reflection of perspective optics and basically eyes are imaged at the visual angle in the front of eyes.
When using head mounted display(HMD)(For example, as the part of HWC 102)For such as augmented reality into During the purpose of picture, expect to provide wide visual field(For example, 60 degree).However, when wide visual field is watched with head mounted display, should It is appreciated that watching image with head mounted display is different from the screen that in the environment rigidity is installed(For example, in wall The TV or movie theatre screen of upper installation)Upper viewing image.In the case of head mounted display, when user moves its head During portion, the display visual field of head mounted display and its association is also relatively moved with surrounding.This is caused for HMD's It is difficult to watch the edge or corner of the image shown with wide visual field for user, because head movement can't help user, only Eyes movement is necessarily used for watching the corner of image.In order to improve when the image shown with wide visual field is watched using HMD Viewing experience, the relation when surrounding is watched between the head movement and eyes movement of librarian use should be answered substantially System.For example, with only beholder's eyes are shifted to into edge relatively, when figure of the viewing with wide visual field on the screen rigidly installed During picture(Such as, at the cinema in when seeing the edge to motion picture screen), beholder is by his head of normal rotation(At least slightly Rotate).It was found by the inventors that some must be made to adapt to provide to towards the external margin of wide visual field in HMD systems Region comfortable and intuitively watch.In embodiment, the content shown in wide visual field may be not necessarily world's locking (That is, the position of the content wherein in visual field depends on the position of the object in environment, so that content shows as in place to user Put and be connected to environment), but may still include position or the motion of eyes based on user or head and by the content for being presented The process that shifted of position.
Because head mounted display is worn on the head of user, compactedness is for the comfortable viewing experience of offer Important.Compact optical typically comprises the short focus optics with low f# to reduce physics size.With these The optics of characteristic usually requires that the wide cone angle of the light from image source.Wherein wide cone angle with from before image source The image source of surface emitting image light is associated, such as example in miniscope or miniscope(Such as:OLED, back are sent out LCD of light etc.)In.These display can launch unpolarized image light or polarization image light.Optical system is received from image source Image light, and and then manipulate image light to form the convergence cone of image light, it forms the user of the related wide visual field of tool Image at eyes.In order that user can interact with shown image and surrounding simultaneously, there is provided surrounding The see-through view that do not distort and become clear and bright and sharp keen shown image is favourable.But, there is provided do not distort and bright Bright see-through view and bright and sharp keen shown image is probably conflicting requirement, especially when providing wide visual field figure During picture.
In order to watch the purpose of augmented reality image, expect to provide 50 degree or bigger wide visual field.However, being suitable for compact The design of the compact optical device with wide visual field used in head mounted display may be challenging to.This enters one Step is complicated by following facts:Human eye is only in the very narrow part of visual field(Referred to as fovea centraliss(fovea))In have High resolution capability and there are much lower resolution capabilities in the periphery of visual field.In order to observe the whole of high-definition picture Region, personnel must move their eyes on wider visual field.
It was found by the inventors that needing such optical system, it provides surrounding the high grade of transparency with around providing The view for not distorting and becoming clear of environment and while also show on visual field bright and sharp keen image in wide display.It is easypro in order to provide Suitable viewing experience, optical system should be taken into account how user moves its eye and its head carrys out viewing environment.This is watched in user Particular importance during augmented reality image.
The system and method for principle of the invention provide a kind of HMD, and it shows superimposition to the perspective for improving The image with wide visual field in the see-through view of the surrounding of view and high-contrast display image.There is provided a kind of optics System, it includes:Including transmitting image source(For example, OLED, back illumination LCD etc.)Top optics, one or more Lens and spuious ligh trap and including the angled beam splitter of plane and the unpolarized lower optical device of sweep reflecting mirror. Transmitting image source provides image light, and described image light includes one or more narrow bands of image light.Wherein, beam splitter and curved One or more in reflecting surface on bent portions reflecting mirror are treated to the major part of the incident illumination reflected in narrow band And the major part of the incident illumination in visible band is transmitted, so as to provide the bright saturating of bright display image and surrounding Depending on view(For example, using the trichroism reflecting mirror on beam splitter).
Spuious ligh trap is also provided so that higher contrast image can as one man show with the highly transmissive view of surrounding Show.Wherein veiling glare may be from each introduces a collection, including:From the perspective light of surrounding;Bent portion reflecting mirror is anti- The image light being emitted back towards in optics;Or have already passed through the light from below of beam splitter.By capturing the veiling glare, pole The earth improves the contrast of the display image seen by user.
The modes of display operation of the improvement viewing for wide visual field image is additionally provided, wherein display image is showing visual field The interior movement with user's head accordingly transverse shift.Wherein the transverse shift of display image is followed by phase Tongfang by detection To head movement eyes movement triggering.Display image then with subsequent head movement accordingly and with it is subsequent Head move transverse shift on contrary direction.The purpose of the pattern be so that user can watch the periphery of image and Their eyes mobile on the completeness of visual field need not be shown in width.Thus user is by eyes movement and the group of head movement Close to watch the wide visual field of display image, to obtain more comfortable viewing experience.
The system and method for principle of the invention provide the highly transmissive see-through view with surrounding and superimposition The head mounted display of the high-contrast display image in the see-through view of surrounding.In this way, the system and side Method provides the head mounted display for being suited well for being used for augmented reality image, because user is provided with becoming clear and sharp Profit display image and remain able to easily view surrounding.The system and method are additionally provided when typical eyes are moved Wide visual field with the acutance corresponding with the distribution of the acuity of human eye when the movement of dynamic and head is taken into account.It is wherein wide Visual field head mounted display can provide for example, at least +/- 25 degree(50 degree of angles)Display visual field.Additionally, compact optical Device is provided with the thickness of reduction to improve the compact form factor of head mounted display.There is provided will wherein display attachment To the operator scheme that the viewing condition of the head mounted display of user's head is taken into account.
Figure 169 illustrates the cross section diagram of the example optical component 16900 for head mounted display.Optical module 16900 include:Top optics 16903, one or more lens 16920 and ligh trap including transmitting image source 16910 16930 and including angled beam splitter 16950 and the lower optical device 16907 of sweep reflecting mirror 16960.Transmitting Image source 16910 provides the image light 16940 with picture material, and described image light is reflected by lens 16920 and sweep To form wide visual field, the wide visual field is presented to the eyes of user in eyes frame 16970 to the optical manipulation of mirror 16960.Wherein eyes Frame is defined as wherein eyes of user it can be seen that the region of display image.Optics is folded so that optical module 16900 It is more compact, so that optics has primary optic axis 16946 vertically extending from transmitting image source 16920.Angled beam splitting Device 16950 redirects a part for image light 16940 by reflecting, so that image light 16940 is passed along the second optical axis 16943 Pass away.A part for the reflected image light 16940 of sweep reflecting mirror 16960 so that its along the second optical axis 16943 back Transmission is simultaneously transmitted towards eyes frame 16970.Meanwhile, from the bent portion reflecting mirror 16960 of scene light 16973 of surrounding Transmit to provide the see-through view of surrounding to eyes frame 16970 with angled beam splitter 16950.Thus, sweep is anti- Penetrate mirror 16960 and serve as combiner, wherein user sees superimposition to the see-through view of the surrounding provided by scene light 16972 The display image provided by image light 16940.
Transmitting image source 16910 can be any kind of active display, and it is not required in top optics 16903 Interior application supplements light(For example, light before the transmittance as described in this paper other positions), active display includes:OLED, back are sent out Light LCD, micro-dimension LED array, diode laser matrix, edge-lit LCD and plasma display.Typically, transmitting shows Device provides the image light of the narrow wavelength band with the light in visible-range.For example, for full-color display, band can include dividing Not Ju You 615-635,510-540 and 450-470 half high bandwidth(FWHM)Red, the green and blue ribbon of wavelength.Additionally, sending out Penetrate the wide cone that image source 16910 provides image light(Such as 100 degree or more).Exist and there is sending out for wide cone angle with using The associated several advantages of image source 16910 are penetrated, is:Optical system can be configured with shorter focal length and very fast f#(For example, 2.5 or faster), this enables optics compact much.Additionally, by eliminating for light is applied to image by illuminator The front surface in source(Such as it is typically reflectogram image source(Such as LCOS or DLP)It is required)Demand, top optics Size of population can be greatly reduced.
In embodiment, in order to provide the highly transmissive of surrounding(For example, more than 50% transmission of the scene light to eyes) Transmission views, lower optical device is unpolarized design, and wherein optical surface allows some parts of unpolarized visible light saturating Penetrate.This is in order to avoid absorption polarizers or reflective polarizer used in the transmission of the optical path along scene light 16973 The light loss more than 50% of Shi Fasheng.Instead, the reflection on angled beam splitter 16950 and sweep reflecting mirror 16960 Surface is treated to part reflection.Which part reflection process can be across whole visible-range and have relatively uniform water The base component reflecting mirror of flat reflectance, or it can be trap reflecting mirror that part reflection is processed, the trap reflecting mirror is carried During one or more narrow wavelength bands of output band of transmitting image source are matched for having been selected in visible-range The higher level absorbance in wavelength between higher level reflectance and the narrow wavelength band(For example, such as this paper other positions It is described).It can be coating that part reflection is processed(Such as laminated coating), phase matched nanostructured or film(Such as multilayer film Or coat film), it has partially reflecting mirror attribute or trap reflecting mirror attribute.
Unpolarized lower optical used in part by the optics for providing the see-through view of surrounding wherein , there is increase and have an advantage that in device 16907:When the polarization image source in viewing environment(Such as LCD TV or computer are supervised Visual organ)Or may be to the very distractive natural source of user(Such as cloud and reflection)When avoid aberration.These aberration typical case Take the form of rainbow pattern, it has may very distractive bright color to wear-type experience.Aberration is by light Learn the interference institute between the polarized light in any polariser or circuit polarizer and polarization image source present in the perspective partial of device Cause.As a result, described system and method provide non-polarized optics device in the perspective partial of optics so that Obtaining user can watch unpolarized image source when head mounted display is worn(Such as Panel PC monitor)And do not expose In rainbow pattern.
Around in the case of the highly transmissive see-through view of environment, high-level scene light 16973 is going to eyes frame 16970 Way in pass through lower optical device.This is opened for following probability:Due to from anti-by angled beam splitter 16950 Be emitted back towards launch image source 16910 scene light 16973 a part and be also from by angled beam splitter 16950 towards send out The veiling glare of penetrating a part for the image light 16940 that image source 16910 back reflects and the contrast in the display image that causes Loss.Combination from the part of the image light 16940 and scene light 16973 that are reflected back to transmitting image source 16910 is spuious Then light be scattered the side wall left in top optics 16903, and is launched the surface reflection of image source 16910, with So that the combination veiling glare adds the image light 16940 for being presented to eyes frame 16970 so that user watches.Due to the veiling glare not With picture material, therefore net effect is to reduce the contrast in display image.In order to reduce from the miscellaneous of the two sources Astigmatism, there is provided ligh trap 16930.
Figure 170 illustrates operation to reduce the diagram of the ligh trap 16930 of veiling glare.Ligh trap 16930 includes sandwich, its bag Include the quarter-wave film 17032 and 17034 on the either side of linear polarizer film 17033.Sandwich can be with bonding Layer is loosely connected or stacked together.Ligh trap 16930 is by allowing the unpolarized image light come spontaneous emission image source 16910 17025 work through quarter-wave film 17032, and the quarter-wave film 17032 does not affect image light 17025, because It is unpolarized for it.Image light 17025 then passes through polariser 17033, and the polariser 17033 makes image light become linear Polarization.Linear polarization image light then passes through quarter-wave film 17034, and it makes image light become circular polarization image light 17026.A part for circular polarization image light 17026 is reflected towards sweep reflecting mirror by angled beam splitter 16950 16960, and another part of circular polarization image light is transmitted to become facial aura by angled beam splitter 16950.Sweep Reflecting mirror 16960 back reflects a part for circular polarization image light 17026 towards angled beam splitter 16950, and while thoroughly Penetrate the part for becoming eyes aura.From the circular polarization image light 17026 back transmitted towards angled beam splitter 16950, one Part is transmitted to eyes frame 16970, and an other part is reflected by angled beam splitter 16950, so that the part Transmit towards transmitting image source 16910.However, when the circular polarization image light 17026 for returning passes through quarter-wave film 17034 When, it is transformed into the linearly polarized photon of inverted polarized orientation compared with image light 17025, so that polariser 17033 Absorb return light.Thus.Approximate 99.99% of the light with inverted polarized state is absorbed in view of typical absorption polariser, court The part of the image light back reflected to transmitting image source 16910 substantially can be eliminated by ligh trap 16930.
Scene light 17045 is unpolarized, and is bent beam splitter 16960 and transmits.When unpolarized scene light 17045 is met During to angled beam splitter 16950, a part transmits to provide the see-through view of environment, and one towards eyes frame 16970 Divide towards transmitting image source 16910 and reflect.Unpolarized scene light 17045 unchangeably passes through quarter-wave film 17034.Work as scene When light passes through polariser 17033, it becomes polarized light.When scene light passes through quarter-wave film 17032, scene light then becomes Into circular polarization scene light 17046.Circular polarization scene light 17046 is launched the surface reflection of image source 16910.When the return justifies inclined When the scene light 17046 that shakes passes back through quarter-wave film 17032, the return circular polarization scene light 17046 is transformed into be had The polarization scene light of inverted polarized state, then it absorbed by polariser 17033.
The net effect of ligh trap 16930 is substantially to be eliminated from the veiling glare for returning image light and scene light, and As a result, greatly increasing the contrast in display image.This is wherein substantial amounts of bright light environments into scene light 17045 Used in head mounted display when be particular importance.By using the ligh trap 16930 with sandwich(It is included in linearly Quarter-wave film 17032 and 17034 on the either side of polarizer film 17033), come from transmit in the opposite direction non- The veiling glare of polarized light 17025 and 17045 can be captured effectively.In the part of image light 17025(It is by angled beam splitting Device 16950 reflects, bent portion reflecting mirror 16960 reflects and is transmitted so that it becomes by angled beam splitter 16950 The display image being viewed by a user)On effect be the image light 16940 be circularly polarized light.Further, since image light 17025 Through polarizer film 17033, there is the reduction in terms of approximate 50% brightness.However, the increase in terms of contrast is much higher, with So that the perceptual image quality of display image is substantially improved, especially in bright light environments.Inventor has been carried out right The measurement of the effectiveness of the such ligh trap positioned above the OLED display surrounded by the textured plastic frame of black.Wherein Quarter-wave film is selected to have the remarkable delustring for providing veiling glare after twice through quarter-wave film in veiling glare The delay level of property and do not damage the colour cast to residual stray light.As a result it is reduced to from the light of OLED display surface reflection 1/117th, and the light from the textured plastic reflective of black is reduced to 1/6th.
Ligh trap 16930 can also be simplified as circuit polarizer by eliminating one of quarter-wave film.In this case, Ligh trap 16930 works to the only one in unpolarized source of stray light.If quarter-wave film 17032 is eliminated, ligh trap 16930 only capture the veiling glare from image light 17025, and the scene light 17046 back reflected towards image source 16910 is right Polarized afterwards.Alternatively, if quarter-wave film 17034 is eliminated, ligh trap 16930 is only captured from scene light 17045 Veiling glare, and image light 17026 then polarized.
In alternative embodiments, ligh trap 16930 can be positioned on the surface of image source 16910.Ligh trap can be folder Polariser 17033 between quarter-wave film 17032 and 17034, to capture towards coming that image source 16910 back reflects From the veiling glare of both image light 17025 and scene light 17045.By the way that ligh trap 16930 is positioned directly in into image source 16910 On surface, the veiling glare from scene light 17045 is effectively captured, because the birefringence in lens 16920 does not affect The polarization state of circular polarization scene light 17046.Thus, ligh trap 16930 can be circuit polarizer, and it is positioned in against figure In the image source 16910 of the quarter-wave film of the circuit polarizer on the surface of image source 16910, only to capture and scene light 17045 Associated veiling glare, as previously described herein.It is except covering image source encapsulation that ligh trap 16930 can be sized The surface of image source 16910 is also covered outside near reflection part or adjacent housings, to capture and the reflection from these surfaces The associated veiling glare of light.
In order to capture the veiling glare from image light 17025 back reflected towards image source 16910, the second circuit polarizer (For example, including polariser 17033 and quarter-wave film 17034)Lens 16920 and lower optical device can be positioned in Between, wherein the quarter-wave film 17034 of the second circuit polarizer is oriented in the face of lower optical device.First circuit polarizer Polarization axle should be aligned with the polarization axle of the second circuit polarizer, to transmit most image lights 17025.The second circuit polarizer pin To by partially reflecting mirror 16960 and angled beam splitter 16950 towards image source 16910 back reflect from image light 17025 veiling glare provides efficient ligh trap.If however, including the first and second circuit polarizers, in the optics of top Lens 16920 in birefringence by the brightness uniformity of image for affecting user to be seen and contrast uniformity.This be because To be polarized by the first circuit polarizer by image light 17025, image light and then will be any present in it through lens 16920 The part for making image light is become elliptical polarization by birefringence.Elliptical polarization image light then will be through the second circuit polarizer, its It is middle that the elliptical polarization part of image light will be accordingly filtered with the degree of existing elliptical polarization.If lens 16920 have There is low-birefringence(For example, postpone less than 50nm), then will be provided using two circuit polarizers and there is brightness uniformity and contrast The image of the almost unnoticed degradation of uniformity, but if birefringence is higher, then brightness uniformity and contrast are equal Even property will be degraded by noticeable.
Table 1 below is shown for the various unpolarized part of angled beam splitter 16950 and sweep reflecting mirror 16960 The comparative analysis that reflection is processed, wherein all numerals are in terms of the percent of the image light 17025 launched by image source 16910 To present.The analysis is illustrated and the base component reflecting mirror on angled beam splitter 16950 and sweep reflecting mirror 16960 (That is, the partially reflecting mirror of all visible wavelengths is substantially equally reflected)What the use trap reflecting mirror that process is compared was processed The effect of effect and ligh trap 16930.The nanostructured for reflecting the phase matched of the light of narrow wavelength band may be provided in embossing Film or the inner mold being provided as on optical surface(molded in)Structure, to provide the process of trap reflecting mirror, but they are in table 1 Not shown in.In this analysis, the reflectance of angled beam splitter 16950 and sweep reflecting mirror 16960 is selected Into " to the perspective light of eyes " of delivering at least 50%(This is the scene light 16973 for reaching eyes frame 16970)With at least 20% " the perspective light under the wavelength of image light ", it considers to be processed the reflection for providing by any trap reflecting mirror on reflecting surface The arrowband of rate.Situation 1 is included at the triple trap reflecting mirrors to angled beam splitter 16950 and sweep reflecting mirror 16960 Reason(Also known as it is used to reflect the trichroism trap reflecting mirror of redness, green and blue light), and it does not include ligh trap 16930. In the analysis, trap reflecting mirror is assumed to be reflected with selected reflectivity percentages in 20nm broadbands for each color (For example, triple trap reflecting mirrors can be provided in the high reflectance in lower band:For blue 450-470nm, for green 515-535nm, for red 615-635nm)And transmit remaining visible ray with 95%.Situation 2 is included to angled point Triple trap reflecting mirrors of beam device 16950 and sweep reflecting mirror 16960 are processed and ligh trap 16930.Situation 3 is included to curved The base component reflecting mirror of bent portions reflecting mirror 16960 process and to triple trap reflecting mirrors of angled beam splitter 16950 at Reason and ligh trap 16930.Situation 4 includes that the base component reflecting mirror to angled beam splitter 16950 is processed and to sweep Triple trap reflecting mirrors of reflecting mirror 16960 are processed and ligh trap 16930.Situation 5 is included to angled beam splitter 16950 and curved The base component reflecting mirror of both bent portions reflecting mirrors 16960 is processed and ligh trap 16930.
Situation is numbered 1 2 3 4 5
Coating on beam splitter Trichroism trap reflecting mirror Trichroism trap reflecting mirror Trichroism trap reflecting mirror Simple partially reflecting mirror Simple partially reflecting mirror
Coating on sweep reflecting mirror Trichroism trap reflecting mirror Trichroism trap reflecting mirror Simple partially reflecting mirror Trichroism trap reflecting mirror Simple partially reflecting mirror
For reflecting back into the quarter-wave/polariser interlayer trap of the light of display It is no It is It is It is 20
Beam splitter reflection rate image light(%) 50 50 60 30 75
Overall beam splitter absorbance(%) 83 83 80.6 65 28
Sweep mirror image luminous reflectance(%) 80 80 33 75 67
Sweep reflecting mirror overall transmission(%) 75.8 75.8 62 77 15
The reflectance of display floater(%) 15 15 15 15 15
To the image light of eyes 20.0 8.4 3.3 6.1 1.8
To the perspective light of eyes 62.9 62.9 50.0 50.1 50.3
Eyes aura 10.0 4.2 16.9 3.2 5.6
Facial aura 50.0 21.0 16.8 27.3 31.5
Towards the light from below of eye reflections 12.0 12.0 14.4 30.0 20.0
Return to the image light of panel 20.0 0.00084 0.000499 0.000284 0.00005
Return to the perspective light with image light wavelength of panel 10.0 4.2 15.6 3.2 5.6
The perspective light with image light wavelength for returning to panel and back reflecting towards eyes 1.5 0.000063 0.000234 4.73E-05 0.00008
To the perspective light with image light wavelength of eyes 20.1 20.1 31.0 25.2 50.3
To the ratio of the image light of image light/the return to panel of eyes 7 10000 6667 21667 37500
To eyes image light/return to panel and reflect back in system with image light The ratio of the perspective light of wavelength 13 133333 14194 130000 20896
Ligh trap 16930 can be in two rows relevant with picture contrast of the bottom of table 1 to the effect of picture contrast See, as " to the image light of eyes " by expression display image brightness divided by " returning to the light of image source " ratio shown by , wherein the light for returning to image source comes from the image light that reflects back into image source or comes from the scene for reflecting back into image source Light.At two groups it is digital in, with situation 1(Without ligh trap)Compare, in situation 2-5(Wherein there is ligh trap 16930)Middle ratio It is significantly higher(1000 times higher).Can also be for " to the image of eyes by the light loss produced with ligh trap See in the numeral of light ", wherein situation 1 illustrates approximate 2 times of high numerals of the display image for indicating brighter.
Can be by having a case that various combination 2-4 and have to angled beam splitting that trichroism trap reflecting mirror is processed The situation 5 that the base component reflecting mirror of device 16950 and sweep reflecting mirror 16960 is processed is compared relatively to see for being directed to " to the image light of eyes "(Image light 16940)" to the perspective light of eyes "(Scene light 16973)Digital trap reflection The effect of mirror process.The trichroism trap reflecting mirror of one or two reflecting surface is processed increased and is delivered to eyes frame 16970 Image light 16940 part, and while also add provide to eyes scene light 16973 part.Using to angled The base component reflecting mirror of beam splitter 16950 and sweep reflecting mirror 16960 is processed and delivers optics to eyes of user The efficiency of image light is reduced to approximate 2/with to 1/4.5th.If it should be noted that angled beam splitter 16950 or curved Bent portions reflecting mirror 16960 includes polariser(Absorbability is reflexive), based on saturating to the typical case of non-polarized light by polariser Percentage ratio is penetrated, only about the 42% of scene light will be transmitted to eyes of user.And if one of surface is polariser, and separately One is 50% partially reflecting mirror, then only about the 21% of scene light will be transmitted to eyes of user.
Also other light losses are illustrated by the numeral in table 1." eyes aura " is transmitted by sweep reflecting mirror 16960 Image light 16940 part." facial aura " is the part of the image light transmitted by angled beam splitter 16950.It is right to determine Which situation more preferably will mitigate eye in terms of eyes aura and facial aura depending on existing for given head mounted display Other controls of eyeball aura or facial aura.If there is the control of eyes aura, then situation 3 is probably optimum selection, because Facial aura is relatively low.If there is the control of facial aura, then situation 4 is probably optimum selection, because it has relatively low eyes Aura.
Generally, with the trichroism trap reflecting mirror to both angled beam splitter 16950 and sweep reflecting mirror 16960 The situation 2 of process has to be used to provide the good of the characteristic that bright and high-contrast image and high perspective are transmitted to eyes of user Combination.This is because situation 2 has the relatively good numeral for the following:By image light be delivered to eyes efficiency, The contrast of acceptable perspective and brilliance at highly transmissive perspective, low eyes aura, bottom surface portion aura, the wavelength of image light Degree.
The trichroism trap reflecting mirror process for reflecting S-polarization light more more than P polarization light can be obtained.However, it is contemplated that The arrowband of the reflection provided by the process of trichroism trap reflecting mirror, the transmissive portion of light can be substantially unpolarized, and because And the transmission of scene light more than 50% is still provided and the polarized light source of aberration not comprising such as rainbow etc is provided and regard Figure.Under the scene, situation 4 can be more efficient for image light being delivered to eyes and provides high perspective transmission.
In many service conditions, such as augmented reality imaging is expected using offer wide visual field(For example, more than 40 Degree)Head mounted display.However, it may be difficult to design on whole wide visual field for uniform sharp keen image provides equal Any kind of optics of even high MTF.As a result, optics is probably extremely complex, and optics Physics size may become to be irrelevantly big for used in head mounted display.In order to avoid this is asked Topic, it is important that understand the acuity of human eye in the periphery of visual field, and understood before personnel move its head The angular range of the eyes movement for typically using.
Figure 172 illustrates the chart of the acuity of the typical human eyes relative to the angle position in visual field(S. Anderson, K Mullen, R Hess; “Human peripheral spatial resolution for achromatic and chromatic stimuli: limits imposed by optical and retinal factors”, Journal of Physiology (1991), 442, pp47-64).The central authorities of the center of human eye Very high acuity on the recessed angular range for providing approximate 2 degree.Acuity is then with the angle position in visual field(Also known as Eccentricity)Increase and decline rapidly.Additionally, colored acuity is substantially less than achromatic color acuity.It is non-as shown in Figure 172 Colored acuity is changed into 5 cycles at 15 degree, and colored acuity from approximate 50 cycles of central recess from central authorities Approximate 30 cycles of recess are changed into 3 cycles at 15 degree.Figure 173 illustrates that the typical acuity of human eye is contrasted with letter The chart of the eccentricity of change form, its highlight in terms of acuity with eccentricity decline and achromatic color acuity and Difference between colored acuity.
But the acuity of the eyes experienced by user must account for the rapid movement of eyes in visual field.Eyes this The high acuity part of a little rapid mobile visual fields that effectively extending user is seen.In augmented reality application, user is carried out Head movement also must be taken into account.When user perceives the object near the field of view edge of eyes, user court first Its eye, and and then mobile its head are moved to the object.By the angle movement for reducing eyes, the movement of these combinations makes Obtaining user can watch wider visual field, and while also causing the object at viewing field of view edge more comfortable.It is moved in people Before head, people are intended to only move the limited amount of its eye.Figure 174 illustrates that the eyes provided with the radian reduced time are moved With the typical chart of head movement(A Doshi, M Trivedi; “Head and eye gaze dynamics in visual attention and Context Learning”, 2009 IEEE, 978-1-4244-3993-5/09, pp 77-84).As seen in the data that are given in Figure 174, user's head is intended to move faster to make eye in visual field Eyeball returns to center, so that head and eyes have identical angle.Angle parallax between eyes and head is intended to be limited It is made as less than approximate 0.25 radian(It is equal to approximate 15 degree), in addition to very brief skew.This is different from working as personnel couple The head movement occurred when sound is reacted, wherein eyes and head are together with minimum parallactic movement.If user wants to see Object of the direction pointed to from head more than approximate 15 degree is seen, then user will first move their eyes, and and then mobile Their head watches object so that the angle parallax between eyes and head is decreased below into 15 degree.When design and operation tool When having the head mounted display of wide display visual field, it is important that the relation between eyes movement and head movement is taken into account 's.Acuity and the eyes movement relative to head movement based on human eye, needs +/- 15 degree at the center for showing visual field To the sharp image with high-resolution and high-contrast in +/- 20 degree of parts, to provide a user with sharp keen and height is perceived as The image of contrast.This is the central area for showing visual field, and wherein user will move its eye to watch image with fovea centraliss. Outside the region for showing visual field, display image need not be sharp keen like that, because direct viewing is typically shown visual field by user The region.Viewing is for example replaced to be located at the augmented reality object away from 30 degree of center for showing visual field, user will be towards the object Mobile its eye are approximate 15 degree, and its head is remaining 15 degree then towards the object moment.If augmented reality image is World's locking(That is, object is shown in the constant position of the real object wherein in relative to surrounding), when user moves When moving its head, augmented reality object will be moved towards the center for showing visual field, and thus it will be moved into display visual field In the cutting region of center.
Figure 175 is to illustrate provided by typical human eyes in the visual field of eyes when moving including eyes and fovea centraliss The chart of effective achromatic color acuity compared of acuity.In the +/- of the visual field watched with fovea centraliss by mobile eyes In 15 degree of parts, the acuity provided by fovea centraliss is equal to respect to acuity.It is quick more than the part of the visual field watched with fovea centraliss Acutance is reduced with the ratio being associated with the eccentricity in eyes, as shown in Figure 173.The acuity chart corresponding to need by The sharpness distribution that head mounted display with wide visual field is provided.As long as providing higher than quick shown in Figure 175 to display image The relative sharpness of sharpness distribution, human eye is just perceived as display image uniform sharp keen.This is because, when with than leading to The broader visual field in part of the comfortable visual field of viewing of fovea centraliss is crossed presenting during image, the acuity of eyes is greatly reduced.For example, Based on the acuity chart in Figure 175, the sharp keen area in center that can be used in +/- 15 degree to +/- 20 degree of size aspect is presented image, And as long as image sharpness is reduced to not less than 20% by the approximately acutance in +/- 25 degree of sharp keen area, image just will be felt by user Know for uniform sharp keen.Figure 176 is to illustrate that the contrast of minimal design MTF provides the uniform sharp keen appearance in wide visual field display image The chart of the angle field position needed for image.In the figure, design MTF to be given as with relative to the 20%MTF's of Nyquist Spatial modulation, wherein Nyquist MTF are 100%, and the MTF for reducing is less.The figure shows out area sharp keen across center(+/- 15 degree)100% Nyquist uniform Design MTF and external zones(More than 15 degree)In rapid reduction design MTF.Pass through The design MTF of the reduction in the exterior section of angle field is provided, optics can greatly simplify, so as to reduces cost and subtracted The size of population of little optics.
Figure 177 is the chart for illustrating relative MTF, and the relative MTF is needed by the display optics for wide visual field display Device shows the acutance of the acuity of human eye in the external zones of visual field to provide matching, wherein for light providing It is the spatial frequency at 20% that the distinguishable acutance of device is determined to be in MTF.In the figure, it is shown for showing visual field In various angle fields position simple 2 MTF curves(100%MTF and 20%MTF):0 to 15 degree(This is top right lateral curvature Line), 20 degree, 25 degree, 30 degree, 35 degree, 40 degree, 45 degree and 50 degree(The curve is bottom left curve).These curves are illustrated to be needed To there is provided to match the minimum MTF of the acuity of human eye across visual field is shown(From Figure 176).As can be seen, the knot Fruit is shown for the MTF of wide visual field optics can decline to a great extent in the exterior section for showing visual field.For example, wide visual field light The MTF for learning device can at the nyquist frequency of image source be higher than 20% in the sharp keen area in center, and MTF is in external zones May be much lower, it is 2% or 20% such as at 1/2 nyquist frequency.It should also be noted that colored quick due to human eye Acutance is less than achromatic color acuity, and a large amount of lateral chromatic aberrations are there may be in the external zones of wide visual field display image(lateral color)(For example, 5 pixels or more at 25 degree), and lateral chromatic aberration will not be attractive.Thus, shown width Lateral chromatic aberration in the external zones of view field image more contributes to the perceived sharpness for reducing image, but eyes in external zones It is non that low sensitivity makes the loss in terms of acutance.Similarly, the hypoallergenic acutance of the human eye in external zones makes Distort in external zones and less can perceive.Acuity loss with make the reduction in terms of the less attractive colored acuity of distortion Combination be all added to the reduction demand of the picture qualities in the external zones to showing visual field together.
As an example, Figure 171 illustrates 60 degree of display visual fields of offer(That is, +/- 30 degree away from center)Simple optical system Diagram.This includes transmitting image source 16910, single lens element 16920, angled beam splitter 16950 and sweep reflecting mirror 16960, as previously described herein.Optical system provides display image to the display visual field with approximate 60 degree of angles Eyes frame 16970.Meanwhile, surrounding is provided a user with by angled beam splitter 16950 and sweep reflecting mirror 16960 See-through view, wherein via the region or neighbouring by neighbouring angled beam splitter 16950 and sweep reflecting mirror 16960 The extension of angled beam splitter 16950 and sweep reflecting mirror 16960 and the view of surrounding is realized, perspective is regarded Field can be more than display visual field.Figure 178 illustrates the MTF curve for being modeled being associated with the optical system of Figure 171, there is shown with Show the MTF curve of the various Difference angles in visual field.In Figure 178 it is indicated with arrows for show visual field in 15,6 The MTF curve of degree position(Expressed with the level in visual field, perpendicularity), where it can be seen that 15 degree of MTF curves are for figure The Nyquist point of image source is sentenced 20%MTF and is terminated, its in this case corresponding to spatial frequency axle right hand end or 75 cycles/ mm.It is 30 degree of MTF curves less than the MTF curve of indicated 15,6 degree of MTF curves.For 30 degree of points in display field have With the 15 degree of point identical perceived sharpness shown in field, according to Figure 176,30 degree of MTF curves needs have at 7.5 cycles/mm At least 20%MTF(10% Nyquist).The all 30 degree of MTF curves illustrated in Figure 178 can be seen easily at 7.5 weeks Be higher than 20%MTF at phase/mm points, therefore so, when consider human eye it is limited mobile when, image will be by human eye outside Enclose and be perceived as in area sharp keen.Therefore, though illustrate in Figure 178 corresponding to the peripheral angle position shown in visual field MTF curve is unsatisfactory for the Nyquist performance condition for the display of the 20%MTF at 75 cycles/mm, the peripheral point in visual field The level of sharpness identical level of sharpness for providing with being provided by the angle point in visual field will be provided.
Figure 179 is the diagram of resolution chart, wherein having passed through the periphery of broad image to simulate from offer The image of the optics in +/- 15 degree with less sharp keen external zones of the sharp keen area in center is reducing the acutance of image.Directly Connect the different piece of viewing image, it can be seen that exterior section 179100 is not sharper keen than center 17920 much.If however, Wherein the center 17920 between vertical bar occupies and watch at distance approximate +/- 15 degree in beholder visual field image, then scheme As will appear to outward flange it is uniform sharp keen, as long as beholder keeps watching the inward flange of vertical bar attentively.
As a result, the system and method as herein described of principle of the invention can be used for being designed for having width Any kind of optics of the head mounted display of visual field, it includes the optics with beam splitter, with ripple The optics led or the projection optics with holographic optical elements (HOE), wherein providing the acuity phase of delivering and fovea centraliss The sharp keen area in center of corresponding MTF levels and be adjacent to the external zones in the sharp keen area in center, when consider eyes it is limited mobile when, institute State external zones provide with the acuity of human eye relative to reduction level of sharpness.In embodiment, the sharp keen area's bag in center Include +/- 15 degree with regard to optical axis(30 degree of angles), and external zones extends beyond the sharp keen area in center, extends to regarding for display image The edge of field.MTF in the sharp keen area in center should be higher than 20% at the Nyquist level of display to provide sharp image. MTF in external zones can with increase angle with compare with eccentricity increase and subtracting in terms of the acuity of human eye Lack less ratio and reduce.For example, if external zones extends to +/- 30 degree from +/- 15 degree(60 degree of angles), then MTF can be with It is low as 10% of the Nyquist space modulation at 20%MTF.The angular area of high MTF is wherein needed by restriction and is reduced Design MTF in external zones, optics can include less element and the relatively simple components with lower cost material, so as to The overall cost of optics is reduced, additionally, optics can be made more compact so that wide visual field optics can Preferably it is coupled in head mounted display.The effect is illustrated by the compact optical device illustrated in Figure 171, as herein State before, the compact optical device provides 60 degree of visual fields, and while including individual plastic field lenses, beam splitter and bending section Divide reflecting mirror.Wherein previously discussed herein the process for beam splitter and sweep reflecting mirror, with when viewing it is inclined Shake light source when provide the high perspective with unpolarized bottom to eliminate rainbow.And additionally, ligh trap can be added to compact light Device is learned to increase contrast, also as being previously discussed as herein.
The system and method as herein described of principle of the invention can be used for manufacture for having wide display visual field Head mounted display compact optical element, it has the contrast of improvement and with regarding for the perspective of surrounding The high grade of transparency of figure.By using emission display, for the needs of front light are eliminated, so as to reduce transmitting image source and bottom Space between optics.The sharp keen area in center for being restricted to be surrounded by bottom MTF external zones by Jiang Gao MTF areas, reduces The number of the lens element needed for wide visual field is shown, so as to also reduce the size of optical element.As shown in Figure 171, utilize Only one or two lens elements in top, 60 degree of visual fields are possible.As a result, the height of optics can be dropped It is low.
In embodiment, the angular dimension and transmitting image source 16910 for showing visual field is chosen to launch image source Single pixel in 16910 against less than human eye fovea centraliss achromatic color acuity display image in angle, with So that the black and white part of display image does not have pixelation appearance when being viewed by a user.This differentiate each black and The image with smooth lines and curve has been provided the user during white pixel and uneven appearance has not been produced.For example, base In the data shown in Figure 172 and 173, human eye has the achromatic color acuity of approximate 50 cycles, black for adjacent Normal complexion white pixel is including 1920 × 1080 pixels(1080p)Display image sharp keen area in can not individually differentiate for, Show that visual field should be less than 38 × 22 degree or 43 degree of diagonal.
In embodiment, the angular dimension and transmitting image source 16910 for showing visual field is chosen to launch image source Single pixel in 16910 is against the angle in the display image less than the colored acuity of human eye, so that showing figure The coloured moiety of picture does not have pixelation appearance when being viewed by a user.This is provided the user when each Colored pixels is differentiated There is the image of smooth lines and curve on colored areas and uneven appearance is not produced.For example, based in Figure 172 and Data shown in 173, human eye has the colored acuity of approximate 30 cycles, for adjacent Colored pixels are in bag For can not individually differentiating in the sharp keen area of the display image for including 1920 × 1080 pixels, show that visual field should be less than 64 × 36 degree Or 73 degree of diagonal.
In embodiment, the angular dimension and transmitting image source 16910 for showing visual field is chosen to constitute transmitting figure The sub-pixel of each pixel in image source(Typically each panchromatic pixels includes adjacent red, green and blue subpixels, and And the relative luminance of sub-pixel determines together the perception color of pixel)Against less than can by human eye differentiate angle, with So that each pixel seems to include single color, and sub-pixel is invisible to user.This is provided the user including a coloring The image of block, without the appreciable spotted appearance when each sub-pixel can be differentiated.For example, based on Figure 172 and Data shown in 173, human eye has the achromatic color acuity of approximate 50 cycles, for sub-pixel is including 1920 For can not differentiating in the image of × 1080 pixels, show that visual field is less than 115 × 64 degree or 131 degree of diagonal.
In embodiment, optics includes the telecentricity area in image light optical path, and wherein lens element can be relative Change in terms of moving each other to affect focusing distance and do not change the amplification of display image.Can be by changing optics unit Spacing between part in head mounted display realizing in a variety of ways the change in terms of focusing distance.For example, focus on Regulation can be realized by the way that image source is moved relative to the remainder of optical system.However, with wide visual field Display system in, the image light 16940 launched by transmitting image source 16910 must extend to fill bending section on area Divide the region of reflecting mirror 16960, which establishes the angle of the display visual field seen from the eyes frame 16970 as shown in Figure 171 Size.For this purpose, the wire harness between transmitting image source 16910 and lens element 16920 dissipates rapidly(Such as 100 degree or bigger folder Angle).Due to the diverging wire harness launched by transmitting image source 16910, between transmitting image source 16910 and lens element 16920 Spacing in any change(It is made to change focusing distance or focusing quality)It is the display figure by being seen by user Change to realize in terms of the vision size of picture.In the head mounted display that augmented reality image is just presented, especially It is the vision of augmented reality object when focus adjustment is made automatically with user's movement or as augmented reality object is moved Size with movement it is consistent be it is important, with provide comfortably watch condition for a user.The vision size of display image Aspect change image can also be made to be pruned by the part that shell is adjacent to optics so that the edge of display image from Eyes frame not may be viewed by, or effective size of eyes frame is reduced.Thus, make the portion for display image or display image Point focal length in terms of change and not change the ability of the vision size of image be for for showing the head of augmented reality image Key character for portion's installing type display.Telecentricity area can be in optics multiple positions providing, such as upper There is provided between lens in portion's optics or between the optics of upper and lower.Figure 171 is illustrated in upper and lower Centrage in telecentricity area 17140 between optics, wherein each wire harness is parallel.In the telecentricity area 17140, can Using by mobile as the relative to the second unit including angled beam splitter 16950 and sweep reflecting mirror 16960 The lens element 16920 and transmitting image source 16910 of Unit one makes focus adjustment to change focusing.As an example, for Optics shown in Figure 171, the spacing side of the 0.5mm between top optics 16903 and lower optical device 16907 The reduction in face can be provided from infinity to the change in terms of 1 meter of focusing distance(This adds 1 dioptric with optics rear Degree correcting lens are identicals).This ability for adjusting focusing distance may be used for the sharp of user's fine tuning display image Degree changes the apparent distance that display image is presented to user.Change wherein in terms of the apparent distance of display image can be used for increasing Strong reality service condition, wherein being at the distance of the object in matched environment or in the specified distance of such as brachium etc Existing display image.
The man-operated mechanism of such as screw or cam etc can be positioned so that by mobile relevant optical remote to change Space in heart district.Wherein adjust manually and focus on or allow users to at its ophthalmology refractive power for adjusting during manufacture Side and fine tuning focus on be useful.Electric actuator can be mounted to for augmented reality application or for including poly- The pattern of the change in terms of defocus distance changes and automatically adjusts the spacing in telecentricity area.
In embodiment, telecentricity area can not be provided, or telecentricity area can only be close telecentricity, and can pass through Move optical element and also digitally adjust content to come to compensate the enlarge-effect caused by the shift component in non-telecentricity area Make focal plane regulation.
In embodiment, there is provided for watching wide angle display figure using any kind of head mounted display Picture(For example, more than 50 degree of angles)Pattern, wherein with the eyes movement for detecting after be that the head carried out by user is moved Accordingly showing transverse shifting image in visual field.The pattern imitates the experience of the first line center for being sitting in cinema, in this place for The wide-angle film image of viewing, beholder only can not cosily watch whole motion picture screen, and generation with eyes movement Its eye alternately must be moved together with its head to see the outer peripheral areas of motion picture screen.In order to realize the pattern, wear-type Display needs the device for detecting the eyes associated with optical module 16900 movement, and to detect what head was moved Inertial Measurement Unit.Thus, the pattern by detecting eyes movement after be the head movement on equidirectional detecting user The expectation of the periphery of display image is watched using the part with higher acuity of eyes visual field.
Then across display field-of-view lateral mobile display figure on the direction contrary with the movement for detecting of eyes and head Value and speed of the value and speed of picture, wherein transverse shifting corresponding to the movement for detecting of eyes and head.Display is regarded This of display image in moves laterally through the sharp keen area in center that the periphery of display image is moved to display visual field In and the periphery of display image moved in the eyes of user position relatively centered on it to be carried for user For the improvement view of the periphery of display image.Additionally, the transverse shifting for showing the display image in visual field can be limited It is that the edge of display image is being shown into required transverse shifting placed in the middle in visual field.The pattern reply following facts:For with Its eye is set to be not easypro in the mobile angle for exceeding approximate 15 to 20 degree more than in shorter time period relative to its head for family Suitable, and because head mounted display is attached to the head of user, eyes movement is that visually viewing shows visual field The sole mode of different piece.This causes to be difficult to cosily watch for the user of head mounted display have to arrive more than 30 The image of the vision size of 40 degree of angles.Disclosed pattern overcomes this restriction, by detecting when user will wish to see See the periphery of display image and and then will show that the display image in visual field moves laterally to following positions:In the position The periphery of place's display image can more comfortably be watched and display image periphery with the acutance that improves and more High-contrast is showing.
By based on detect in a direction combination eyes movement after be in the same direction head movement and Triggering show visual field in display image transverse shifting, the pattern be different from display image the world locking or body locking Present, wherein the transverse shifting of image accordingly occurs with head movement, and unrelated with eyes movement.For example in United States Patent (USP) The description of the body locking of the virtual objects provided in 2014204759 in head mounted display is disclosed.In embodiment, show The transverse shifting of diagram picture is restricted to for the edge of display image to be positioned at the center of display visual field in visual field or regards showing The required transverse shifting of other comfortable points of certain in.Wherein it is by another example for being not intended to the transverse shifting of image When user only temporarily watches towards edge or corner(For example, alert light to flash in the corner of image, and user is only temporary Its eye of Shi Yidong are verifying passage of scintillation light).In this case, user does not move its head, and does not trigger image as a result Transverse shifting, and display image show visual field in remains stationary.
It is after the head of equidirectional is moved, with user after having been detected by the eyes higher than predetermined threshold and moving The angle movement for detecting of head is accordingly and on opposite to that direction across showing field-of-view lateral mobile display figure Picture(It is noted that the method can also be come for the corresponded manner for passing through axle or moving radially for showing the display image in visual field Use).Eyes camera can be utilized(For example, as disclosed in this paper other positions)To detect that eyes are moved, the eyes phase Machine captures the image of eyes of user or by detecting the electric field associated with eyes while eyes of user watches display image The change of aspect is capturing the image of eyes of user.Motion sensor can be passed through(For example, IMU)Relative to the world, relative to User's body etc. is moved come the angle for detecting user's head.With environmentally hazardous fixed display image for just sitting quietly as user or Quiet wide angle image of watching immediately is good.With user's body display image is associatedly fixed for just walking, run as user Viewing wide angle image is good when moving or being sitting in car.Can for example by the Inertial Measurement Unit in head mounted display Or by using the camera in head mounted display picture charge pattern is carried out to the object in environment measure user's head relative to The angle movement of environment.The angle that user's head can be measured by camera downwards relative to user's body is moved, The camera downwards can for example capture the image of a part for user's body.The image of the part of user's body is right Analyzed to detect relative changes afterwards, the relative changes can be used for detecting movement of the user's head relative to user's body. Alternately, two Inertial Measurement Units can be used for movement of the detection user's head relative to user's body, wherein, one is attached It is connected to head mounted display and one attaches to user's body, and difference measurement is used for determining user's head relative to user The movement of body.Move and tested higher than the movement of the user's head of threshold value the eyes higher than threshold value are had been detected by After surveying to follow eyes movement, start across display field-of-view lateral mobile display image.The speed of the transverse shifting of display image Move and on the direction contrary with the head movement corresponding to the subsequent head for being detected.The horizontal shifting of display image It is dynamic to proceed, until the edge of display image reaches the center that shows visual field or eyes are detected and watch display and regard The center of field(Or watch in the predetermined threshold at center for showing visual field), so as to indicate to have arrived at the figure that user wants to watch The periphery of picture.
Figure 180 and 181 is to illustrate that how image is in the diagram for showing visual field internal shift when user moves its head.Note It is shown as in the side of image to user's head, because image is actually presented to the use on the inside of head mounted display Family.Figure 180 is illustrated in the user's head 18050 for showing image 18055 placed in the middle in visual field with always point to front.Figure 181 shows Go out to refer to sideways user's head 18150, and as a result image 18155 is being shown in visual field in the movement with user's head Contrary square upward displacement, so as to stay without the picture material blank parts 18130 to be shown.In Figure 182, wherein Blank parts 18230 of the image from its display visual field being displaced from are shown as dark areas and enable a user to perspective Surrounding in blank parts.However, in different service conditions, blank parts are shown as into neutral gray or colour It is possibly favourable.
In embodiment, the user of wide visual field head mounted display is provided with selection and different images or applies phase The size of the display image of association(For example, angular dimension)Option.Then display image is reset size and is selected the role with providing Image size is spent for for displaying to the user that.For example, in film watching mode, user can by display image select be Size aspect is approximate 30 degree, and its imitation is sitting in the experience of the heel row of cinema, wherein moving merely with eyes for a user It is comfortable to watch whole display image.Alternately, it is its mould 50 degree in terms of size that user can select display image It is imitative to be sitting in the front-seat experience of cinema, wherein need the combination moved using eyes movement and head with it is described previously herein Image shift comes together to watch display image, cosily to watch whole display image.Figure 183 illustrates wide display visual field 18360 Diagram, wherein user can be selected for given image or application(For example, play)Show compared with small field of view 18365, to improve Personal viewing experience.Wherein allow users to watch image compared with small field of view 18365 or come too much using its eye without movement See whole image.
In embodiment, display format is chosen to have the narrow vertical field of view relative to horizontal field of view, so that Thickness across the optics of lower optical device measurement can be reduced.Angled beam splitting in due to lower optical device The angled orientation of device 16950, the vertical field of view in display image is in direct ratio with the thickness of optical module.Regard for edge shows The given display visual field of the diagonal measurement of field, the form ratio for reducing vertical field of view and thus increasing display image causes optics The thickness of component can be lowered.For example, for 50 degree of diagonal linear fields 16:9 format-patterns, optical module 18415 Thickness 18410 can be approximated to be 17mm, as in Figure 184 it is illustrative illustrate as.If the form of display image is increased It is added to 50 degree of diagonal linear fields 30:9, then the thickness 18510 of optical module 18515 can be approximated to be 10mm, such as Figure 185 In it is illustrative illustrate as.This represent by change to higher form than the optical module for being provided thickness in terms of it is approximate 40% reduces.Figure 186 illustrates 30:9 form visual fields 18620 and 22:9 form visual fields 18625, two of which visual field has identical Vertical field of view and different horizontal field of view.By using higher form ratio, wide visual field can be shown so that the head of relative thin is pacified Enhancing display map in dress formula display is used, to improve the form factor of head mounted display.Can be by using High form compares emission display than emission display or by using normal format(For example, 4:3、16:9 or 22:9)And so Obtain high form ratio using the upper area of emission display or the part of lower area afterwards.For example, head-mounted shows Device can include 1080p emission displays, and it has 1920 × 1080 pixels, and can be by using on emission display 1920 × 576 pixels are showing 30:9 images.Then thin optical module will be provided, it only can be displayed in vertical direction includes The image of 576 pixels, but optics can show the image for reaching 1920 pixels in level.To show with difference In the case of the image of form, the image will be reset size into suitable available display space(For example, 16:9 format-patterns can be with It is shown as 1024 × 576 pixel images, and 22:9 images can be shown as 1408 × 576 pixel images or with level Or any other ratio that the form of vertical available number of pixels and just shown image is associated).In preferred embodiment In, show that visual field has and be more than 22:9 form ratio.For example, by with such as 30:9 form ratio, core can be used for Show 22:9 images, such as film, and 22:Region 18627 outside 9 display visual fields is displayed for auxiliary information, institute State auxiliary information need not be it is can easily watching or with high-resolution present, all battery lifes in this way, the time, temperature, Whether directivity direction, new Email or text can use.
In another embodiment, the sharp keen area in the center of display is displayed for different types of with outer peripheral area Image.For example, the sharp keen area in center is displayed for 22:9 or 16:9 film images, it is sharp keen into suitable center that it is reset size Number of pixels included in area.Then outer peripheral area can be used as second display, be shown described second Other kinds of information is shown at device, the other kinds of information can be watched in short time period with low resolution, So that required uncomfortable eye positions are acceptable.
In another embodiment, compared with the sharp keen area in center, the information shown in outer peripheral area is differently rendered.This can To include using larger font letter, higher contrast setting or different colours so that the information presented in outer peripheral area can be more Easily viewing.
In a further embodiment, display image is accordingly adjusted with the change in terms of focusing distance.In order to reality The measurement of existing focusing distance, can provide sensor to measure the distance between optical element, and the optical element is used to change Focusing between such as image source 16910 and lens element 16920 or between lens element 16920 and lower optical device away from From.Wherein display image can be digitally adjusted to greater or lesser, not be remote to compensate light between optical element The amplification that may occur in the case of the heart.Display image can also be for distorting and digitally being adjusted, and the distortion may be Optical element be moved in the change in terms of realizing focusing distance change optical element between apart from when occur.Its Change in terms of middle focusing distance can be associated with augmented reality operator scheme, the augmented reality operator scheme it is all in this way its Middle focusing distance is needed in specific range(Such as, at brachium)To allow user and shown augmented reality object The pattern for interacting.
In another embodiment, optical module is designed to provide telecentricity light to the light processed including triple trap reflecting mirrors Learn surface to reduce the angular range of incident illumination and thus improve the performance of triple trap reflecting mirrors.Wherein telecentricity light can enter It is mapped on angled beam splitter or incides on sweep reflecting mirror.The embodiment when head mounted display provides wide visual field Possible particular importance, because triple trap reflecting mirrors are designed to the limited angle distribution for having around special angle At special angle.By providing telecentricity light to triple trap reflecting mirrors, color homogeneity and brightness uniformity can be improved.Another In outer improvement, wide angle display image can be rendered into by radially increasing digital brightness(For example, radially increase in image Code value and the illumination for associating)And radial direction changes the color balance in image(For example, color rendering)To compensate radial direction primary colours Roll-off with brightness.In this way, image is provided the user, described image is perceived as with uniform brightness and uniform face Color, although the angle limits that triple trap reflecting mirrors are processed affect the wide display image shown on visual field.
Another aspect of the present invention is related to include the display floater in Wearing-on-head type computer, and it there is presentation to be wider than use field The ability of the image needed for scape, so that the edge of panel can be by the displacement in being left blank to allow display content.Show Then content can be presented completely(Even if when being shifted), because content can be displaced to the normal blank region of panel In.For example, panel may be selected so that it can produce 50 degree of visual fields, but digital content may only consume 45 degree of visual fields, So that whole image still can be watched in the case that it is shifted 2.5 degree in either direction.Such as this paper other positions Illustrated, in wide visual field head mounted display systems, if user attempts seeing the distal edge to content that content may be needed It is shifted.In such circumstances, system may begin at visual field(It is multiple)Reservation white space on edge is taking into account Entire content is shifted.In other embodiments, arrive(It is multiple)The displacement retained in edge can be by content augmentation focal plane, meeting Used when poly- etc..
In embodiment, the content of presentation has and is intended to occupy the content type of all visual fields in visual field(Such as work as sight When seeing a film).When film is presented, its be intended to occupy as can by cosily viewing more than visual field.In embodiment, Exactly such full display content is present in the centre portion of visual field, the visual field have intentionally be left blank Edge.The arrangement allows full display content to be displaced in untapped edge to carry out adaptation illustrated herein.
In embodiment, wide visual field display is used for the number of the image that display image is passed through in image source 110 Word is shifted and transverse shift, to change the focusing distance being associated with the viewing of stereo-picture, and is thus changed to display figure The perceived distance of picture.Wherein can with the type of just shown image, be associated with making for just shown augmented reality object With the type of situation detecting accordingly or in response to the eyes of user in head mounted display(For example, such as can be with Detected with eyes camera)Characteristic(The focusing distance or focusing distance of such as eyes of user)To change focusing distance.Figure 187 shows Go out through the diagram for showing the eyes of user 18721 that visual field 18723 is watched.In this case, eyes of user 18721 has Parallel sight line 18725 so that approximate at infinity with the convergent point that stereo-picture is associated.Each shows visual field 18723 Core be subsequently used for display image(It is shown as showing the dark areas in visual field 18723), it prevents take up whole display and regards Field 18723.In this way, user perceives stereo-picture, and it includes will be away from approximate with the convergence prompting that focusing distance is associated Mutually overlapping left image on top and right image that infinite point is presented.Preferably, focusing distance is identical with focusing distance So that it is identical with prompting is assembled with the focusing prompting that focusing distance is associated, and stereo-picture is thus provided a user with, institute State stereo-picture and there are consistent stereo cues for more comfortable viewing experience.Importantly, in Figure 187, existing every The part of the side for being not used for display image of individual display visual field 18723, because display image is prevented take up shows visual field 18723 Whole horizontal angular range.Therefore, showing that transverse shift left image and right image are possible in visual field 18723(Such as Figure 188 Shown in)With provide closer to focusing distance.Eyes of user 18821 is wherein shown in the position for slightly rotating so that when saturating When the center for crossing left display image and right display image is watched, sight line 18825 is angled toward each other.By making left display Image and right display image accordingly show in visual field 18823 at it and are displaced towards one another to produce the geometry.Figure 189 is illustrated Left display image and right display image(18911 and 18910)When they are for when focusing distance is approximately infinity And the diagram that will be present in when display in visual field 18723.Figure 190 illustrates left display image and right display image(19012 With 19014)The figure that will be present in when display in visual field 18823 when they are for when focusing distance is nearer Show.Thus, it is that wide display visual field 18723 and 18823 provides the display that narrow vertical field of view is shown in visual field by digitally displacement Image and provide converge distance adjust additional benefits.Focusing distance is adjusted and may be used to provide augmented reality image, described Augmented reality image is perceived as at the different distances, such as certain is applied or desired viewing experience required for that Sample.When display image has the form ratio lower than showing visual field(For example, display image has 22:9 forms and display regard Field has 30:9 forms), this feature is useful especially so that show the part of visual field show left image and during right image not Used.In this example, 16:9 form stereo-pictures are providing 25:It is shown in the optics of 9 forms display visual field, wherein Stereo-picture is shown in the case of without pruning so that the range of vertical angles matching optics device of shown stereo-picture The range of vertical angles of the display visual field of part.Left display image and the right side are needed in order to converge distance 2 feet be changed into from 8 feet Toward each other digitally displacement reaches approximate 10% of the horizontal angular range of each in display image to display image(For example, it is right In 1280 × 720 pixel images, numerical shift amounts to 146 pixels).This example change of focusing distance is well adapted to change Imaging service condition between change, such as from viewing have 8 feet at perceive image film change to need to The augmented reality object for wanting image perceived in the arm's reach of user is interacted.
In another embodiment, wide visual field display be used to enable display image to pass through the figure in image source 110 The numerical shift of picture being essentially displaced laterally, to change the interocular distance between display image.Figure 191 is illustrated through display visual field The diagram of 19123 eyes of user 19121 watched, wherein compared with the eyes of user 18721 shown in Figure 187, using Family eyes 19121 have in-between bigger interocular distance.In both Figure 187 and 191, the He of eyes of user 18721 19121 have respectively parallel sight line 18725 and 19125 so that approximate in infinity with the convergent point that stereo-picture is associated Place.Each shows that the core of visual field 18723 and 19123 is used for display image(It is shown as showing visual field 18723 and 19123 Interior dark areas), described image prevents take up and whole shows visual field 18723 and 19123.However, because eyes of user 19121 is at this There is wider interocular distance in situation, therefore left image and right figure are made by shifting with making the image digitization in image source As showing transverse shift in visual field 19123(As shown in Figure 191), with as seen in display visual field 19123 by user Like that framing is obtained into farther, and thus desired sight line 19125 is provided.Wherein eyes of user 19121 is illustrated in In parallel position so that when the center through left display image and right display image is watched, sight line 19125 is parallel.It is logical Crossing makes left display image and right display image to show accordingly at it shift to produce the geometry away from each other in visual field 19123 Structure.Figure 192 illustrates left display image and right display image(19212 and 10214)For in focusing distance approximately infinite Distant place and eyes of user 19121 have a case that they will be present in display visual field 19123 during big interocular distance When or the diagram as seeing in image source 110.Furthermore, wide level is provided together with narrow vertical field of view and shows visual field 19123 provide the numeral being adjusted for interocular distance by making the display image in display visual field digitally shift The additional benefits of method.
In a preferred embodiment, the part for the display visual field of the transverse shift of image show altogether visual field 10% or It is more.Thus, although these parts for showing visual field are not used for display image, but they be used for for provide it is desired assemble away from From or adjust shown left image and right image interocular distance purpose positioning image.As in Figure 189,190 and 192 Can see, when display image is made by shifting with making the image digitization in image source transverse shift in visual field is being shown When, the blank or unused portion for showing visual field changes the left side and right side to display image in terms of its relative size, and same When maintain constant total amount.In a further preferred embodiment, show that the total amount of the blank or unused portion of visual field is aobvious altogether Show 10% of visual field or more.
Although describing the embodiment of HWC in the language specific to feature, system, computer procedures and/or method, But claims are not necessarily limited to special characteristic, system, computer procedures and/or the method for describing.But, it is specific Feature, system, computer procedures and/or method are disclosed as the non-limiting example embodiment of HWC.Herein with reference to All documents are merged in accordingly by reference.
The additional statement of the disclosure
In some embodiments, can described in following clause or herein system and method described otherwise above.
Clause group A
A kind of figure having for control in the perspective wear-type display system for being directed to the visibility of the improvement of user of clause 1. Method as presenting, including:Determine the brightness of the see-through view of surrounding;Determine the brightness metric of image to be displayed; And the brightness of the see-through view of the brightness metric based on image and surrounding is adjusting the attribute of image, so that image Brightness and the predetermined combinations brightness of see-through view are presented to user.
Method of the clause 2. according to clause 1, also including the photoresponse operating space for determining eyes of user, and wherein The step of attribute for adjusting image, is based further on the operating space.
Method of the clause 3. according to clause 2, wherein the perspective that the step of adjusting the attribute of content improves user is considerable The property seen.
Method of the clause 4. according to clause 2, wherein the user that the step of adjusting the attribute of content improves image regards Figure.
Method of the clause 5. according to clause 2, the operating space of wherein human eye is from photoptic vision, mesopic vision With a selection in scotopic vision.
Method of the clause 6. according to clause 1, wherein the attribute includes changing the contrast in image.
Method of the clause 7. according to clause 1, wherein the attribute includes changing the color of the object in image.
Method of the clause 8. according to clause 1, wherein the attribute includes changing the color balance in image.
Method of the clause 9. according to clause 1, wherein the attribute includes that the font for changing the text in image is big It is little.
Method of the clause 10. according to clause 1, wherein the attribute is included image modification monochromatizing image.
Method of the clause 11. according to clause 10, wherein the monochrome image is red image.
Method of the clause 12. according to clause 10, wherein the monochrome image is green image.
Method of the clause 13. according to clause 1, wherein the wear-type display system is also included around for capturing The camera of the image of environment, described image includes at least a portion of the see-through view of surrounding.
Method of the clause 14. according to clause 13, it is further comprising the steps:Analyze captured image to know The attribute of other surrounding;And including being based further on being recognized for surrounding the step of wherein adjust the attribute of image Attribute is adjusting attribute.
Method of the clause 15. according to clause 14, the attribute of wherein surrounding is the type of object.
Method of the clause 16. according to clause 14, the attribute of wherein surrounding is the scope of color.
Method of the clause 17. according to clause 14, the attribute of wherein surrounding is in a part for see-through view The subrange of color, and the adjusted attribute of image is the local color in a part for display image.
Method of the clause 18. according to clause 1, wherein the head mounted display further includes to be used for capturing The image of family eyes is determining the camera in the direction that user just look at;And the wherein brightness of the see-through view of determination surrounding The step of the brightness of see-through view that is related to determine surrounding in said direction.
Method of the clause 19. according to clause 18, wherein different in the part corresponding to the direction of image Ground adjusts described image.
Method of the clause 20. according to clause 1, wherein image to be displayed include being controlled by eye tracks User interface, and described image be adjusted to it is brighter than see-through view with reduce shake eyes movement.
Method of the clause 21. according to clause 20, wherein described image are adjusted to be 2 times of see-through view to become clear Or it is brighter.
Clause 22. is a kind of for providing changing for display image and the see-through view of surrounding in head mounted display The method of kind alignment, the head mounted display provides the display image in superimposition to the see-through view of surrounding, wherein institute Stating head mounted display includes the eyes camera for being imaged to eyes of user and the facing external for being imaged to surrounding Camera, methods described includes:The image of surrounding is captured with the camera of facing external;To the user in head mounted display The image for being captured of display environment, therefore user sees surrounding image of the superimposition to the see-through view of surrounding simultaneously Display image;The positioning that the control input from user adjusts display image is collected using eyes camera, around improving The alignment of the display image of environment and the see-through view of surrounding;And improved using the adjusted positioning of display image The alignment of the see-through view of other display images and surrounding.
Method of the clause 23. according to clause 22, wherein described other display images include augmented reality image.
Clause group A1
Clause 1. is a kind of to be aligned for providing display image in head mounted display with the improvement of the see-through view of surrounding Method, the head mounted display provides the display image in superimposition to the see-through view of surrounding, wherein described wear Formula display includes the camera of the eyes camera for being imaged to eyes of user and the facing external for being imaged to surrounding, Methods described includes:The image of surrounding is captured with the camera of facing external;Ring is shown to the user in head mounted display The image for being captured in border, therefore user sees the display figure of surrounding image of the superimposition to the see-through view of surrounding simultaneously Picture;The positioning that the control input from user adjusts display image is collected using eyes camera, to improve surrounding The alignment of the see-through view of display image and surrounding;And improved using the adjusted positioning of display image other show The alignment of the see-through view of diagram picture and surrounding.
Method of the clause 2. according to clause 1, wherein described other display images include augmented reality image.
Clause group B
A kind of head mounted display with multiple folding optics of clause 1., it provides perspective of the superimposition to surrounding The display image of the improvement on view, the head mounted display includes:Solid prisms with angled plane surface;It is spontaneous Optical display unit, the image light that its offer is associated with display image;And it is joined to the planar reflective plate of plane surface, its reflection The image light being associated with display image, wherein the planar reflective plate is joined to solid prisms.
Head mounted display of the clause 2. according to clause 1, wherein the self-emitting display is OLED.
Head mounted display of the clause 3. according to clause 1, wherein the self-emitting display is back illumination LCD.
Head mounted display of the clause 4. according to clause 1, wherein will be described flat with the binding agent of refractive index match Smooth reflecting plate is joined to solid prisms.
Head mounted display of the clause 5. according to clause 4, wherein it is solid that the binding agent of the refractive index match has The refractive index of +/- the 0. 05 of the refractive index of body prism.
Clause group B1
A kind of head mounted display with multiple folding optics of clause 1., it provides perspective of the superimposition to surrounding The display image of the improvement on view, the head mounted display includes:Solid prisms with angled plane surface;Engagement To the image light that the flat reflecting plate of plane surface, a part for its transillumination light and reflection are associated with display image A part;Reflectogram image source, its indirect illumination light is providing image light;And it is attached to the backlight of angled plane surface, It includes the prism film of a part for orienting reflex image source guiding illumination light.
Head mounted display of the clause 2. according to clause 1, wherein the reflected image source is LCOS.
Head mounted display of the clause 3. according to clause 1, wherein the flat reflecting plate includes polarization by reflection Device.
Head mounted display of the clause 4. according to clause 1, wherein the prism film is joined to flat reflection Plate.
Head mounted display of the clause 5. according to clause 1, wherein the prism film with prism back to reflectogram image source And it is orientated towards the light source for illumination light.
Head mounted display of the clause 6. according to clause 5, wherein illumination light is divided into two vertebras by the prism film Body, and only one vertebral body is illuminated to reflectogram image source.
Head mounted display of the clause 7. according to clause 6, also including analysis polarizer, it absorbs illumination light not The vertebral body that reflectogram image source is illuminated.
Head mounted display of the clause 8. according to clause 7, wherein, the analysis polarizer also absorbs and display figure The image light that dark-part as in is associated.
Head mounted display of the clause 9. according to clause 1, wherein with transparent viscous with solid prisms refractive index match Mixture is by planar reflective plate engagement to plane surface.
Head mounted display of the clause 10. according to clause 9, wherein the refractive index of the clear binder is in solid In +/- the 0. 05 of the refractive index of prism.
Clause group B2
A kind of method of the solid prisms with flat reflective surface for being used for head mounted display for manufacture of clause 1., bag Include:Solid prisms of the molding with one or more surfaces with refractive power and the optical material of at least one plane surface; After molding, using transparent UV the drop of binding agent is solidified, the transparent UV solidifications binding agent has the optics with flat surfaces The refractive index of Refractive Index of Material matching;Planar reflective plate is applied to into the drop of binding agent;Binding agent is allowed to rely on capillarity Across the interface between plane surface and flat reflecting plate not to planar reflective plate applying pressure, to avoid making planar reflective plate Deformation, till whole interface is covered by adhesive;And be applied to the interface to solidify binding agent and formed by UV light Solid prisms with flat reflective surface.
The method according to claim 1 of clause 2., wherein the planar reflective plate is employed, therefore planar reflective The reflection side contact adhesive of plate so that the reflection side is inside the solid prisms with flat reflective surface.
The method according to claim 1 of clause 3., wherein the planar reflective plate is reflecting mirror.
The method according to claim 1 of clause 4., wherein the planar reflective plate is partially reflecting mirror.
The method according to claim 1 of clause 5., wherein the planar reflective plate is reflective polarizer.
The method according to claim 5 of clause 6., wherein the reflective polarizer contact adhesive, therefore it is described Reflective polarizer is inside the solid prisms with flat reflective surface.
Shrink mark on the method according to claim 1 of clause 7., wherein described adhesive filling plane surface.
Clause group B3
A kind of head mounted display for showing display image of the superimposition to the see-through view of surrounding of clause 1., its Including multiple folding optics, the head mounted display includes:With at least one surface with refractive power and flat table The solid prisms in face, the first folded inside of the optical axis of the image light that its offer is associated with display image;Combiner, its provide with Second folding of the associated optical axis of image light;And wherein planar plate reflector be joined to the plane surface of solid prisms with to Solid prisms provide flat reflective surface.
Head mounted display of the clause 2. according to clause 1, wherein the combiner is flat reflecting mirror.
Head mounted display of the clause 3. according to clause 1, wherein the multiple folding optics also includes providing The back illumination display or self-luminous image source of image light, and planar plate reflector is completely reflecting mirror.
Head mounted display of the clause 4. according to clause 1, wherein the multiple folding optics also includes reflection Image source, and illumination light, by the backlight offer being positioned at behind planar plate reflector, wherein planar plate reflector is that part is anti- Mirror is penetrated, and illumination light is transmitted through planar plate reflector.
Head mounted display of the clause 5. according to clause 1, wherein being solidified with the UV with solid prisms refractive index match Clear binder is arrived the plane surface of solid prisms by planar plate reflector engagement.
Contracting on head mounted display of the clause 6. according to clause 5, wherein described adhesive filling plane surface Trace.
Head mounted display of the clause 7. according to clause 5, wherein the refractive index of UV solidification clear binders exists In +/- the 0. 05 of the refractive index of solid prisms.
Clause group B4
A kind of head mounted display with multiple folding optics of clause 1., it is used to providing superimposition and arrives surrounding Display image in see-through view, the head mounted display includes:Solid prisms, the figure that its offer is associated with display image As the first folded inside of light;Combiner, it provides the second folding of image light while the see-through view of surrounding is provided It is folded;And the optical element being associated with solid prisms, it provides regarding from eyes of user to the reflected light of eye imaging camera .
Head mounted display of the clause 2. according to clause 1, wherein the optical element provide by multiple folding from The visual field of the light of eyes of user reflection.
Head mounted display of the clause 3. according to clause 1, wherein the optical element provide substance fold from The visual field of the light of family eye reflections.
Head mounted display of the clause 4. according to clause 1, wherein optical element and solid prisms are molded into one Rise.
Head mounted display of the clause 5. according to clause 1, wherein optical element has been molded it in solid prisms After be attached to solid prisms.
Clause group B5
A kind of head mounted display with folded optics of clause 1., it is used to provide perspective of the superimposition to surrounding Display image on view, the head mounted display includes:Combiner, its provide surrounding see-through view and while Image light is redirected towards eyes of user to provide the display image of superimposition;Light source, it is illuminated to eyes of user;Phase Machine, its capture when the display image that user is watched in superimposition to see-through view includes user's eye of the light reflected by eyes of user The image of eyeball;And wherein described light source provides infrared light, and camera is sensitive to infrared light.
Head mounted display of the clause 2. according to clause 1, wherein a part for combiner are applied including hot mirror Layer, it is reflexive to infrared light and is radioparent to visible ray.
Head mounted display of the clause 3. according to clause 2, wherein the camera is positioned to the side of combiner.
Head mounted display of the clause 4. according to clause 3, wherein the combiner includes of reflected image light The partially reflecting mirror coating divided.
Head mounted display of the clause 5. according to clause 3, wherein the combiner includes of reflected image light The trap mirror coating for dividing.
Head mounted display of the clause 6. according to clause 3, wherein the combiner includes of reflected image light The holographic optical elements (HOE) for dividing.
Head mounted display of the clause 7. according to clause 3, wherein the light source is positioned to the side of combiner.
Head mounted display of the clause 8. according to clause 1, wherein the combiner includes waveguide, it is by image light Viewing area is sent to from image source.
Head mounted display of the clause 9. according to clause 8, wherein the waveguide includes angle part reflector, Its redirect image light a part for user viewing, and also redirect by eyes of user reflect light a part for Camera is captured.
Head mounted display of the clause 10. according to clause 9, wherein described image light and by eyes of user reflect It is just coaxial.
Head mounted display of the clause 11. according to clause 10, wherein the waveguide includes:Part I reflector, Its along waveguide redirect image light a part and while a part for the light reflected by eyes of user is transmitted to into camera;And Part II reflector, a part for image light is redirected and also redirected by user's eye along waveguide by it towards eyes of user A part for the light of eyeball reflection.
Head mounted display of the clause 12. according to clause 11, wherein the light source is anti-along waveguide and by Part II A part for the light that emitter is redirected towards eyes of user is directed.
Head mounted display of the clause 13. according to clause 3, wherein the combiner includes waveguide, it is by image light Viewing area is sent to from image source.
Head mounted display of the clause 14. according to clause 13, wherein the illumination light is transmitted by waveguide from light source To be illuminated to eyes of user.
Head mounted display of the clause 15. according to clause 14, wherein the combiner is included image light towards use The holographic optical elements (HOE) that family eyes are redirected.
Head mounted display of the clause 16. according to clause 2, wherein the coating reflects greater than 80% infrared light simultaneously And visible ray of the transmission more than 50%.
Clause group B6
A kind of compact head mounted display with multiple folding optics of clause 1., it provides superimposition and arrives surrounding Display image in see-through view, the compact head mounted display includes:The solid prisms of the first material, it has folding light The angled plane surface of axle and one or more surfaces of offer refractive power;By the second material of the material different from solid prisms One or more additional lens elements with refractive power made by material;Image source, the figure that its offer is associated with display image As light;Combiner, it folds optical axis and towards eyes of user navigational figure light;And wherein described multiple folding optics Greater compactness of head mounted display is provided, and the first material and the second material are selected to reduce the lateral chromatism in display image Difference.
Clause group B7
Clause 1. it is a kind of provide superimposition to the see-through view of surrounding on display image with the tight of display optics Gather head mounted display, the display optics have the optical axis of multiple folding, and the compact head mounted display includes:Figure Image source, the image light that its offer is associated with display image;Top optical device module, it includes providing refractive power and optical axis The first multiple optical elements for folding;Lower optical device blocks, it includes combiner, and the combiner provides the second of optical axis Fold with towards eyes of user navigational figure light, and while also allow light from surrounding through to eyes of user, so that Obtain display image to be seen by the user in the see-through view for superimposition to surrounding;And wherein, top optics includes carrying Solid prisms for refractive power and fold optical axis and towards the reflecting mirror of lower optical device blocks navigational figure light.
Compact head mounted display of the clause 2. according to clause 1, wherein, described image source is self-luminous micro display Device.
Compact head mounted display of the clause 3. according to clause 1, wherein, described image source is OLED micro-displays.
Compact head mounted display of the clause 4. according to clause 1, wherein, described image source is that back illumination LCD is micro- Display.
Compact head mounted display of the clause 5. according to clause 3, the reflecting mirror of wherein solid-state components is part reflection Mirror, and the camera for capturing the image of eyes of user is positioned in behind partially reflecting mirror.
Compact head mounted display of the clause 6. according to clause 5, wherein the partially reflecting mirror is cold reflector, Its reflection visible ray and transmitted infrared light, and the camera captures the infrared image of eyes of user.
Compact head mounted display of the clause 7. according to clause 2, wherein, described image source is reflective microdisplay.
Compact head mounted display of the clause 8. according to clause 2, wherein, described image source is LCOS or FLCOS.
Compact head mounted display of the clause 9. according to clause 2, wherein, described image source is DLP.
Compact head mounted display of the clause 10. according to clause 8, the reflecting mirror of wherein solid prisms is that have the back of the body The partially reflecting mirror of light, the backlight is positioned at behind partially reflecting mirror to provide illumination light to image source.
Compact head mounted display of the clause 11. according to clause 10, wherein the partially reflecting mirror is polarization by reflection Device, a part for its transillumination light, and the polarization state of illumination light change when being reflected to provide image light by image source, So that image light is partially reflected mirror and is reflected.
Compact head mounted display of the clause 12. according to clause 2, the wherein material of solid prisms have and top The different refractive index of the material of other optical elements in optical device module.
Compact head mounted display of the clause 13. according to clause 12, wherein the multiple optics with top optical module The associated material of element and refractive power are selected to reduce and provide to the lateral chromatic aberration in the display image of eyes of user.
Compact head mounted display of the clause 14. according to clause 13, the wherein material of solid prisms have than top The higher refractive index of the material of other optical elements in optical device module.
Compact head mounted display of the clause 15. according to clause 14, the refractive power of wherein solid prisms is selected to Reduce the size of population of top optical device module.
Compact head mounted display of the clause 16. according to clause 2, wherein the top optical device module is also wrapped Include the field lenses of neighborhood graph image source and the power lens of neighbouring lower optical device blocks.
Compact head mounted display of the clause 17. according to clause 16, wherein the angle folding being associated with solid prisms Degree is selected to reduce the size of population of top optical device module.
Compact head mounted display of the clause 18. according to clause 16, wherein solid prisms are selected to reduce top The overall height of optical device module.
Clause group C
A kind of wear-type see-through display of clause 1., including:Perspective optical element, it is installed such that it is saturating in wear-type Eyes of user front is positioned in when being worn by the user depending on display;Processor, it is adapted to regarding on perspective optical element Digital content is presented in, wherein the digital content has the position in the visual field depending on the position in surrounding;And And the processor is also adapted to change the outward appearance of content at the edge of the close visual field of content, so that in the close visual field of content Edge when content seem disappear.
Head mounted display of the clause 2. according to clause 1, wherein the processor includes display driver.
Head mounted display of the clause 3. according to clause 1, wherein the processor includes application processor.
The modification of head mounted display of the clause 4. according to clause 1, wherein outward appearance is the change in terms of content brightness.
The modification of head mounted display of the clause 5. according to clause 1, wherein outward appearance is changing in terms of content contrast Become.
The modification of head mounted display of the clause 6. according to clause 1, wherein outward appearance is the change in terms of content acutance.
The modification of head mounted display of the clause 7. according to clause 1, wherein outward appearance is changing in terms of content resolution Become.
Head mounted display of the clause 8. according to clause 1, wherein the processor is also adapted to generate auxiliary visual field, User watches presented digital content and user sees surrounding by the auxiliary visual field in the auxiliary visual field, described Processor is also adapted to for content to be transitioned into auxiliary visual field from visual field.
Head mounted display of the clause 9. according to clause 8, wherein compared with the outward appearance of the content in visual field, it is auxiliary to regard The outward appearance of the content in is weakened.
Head mounted display of the clause 10. according to clause 8, wherein auxiliary visual field is with lower than the resolution of visual field Resolution.
Head mounted display of the clause 11. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 12. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror is by image light for the combiner navigational figure light Reflex to eyes of user.
Head mounted display of the clause 13. according to clause 8, wherein auxiliary visual field is generated by OLED, the OLED is by light Project on combiner.
Head mounted display of the clause 14. according to clause 8, wherein auxiliary visual field is generated by LED array, the LED battle arrays Row are projected light onto on combiner.
Head mounted display of the clause 15. according to clause 8, wherein auxiliary visual field is generated by edge-lit LCD, it is described Edge-lit LCD is projected light onto on combiner.
Head mounted display of the clause 16. according to clause 8, wherein auxiliary visual field is by being positioned at eyes of user dead ahead Perspective panel presenting.
Head mounted display of the clause 17. according to clause 16, wherein the perspective panel is arranged on combiner.
Head mounted display of the clause 18. according to clause 16, wherein the see-through display is mounted vertically.
Head mounted display of the clause 19. according to clause 16, wherein the perspective panel is OLED.
Head mounted display of the clause 20. according to clause 16, wherein the perspective panel is edge-lit LCD.
Head mounted display of the clause 21. according to clause 1, wherein in the processor is also adapted to predict when Hold will close visual field edge and make outward appearance transition be based at least partially on the prediction.
Head mounted display of the clause 22. according to clause 21, wherein the prediction is based at least partially on eyes figure Picture.
Clause group C1
A kind of wear-type see-through display of clause 1., including:Perspective optical element, it is installed such that it is saturating in wear-type Eyes of user front is positioned in when being worn by the user depending on display;Processor, it is adapted to regarding on perspective optical element Digital content is presented in, wherein the digital content has the position in the visual field depending on the position in surrounding;And And the processor is also adapted to predict when that digital content will be shifted due to the position change of wear-type see-through display The outward appearance of content is changed when going out visual field and the edge in the close visual field of content, so that interior at the edge of the close visual field of content Appearance seems to disappear.
Head mounted display of the clause 2. according to clause 1, wherein the prediction is shown based on instruction wear-type perspective The compass direction in the direction of the face forward of device.
Head mounted display of the clause 3. according to clause 1, wherein tracked eyes of the prediction based on user It is mobile, wherein tracked eyes movement instruction user will rotate user's head.
The modification of head mounted display of the clause 4. according to clause 1, wherein outward appearance is the change in terms of content brightness.
The modification of head mounted display of the clause 5. according to clause 1, wherein outward appearance is changing in terms of content contrast Become.
The modification of head mounted display of the clause 6. according to clause 1, wherein outward appearance is the change in terms of content acutance.
The modification of head mounted display of the clause 7. according to clause 1, wherein outward appearance is changing in terms of content resolution Become.
Head mounted display of the clause 8. according to clause 1, wherein the processor is also adapted to generate auxiliary visual field, User watches presented digital content and user sees surrounding by the auxiliary visual field in the auxiliary visual field, described Processor is also adapted to for content to be transitioned into auxiliary visual field from visual field.
Head mounted display of the clause 9. according to clause 8, wherein compared with the outward appearance of the content in visual field, it is auxiliary to regard The outward appearance of the content in is weakened.
Head mounted display of the clause 10. according to clause 8, wherein auxiliary visual field is with lower than the resolution of visual field Resolution.
Head mounted display of the clause 11. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 12. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror is by image light for the combiner navigational figure light Reflex to eyes of user.
Head mounted display of the clause 13. according to clause 8, wherein auxiliary visual field is generated by OLED, the OLED is by light Project on combiner.
Head mounted display of the clause 14. according to clause 8, wherein auxiliary visual field is generated by LED array, the LED battle arrays Row are projected light onto on combiner.
Head mounted display of the clause 15. according to clause 8, wherein auxiliary visual field is generated by edge-lit LCD, it is described Edge-lit LCD is projected light onto on combiner.
Head mounted display of the clause 16. according to clause 8, wherein auxiliary visual field is by being positioned at eyes of user dead ahead Perspective panel presenting.
Head mounted display of the clause 17. according to clause 16, wherein the panel is arranged on combiner.
Head mounted display of the clause 18. according to clause 16, wherein the panel is mounted vertically.
Head mounted display of the clause 19. according to clause 1, wherein in the processor is also adapted to predict when Hold will close visual field edge and make outward appearance transition be based at least partially on the prediction.
Head mounted display of the clause 20. according to clause 1, wherein the prediction is based at least partially on eyes figure Picture.
Head mounted display of the clause 21. according to clause 16, wherein the perspective panel is OLED.
Head mounted display of the clause 22. according to clause 16, wherein the perspective panel is edge-lit LCD.
Clause group C2
A kind of wear-type see-through display of clause 1., including:Perspective optical element, it is installed such that it is saturating in wear-type Eyes of user front is positioned in when being worn by the user depending on display;Processor, it is adapted to the master on perspective optical element Digital content is presented in visual field, user watches presented digital content in the main view field and user is by the main view See surrounding in field;The processor is also adapted to that digital content is presented in the visual field for extending, and user is in the extension Presented digital content is watched in visual field and user sees surrounding by the visual field of the extension;The main view field tool There is the resolution higher than the visual field of the extension;And the processor is also adapted to that world's locking is presented in main view field The digital content of positioning, and changing position in head mounted display makes the digital content transition of the positioning of world's locking go out main view The presentation of the digital content of the positioning for locking in the world during field is transitioned into the visual field of extension.
Head mounted display of the clause 2. according to clause 1, wherein the processor includes display driver.
Head mounted display of the clause 3. according to clause 1, wherein the processor includes application processor.
Head mounted display of the clause 4. according to clause 1, wherein compared with the content in be presented on main view field When, the visual field of the extension has the generation resolution fuzzy to the essence of content.
Head mounted display of the clause 5. according to clause 1, wherein the visual field of the extension is by the way that image light is reflected Generate on combiner, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 6. according to clause 1, wherein the visual field of the extension is by the way that image light is reflected Generate on combiner, towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror will for the combiner navigational figure light Image light reflexes to eyes of user.
Head mounted display of the clause 7. according to clause 1, wherein the visual field of the extension is generated by OLED, it is described OLED is projected light onto on combiner.
Head mounted display of the clause 8. according to clause 1, wherein the visual field of the extension is generated by LED array, institute State LED array to project light onto on combiner.
Head mounted display of the clause 9. according to clause 1, wherein the visual field of the extension is given birth to by edge-lit LCD Into the LCD of the edge-lit is projected light onto on combiner.
Head mounted display of the clause 10. according to clause 1, wherein the visual field of the extension is by being positioned at user's eye The perspective panel of eyeball dead ahead is generated.
Head mounted display of the clause 11. according to clause 10, wherein the panel is arranged on combiner.
Head mounted display of the clause 12. according to clause 10, wherein the panel is mounted vertically.
Head mounted display of the clause 13. according to clause 1, wherein in the processor is also adapted to predict when Hold will close visual field edge and make outward appearance transition be based at least partially on the prediction.
Head mounted display of the clause 14. according to clause 1, wherein the prediction is based at least partially on eyes figure Picture.
Head mounted display of the clause 15. according to clause 10, wherein the perspective panel is OLED.
Head mounted display of the clause 16. according to clause 10, wherein the perspective panel is edge-lit LCD.
Clause group C3
A kind of wear-type see-through display of clause 1., including:Perspective optical element, it is installed such that it is saturating in wear-type Eyes of user front is positioned in when being worn by the user depending on display;Processor, it is adapted to the master on perspective optical element Digital content is presented in visual field, user watches presented digital content in the main view field and user is by the main view See surrounding in field;The processor is adapted to that digital content is presented in the visual field for extending, and user regards the extension Presented digital content is watched in and user sees surrounding by the visual field of the extension;The main view field has The resolution higher than the visual field of the extension;And the processor is also adapted to be presented the of digital content in main view field Part II a part of and that digital content is presented in the visual field for extending.
Head mounted display of the clause 2. according to clause 1, wherein when digital content is excessive so that master can not be suitable for During visual field, second of the digital content in the Part I of digital content of the processor in main view field and the visual field of extension Soft transition is created between part, so that digital content does not seem to interrupt suddenly in the edge of main view field.
Head mounted display of the clause 3. according to clause 1, wherein the processor is adapted to generate towards main view field Edge soft outward appearance.
Head mounted display of the clause 4. according to clause 1, wherein the processor changes the edge towards display Pixel how rendering content.
Head mounted display of the clause 5. according to clause 1, also including display driver, its modification direction is worn The pixel at the edge of formula display how rendering content.
Head mounted display of the clause 6. according to clause 1, wherein the head mounted display has towards wear-type The pixel at the edge of display, its pixel with the core towards head mounted display differently rendering content.
Head mounted display of the clause 7. according to clause 6, wherein having than towards wear-type towards extrorse pixel The less gain of the pixel of the core of display.
Head mounted display of the clause 8. according to clause 1, wherein digitally changing court by content transitions algorithm To the pixel at the edge of main view field.
Head mounted display of the clause 9. according to clause 1, wherein the visual field of the extension is by the way that image light is reflected Generate on combiner, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 10. according to clause 1, wherein the visual field of the extension is by anti-by image light Be mapped on combiner and generate, the combiner navigational figure light towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror Image light is reflexed to into eyes of user.
Head mounted display of the clause 11. according to clause 1, wherein the visual field of the extension is generated by OLED, it is described OLED is projected light onto on combiner.
Head mounted display of the clause 12. according to clause 1, wherein the visual field of the extension is generated by LED array, The LED array is projected light onto on combiner.
Head mounted display of the clause 13. according to clause 1, wherein the visual field of the extension is given birth to by edge-lit LCD Into the edge-lit LCD is projected light onto on combiner.
Head mounted display of the clause 14. according to clause 1, wherein the visual field of the extension is by being positioned at user's eye The perspective panel of eyeball dead ahead is generated.
Head mounted display of the clause 15. according to clause 14, wherein the panel is arranged on combiner.
Head mounted display of the clause 16. according to clause 14, wherein the panel is mounted vertically.
Head mounted display of the clause 17. according to clause 14, wherein the perspective panel is OLED.
Head mounted display of the clause 18. according to clause 14, wherein the perspective panel is edge-lit LCD.
Head mounted display of the clause 19. according to clause 1, the processor is also adapted to predict when that content will Will close visual field edge and make outward appearance transition be based at least partially on the prediction.
Head mounted display of the clause 20. according to clause 19, wherein the prediction is based at least partially on eyes figure Picture.
Clause group C4
A kind of wear-type see-through display of clause 1., including:Perspective optical element, it is installed such that it is saturating in wear-type Eyes of user front is positioned in when being worn by the user depending on display;Processor, it is adapted to be presented in numeral in main view field Hold, presented digital content is watched in the main view field for user and user sees surrounding by the main view field; The processor is also adapted to that digital content is presented in the visual field for extending, and user watches in the visual field of the extension and being presented Digital content and user sees surrounding by the visual field of the extension;The main view field has regarding than the extension The higher resolution in field;The processor is also adapted to that digital content is presented in main view field, and when the close main view field of content Edge when reduce content outward appearance;And it is interior that the processor is also adapted to the reduction when the presentation content in the visual field for extending The outward appearance of appearance.
Head mounted display of the clause 2. according to clause 1, wherein the processor becomes closer to prolonging with content The outward appearance at the edge of the visual field stretched and the content in phasing down the visual field of extension.
Head mounted display of the clause 3. according to clause 2, wherein interior when edge of the content in the visual field for extending Appearance is substantially occurred without.
The reduction of head mounted display of the clause 4. according to clause 1, wherein outward appearance is the reduction in terms of content brightness.
The reduction of head mounted display of the clause 5. according to clause 1, wherein outward appearance is the drop in terms of content contrast It is low.
The reduction of head mounted display of the clause 6. according to clause 1, wherein outward appearance is the reduction in terms of content acutance.
The reduction of head mounted display of the clause 7. according to clause 1, wherein outward appearance is the drop in terms of content resolution It is low.
Head mounted display of the clause 8. according to clause 1, wherein the visual field of the extension is by the way that image light is reflected Generate on combiner, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 9. according to clause 1, wherein the visual field of the extension is by the way that image light is reflected Generate on combiner, towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror will for the combiner navigational figure light Image light reflexes to eyes of user.
Head mounted display of the clause 10. according to clause 1, wherein the visual field of the extension is generated by OLED, it is described OLED is projected light onto on combiner.
Head mounted display of the clause 11. according to clause 1, wherein the visual field of the extension is generated by LED array, The LED array is projected light onto on combiner.
Head mounted display of the clause 12. according to clause 1, wherein the visual field of the extension is given birth to by edge-lit LCD Into the edge-lit LCD is projected light onto on combiner.
Head mounted display of the clause 13. according to clause 1, wherein the visual field of the extension is by being positioned at user's eye The perspective panel of eyeball dead ahead is generated.
Head mounted display of the clause 14. according to clause 13, wherein the panel is arranged on combiner.
Head mounted display of the clause 15. according to clause 13, wherein the panel is mounted vertically.
Head mounted display of the clause 16. according to clause 13, wherein the perspective panel is OLED.
Head mounted display of the clause 17. according to clause 13, wherein the perspective panel is edge-lit LCD.
Head mounted display of the clause 18. according to clause 1, wherein in the processor is also adapted to predict when Hold will close main view field edge and make outward appearance reduce be based at least partially on the prediction.
Head mounted display of the clause 19. according to clause 18, wherein the prediction is based at least partially on eyes figure Picture.
Clause group C5
A kind of optical system of wear-type see-through display of clause 1., including:Primary image content optics, it is used to produce Center eyes picture material;Extend picture material optics, it is used to produce off-center eye image content;Combiner, It is oriented to that image is presented to user and user watches surrounding by the combiner;And wherein primary image content Each in optics and extension picture material optics is oriented to its respective image light projection to combiner, institute State combiner and respective image light is reflexed to into eyes of user.
Optical system of the clause 2. according to clause 1, wherein respective image light is directly reflexed to use by the combiner Family eyes.
Optical system of the clause 3. according to clause 1, wherein the combiner by the indirect reference of respective image light to use Family eyes.
Optical system of the clause 4. according to clause 3, wherein the combiner by respective image light towards ultimate part Reflecting mirror reflects.
Optical system of the clause 5. according to clause 1, wherein the central eye eyeball picture material and off-center eyes Picture material was folded before combiner is reflect off through at least one of optical system.
Optical system of the clause 6. according to clause 1, wherein the extension bitmap is installed in group as content optics Directly over clutch, so that off-center eye image is projected directly at combiner.
Optical system of the clause 7. according to clause 1, also including processor, it is adapted in content from master image The visual field for holding optics moves to the visual field of extension picture material optics and moves to extension picture material optics device Coordinate the smooth disappearance transition of the content of the world's locking during edge of the visual field of part.
Optical system of the clause 8. according to clause 1, wherein the extension bitmap is OLED as content optics.
Optical system of the clause 9. according to clause 1, wherein the extension bitmap is that LCD shows as content optics Device.
Optical system of the clause 10. according to clause 1, wherein the extension bitmap is as battle array that content optics is LED Row.
Optical system of the clause 11. according to clause 1, wherein the extension bitmap is linear as content optics.
Optical system of the clause 12. according to clause 1, wherein the extension bitmap is two-dimentional as content optics.
Optical system of the clause 13. according to clause 1, wherein the extension bitmap is bending as content optics.
Optical system of the clause 14. according to clause 1, wherein the extension bitmap generates correspondence as content optics In the lighting effect of picture material.
Optical system of the clause 15. according to clause 1, wherein the extension bitmap as content optics include for The lens combination of modification projection.
Optical system of the clause 16. according to clause 15, wherein the lens combination includes lenticular array.
Clause group C6
A kind of wear-type see-through display of clause 1., including:Primary image content display, its be adapted to produce image light and Image light is projected on the direction to be reflected by perspective combiner, so that described image light reaches eyes of user;And auxiliary figure As content indicator, wherein the auxiliary picture material display is perspective panel, it is positioned at eyes of user dead ahead and uses In the visual experience that enhancing is delivered by primary image content display.
Head mounted display of the clause 2. according to clause 1, wherein Auxiliary display are being produced by master image display Main view provide in the region in face outside the venue in perhaps effect.
Head mounted display of the clause 3. according to clause 2, wherein the region adjacent main view field of the outside.
Head mounted display of the clause 4. according to clause 2, wherein the region of the outside surrounds main view field.
Head mounted display of the clause 5. according to clause 2, wherein the region of the outside overlaps with main view field.
Head mounted display of the clause 6. according to clause 1, wherein Auxiliary display with produced by master image display The overlapping region in main view field in provide in perhaps effect.
Head mounted display of the clause 7. according to clause 1, wherein Auxiliary display are arranged on combiner, described group Clutch is adapted to for image light to reflex to eyes of user.
Head mounted display of the clause 8. according to clause 1, wherein Auxiliary display are vertically mounted on and are shown by master image The image light optical path outside that device is set up.
Head mounted display of the clause 9. according to clause 1, also including processor, it is adapted to follow the trail of the eye of user Eyeball position, the processor is also adapted to change the position of the content being presented in Auxiliary display.
Head mounted display of the clause 10. according to clause 9, wherein when eyes of user is moved, modified position Substantially maintain the alignment of the master image display from the visual angle of user and auxiliary image display.
Head mounted display of the clause 11. according to clause 1, wherein the perspective panel is OLED.
Head mounted display of the clause 12. according to clause 1, wherein the perspective panel is edge-lit LCD.
Clause group C7
A kind of wear-type see-through display of clause 1., including:The visual field generated by image display, wherein user viewing visual field In digital content and have an X-rayed the visual field to watch surrounding;And processor, it is adapted to two types of generation Content, wherein the content of two types is presented in visual field;The content of the wherein first kind is that have to depend in surrounding Place field positions the world locking content, wherein the outward appearance of the content of the first kind the first kind content be close to Weaken during the edge of visual field;And wherein the content of Second Type is not world's locking, wherein the content of Second Type is at it The outward appearance of substantial constant is maintained during the edge of close visual field.
Head mounted display of the clause 2. according to clause 1, wherein the outward appearance for weakening includes the drop in terms of resolution It is low.
Head mounted display of the clause 3. according to clause 1, wherein the outward appearance for weakening includes the reduction in terms of brightness.
Head mounted display of the clause 4. according to clause 1, wherein the outward appearance for weakening includes the drop in terms of contrast It is low.
Head mounted display of the clause 5. according to clause 1, wherein the outward appearance for weakening is adjusted by display driver It is whole.
Head mounted display of the clause 6. according to clause 1, wherein the outward appearance for weakening is adjusted by application processor.
Head mounted display of the clause 7. according to clause 1, wherein the outward appearance for weakening is by the display for generating visual field Modified pixel is adjusting.
Head mounted display of the clause 8. according to clause 1, also includes the auxiliary visual field generated by image display, uses Presented digital content is watched in the auxiliary visual field for family and user sees surrounding, the place by the auxiliary visual field Reason device is also adapted to for content to be transitioned into auxiliary visual field from visual field.
Head mounted display of the clause 9. according to clause 8, wherein compared with the outward appearance of the content in visual field, it is auxiliary to regard The outward appearance of the content in is weakened.
Head mounted display of the clause 10. according to clause 8, wherein auxiliary visual field is with lower than the resolution of visual field Resolution.
Head mounted display of the clause 11. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, image light is conducted directly to eyes of user by the combiner.
Head mounted display of the clause 12. according to clause 10, wherein auxiliary visual field by image light by reflexing to combination Generate on device, towards ultimate partially reflecting mirror, the ultimate partially reflecting mirror is by image light for the combiner navigational figure light Reflex to eyes of user.
Head mounted display of the clause 13. according to clause 8, wherein auxiliary visual field is generated by OLED, the OLED is by light Project on combiner.
Head mounted display of the clause 14. according to clause 8, wherein auxiliary visual field is generated by LED array, the LED battle arrays Row are projected light onto on combiner.
Head mounted display of the clause 15. according to clause 8, wherein auxiliary visual field is generated by edge-lit LCD, it is described Edge-lit LCD is projected light onto on combiner.
Head mounted display of the clause 16. according to clause 8, wherein auxiliary visual field is by being positioned at eyes of user dead ahead Perspective panel generate.
Head mounted display of the clause 17. according to clause 16, wherein the panel is arranged on combiner.
Head mounted display of the clause 18. according to clause 16, wherein the panel is mounted vertically.
Head mounted display of the clause 19. according to clause 16, wherein the perspective panel is OLED.
Head mounted display of the clause 20. according to clause 16, wherein the perspective panel is edge-lit LCD.
Head mounted display of the clause 21. according to clause 1, wherein in the processor is also adapted to predict when Hold will close visual field edge and make outward appearance transition be based at least partially on the prediction.
Head mounted display of the clause 22. according to clause 21, wherein the prediction is based at least partially on eyes figure Picture.
Clause group C8
A kind of wear-type see-through display of clause 1., including:Hybrid optical system, it is adapted to produce is used for high-resolution The main perspective visual field of presentation content and for the auxiliary perspective visual field of low resolution presentation content, wherein main view field and auxiliary regards Field is close to each other to present;Processor, it is adapted to adjust the relative proximities of main view field and auxiliary visual field;And eye position inspection Examining system, it is adapted to detect the position of eyes of user, wherein the processor adjusts main view based on the position of eyes of user Field and the relative proximities of auxiliary visual field.
Head mounted display of the clause 2. according to clause 1, wherein in the perspective for being positioned at eyes of user dead ahead Auxiliary visual field is produced on oled panel.
Head mounted display of the clause 3. according to clause 1, wherein on the perspective side for being positioned at eyes of user dead ahead Auxiliary visual field is produced in the luminous LCD of edge.
Head mounted display of the clause 4. according to clause 1, wherein being positioned at the perspective group of eyes of user dead ahead Auxiliary visual field is generated in clutch.
Head mounted display of the clause 5. according to clause 1, wherein the relative proximities are degree of being on close level.
Head mounted display of the clause 6. according to clause 1, wherein the relative proximities are vertical proximity to degree.
Head mounted display of the clause 7. according to clause 1, wherein the relative proximities define main view field regarding with auxiliary Overlapping tolerance between.
Head mounted display of the clause 8. according to clause 1, wherein the relative proximities define main view field regarding with auxiliary Detached tolerance between.
Head mounted display of the clause 9. according to clause 1, wherein the eye position detection system basically exists The visual angle of drawing axis is imaged to eyes.
Head mounted display of the clause 10. according to clause 1, wherein the eye position detection system is with bag The reflection of the perspective optics of hybrid optical system is left in the region for including main view field and eyes are imaged.
Head mounted display of the clause 11. according to clause 1, wherein the eye position detection system is with bag The reflection of the perspective optics of hybrid optical system is left in the region for including auxiliary visual field and eyes are imaged.
Clause group D
A kind of head mounted display of the highly transmissive see-through view of improvement with surrounding of clause 1., the perspective is regarded High-contrast display image of the figure with superimposition, the head mounted display includes:
Top optics with primary optic axis, it includes:Transmitting image source, the transmitting image source is provided includes the one of light The image light of individual or multiple narrow bands;One or more lens;Spuious ligh trap;And
Unpolarized lower optical device with the second optical axis, it includes:Angled relative to primary optic axis and the second optical axis Planar splitter;And sweep reflecting mirror;One or more wherein in reflecting surface are processed into and are reflected in described one Incident illumination in individual or multiple narrow bands most of and transmit the major part of incidence visible light from surrounding.
Head mounted display of the clause 2. according to clause 1, wherein the transmitting image source is that OLED shows Device.
Head mounted display of the clause 3. according to clause 1, wherein the transmitting image source is back illumination LCD。
Head mounted display of the clause 4. according to clause 1, wherein the transmitting image source is that micro- LED shows Device.
Head mounted display of the clause 5. according to clause 1, wherein the transmitting image source is that plasma shows Device.
Head mounted display of the clause 6. according to clause 1, wherein described process is trap mirror coating, The major part that is most of and transmiting visible ray of at least one of the narrow band that its reflection is provided by transmitting image source.
Head mounted display of the clause 7. according to clause 6, wherein the coating is trap mirror coating, The major part that is most of and transmiting visible ray of the multiple narrow band that its reflection is provided by transmitting image source.
Head mounted display of the clause 8. according to clause 6, wherein the trap mirror coating is applied to Planar splitter.
Head mounted display of the clause 9. according to clause 6, wherein the trap mirror coating is applied to Sweep reflecting mirror.
Head mounted display of the clause 10. according to clause 1, wherein it is described process be multilayer film, its reflection by The major part that is most of and transmiting visible ray of at least one of the narrow band that transmitting image source is provided.
Head mounted display of the clause 11. according to clause 1, wherein the veiling glare trap includes one or many Individual circuit polarizer.
Head mounted display of the clause 12. according to clause 1, wherein the veiling glare trap is included on both sides Polariser with quarter-wave film.
Head mounted display of the clause 13. according to clause 12, wherein the veiling glare trap is positioned in lens And beam splitter between.
Head mounted display of the clause 14. according to clause 11, wherein the circuit polarizer is positioned adjacent to In image source.
Head mounted display of the clause 15. according to clause 11, wherein the first circuit polarizer is positioned adjacent to In image source, and the second circuit polarizer is positioned between lens and beam splitter.
Head mounted display of the clause 16. according to clause 13, wherein the lens provide telecentricity to beam splitter Image light, it passes through spuious ligh trap.
Head mounted display of the clause 17. according to clause 1, wherein the veiling glare trap absorbs carrys out self-reflection Image light or from surrounding see-through view light through lower optical device and towards image source transmission light.
Head mounted display of the clause 18. according to clause 1, wherein the perspective of the environment seen by user View includes at least 50% of the available light from surrounding.
Head mounted display of the clause 19. according to clause 1, wherein the perspective of the environment seen by user View includes at least 60% of the available light from surrounding.
Head mounted display of the clause 20. according to clause 1, wherein the perspective of the environment seen by user View includes at least 20% of the available light from surrounding in narrow band.
Clause group D1
A kind of offer of clause 1. has having for the highly transmissive see-through view of the surrounding of the high-contrast display image of superimposition Width shows the head mounted display of visual field, and it includes:
Top optics with primary optic axis, it includes:Transmitting image source, its offer includes one or more narrow light of light The image light of bands of a spectrum;One or more lens;Spuious ligh trap;And
Unpolarized lower optical device with the second optical axis, it includes:Angled relative to primary optic axis and the second optical axis Planar splitter;And sweep reflecting mirror;Its middle and upper part optics and lower optical device are designed to be moved with having The acuity of dynamic human eye accordingly provides the sharp keen area in limited center and less sharp keen surrounding's external zones.
Head mounted display of the clause 2. according to clause 1, wherein the sharp keen area in the center be +/- 15 degree or It is less.
Head mounted display of the clause 3. according to clause 1, wherein the sharp keen area in the center be +/- 20 degree or It is less.
Head mounted display of the clause 4. according to clause 1, wherein the external zones extends from the sharp keen area in center To at least +/- 25 degree.
Head mounted display of the clause 5. according to clause 1, it is right that the lateral chromatic aberration of plurality of pixel is presented on Should be in the part of the display image of external zones.
Head mounted display of the clause 6. according to clause 5, wherein the lateral chromatic aberration is 5 pixels or more.
Head mounted display of the clause 7. according to clause 1, wherein it is 100 that the transmitting image source is provided The cone of the image light of degree or more mitre.
Head mounted display of the clause 8. according to clause 1, wherein the optics has 2.5 or faster F#.
Head mounted display of the clause 9. according to clause 1, wherein the emission display includes pixel and son Pixel, and emission display resolution and show visual field be chosen to each sub-pixel it is wide show in visual field against Less than approximate 1/50 degree, so that adjacent subpixels can not be differentiated.
Head mounted display of the clause 10. according to clause 1, wherein the emission display includes pixel, and And emission display and show that visual field is chosen to each pixel in wide display visual field against less than approximate 1/30 degree, So that adjacent Colored pixels can not be differentiated.
Head mounted display of the clause 11. according to clause 10, wherein the emission display is 1080p showing Show device, and show that visual field is less than 73 degree of diagonal.
Head mounted display of the clause 12. according to clause 1, wherein the emission display includes pixel, and And emission display and show that visual field is chosen to each pixel in wide display visual field against less than approximate 1/50 degree, So that adjacent black and white pixel can not be differentiated.
Head mounted display of the clause 13. according to clause 1, also including ligh trap, its capture reflects back into image The light in source.
Ligh trap of the clause 14. according to clause 13, wherein the ligh trap is included on both sides has quarter-wave film Polariser sandwich.
Ligh trap of the clause 15. according to clause 13, wherein the ligh trap is positioned in top optics and bottom light Learn between device.
Head mounted display of the clause 16. according to clause 1, wherein wide visual field include 50 degree or more mitre.
Head mounted display of the clause 17. according to clause 1, wherein wide visual field are included more than 22:9 form Than enabling to realize the reduce thickness of optics.
Head mounted display of the clause 18. according to clause 1, outside the sharp keen area in center of wherein optics Portion edge has the MTF at the nyquist frequency of image source higher than 20%, and the external margin of external zones has in image MTF at the nyquist frequency in source less than 20%.
Head mounted display of the clause 19. according to clause 1, outside the sharp keen area in center of wherein optics Portion edge has the MTF at the nyquist frequency of image source higher than 20%, and the external margin of external zones has in image MTF at 1/2 nyquist frequency in source less than 20%.
Clause group D2
Clause 1. is a kind of for method of the operation with the wide head mounted display for showing visual field, and the head mounted display is The shown wide visual field image of viewing is provided and improves comfort level, and methods described includes:The eyes movement of detection user and head are moved It is dynamic;Detection is moved higher than the head that the second predetermined threshold is above after the eyes movement of the first predetermined threshold, wherein detecting Eyes movement and the head movement that detects on the equidirectional;And the subsequent movement for being detected with user's head The wide shown wide visual field image shown in visual field is accordingly shifted, with thus by the periphery of shown wide visual field image In being partially moved to the wide core for showing visual field, the periphery of wide visual field image shown in this place can be in Geng Ju In position by user with the viewing of its eye.
Method of the clause 2. according to clause 1, wherein the head mounted display also includes eyes camera, and uses Eyes camera calibration eyes are moved.
Method of the clause 3. according to clause 1, wherein the head mounted display also includes Inertial Measurement Unit, and And detect that the head relative to environment is moved with Inertial Measurement Unit.
Method of the clause 4. according to clause 1, wherein the head mounted display also includes the one of capture surrounding Relative changes in the camera of partial image, and the image for passing through analysis environments detect relative to environment head move It is dynamic.
Method of the clause 5. according to clause 1, wherein the head mounted display also includes the one of capture user's body The camera of partial image, and detected relative to user's body by the relative changes in the image for analyzing user's body Head is moved.
Method of the clause 6. according to clause 5, under wherein the camera in head mounted display is directed to.
Method of the clause 7. according to clause 1, wherein the head mounted display also includes head mounted display In the first Inertial Measurement Unit and be attached to the second Inertial Measurement Unit of user's body, and according to the first inertia measurement Difference between unit and the second Inertial Measurement Unit changes to determine the movement of the user's head relative to user's body.
Method of the clause 8. according to clause 3, wherein by the Inertial Measurement Unit in head mounted display Time weight is averagely measuring.
Method of the clause 9. according to clause 1, also comprises the steps:Just see when detecting eyes in this step Stop the wide displacement for showing the shown wide visual field image in visual field during the core for wide display visual field.
Method of the clause 10. according to clause 1, also comprises the steps:In this step when the side of wide visual field image Edge is confirmed as stopping the wide shown wide visual field figure shown in visual field when being displaced to the core of wide display visual field The displacement of picture.
Clause 11. is a kind of to show visual field with the comfort level for improving when different application is watched for operation with wide Head mounted display method, wherein the optics device of the head mounted display including the sharp keen area in offer center Part, methods described includes:User selects the application with image for watching in head mounted display;User selects to use In the visual field of viewing image;Image is reset size into selected visual field and display image by head mounted display;With And if the image that Jing resets size is more than predefined size in angle;It is user's head after the movement of detection eyes of user Mobile, wherein eyes movement and head mobile phase are for permanent datum is on equidirectional;And the institute with user's head The movement for detecting shows accordingly and in the square upward displacement width contrary with the movement detected by user's head and regards Shown wide visual field image in, the periphery of image is moved in the sharp keen area in center, in this place described image Periphery can eyes of user reduction move in the case of be viewed by a user.
Method of the clause 12. according to clause 11, wherein permanent datum are environment.
Method of the clause 13. according to clause 12, wherein head mounted display is included for detecting that eyes are moved Eyes camera and for detect head move Inertial Measurement Unit.
Method of the clause 14. according to clause 12, wherein head mounted display is included for detecting that eyes are moved Eyes camera and for detect head move camera.
Method of the clause 15. according to clause 11, wherein permanent datum are user's bodies.
Method of the clause 16. according to clause 15, wherein head mounted display is included for detecting that eyes are moved Eyes camera and for detect head move Inertial Measurement Unit.
Method of the clause 17. according to clause 16, wherein the first inertia measurement in by head mounted display Unit and be attached to user's body the second Inertial Measurement Unit comparative measurement measuring.
Method of the clause 18. according to clause 15, wherein by the Inertial Measurement Unit in head mounted display Time weight averagely measuring.
Method of the clause 19. according to clause 15, the wherein sharp keen area in center are in shown wide visual field less than +/- 20 degree.
Method of the clause 20. according to clause 15, wherein shown wide visual field is at least +/- 25 degree.
Clause group D3
A kind of highly transmissive perspective of the surrounding for providing wide visual field and the high-contrast display image with superimposition of clause 1. is regarded Figure with the head mounted display for improving form factor, it includes:
Top optics with primary optic axis, it includes:The transmitting image source of image light is provided;One or more lens; Spuious ligh trap;And
Unpolarized lower optical device with the second optical axis, it includes:Angled relative to primary optic axis and the second optical axis Planar splitter;And sweep reflecting mirror;Wherein head mounted display is provided and has the vertical field of view that reduces and big In 22:The rectangular image of 9 form, so that can realize showing the top optics of visual field for given diagonal With the thickness of the reduction of lower optical device.
Head mounted display of the clause 2. according to clause 1, wherein wide visual field include 50 degree or more mitre Show visual field.
Head mounted display of the clause 3. according to clause 1, wherein the transmitting image source is provided and is more than 100 The cone of the image light of degree angle.
Head mounted display of the clause 4. according to clause 1, wherein the head mounted display also includes For left eye and the single three-dimensional display of right eye, each provides 50 degree or bigger of display visual field, and uses It is overlapping in the display visual field of left eye and right eye only part, so that the visual field of combination is more than each in three-dimensional display.
Head mounted display of the clause 5. according to clause 1, its middle and upper part optics includes two or more Telecentricity area is provided between lens, and two or more lens in the optics of top, and by changing between lens Spacing to provide focusing distance in terms of change without show image amplification in terms of change.
Head mounted display of the clause 6. according to clause 5, wherein providing manually changing for focusing distance Mechanism.
Head mounted display of the clause 7. according to clause 5, wherein electrically driven (operated) actuator is included to provide Automatic change in terms of focusing distance.
Head mounted display of the clause 8. according to clause 7, the automatic change wherein in terms of focusing distance is carried It is provided with that a part for display image is positioned at the apparent distance being associated with augmented reality application.
Head mounted display of the clause 9. according to clause 1, wherein in top optics and lower optical device Telecentricity area is provided between part, and provided by changing the spacing between top optics and lower optical device focus on away from From aspect change without display image amplification in terms of change.
Head mounted display of the clause 10. according to clause 9, wherein providing changing manually for focusing distance The mechanism of change.
Head mounted display of the clause 11. according to clause 9, wherein electrically driven (operated) actuator is included to carry Automatic change in terms of for focusing distance.
Head mounted display of the clause 12. according to clause 11, the automatic change quilt wherein in terms of focusing distance There is provided that a part for display image is positioned at the apparent distance being associated with augmented reality application.
Head mounted display of the clause 13. according to clause 1, wherein the transmitting image source is that OLED shows Device.
Head mounted display of the clause 14. according to clause 1, wherein the transmitting image source is back illumination LCD display.
Head mounted display of the clause 15. according to clause 1, wherein the transmitting image source is micro- LED array Display.
Head mounted display of the clause 16. according to clause 1, wherein ligh trap capture reflects back into transmitting The veiling glare of image source.
Head mounted display of the clause 17. according to clause 1, wherein the ligh trap is by capturing top optics Veiling glare in element to increase the display image being seen by the user in contrast.
Head mounted display of the clause 18. according to clause 1, wherein showing that the central area of visual field is used to show Show the image with the form ratio lower than showing visual field, and show that the part outside display image of visual field is used to show Additional information.
Head mounted display of the clause 19. according to clause 1, wherein it is 100 degree that the transmitting image source is provided Or the cone of the image light of more mitre, and the optics has 2.5 or faster f#.
Head mounted display of the clause 20. according to clause 1, wherein the emission display include pixel and Sub-pixel, and emission display and display visual field are chosen to each pixel in wide display visual field against less than near Like 1/30 degree, so that adjacent colored sub-pixels can not be differentiated by human eye.
Clause group D4
A kind of highly transmissive perspective of the surrounding for improving visual uniformity provided a user with display image of clause 1. is regarded Figure and the wide head mounted display for showing visual field, it includes:
Top optics with primary optic axis, it includes:The transmitting image source of image light is provided;One or more lens; And
Unpolarized lower optical device with the second optical axis, it includes:Angled relative to primary optic axis and the second optical axis Planar section reflective beam splitter;And sweep reflecting mirror;And at least one of which part reflecting surface includes falling into The process of wave reflection mirror.
Head mounted display of the clause 2. according to clause 1, wherein the top optics is to lower optical Device provides telecentricity light, with by reducing and inciding being associated with display image on the surface processed including trap reflecting mirror Light angular range to improve display image in uniformity.
Head mounted display of the clause 3. according to clause 1, wherein display image is radially increased by digital modifications Plus the digital brightness in display image, roll-offed with the radial luminance compensated from the process of trap reflecting mirror.
Head mounted display of the clause 4. according to clause 1, wherein display image is radially increased by digital modifications Plus the color rendering in display image, changed with the primary colours compensated in the angle of trap reflecting mirror process.
The process reflection of head mounted display of the clause 5. according to clause 1, wherein trap reflecting mirror is red, green The arrowband of normal complexion blue light.
Head mounted display of the clause 6. according to clause 5, wherein the arrowband of red, green and blue light with The band matching of the colored light that emission display is exported.
The process of head mounted display of the clause 7. according to clause 1, wherein trap reflecting mirror has inclined for S Shake the high reflectance of incident illumination.
The process of head mounted display of the clause 8. according to clause 1, wherein trap reflecting mirror has to incident illumination Polarization insensitive reflectance.
Head mounted display of the clause 9. according to clause 1, also including multiple optical elements, and wherein phase The distance between adjacent optical element can be adjusted to alter the focusing distance of display image.
Head mounted display of the clause 10. according to clause 9, wherein sensor is provided in focusing distance The distance between adjacent optical elements are measured when being conditioned.
Head mounted display of the clause 11. according to clause 10, wherein display image were counted before shown Word is changed, with the change in terms of the size for compensating the display image being associated with the change in terms of focusing distance.
Head mounted display of the clause 12. according to clause 1, wherein it is coating that the trap reflecting mirror is processed.
Head mounted display of the clause 13. according to clause 1, wherein it is film that the trap reflecting mirror is processed.
Head mounted display of the clause 14. according to clause 1, wherein it is phase place that the trap reflecting mirror is processed The nanostructured of matching.
Clause group E
A kind of device of clause 1., including:Platform, it is mechanically adapted to be worn in user's head;Fluoroscopy images display, It is installed on platform and is adapted to that picture material is presented to eyes of user, wherein the fluoroscopy images display is also to user The see-through view of the environment of close user is provided;Removable and interchangeable eyeshield, it is adapted for connection to platform, wherein eyeshield It is also adapted to the light comprising the internal cavity effusion formed from the facial seam with user;And it is removable and interchangeable outer Portion's lens, it is arranged on platform along the optical axis of the Perspective User View being aligned with environment.
Device of the clause 2. according to clause 1, wherein the eyeshield is adapted to be connected to platform with magnet.
Device of the clause 3. according to clause 1, wherein the eyeshield is adapted to be connected to platform with mechanical attachment.
Device of the clause 4. according to clause 1, wherein the eyeshield be adapted to it is flat at least partially through being attached to The arm of platform is held in place and is connected to platform, wherein the arm is adapted to that platform is maintained in user's head.
Device of the clause 5. according to clause 1, wherein outer lens have the perspective transparency between 2% and 5%, To produce immersive environment for user while producing the transparency for maintaining to connect for the vision of user to surrounding.
Device of the clause 6. according to clause 1, wherein outer lens have the perspective transparency between 5% and 10%, To produce immersive environment for user while producing the transparency for maintaining to connect for the vision of user to surrounding.
Device of the clause 7. according to clause 1, wherein outer lens have the perspective between 10% and 20% transparent Degree, to be directed to user's generation immersive environment while generation maintains the transparent of the vision connection for user to surrounding Degree.
Device of the clause 8. according to clause 1, wherein outer lens have the perspective transparency more than 20%.
Device of the clause 9. according to clause 1, wherein outer lens have can electrical adjustment transparency.
Device of the clause 10. according to clause 9, wherein can electrical adjustment transparency be based on liquid crystal system.
Device of the clause 11. according to clause 1, wherein outer lens have behind the visual field for presenting to eyes of user Low transparency and the higher clarity outside the region at visual field rear in the region of side.
Device of the clause 12. according to clause 1, wherein outer lens have for adjust perspective transparency can machine The crossed-polarizer that tool is adjusted.
Device of the clause 13. according to clause 1, wherein the eyeshield has the visual angle for providing a user with surrounding Transparency region.
Device of the clause 14. according to clause 13, wherein the transparency is partial transparency.
Device of the clause 15. according to clause 1, wherein the eyeshield also shines effect system including interior lights, its offer The peripheral lighting effect mutually coordinated with the content presented in visual field.
Device of the clause 16. according to clause 15, wherein interior lights produce illumination according to effect system with LED or OLED Effect.
Device of the clause 17. according to clause 16, wherein lighting effect are coloured lighting effects.
Device of the clause 18. according to clause 15, wherein internal illumination system includes light source, its essentially around with In the inner side cavity for controllably throwing in effect direction of illumination.
Device of the clause 19. according to clause 1, wherein the eyeshield also includes tactile effect system, it is adapted to reality The haptic effect now mutually coordinated with the content of presentation in visual field.
Device of the clause 20. according to clause 19, wherein tactile effect system include piezoelectric vibration system.
Device of the clause 21. according to clause 20, wherein piezoelectric vibration system is positioned on the side of eyeshield.
Device of the clause 22. according to clause 20, wherein piezoelectric vibration system is positioned on the top of eyeshield.
Device of the clause 23. according to clause 20, wherein piezoelectric vibration system is positioned on the bottom of eyeshield.
Device of the clause 24. according to clause 1, also including the data cube computation between eyeshield and platform.
Device of the clause 25. according to clause 24, wherein setting up data cube computation, the attachment system by attachment system Eyeshield is mechanically connected to platform by system.
Device of the clause 26. according to clause 24, wherein the data cube computation is wireless data connection.
Clause group E1
A kind of veiling glare suppression system of clause 1., including:Shield, it is mechanically adapted to removedly and alternatively install To perspective display system, the perspective display system is adapted to be worn in user's head;The shield is also adapted to when installation Suppress the light from perspective display system transmitting when on perspective display system and suppress surrounding environment light to enter perspective display system The side of system;And the shield also includes peripheral lighting effect system.
System of the clause 2. according to clause 1, wherein the shield is adapted to magnet removedly and alternatively It is installed to see-through display.
System of the clause 3. according to clause 1, wherein the shield is adapted to removedly and to be replaced with mechanical attachment It is installed to see-through display with changing.
System of the clause 4. according to clause 1, wherein the shield is adapted to removedly and alternatively be installed to See-through display and be held in place by the arm for being attached to see-through display at least in part, wherein the arm be adapted to by Platform is maintained in user's head.
System of the clause 5. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 2% and 5%, maintain to be arrived for user while producing to produce immersive environment for user The transparency of the vision connection of surrounding.
System of the clause 6. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 5% and 10%, maintain to be used for user while producing to produce immersive environment for user To the transparency that the vision of surrounding connects.
System of the clause 7. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 10% and 20%, maintain to be used for user while producing to produce immersive environment for user To the transparency that the vision of surrounding connects.
System of the clause 8. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency more than 20%.
System of the clause 9. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the low transparency in the region at visual field rear of eyes of user is presented to and higher outside the region at visual field rear Transparency.
System of the clause 10. according to clause 1, wherein the shield has the visual angle for providing a user with surrounding Transparency region.
System of the clause 11. according to clause 10, wherein the transparency is partial transparency.
System of the clause 12. according to clause 1, wherein the shield also includes tactile effect system, it is adapted to reality The haptic effect now mutually coordinated with the content of presentation in visual field.
System of the clause 13. according to clause 12, wherein tactile effect system include piezoelectric vibration system.
System of the clause 14. according to clause 13, wherein piezoelectric vibration system is positioned on the side of eyeshield.
System of the clause 15. according to clause 13, wherein piezoelectric vibration system is positioned on the top of eyeshield.
System of the clause 16. according to clause 13, wherein piezoelectric vibration system is positioned on the bottom of eyeshield.
System of the clause 17. according to clause 1, also including being adapted to connect the number of the shield and see-through display According to connection.
System of the clause 18. according to clause 1, wherein setting up data cube computation, the attachment system by attachment system The shield is mechanically connected to into see-through display.
System of the clause 19. according to clause 1, wherein the data cube computation is wireless data connection.
System of the clause 20. according to clause 1, wherein peripheral illumination effect system LED or OLED produces illumination effect Really.
System of the clause 21. according to clause 20, wherein lighting effect are coloured lighting effects.
System of the clause 22. according to clause 1, wherein peripheral lighting effect system includes light source, its essentially around For controllably throwing in the internal cavity of effect direction of illumination.
Clause group E2
A kind of veiling glare suppression system of clause 1., including:Shield, it is mechanically adapted to removedly and alternatively install To perspective display system, the perspective display system is adapted to be worn in user's head;The shield is also adapted to when installation Suppress the light from perspective display system transmitting when on perspective display system and suppress surrounding environment light to enter perspective display system The side of system;And the shield also includes tactile lighting effect system.
System of the clause 2. according to clause 1, wherein the shield is adapted to magnet removedly and alternatively It is installed to see-through display.
System of the clause 3. according to clause 1, wherein the shield is adapted to removedly and to be replaced with mechanical attachment It is installed to see-through display with changing.
System of the clause 4. according to clause 1, wherein the shield is adapted to removedly and alternatively be installed to See-through display and be held in place by the arm for being attached to see-through display at least in part, wherein the arm be adapted to by Platform is maintained in user's head.
System of the clause 5. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 2% and 5%, maintain to be arrived for user while producing to produce immersive environment for user The transparency of the vision connection of surrounding.
System of the clause 6. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 5% and 10%, maintain to be used for user while producing to produce immersive environment for user To the transparency that the vision of surrounding connects.
System of the clause 7. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency between 10% and 20%, maintain to be used for user while producing to produce immersive environment for user To the transparency that the vision of surrounding connects.
System of the clause 8. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the perspective transparency more than 20%.
System of the clause 9. according to clause 1, wherein Xanthophyll cycle system also include outer lens, wherein outer lens With the low transparency in the region at visual field rear of eyes of user is presented to and higher outside the region at visual field rear Transparency.
System of the clause 10. according to clause 1, wherein the shield has the visual angle for providing a user with surrounding Transparency region.
System of the clause 11. according to clause 10, wherein the transparency is partial transparency.
System of the clause 12. according to clause 1, wherein tactile effect system include piezoelectric vibration system.
System of the clause 13. according to clause 1, wherein piezoelectric vibration system is positioned on the side of eyeshield.
System of the clause 14. according to clause 1, wherein piezoelectric vibration system is positioned on the top of eyeshield.
System of the clause 15. according to clause 1, wherein piezoelectric vibration system is positioned on the bottom of eyeshield.
System of the clause 16. according to clause 1, also including being adapted to connect the number of the shield and see-through display According to connection.
System of the clause 17. according to clause 16, wherein setting up data cube computation, the attachment system by attachment system The shield is mechanically connected to see-through display by system.
System of the clause 18. according to clause 16, wherein the data cube computation is wireless data connection.
Clause group F
A kind of device of clause 1., including:Eyeshield, it is adapted to be removably mounted at the head with perspective computer display Wear on formula computer;And the audio earphone with adjustable articulator of eyeshield is connected to, wherein adjustable articulator provides and extends and revolve Turn to provide the mechanism for being directed at audio earphone with user ear to the user of Wearing-on-head type computer.
Device of the clause 2. according to clause 1, wherein audio earphone include the sound being connected with the adapter on eyeshield Frequency line, eyeshield adapter is adapted to removedly match with the adapter in Wearing-on-head type computer.
Device of the clause 3. according to clause 1, wherein audio earphone are adapted to be calculated from wear-type by wireless connection Machine receives audio signal.
Device of the clause 4. according to clause 1, wherein Wearing-on-head type computer have removable and interchangeable front saturating Mirror.
Device of the clause 5. according to clause 1, wherein the eyeshield includes the electricity to the system power supply inside eyeshield Pond.
Device of the clause 6. according to clause 1, wherein the eyeshield includes that the system to wear-type computer-internal is supplied The battery of electricity.
Device of the clause 7. according to clause 1, wherein the eyeshield includes fan, it is adapted to by user's face Exchange of air between the inner space for partly limiting and external environment condition, to cool down inner space in air.
Device of the clause 8. according to clause 1, wherein the audio earphone include vibrational system, its be adapted to Family provides the touch feedback mutually coordinated with the digital content presented in perspective computer display.
Device of the clause 9. according to clause 1, wherein the Wearing-on-head type computer includes vibrational system, it is adapted to Provide a user with the touch feedback mutually coordinated with the digital content presented in perspective computer display.
A kind of device of clause 10., including:Eyeshield, it is adapted to be removably mounted at perspective computer display Wearing-on-head type computer on;And the flexible audio earphone of eyeshield is installed to, wherein the flexible use to Wearing-on-head type computer Family provides the mechanism for being directed at audio earphone with user ear.
Device of the clause 11. according to clause 10, wherein flexible audio earphone is installed to into eyeshield with magnetic connection.
Device of the clause 12. according to clause 10, wherein flexible audio earphone is installed to into eyeshield with being mechanically connected.
Clause group G
A kind of wear-type of stereo-picture of the offer superimposition of clause 1. shown by the see-through view of surrounding shows Device, wherein the focusing distance being associated with shown stereo-picture and vergence distance can change, the wear-type shows Device includes:Left display optics and right display optics, each of which includes top optics and part combinations of reflections Device, wherein each top optics include image source, light source and one or more lens;Two removable focusing shift Element, each is positioned between one of image source and its corresponding combiner to change the focusing of shown stereo-picture Distance;And integrated processor, to the left display optics and right display optics provide stereo-picture and are adapted to for it Stereo-picture is positioned at vergence distance, the vergence distance accordingly changes with focusing distance.
Head mounted display of the clause 2. according to clause 1, wherein the shift component that focuses on is by the focusing distance Change into the focusing distance in the brachium of user.
Head mounted display of the clause 3. according to clause 2, wherein shown stereo-picture includes one or more Augmented reality object.
Head mounted display of the clause 4. according to clause 1, wherein removable focusing shift component is directed to left display light It is detached to learn device and right display optics.
Head mounted display of the clause 5. according to clause 1, wherein removable focusing shift component is bonded to left showing Show between optics and right display optics.
Head mounted display of the clause 6. according to clause 1, also including sensor, its detection is removable to focus on displacement The presence of element.
Head mounted display of the clause 7. according to clause 6, wherein the sensor is also detected with regard to poly- with removable The information of the associated focusing displacement of burnt shift component.
Head mounted display of the clause 8. according to clause 1, wherein image processor with the parallax for changing by being rendered Stereo-picture is changing the vergence distance of the part of stereo-picture.
Head mounted display of the clause 9. according to clause 8, wherein the parallax of whole stereo-picture is altered to vertical Body image provides different vergence viewing distances.
Head mounted display of the clause 10. according to clause 1, also including correcting lens, it is positioned at combiner rear To improve display image and the view both see-through view based on the perception of user.
Head mounted display of the clause 11. according to clause 10, wherein correcting lens, combiner and removable focusing Shift component is connected.
Head mounted display of the clause 12. according to clause 7, wherein with it is removable focusing shift component associated by Detected focusing displacement accordingly change the vergence distance of shown stereo-picture automatically.
Head mounted display of the clause 13. according to clause 7, wherein focusing on shift component also includes bar code, it is retouched The focusing shift amount provided by focusing shift component is provided, and the bar code is detected by sensor.
Head mounted display of the clause 14. according to clause 7, wherein when removable focusing shift component is detected, Visual indicators are added to into display image.
Head mounted display of the clause 15. according to clause 7, wherein when removable focusing shift component is detected, The presentation of modification display image.
Head mounted display of the clause 16. according to clause 1, wherein the focusing shift component is Fresnel Lenses.
Head mounted display of the clause 17. according to clause 10, wherein the correcting lens are Fresnel Lenses.
Head mounted display of the clause 18. according to clause 10, wherein the correcting lens are adjustable lens.
Head mounted display of the clause 19. according to clause 10, wherein the correcting lens are attached to wear-type showing The framework of device, so that the correcting lens outer when not in use can show display visual field.
Head mounted display of the clause 20. according to clause 10, wherein focusing on shift component and correcting lens removable Except being attached together in component.
Clause group G1
A kind of device for head mounted display of clause 1., it provides the display in superimposition to the see-through view of surrounding Change in terms of the viewing distance of image, described device includes:Top optics, it include image source, light source, one or Multiple lens and focusing change module;Part combinations of reflections device;Integrated processor;And change module is wherein focused on predetermined Mobile image source between position, so as to provide two or more focusing distances for display image.
Device of the clause 2. according to clause 1, wherein the change module that focuses on is moved between two predetermined locations Image source, described two precalculated positions enable the focusing distance that display image is provided with the brachium of user and More than another focusing distance of the brachium of user.
Device of the clause 3. according to clause 1, wherein described focusing changes module including transverse shifting with pre-determined bit The wedge in mobile image source between putting.
Device of the clause 4. according to clause 3, wherein one or more solenoids are used for wedge shape described in transverse shifting Thing.
Device of the clause 5. according to clause 3, the wherein screw rod of manual operation are used for wedge described in transverse shifting.
Device of the clause 6. according to clause 3, wherein motor are used to rotate the spiral shell of wedge described in transverse shifting Bar.
Device of the clause 7. according to clause 3, wherein the wedge is positioned between image source and lens, and And the wedge is included for light through the window to lens and combiner.
Device of the clause 8. according to clause 3, wherein the wedge is positioned in image source top.
Device of the clause 9. according to clause 1, wherein described focusing changes module and include guide mechanism, itself and image Source is associated to be guided with the movement to the image source between precalculated position.
Device of the clause 10. according to clause 9, wherein the guide mechanism is pin.
Device of the clause 11. according to clause 9, wherein the guide mechanism is leaf spring.
Device of the clause 12. according to clause 9, wherein the guide mechanism is four bar linkage.
Device of the clause 13. according to clause 3, wherein the wedge is transparent, and the horizontal shifting of wedge The dynamic optical thickness changed through the wedge, it changes the focusing distance of display image.
Clause group G2
Clause 1. is a kind of accordingly to adjust the focusing distance of display image in head mounted display with the eyes movement of user Method, the head mounted display includes integrated processor, Inertial Measurement Unit and left optical device module and right optics device Part module, each in the left optical device module and right optical device module includes:It is aobvious with focus adjustment module Show optics, one or more lens and combiner;And the camera of the image of capture eyes of user, methods described bag Include:The image of an at least eyes of user is captured with camera;Analyze captured image to determine eyes of user just with processor The relative direction that look at;Contra always determines the display image that user just look at according to determined by eyes of user just look at Part;And control focus adjustment module is come the accordingly metering needle pair of part determined by the image that just look at user The focusing distance of display image.
Method of the clause 2. according to clause 1, it is further comprising the steps of:Determine that wear-type shows with Inertial Measurement Unit Show the direction of gaze of device, the relative direction that eyes of user just look at direction of gaze with determined by is compared to determine user The compass heading that just look at.
Method of the clause 3. according to clause 1, also including capture user left eye and right eye image two phases Machine.
Method of the clause 4. according to clause 3, also the image of the left eye including analysis user and right eye is determining user Left eye and the relative direction that just look at of right eye.
Method of the clause 5. according to clause 4, it is further comprising the steps of:The left eye and right eye of analysis user just look at Relative direction between difference determining the vergence viewing distance of user;And accordingly adjust with vergence viewing distance The vergence distance that section is associated with a part for display image.
Method of the clause 6. according to clause 5, it is further comprising the steps of:Vergence viewing distance is just seen with user The image determines that the vergence distance that is associated with of part compares, with determine user just look at display image or around The see-through view of environment.
Method of the clause 7. according to clause 1, wherein changing in terms of the relative direction that just look in response to eyes of user Become continuously to adjust focusing distance.
Method of the clause 8. according to clause 5, wherein display image are stereo-pictures, and methods described also includes Following steps:The stereo-picture that just look at eyes of user determine part and stereo-picture the part associated by regard Difference accordingly adjusts focusing distance and vergence distance.
Method of the clause 9. according to clause 6, wherein the head mounted display also include camera, its capture with The image of the surrounding in front of family, and methods described is further comprising the steps of:If user just look at the saturating of surrounding Depending on view, the then surrounding that the contra based on determined by the left eye and right eye of user just look at always just look in user The image for being captured in identification object.
Method of the clause 10. according to clause 9, wherein based on being recognized in the surrounding that just look in user Object is changing display image.
Method of the clause 11. according to clause 1, wherein the camera also includes focusing automatically, and methods described bag Include following steps:The metadata being associated based on the image for being captured with eyes of user is set come the focusing for determining automatic focusing Put, to determine the presence of correcting lens.
Method of the clause 12. according to clause 11, wherein whether being confirmed as existing to change depending on correcting lens The regulation of focus adjustment module.
Clause group G3
A kind of wear-type display system for watching augmented reality image of clause 1., the augmented reality image includes superimposition The display image of the object in the see-through view of surrounding, the wear-type display system includes:The integrated of image is provided Processor;Focus adjustment module, it includes image source, actuator and guide mechanism;Multiple folding display optics, it includes One or more lens;Light source;Combiner, it reflects a part for the light from image source and transmits from surrounding Light a part.
Head mounted display of the clause 2. according to clause 1, wherein the multiple folding display optics include gathering Folding mirror between burnt adjustment module and combiner.
Head mounted display of the clause 3. according to clause 2, wherein the folding mirror rolls over display optics The side of combiner is laminated to, to reduce the height of display optics.
Head mounted display of the clause 4. according to clause 1, wherein the multiple folding display optics include rib Mirror.
Head mounted display of the clause 5. according to clause 1, wherein the display optics are remote at image source The heart.
Head mounted display of the clause 6. according to clause 5, wherein the telecentricity that the light source provides image source is shone It is bright.
Head mounted display of the clause 7. according to clause 1, also including the camera of the image for capturing eyes of user.
The image for being captured of head mounted display of the clause 8. according to clause 7, wherein eyes of user is by phase From combiner reflection before machine capture.
Head mounted display of the clause 9. according to clause 7, also includes the LED being illuminated to eyes of user.
Head mounted display of the clause 10. according to clause 9, wherein LED provides the infrared light that camera is sensitive to.
Head mounted display of the clause 11. according to clause 1, also including Inertial Measurement Unit.
Head mounted display of the clause 12. according to clause 1, wherein the actuator is coupled to a pair of wedges Solenoid.
Head mounted display of the clause 13. according to clause 1, wherein the actuator is a pair of bi-morph piezo-electrics causing Dynamic device.
Head mounted display of the clause 14. according to clause 1, wherein the actuator is scissors-type jack actuator.
Head mounted display of the clause 15. according to clause 1, wherein the actuator is voice coil motor.
Head mounted display of the clause 16. according to clause 1, wherein the guide mechanism is leaf spring.
Head mounted display of the clause 17. according to clause 1, wherein the guide mechanism is four bar linkage.
Head mounted display of the clause 18. according to clause 3, wherein the focus adjustment module is located at combiner Side, image source is approximately perpendicularly orientated and compares with guide mechanism closer to multiple folding with actuator and shows optics device Part.
Head mounted display of the clause 19. according to clause 7, wherein the eyes camera includes focusing automatically.
Head mounted display of the clause 20. according to clause 19, wherein using with focusing on the focusing that is associated automatically and arranging In automatically adjusting.
Clause group H
A kind of method of clause 1., including:Eyes of user is illuminated with the light source in head mounted display;Use wear-type Eyes camera in display captures the image of eyes of user, and wherein described image is included by reflecting from the surface of eyes of user From the eyes flash of light that the light of light source is produced;And accordingly recognize for using with the change in terms of the size of eyes flash of light Change in terms of the focusing distance of family eyes.
Method of the clause 2. according to clause 1, wherein the light source is LED.
Method of the clause 3. according to clause 1, wherein the light source is the display figure from head mounted display Picture.
Method of the clause 4. according to clause 1, the change for being recognized wherein in terms of focusing distance is used to determine user Around what just look in environment.
Method of the clause 5. according to clause 1, the change for being recognized wherein in terms of focusing distance is used to automatically select For the display pattern of head mounted display.
Method of the clause 6. according to clause 5, wherein the display pattern include display image should more it is bright still It is dimer.
Method of the clause 7. according to clause 1, the change for being recognized wherein in terms of focusing distance is used to determine user Just look at display image or user just look at surrounding.

Claims (27)

1. a kind of head mounted display of the highly transmissive see-through view of improvement with surrounding, the see-through view has The high-contrast display image of superimposition, the head mounted display includes:
A. there is the top optics of primary optic axis, it includes:
I. image source is launched, its offer includes the image light of one or more narrow bands of light;
Ii. one or more lens;
Iii. spuious ligh trap;And
B. there is the unpolarized lower optical device of the second optical axis, it includes:
I. relative to the planar splitter that primary optic axis and the second optical axis are angled;And
Ii. sweep reflecting mirror;
One or more wherein in reflecting surface are processed into the incident illumination being reflected in one or more of narrow bands Major part that is most of and transmiting incidence visible light from surrounding.
2. head mounted display according to claim 1, wherein the transmitting image source is OLED display.
3. head mounted display according to claim 1, wherein the transmitting image source is back illumination LCD.
4. head mounted display according to claim 1, wherein the transmitting image source is micro- light-emitting diode display.
5. head mounted display according to claim 1, wherein the transmitting image source is plasma display.
6. head mounted display according to claim 1, wherein described process is trap mirror coating, its reflection The major part that is most of and transmiting visible ray of at least one of the narrow band provided by transmitting image source.
7. head mounted display according to claim 6, wherein the coating is trap mirror coating, its reflection The major part that is most of and transmiting visible ray of the multiple narrow band provided by transmitting image source.
8. head mounted display according to claim 6, wherein the trap mirror coating is applied to plane Beam splitter.
9. head mounted display according to claim 6, wherein the trap mirror coating is applied to bending Partially reflecting mirror.
10. head mounted display according to claim 1, wherein described process is multilayer film, its reflection is by launching The major part that is most of and transmiting visible ray of at least one of the narrow band that image source is provided.
11. head mounted displays according to claim 1, wherein the veiling glare trap includes that one or more circles are inclined Shake device.
12. head mounted displays according to claim 1, wherein the veiling glare trap is included on both sides has four The polariser of/mono- ripple film.
13. head mounted displays according to claim 12, wherein the veiling glare trap is positioned in lens and divides Between beam device.
14. head mounted displays according to claim 11, wherein the circuit polarizer is positioned adjacent to figure Image source.
15. head mounted displays according to claim 11, wherein the first circuit polarizer is positioned adjacent to figure Image source, and the second circuit polarizer is positioned between lens and beam splitter.
16. head mounted displays according to claim 13, wherein the lens provide telecentric image to beam splitter Light, the telecentric image light passes through spuious ligh trap.
17. head mounted displays according to claim 1, wherein the veiling glare trap absorbs the image for carrying out self-reflection Light or from surrounding see-through view light through lower optical device and towards image source transmission light.
18. head mounted displays according to claim 1, wherein the see-through view bag of the environment seen by user Include at least 50% of the available light from surrounding.
19. head mounted displays according to claim 1, wherein the see-through view bag of the environment seen by user Include at least 60% of the available light from surrounding.
20. head mounted displays according to claim 1, wherein the see-through view bag of the environment seen by user Include at least 20% of the available light from surrounding in narrow band.
A kind of 21. head mounted displays with multiple folding optics, it provides see-through view of the superimposition to surrounding On improvement display image, the head mounted display includes:Solid prisms with angled plane surface;Self-luminous shows Show device, the image light that its offer is associated with display image;And it is joined to the planar reflective plate of plane surface, its reflection and aobvious The associated image light of diagram picture, wherein the planar reflective plate is joined to solid prisms.
A kind of head mounted display of stereo-picture of the 22. offer superimposition shown by the see-through view of surrounding, its In the focusing distance that is associated with shown stereo-picture and vergence distance can change, the head mounted display bag Include:Left display optics and right display optics, each of which includes top optics and part combinations of reflections device, its In each top optics include image source, light source and one or more lens;Two removable focusing shift components, Each is positioned between its corresponding combiner of one of image source, with change the focusing of shown stereo-picture away from From;And integrated processor, its to the left display optics and right display optics provide stereo-picture and be adapted to by Stereo-picture is positioned at vergence distance, and the vergence distance accordingly changes with focusing distance.
A kind of 23. wear-type see-through displays, it includes:Perspective optical element, it is installed such that it has an X-rayed in wear-type Eyes of user front is positioned in when display is worn by the user;Processor, it is adapted to the visual field on perspective optical element Middle presentation digital content, wherein the digital content has the position in the visual field depending on the position in surrounding;And The processor is also adapted to change the outward appearance of content at the edge of the close visual field of content, so that in the close visual field of content Content seems to disappear during edge.
A kind of 24. devices, including:Platform, it is mechanically adapted to be worn in user's head;Fluoroscopy images display, its quilt On platform and be adapted to eyes of user present picture material, wherein the fluoroscopy images display is also provided a user with The see-through view of the environment of close user;Removable and interchangeable eyeshield, it is adapted for connection to platform, and wherein eyeshield is also fitted It is made into the light comprising the internal cavity effusion formed from the facial seam with user;And removable and interchangeable outside is saturating Mirror, it is arranged on platform along the optical axis of the Perspective User View being aligned with environment.
A kind of 25. devices, including:Eyeshield, it is adapted to be removably mounted at the wear-type with perspective computer display On computer;And be connected to the audio earphone with adjustable articulator of eyeshield, wherein adjustable articulator provide extend and rotate with The mechanism that audio earphone is aligned with user ear is provided to the user of Wearing-on-head type computer.
A kind of 26. image presentations having for control in the perspective wear-type display system for improving visibility for user Method, including:Determine the brightness of the see-through view of surrounding;Determine the brightness metric of image to be displayed;And base In the brightness metric and surrounding of image see-through view brightness adjusting the attribute of image so that the brightness of image and The predetermined combinations brightness of see-through view is presented to user.
A kind of 27. methods, including:Eyes of user is illuminated with the light source in head mounted display;Shown with wear-type Eyes camera in device captures the image of eyes of user, wherein described image include by reflect from the surface of eyes of user from The eyes flash of light that the light of light source is produced;And accordingly recognize for user's eye with the change in terms of the size of eyes flash of light Change in terms of the focusing distance of eyeball.
CN201680002425.3A 2015-02-17 2016-02-16 See-through computer display system Active CN106662750B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110186961.6A CN113671703A (en) 2015-02-17 2016-02-16 See-through computer display system

Applications Claiming Priority (17)

Application Number Priority Date Filing Date Title
US14/623932 2015-02-17
US14/623,932 US20160239985A1 (en) 2015-02-17 2015-02-17 See-through computer display systems
US14/635390 2015-03-02
US14/635,390 US20150205135A1 (en) 2014-01-21 2015-03-02 See-through computer display systems
US14/670,677 US20160286203A1 (en) 2015-03-27 2015-03-27 See-through computer display systems
US14/670677 2015-03-27
US14/741,943 US20160018645A1 (en) 2014-01-24 2015-06-17 See-through computer display systems
US14/741943 2015-06-17
US14/813,969 US9494800B2 (en) 2014-01-21 2015-07-30 See-through computer display systems
US14/813969 2015-07-30
US14/851755 2015-09-11
US14/851,755 US9651784B2 (en) 2014-01-21 2015-09-11 See-through computer display systems
US14/861496 2015-09-22
US14/861,496 US9753288B2 (en) 2014-01-21 2015-09-22 See-through computer display systems
US14/884,567 US9836122B2 (en) 2014-01-21 2015-10-15 Eye glint imaging in see-through computer display systems
US14/884567 2015-10-15
PCT/US2016/018040 WO2016133886A1 (en) 2015-02-17 2016-02-16 See-through computer display systems

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110186961.6A Division CN113671703A (en) 2015-02-17 2016-02-16 See-through computer display system

Publications (2)

Publication Number Publication Date
CN106662750A true CN106662750A (en) 2017-05-10
CN106662750B CN106662750B (en) 2021-03-12

Family

ID=56692324

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201680002425.3A Active CN106662750B (en) 2015-02-17 2016-02-16 See-through computer display system
CN202110186961.6A Pending CN113671703A (en) 2015-02-17 2016-02-16 See-through computer display system

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202110186961.6A Pending CN113671703A (en) 2015-02-17 2016-02-16 See-through computer display system

Country Status (3)

Country Link
EP (1) EP3259632A4 (en)
CN (2) CN106662750B (en)
WO (1) WO2016133886A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109683317A (en) * 2018-12-28 2019-04-26 北京灵犀微光科技有限公司 Augmented reality eyepiece device and augmented reality display device
CN110174767A (en) * 2019-05-13 2019-08-27 成都工业学院 A kind of nearly eye display device of super multiple views
CN110596889A (en) * 2018-06-13 2019-12-20 托比股份公司 Eye tracking device and method of manufacturing an eye tracking device
CN110618529A (en) * 2018-09-17 2019-12-27 武汉美讯半导体有限公司 Light field display system for augmented reality and augmented reality device
CN110800159A (en) * 2017-06-26 2020-02-14 华为技术有限公司 Feed equipment
CN110955046A (en) * 2018-09-27 2020-04-03 精工爱普生株式会社 Head-mounted display device and cover member
CN111602100A (en) * 2017-07-11 2020-08-28 交互数字Ce专利控股公司 Method, device and system for providing alternative reality environment
CN112147639A (en) * 2020-07-17 2020-12-29 中国工程物理研究院应用电子学研究所 MEMS one-dimensional laser radar and digital camera surveying and mapping device and method
CN112150940A (en) * 2020-09-22 2020-12-29 郑州胜龙信息技术股份有限公司 Grating type screen display system for information safety protection
CN112513715A (en) * 2018-07-30 2021-03-16 苹果公司 Electronic device system with supplemental lens
TWI745867B (en) * 2020-02-18 2021-11-11 宏碁股份有限公司 Method for adjusting blue light components and head-mounted display
CN113906327A (en) * 2019-06-07 2022-01-07 脸谱科技有限责任公司 Optical element for reducing stray infrared light
CN114322944A (en) * 2021-12-24 2022-04-12 中国科学院长春光学精密机械与物理研究所 Coaxial fold-back type navigation and spectrum integrated optical system
US20220334648A1 (en) * 2021-04-15 2022-10-20 Canon Kabushiki Kaisha Wearable information terminal, control method thereof, and storage medium
WO2023131980A1 (en) * 2022-01-07 2023-07-13 Tesseract Imaging Limited Apparatus for viewing optical images and method thereof
US11741879B2 (en) 2020-07-29 2023-08-29 Kunshan New Flat Panel Display Technology Center Co., Ltd. Method, device and apparatus for brightness compensation of display panel
US11881145B2 (en) 2020-07-29 2024-01-23 Kunshan New Flat Panel Display Technology Center Co., Ltd. Method, device and apparatus for determining brightness compensation parameter

Families Citing this family (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9298007B2 (en) 2014-01-21 2016-03-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9952664B2 (en) 2014-01-21 2018-04-24 Osterhout Group, Inc. Eye imaging in head worn computing
US9965681B2 (en) 2008-12-16 2018-05-08 Osterhout Group, Inc. Eye imaging in head worn computing
US9400390B2 (en) 2014-01-24 2016-07-26 Osterhout Group, Inc. Peripheral lighting for head worn computing
US9229233B2 (en) 2014-02-11 2016-01-05 Osterhout Group, Inc. Micro Doppler presentations in head worn computing
US10254856B2 (en) 2014-01-17 2019-04-09 Osterhout Group, Inc. External user interface for head worn computing
US9594246B2 (en) 2014-01-21 2017-03-14 Osterhout Group, Inc. See-through computer display systems
US20160019715A1 (en) 2014-07-15 2016-01-21 Osterhout Group, Inc. Content presentation in head worn computing
US10649220B2 (en) 2014-06-09 2020-05-12 Mentor Acquisition One, Llc Content presentation in head worn computing
US10684687B2 (en) 2014-12-03 2020-06-16 Mentor Acquisition One, Llc See-through computer display systems
US9939934B2 (en) 2014-01-17 2018-04-10 Osterhout Group, Inc. External user interface for head worn computing
US10191279B2 (en) 2014-03-17 2019-01-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9829707B2 (en) 2014-08-12 2017-11-28 Osterhout Group, Inc. Measuring content brightness in head worn computing
US9299194B2 (en) 2014-02-14 2016-03-29 Osterhout Group, Inc. Secure sharing in head worn computing
US9575321B2 (en) 2014-06-09 2017-02-21 Osterhout Group, Inc. Content presentation in head worn computing
US11103122B2 (en) 2014-07-15 2021-08-31 Mentor Acquisition One, Llc Content presentation in head worn computing
US9841599B2 (en) 2014-06-05 2017-12-12 Osterhout Group, Inc. Optical configurations for head-worn see-through displays
US9810906B2 (en) 2014-06-17 2017-11-07 Osterhout Group, Inc. External user interface for head worn computing
US9746686B2 (en) 2014-05-19 2017-08-29 Osterhout Group, Inc. Content position calibration in head worn computing
US9753288B2 (en) 2014-01-21 2017-09-05 Osterhout Group, Inc. See-through computer display systems
US9836122B2 (en) 2014-01-21 2017-12-05 Osterhout Group, Inc. Eye glint imaging in see-through computer display systems
US9494800B2 (en) 2014-01-21 2016-11-15 Osterhout Group, Inc. See-through computer display systems
US9523856B2 (en) 2014-01-21 2016-12-20 Osterhout Group, Inc. See-through computer display systems
US11737666B2 (en) 2014-01-21 2023-08-29 Mentor Acquisition One, Llc Eye imaging in head worn computing
US9811159B2 (en) 2014-01-21 2017-11-07 Osterhout Group, Inc. Eye imaging in head worn computing
US20150205135A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
US9538915B2 (en) 2014-01-21 2017-01-10 Osterhout Group, Inc. Eye imaging in head worn computing
US9651784B2 (en) 2014-01-21 2017-05-16 Osterhout Group, Inc. See-through computer display systems
US11487110B2 (en) 2014-01-21 2022-11-01 Mentor Acquisition One, Llc Eye imaging in head worn computing
US11669163B2 (en) 2014-01-21 2023-06-06 Mentor Acquisition One, Llc Eye glint imaging in see-through computer display systems
US11892644B2 (en) 2014-01-21 2024-02-06 Mentor Acquisition One, Llc See-through computer display systems
US9766463B2 (en) 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
US20150241963A1 (en) 2014-02-11 2015-08-27 Osterhout Group, Inc. Eye imaging in head worn computing
US9401540B2 (en) 2014-02-11 2016-07-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
US20160187651A1 (en) 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
US10853589B2 (en) 2014-04-25 2020-12-01 Mentor Acquisition One, Llc Language translation with head-worn computing
US9672210B2 (en) 2014-04-25 2017-06-06 Osterhout Group, Inc. Language translation with head-worn computing
US9651787B2 (en) 2014-04-25 2017-05-16 Osterhout Group, Inc. Speaker assembly for headworn computer
US10663740B2 (en) 2014-06-09 2020-05-26 Mentor Acquisition One, Llc Content presentation in head worn computing
US9684172B2 (en) 2014-12-03 2017-06-20 Osterhout Group, Inc. Head worn computer display systems
USD751552S1 (en) 2014-12-31 2016-03-15 Osterhout Group, Inc. Computer glasses
USD753114S1 (en) 2015-01-05 2016-04-05 Osterhout Group, Inc. Air mouse
US20160239985A1 (en) 2015-02-17 2016-08-18 Osterhout Group, Inc. See-through computer display systems
JP2019519803A (en) * 2016-04-26 2019-07-11 ルミレッズ リミテッド ライアビリティ カンパニー LED flash ring surrounding the camera lens
US20190278090A1 (en) * 2016-11-30 2019-09-12 Nova-Sight Ltd. Methods and devices for displaying image with changed field of view
CN106803988B (en) * 2017-01-03 2019-12-17 苏州佳世达电通有限公司 Information transmission system and information transmission method
CN109932806B (en) * 2017-12-18 2021-06-08 中强光电股份有限公司 Optical lens
US20190204910A1 (en) * 2018-01-02 2019-07-04 Microsoft Technology Licensing, Llc Saccadic breakthrough mitigation for near-eye display
US10726765B2 (en) 2018-02-15 2020-07-28 Valve Corporation Using tracking of display device to control image display
JP7067185B2 (en) * 2018-03-27 2022-05-16 セイコーエプソン株式会社 Display device
WO2020023266A1 (en) * 2018-07-23 2020-01-30 Magic Leap, Inc. Systems and methods for external light management
WO2020056384A1 (en) 2018-09-14 2020-03-19 Magic Leap, Inc. Systems and methods for external light management
JP6958530B2 (en) * 2018-10-10 2021-11-02 セイコーエプソン株式会社 Optical module and head-mounted display
CN109615648B (en) * 2018-12-07 2023-07-14 深圳前海微众银行股份有限公司 Depth of field data conversion method, device, equipment and computer readable storage medium
CN112433327B (en) * 2019-08-06 2022-12-20 三赢科技(深圳)有限公司 Lens module and electronic device
US11300791B2 (en) 2019-08-21 2022-04-12 Magic Leap, Inc. Flat spectral response gratings using high index materials
CN110865458A (en) * 2019-11-29 2020-03-06 联想(北京)有限公司 Head-mounted equipment
GB2597099A (en) * 2020-07-15 2022-01-19 Sony Interactive Entertainment Inc Head mounted display
TWI798853B (en) * 2021-10-01 2023-04-11 佐臻股份有限公司 Augmented reality display device
WO2023096807A1 (en) * 2021-11-29 2023-06-01 Corning Incorporated Triple notched filter coverglass for high ambient contrast display
CN116413914A (en) * 2022-01-05 2023-07-11 华为技术有限公司 Display device and vehicle
GB2622684A (en) * 2022-07-27 2024-03-27 Bae Systems Plc A coating for optical surfaces

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020060851A1 (en) * 2000-09-27 2002-05-23 Shoichi Yamazaki Image display apparatus and head mounted display using it
US20070075917A1 (en) * 2003-11-21 2007-04-05 Kenji Nishi Image display device and simulation device
US20120242697A1 (en) * 2010-02-28 2012-09-27 Osterhout Group, Inc. See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
CN202948204U (en) * 2012-12-07 2013-05-22 香港应用科技研究院有限公司 Perspective-type head-mounted display optical system

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5483307A (en) * 1994-09-29 1996-01-09 Texas Instruments, Inc. Wide field of view head-mounted display
JP4048844B2 (en) * 2002-06-17 2008-02-20 カシオ計算機株式会社 Surface light source and display device using the same
US7791889B2 (en) * 2005-02-16 2010-09-07 Hewlett-Packard Development Company, L.P. Redundant power beneath circuit board
US8570656B1 (en) * 2009-04-06 2013-10-29 Paul Weissman See-through optical system
WO2012118573A1 (en) * 2011-02-28 2012-09-07 Osterhout Group, Inc. Light control in head mounted displays
JP6111636B2 (en) * 2012-02-24 2017-04-12 セイコーエプソン株式会社 Virtual image display device
TWI498771B (en) * 2012-07-06 2015-09-01 Pixart Imaging Inc Gesture recognition system and glasses with gesture recognition function
US9069115B2 (en) * 2013-04-25 2015-06-30 Google Inc. Edge configurations for reducing artifacts in eyepieces
US20150205135A1 (en) * 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
CN203858415U (en) * 2014-04-03 2014-10-01 中航华东光电(上海)有限公司 Head-mounted display structure

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020060851A1 (en) * 2000-09-27 2002-05-23 Shoichi Yamazaki Image display apparatus and head mounted display using it
US20070075917A1 (en) * 2003-11-21 2007-04-05 Kenji Nishi Image display device and simulation device
US20120242697A1 (en) * 2010-02-28 2012-09-27 Osterhout Group, Inc. See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
CN202948204U (en) * 2012-12-07 2013-05-22 香港应用科技研究院有限公司 Perspective-type head-mounted display optical system

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110800159A (en) * 2017-06-26 2020-02-14 华为技术有限公司 Feed equipment
US11322816B2 (en) 2017-06-26 2022-05-03 Huawei Technologies Co., Ltd. Feeding device
CN111602100A (en) * 2017-07-11 2020-08-28 交互数字Ce专利控股公司 Method, device and system for providing alternative reality environment
CN110596889A (en) * 2018-06-13 2019-12-20 托比股份公司 Eye tracking device and method of manufacturing an eye tracking device
CN112513715A (en) * 2018-07-30 2021-03-16 苹果公司 Electronic device system with supplemental lens
CN110618529A (en) * 2018-09-17 2019-12-27 武汉美讯半导体有限公司 Light field display system for augmented reality and augmented reality device
CN110955046B (en) * 2018-09-27 2022-02-11 精工爱普生株式会社 Head-mounted display device and cover member
CN110955046A (en) * 2018-09-27 2020-04-03 精工爱普生株式会社 Head-mounted display device and cover member
CN109683317A (en) * 2018-12-28 2019-04-26 北京灵犀微光科技有限公司 Augmented reality eyepiece device and augmented reality display device
CN110174767A (en) * 2019-05-13 2019-08-27 成都工业学院 A kind of nearly eye display device of super multiple views
CN110174767B (en) * 2019-05-13 2024-02-27 成都工业学院 Super-multi-view near-to-eye display device
CN113906327A (en) * 2019-06-07 2022-01-07 脸谱科技有限责任公司 Optical element for reducing stray infrared light
TWI745867B (en) * 2020-02-18 2021-11-11 宏碁股份有限公司 Method for adjusting blue light components and head-mounted display
CN112147639A (en) * 2020-07-17 2020-12-29 中国工程物理研究院应用电子学研究所 MEMS one-dimensional laser radar and digital camera surveying and mapping device and method
US11741879B2 (en) 2020-07-29 2023-08-29 Kunshan New Flat Panel Display Technology Center Co., Ltd. Method, device and apparatus for brightness compensation of display panel
US11881145B2 (en) 2020-07-29 2024-01-23 Kunshan New Flat Panel Display Technology Center Co., Ltd. Method, device and apparatus for determining brightness compensation parameter
CN112150940A (en) * 2020-09-22 2020-12-29 郑州胜龙信息技术股份有限公司 Grating type screen display system for information safety protection
US20220334648A1 (en) * 2021-04-15 2022-10-20 Canon Kabushiki Kaisha Wearable information terminal, control method thereof, and storage medium
CN114322944A (en) * 2021-12-24 2022-04-12 中国科学院长春光学精密机械与物理研究所 Coaxial fold-back type navigation and spectrum integrated optical system
CN114322944B (en) * 2021-12-24 2023-09-12 中国科学院长春光学精密机械与物理研究所 Coaxial foldback type navigation and spectrum integrated optical system
WO2023131980A1 (en) * 2022-01-07 2023-07-13 Tesseract Imaging Limited Apparatus for viewing optical images and method thereof

Also Published As

Publication number Publication date
WO2016133886A1 (en) 2016-08-25
EP3259632A4 (en) 2018-02-28
CN113671703A (en) 2021-11-19
CN106662750B (en) 2021-03-12
EP3259632A1 (en) 2017-12-27

Similar Documents

Publication Publication Date Title
CN106662750A (en) See-through computer display systems
US11947120B2 (en) Image expansion optic for head-worn computer
US11947126B2 (en) See-through computer display systems
US11353957B2 (en) Eye glint imaging in see-through computer display systems
US11900554B2 (en) Modification of peripheral content in world-locked see-through computer display systems
US20210165225A1 (en) See-through computer display systems
US10073266B2 (en) See-through computer display systems
US9880441B1 (en) Electrochromic systems for head-worn computer systems
CN103946732B (en) Video based on the sensor input to perspective, near-eye display shows modification
CN106133674A (en) Perspective computer display system
CN107250882A (en) The power management calculated for wear-type
WO2017066556A1 (en) Compact optical system for head-worn computer
US11669163B2 (en) Eye glint imaging in see-through computer display systems
WO2017151872A1 (en) Speaker systems for head-worn computer systems

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20211103

Address after: Florida, USA

Patentee after: Manto first acquisition Co.,Ltd.

Address before: Delaware, USA

Patentee before: JGB mortgage Co.,Ltd.

Effective date of registration: 20211103

Address after: Delaware, USA

Patentee after: JGB mortgage Co.,Ltd.

Address before: California, USA

Patentee before: Osterhout Group Inc.

TR01 Transfer of patent right