WO2013098366A1

WO2013098366A1 - Apparatus comprising a mask for viewing augmented reality

Info

Publication number: WO2013098366A1
Application number: PCT/EP2012/077016
Authority: WO
Inventors: Lien Luong; Zile Liu; Henri CHAMBAUD; Tanguy BERLAUD; Brieuc TOULLAT
Original assignee: Thales
Priority date: 2011-12-30
Filing date: 2012-12-28
Publication date: 2013-07-04
Also published as: FR2985323A1; FR2985323B1

Abstract

The invention relates to an apparatus for viewing augmented reality, comprising: a mask (16) comprising a frame (22) comprising a body (22A) onto which an inextensible strip (102) is mounted, the latter defining a surface (24) for bearing on the face of a user, and a strap (20) for holding the frame (22) on the face of the user, with the bearing surface (24) thereof bearing on the face around the eyes; and at least one optical device (18A, 18B) comprising a semitransparent screen (76) attached to the frame (22) and opposite the eye of the user, and a projection system (82) attached to the frame (22), said projection system (82) being suitable for ensuring the projection of an augmented reality image onto the semitransparent screen (76), characterized in that it is free of any means for adjusting the position of the screen (76) relative to the bearing surface (24) when the mask is placed on the face of a user, and in that the relative positions of the screen (76), the bearing surface (24), and the projection system (82) are translatably and rotatably invariant in all of the six degrees of freedom, regardless of the position of the mask on the face of the user, such that the position of the exit pupil of the optical device (18A, 18B) relative to the user is only adjusted by moving the mask relative to the face of the user.

Description

Augmented reality vision equipment with a mask

The present invention relates to augmented reality vision equipment of the type comprising:

a mask comprising:

- A frame having a body on which is reported an inextensible band delimiting a bearing surface on the face of a user;

- A headband of the frame on the face of the user with its bearing surface bears with the face following the eye area;

at least one optical device comprising:

- a semi-transparent screen attached to the frame next to the eye of the user;

a projection chain attached to the frame, which chain of projections is suitable for projecting an augmented reality image onto the semi-transparent screen.

It is known, for gaming applications, driving aids, or military applications to provide a human being with augmented reality vision equipment allowing him to simultaneously see the environment in which it is located. as images added in its field of vision, thus increasing the reality perceived visually by the user.

Such equipment includes a semi-transparent screen, placed in the field of view of the user and on which the images of augmented reality are projected. This screen is formed for example by the glass of a pair of glasses worn by the user.

The equipment can be equipped with orientation sensors to determine the direction of the user's gaze, including the position of the head of the latter relative to the environment. Thus, the superimposed images in the natural field of view of the user are positioned in accordance with the environment perceived visually by the user.

Many information visualization equipment has been proposed.

US-2009004 0296 discloses a mask equipped with a bulky projection system located on the front of the mask that hides a large part of the natural field of view of the user.

WO 201 1/85501 discloses a ski mask with a screen and sensors for displaying information of speed and geo-location of the skier. The display screen consists of an LCD type screen placed under the user's eye. To access the information, the user has to look down to look at the partially located eyepiece low. This arrangement does not allow information to be superimposed directly in the natural field of view of the user.

The previously described systems do not allow a superposition of the augmented reality images and the environment perceived by the user.

Other systems have been proposed for superimposing the augmented reality images in accordance with the images of the environment perceived by the user. These devices require precise positioning of the exit pupil of the optical device for projecting augmented reality images relative to the pupil of the user. A precise adaptation between the position of the eye and the position of the exit pupil of the optical device must be performed manually. To allow the equipment to be adapted to different users, these devices commonly include optomechanical mechanisms allowing adjustment according to the six degrees of freedom of the optical device relative to the pupil of the eye of the user. Thus, the optical device is movable in three degrees of freedom of rotation and three degrees of freedom in translation relative to a frame of the equipment worn by the user. In addition, the user must perform a calibration procedure each time he uses these devices to ensure alignment between the visualization axes and real world references.

For beginners or less experienced users, the need to adjust these six degrees of freedom and calibration makes the implementation of the equipment complex and tedious, especially because of a lack of visual and mechanical cue.

The object of the invention is to provide augmented reality vision equipment that can be easily used by different users of non-strictly identical morphologies, which is simple to put in place.

For this purpose, the subject of the invention is an augmented reality vision equipment of the aforementioned type, characterized in that it does not have means for adjusting the position of the screen with respect to the bearing surface when the mask is placed on the face of a user and that the relative positions of the screen, the support surface and the projection chain are invariant in translation and in rotation according to the six degrees of freedom whatever the position of the user. mask on the face of the user, so that the adjustment of the position of the exit pupil of the optical device relative to the user is done only by moving the mask relative to the face of the user. According to particular embodiments, the vision equipment comprises one or more of the following characteristics:

the inextensible band and the body of the frame comprise complementary fastening means of the inextensible band on the body in at least two distinct positions defining different distances between the screen and the bearing surface;

said complementary fixing means comprise pins projecting from one of the body of the frame and from the inextensible band and from the receiving holes of the pins in the other part of the body of the frame and the inextensible band, the number of orifices being greater than the number of pins;

- The headband comprises a resilient strap to bear on the skull of the user and two rigid brackets connecting the strap to the frame of the mask at each end of the strap, which stirrups are hinged to the frame;

- Each stirrup has a curved light in which is received one end of the strap slidably mounted along the length of the light, and that the length of the light is greater than the height of the strap.

The subject of the invention is also a method of setting up augmented reality vision equipment comprising the following successive steps:

A- Position the mask in the user's field of vision;

B- Ensuring the projection from the or each optical device of an augmented reality image on the screen;

C- Move the mask relative to the face by keeping the bearing surface (24) in contact with the user's face until the user sees the augmented reality image projected on the screen; and

D- Keep the equipment thus positioned on the skull of the user with the headband (20) without modifying the relative position of the projection chain with respect to the pupil of the eye.

Preferably, the inextensible band is fixed in a predetermined position relative to the body of the frame before positioning the mask in the field of view of the user.

The invention will be better understood on reading the description which follows, given solely by way of example and with reference to the drawings in which:

FIG. 1 is a perspective view of augmented reality vision equipment connected to an augmented reality image supply calculator; FIG. 2 is a perspective view of augmented reality vision equipment; - Figure 3 is a side view of the vision equipment of Figure 1 carried by the head of a user;

FIG. 4 is a perspective view of three quarters of augmented reality vision equipment carried by the head of a user;

FIG. 5 is a view from above of the optical device of the equipment of the preceding figures; and

- Figure 6 is a top view of the vision equipment.

In Figure 1 is shown an augmented reality vision equipment 10 connected by a wire 12 to a computer 14 for processing signals received by the equipment 10 and providing the latter with augmented reality images.

The computer 14 is known per se and will not be described further.

The vision equipment shown in more detail in FIGS. 2 to 4 comprises a vision mask 16, two optical devices 18A, 18B rigidly attached to the mask 16 and a mask retaining strip 20 on the face of the user.

The mask 16 has a general plane of symmetry corresponding to the plane of symmetry of the face when the mask is in place.

More specifically, the mask 16 comprises a frame 22 having a generally tubular body 22A delimiting, on the side of the user's face, a flexible and extensible frame 23 on which is attached a non-stretchable surface 24 of support on the face . At its other end, the body 22A defines a strapping 26 in which is fixed a visor 28 for protecting the user against dust and possibly solar radiation. Alternatively, the visor 28 is a ballistic visor, that is to say a visor for protection against projectile shards, including bullets or explosives.

The body 22A of the frame 22 is delimited laterally by rigid flanks

30A, 30B connected to each other by the frame 23 on one side and the strapping 26 retaining the visor on the other side. The optical devices 18A, 18B are rigidly connected to the sidewalls 30A, 30B. The visor 28 and the frame 23 are connected to each other by a trellis 32 of flexible and elastic beams delimiting between them openings 34 normally concealed by a permeable foam film not shown.

The material constituting the body 22A is overmolded on the rigid flanks 30A, 30B thus forming a hinge with elastic return between the strapping 26 stiffened by the visor 28 and each rigid flank. The hinge axis of each hinge extends generally vertically, that is to say perpendicular to the axis connecting the two eyes of the user and parallel to the plane of symmetry of the mask. In a variant, the hinge is formed by a zone of lesser thickness. Under these conditions, the mask forms, schematically, a trapezium whose face formed by the visor 28 and those formed by the flanks are rigid while the rest of the body 22A is extensible. Thus, the flanks 30A, 30B hinged relative to the strapping 26 are free to deviate from each other following an angular deflection of a few degrees, in particular at most +/- 5 degrees with respect to a rest position . The body 22A, outside the flanks and the visor being elastic, the flanks 30A, 30B are resiliently returned to their rest position.

In its lower part, between the two eyes, the body 22A of the mask has a shape of arch proper to receive the nose of the user. This arch has a size much larger than the corresponding size of the nose to allow a movement of the mask following the surface of the user's face without the body of the mask being in abutment against the nose of the user. This possible displacement is for example between 0.5 cm and 2 cm in two directions perpendicular to each other contained in the surface of the face of the user.

The headband 20 comprises a clean elastic strap 42 to bear on the rear part of the head of the user. This strap is connected to the mount 22 of the helmet by two U-shaped articulated connecting brackets 44A, 44B, each fixed on a corresponding rigid flank 30A, 30B.

These stirrups each comprise two branches 46, 47 extending generally parallel to each other and a bridge 48 connecting the two branches.

This bridge, of generally arcuate shape with its radius of curvature disposed between the two branches 46, 47 is traversed by a curved light 50 in which the strap 42 is engaged. The light 50 separates the bridge 48 into two parallel members 51, 52.

The length of the light 50 is greater than the height of the strap 42. Its length is for example between 1, 5 and 2.5 times the height of the strap 42. The strap 42 is engaged through the light 50 and it is fixed for example by an end loop surrounding the outer frame 52 delimited by the light 50 in the bridge 48.

At its opposite end to the connecting end of the strap 42, each yoke 44A, 44B comprises articulation profiles on the frame 22. These profiles consist for example of pins 58 received in coaxial bores 60 arranged through the flanks 30A, 30B. The axis of articulation of the stirrups 44A, 44B extends along the height of the head of the user, that is to say in a direction parallel to the plane of symmetry of the mask and perpendicular to the straight line passing through the two eyes of the user.

The two branches 46, 47 delimit between them a receiving space for optical devices 18A, 18B. The optical devices 18A, 18B are identical and symmetrical to one another with respect to the plane of symmetry of the mask 16.

In the case of a binocular system, the two optical devices 18A, 18B are rigidly fixed, for example by snapping, to the frame 22. They are each connected to the computer 14. It is also possible in the case of a monocular system to fix only one of the two optical devices preferably on the directing eye. In this case, the other side may either be left empty or be replaced by another branch with other features.

Each optical device comprises an orientation sensor adapted to address to the computer 14 information on the position of the optical device considered relative to the frame 22.

For example, this sensor comprises two clean switches each to cooperate in the orientation with the same actuating pin provided on the mount 22. Thus, once fixed on the mount, only one of the switches is closed under the action pawn. The switch thus closed depends on the side and therefore the mounting direction of the optical device. From the analysis of the state of the switches, the computer 14 deduces the orientation of each optical device.

The optical device 18A is shown in greater detail in FIG. 5. It comprises a sealed support block 70 having a main section 72 formed in an opaque material extended by a transparent structure 74.

The main section 72 extends between the branches 46, 47 of the connecting brackets of the strip 20, while the structure 74 extends in the space defined by the frame 22 in the visual field of the user.

The structure 74 has a geometry in the form of a polyhedron whose one face may be curved, and has on its end face a semi-transparent screen 76 disposed opposite the pupil of the eye of the user who is placed at the exit pupil denoted 78 of the optical system in FIG. 5 when the equipment is worn by a user.

The screen 76 is connected to the main section 72 by a transparent skirt 80 delimiting with the screen 76 an enclosed space connected only to the main section 72. Thus, the support block 70 forms a sealed box delimiting an enclosed space in which are confined the elements constituting each optical device.

The main section 72 encloses a projection chain 82 successively comprising a matrix of pixels 84 capable of forming an image, lenses 86 arranged along the length of the main branch 72 and a reflection mirror 88 of the beam towards the screen 76. The matrix 84 is capable of transmitting augmented reality images received from the computer 14 and the lenses 86 ensure their projection on the screen 76.

The screen 76 is convex and has a reduced area of projection of augmented reality images. The normal in the center of the exit pupil 78 of the optical system constitutes the main axis of augmented vision noted X1 -X1. The projection chain is able to project on the screen an undeformed image on the projection zone.

A set of environment sensors of the mask designated by the reference 90 is attached to the block 70 of the optical device 18A. These sensors, for example formed of an inertial unit or an electronic compass are suitable for determining the orientation and / or the position of the vision equipment relative to the external environment. The information of these sensors are sent to the computer 14 so that the computer addresses the relevant images according to the orientation of the equipment.

The environment sensors 90 are arranged along a preferred measurement axis X2-X2 fixed with respect to the X1 -X1 direction. The axis extends parallel to the preferred viewing direction X1-X1.

According to a particular embodiment, the sensors 90 integrate an observation camera, whose observation axis extends along the axis X2-X2. Alternatively, the camera is replaced by an electronic compass to determine the Earth's magnetic field.

In the embodiment illustrated in FIG. 6, the frame 22 comprises a band 102 that is deformable, but inextensible in its length, which is added along the length of the frame 23. This strip, again designated by strip, delimits the bearing surface 24 on the face of the user. It consists, for example, of a supple and non-extensible support strip 104 covered with a layer 106 of compressible foam capable of bearing on the user's forehead. The band 102 is secured to the frame 23 by two pins 108 disposed at each end of the support strip 104. These pins 108 are engaged in orifices 1 10 formed through the frame 23. The pins are adapted to engage elastically at through orifices 1 10 and to be so retained.

The number of orifices disposed at each end of the frame 23 is greater than the number of pins 108, thus allowing the user to choose the orifices in which the pins are engaged. The length of the strip 102 being inextensible, the distance marked Z separating the strip 102 from the frame 23 is thus adjustable as a function of the orifices in which the pins 108 are engaged.

In Figure 6, the strip 102 is shown in two different positions, one of the positions being shown in phantom. The augmented reality vision equipment described here is formed of independent modules that can be easily assembled together and disassembled for replacement. These modules comprise the frame 22 of the mask, the protective visor 28, the strip 20 and the two optical devices 18A, 18B.

Each module or combination of modules 20, 22, 28, 18A, 18B is self-supporting and can be assembled and disassembled in one piece of the equipment while maintaining its integrity.

To use the vision equipment, the user first positions the band 102 on the frame 22 by selecting the orifices 1 10 in which the pins 108 are introduced so that the distance Z between the band 102 and the frame 23 allow to obtain a complete vision on the whole field of projection of augmented reality images projected on the screens 76.

After fixing the headband 102, the user puts the mask on his face and engages the headband 20 behind his skull. Under the action of the elasticity of the headband 20, the mask is placed on the face.

While the optical devices 18A, 18B project augmented reality images on the screens 76, the frame 22 of the mask is displaced in translation relative to the face of the user, by manual action thereof, until the projected images are perceived by the user, that is to say that the privileged axes of vision X1-X1 pass through the pupils of the user.

Thus, a correct alignment between the projection zones of the augmented reality images and the pupils of the user is easily obtained, by a simple manual movement of the mask, without it being necessary to resort to complex adjustments of the position of the images. screens 76 relative to the support surface 24, as is the case in equipment of the state of the art. This is why the equipment according to the invention may be devoid of such adjustment means.

The bearing surface 24 of the mask on the face of the user allows correct positioning of the pupils of the user with respect to the projection areas, without complex relative positional adjustments between the mask frame and the projection screens. are necessary.

The presence of the curved lights in the binding brackets of the frame to the strap 42 allows movement of the strap relative to the stirrups along the length of the lights in the direction of the arrow F1 illustrated in Figure 3. This displacement allows the user to position the strap for a comfortable hold of the equipment on his face. Finally, the frame 23 and the mesh 32 form a flexible and elastic structure adapted to the deformation of the inextensible strip in its length 102. This deformation of the strip ensures a homogeneous distribution of the pressure of the strip 102 on the front of the user. This deformation according to the morphology of the head of the user is controlled by the rigidity of the sidewalls 30A and 30B and by the force feedback effect of the hinges allowing the mask to conform to the shape of the user's face, without the visor and especially the two optical devices 18A, 18B are substantially displaced relative to the pupils of the user.

Indeed, when the flanks 30A, 30B deviate from each other to allow satisfactory positioning on the face of the user, the optical devices 18A, 18B which are integral are slightly displaced. Each screen 76 is thus close to the strip 102. At the same time the strip 102, retained at these ends in the vicinity of the free ends of the flanks 30A, 30B, is stretched, leading to an increased spacing between the strip 102 and the screen 76. The two effects substantially offsetting each other, the distance between the pupil of the user and the screens remains substantially constant.

The presence of the environmental sensors directly on the housing of the optical devices 18A, 18B makes it possible to guarantee a fixity of the privileged axes of vision X1-X1 and of measurement X2-X2, thus guaranteeing a correct determination of the position of the axis of privileged vision relative to its environment, even if the mount 22 is caused to deform.

As a variant, the screen 76 is integrated with the visor 28. In a variant also, the screen 76 is mechanically independent of the projection chain 82.

Claims

1. - augmented reality vision equipment comprising:

a mask (16) comprising:

- A mount (22) having a body (22A) on which is reported an inextensible band (102) defining a bearing surface (24) on the face of a user;

- a headband (20) for retaining the frame (22) on the face of the user with its bearing surface (24) bearing with the face following the periphery of the eyes;

at least one optical device (18A, 18B) comprising:

a semitransparent screen (76) fixed to the frame (22) facing the user's eye;

a projection chain (82) fixed to the frame (22), which chain of projections (82) is suitable for projecting an augmented reality image onto the semi-transparent screen (76),

characterized in that there is no means for adjusting the position of the screen (76) with respect to the bearing surface (24) when the mask is placed on the face of a user and in that the relative positions of the screen (76), the bearing surface (24) and the projection chain (82) are invariant in translation and in rotation according to the six degrees of freedom whatever the position of the equipment on the face of the user, so that the adjustment of the position of the exit pupil of the optical device (18A, 18B) relative to the user is done only by moving the equipment relative to the face of the user.

2. - Equipment according to claim 1, characterized in that the inextensible band (102) and the body (22A) of the frame (22) comprise complementary fastening means of the inextensible band (102) on the body (22A). in at least two distinct positions defining different distances (Z) between the screen (76) and the support surface (24).

3. - Equipment according to claim 2, characterized in that said complementary fixing means comprise pins (108) projecting from one of the body (22A) of the frame (22) and the inextensible band (102). ) and ports (1 10) for receiving the pins (108) in the other of the body (22A) of the frame (22) and the inextensible band (102), the number of orifices (1 10) being greater than number of pins (108).

4. - Equipment according to any one of the preceding claims, characterized in that the strip (20) comprises an elastic strap (42) adapted to bear on the skull of the user and two rigid brackets (44A, 44B) connecting the strap (42) to the frame (22) of the mask (16) at each end of the strap (42), which stirrups (44A, 44B) are hinged to the frame (22).

5. - Equipment according to claim 4, characterized in that each yoke (44A, 44B) comprises a curved bore (50) in which is received an end of the strap (42) slidably mounted along the length of the light (50) , and in that the length of the light (50) is greater than the height of the strap (42).

6. - Method of setting up an augmented reality vision equipment according to claim 1, comprising the following successive steps:

A- Position the mask in the user's field of vision;

B- providing the projection from the or each optical device of an augmented reality image on the screen (76);

C- moving the mask relative to the face by keeping the bearing surface (24) in contact with the face of the user until the user sees the augmented reality image projected on the screen, and

D- Keep the equipment thus positioned on the skull of the user with the headband (20) without modifying the relative position of the projection chain (82) relative to the pupil of the eye.

7. - Method according to claim 6, for the establishment of an equipment according to claim 2, characterized in that the inextensible band (102) is fixed in a specific position relative to the body (22A) of the frame ( 22) before positioning the mask in the field of view of the user.