WO2017076241A1

WO2017076241A1 - Display control method and device

Info

Publication number: WO2017076241A1
Application number: PCT/CN2016/103847
Authority: WO
Inventors: 郑少华; 黎剑辉; 张圳; 朱一伟; 罗海彬; 湛浩
Original assignee: 丰唐物联技术（深圳）有限公司
Priority date: 2015-11-05
Filing date: 2016-10-28
Publication date: 2017-05-11
Also published as: CN106680997A

Abstract

A display control method, comprising: projecting a projection display interface of the near-eye display technology into a display interface of a VR display screen, so that the projection display interface is superimposed in the display interface of the VR display screen (S101); in combination with the virtual real scene in the display interface of the VR display screen, adjusting the projection focus of the near-eye display technology, so as to change the display effect of the image in the projection display interface in the virtual real scene (S102). Further disclosed is a display control device. Such display method and device enhance the user's visual experience.

Description

Display control method and device

Technical field

[0001] Embodiments of the present invention relate to the field of interface display, and in particular, to a display control method and apparatus.

Background technique

[0002] Virtual Reality (VR) is a virtual world that uses computer simulation to generate a three-dimensional space, providing users with simulations of visual, auditory, tactile and other senses, making users feel like they are there. You can observe things in the third dimension without restrictions.

[0003] In the current virtual reality, the optical system can locate microdisplay, optics, and illumination, and how to ensure that the transparent area of the displayed image does not hinder the user's field of view becomes an important issue. In order not to hinder the user's field of view, allowing more content to overlap with the user's natural observations of the real world, a display control method and apparatus are needed to provide a higher quality visual experience for the user.

technical problem

[0004] An object of the present invention is to provide a display control method and apparatus for changing the display effect of an image in a projection display interface of a near-eye display technology in a virtual reality scene by adjusting a projection focal length of the near-eye display technology. Provide a higher quality visual experience.

Problem solution

Technical solution

[0005] In a first aspect, the present invention provides a display control method, the display control method comprising the steps of: [0006] projecting a projection display interface of a near-eye display technology to a display interface of a VR display screen, so that the projection display The interface is superimposed on the display interface of the VR display;

Combining the virtual reality scene in the display interface of the VR display screen, adjusting the projection focal length of the near-eye display technology, and changing the display effect of the image in the projection display interface in the virtual reality scene

In conjunction with the first aspect, in a first implementation thereof, the projection display interface of the near-eye display technology is transparently superimposed on the display interface of the VR display screen.

[0009] In combination with the first aspect and the foregoing implementation manner, in a second implementation manner of the first aspect, the combining The step of adjusting the projection focal length of the near-eye display technology and changing the display effect of the image in the virtual reality scene in the display interface of the VR display includes:

[0010] combining the virtual reality scene in the display interface of the VR display screen, adjusting the projection focal length of the near-eye display technology, and transforming the projection distance of the projection display interface of the near-eye display technology onto the display interface of the VR display screen;

[0011] Depending on the projection distance, an image in the projection display interface of the near-eye display technology is positionally changed in the virtual reality scene to change the display effect.

[0012] In combination with the first aspect and the foregoing implementation manner, in a third implementation manner of the first aspect, adjusting the near-eye display technology in the virtual reality scene in the display interface combined with the VR display screen The projection focal length, before the step of changing the display effect of the image in the projection display interface in the virtual reality scene, further includes:

[0013] The correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene is set in advance.

[0014] In combination with the first aspect and the foregoing implementation manner, in a fourth implementation manner of the first aspect, displaying, in the virtual reality scene, the projection focal length of the near-eye display technology and the image in the projection display interface After the steps of the correspondence between the effects, the method further includes:

[0015] adjusting a projection focal length of the near-eye display technology based on a correspondence between a projection focal length of a preset near-eye display technology and a display effect of an image in a projection display interface in a virtual reality scene, so that the projection display interface is adjusted The display effect of the image in the virtual reality scene changes.

[0016] In a second aspect, the present invention provides a display control device, where the display control device includes:

[0017] a projection display interface module, configured to project a projection display interface of the near-eye display technology to a display interface of the VR display screen, and superimpose the projection display interface on the display interface of the VR display screen;

[0018] a control display interface module, configured to combine a virtual reality scene in the display interface of the VR display screen, adjust a projection focal length of the near-eye display technology, and change an image in the projection display interface in the virtual reality scene The display effect in .

[0019] With reference to the second aspect, in a first implementation manner of the second aspect, the projection display interface of the near-eye display technology is transparently superimposed on the display interface of the VR display screen. [0020] In combination with the second aspect and the foregoing implementation manner, in a second implementation manner of the second aspect, the control display interface module includes:

[0021] adjusting a projection focus module for combining a virtual reality scene in a display interface of the VR display screen, adjusting a projection focal length of the near-eye display technology, and transforming a projection display interface of the near-eye display technology to a display interface of the VR display screen Projection distance

[0022] The sub-control display interface module is configured to perform position conversion on the image in the projection display interface of the near-eye display technology according to the projection distance to change the display effect.

[0023] In combination with the second aspect and the foregoing implementation manner, in a third implementation manner of the second aspect, the display control apparatus further includes:

[0024] a preset correspondence relationship module configured to preset a correspondence between a projection focal length of the near-eye display technology and a display effect of the image in the projection display interface in the virtual reality scene.

[0025] In combination with the second aspect and the foregoing implementation manner, in a fourth implementation manner of the second aspect, the display control apparatus further includes:

a first sub-control display interface module, configured to adjust the near-eye display technology based on a correspondence between a projection focal length of a preset near-eye display technology and a display effect of an image in a projection display interface in a virtual reality scene The projection focal length changes the display effect of the image in the projection display interface in the virtual reality scene.

Advantageous effects of the invention

Beneficial effect

[0027] The display control method and device provided by the embodiment of the present invention, by projecting the projection display interface of the near-eye display technology to the display interface of the VR display screen, adjusting the projection focal length of the near-eye display technology, so that the projection display interface is on the VR display screen. The position change is performed in the display interface, thereby changing the display effect of the image in the projection display interface in the virtual reality scene, and enhancing the visual experience of the user.

Brief description of the drawing

DRAWINGS

1 is a flow chart of one embodiment of a display control method of the present invention;

2 is a schematic structural view of an embodiment of a display control device according to the present invention. Embodiments of the invention

[0030] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention, rather than the invention. It is also to be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

Those skilled in the art can understand that the idea of the display control method and apparatus described in the embodiments of the present invention is mainly to emphasize the following process: the user observes the scene of the three-dimensional space by using the helmet display, and projects the projection of the near-eye display technology. The display interface is projected onto the display interface of the VR display screen, and the projection display interface is transparently superimposed on the display interface of the VR display screen, and the projection focal length of the near-eye display technology is adjusted to make the projection display interface of the near-eye display technology The image is transformed in the virtual reality scene to change the contrast and the angle of view to provide a higher quality visual experience for the user. Therefore, the present invention does not specifically limit the type and specific presentation manner of the display control device. The description of the display control method and apparatus is as described above, and in the following specific embodiments for describing the corresponding technical solutions, the above description will not be repeated.

[0032] Embodiment 1:

1 shows an implementation flow of an embodiment of a display control method of the present invention, which is described in detail as follows:

[0034] Step S101: Projecting a projection display interface of the near-eye display technology to a display interface of the VR display screen, so that the projection display interface is superimposed on the display interface of the VR display screen.

[0035] Technology for Near Eye Display (NED) described in the embodiments of the present invention

It is mainly realized by a near-eye display system (also called a head-mounted display), and has the characteristics of being sturdy and portable, and can be a single-purpose prism type helmet display or a single-purpose eyepiece type helmet display, which can be understood by those skilled in the art. The embodiment of the present invention does not specifically limit the type and form of the near-eye display system, as long as the idea of the present invention can be implemented.

[0036] The display interface described in the embodiment of the present invention includes two, one is a projection display interface of the near-eye display technology, and the other is a display interface of the VR helmet display, and the projection display interface of the near-eye display technology is projected onto the VR display screen. The display interface, that is, the projection display interface of the near-eye display technology is projected onto the display interface of the VR helmet display, so that the projection display interface of the near-eye display technology is transparently superimposed on the display interface of the VR display screen. [0037] The virtual reality scene described in the embodiment of the present invention exists in the display interface of the VR display screen, and is a simulation of a natural scene by using a three-dimensional computer graphics technology and a wide-angle stereoscopic display technology, and uses a near-eye display system. The projection mirror projects a projection display interface of the near-eye display technology to a display interface of the VR display screen, the projection mirror includes a plurality of lens groups, wherein each lens group includes a plurality of zoom projection lenses having positive refractive power, or Multiple zoom projection lenses with negative refractive power. It can be understood by those skilled in the art that the number of the lens groups included in the projection mirror, the number of the zoom projection lenses included in each lens group, and the order of arrangement of the lens groups are not specifically limited, as long as the present invention can be implemented. The idea can be.

[0038] A specific embodiment includes, in order from the object, a first lens group having positive refractive power, a second lens group having negative refractive power, a third lens group having positive refractive power, and positive refractive power. The fourth lens group. When zooming from the wide-angle end state to the telephoto end state, the distance between the first lens group and the second lens group increases, the distance between the second lens group and the third lens group decreases, and the The distance between the three lens group and the fourth lens group changes.

[0039] Step S102: Adjust a projection focal length of the near-eye display technology in combination with a virtual reality scene in a display interface of the VR display screen, and change a display effect of an image in the projection display interface in the virtual reality scene. .

[0040] In the embodiment of the present invention, the virtual reality scene exists in the display interface of the VR display screen, and the projection display interface is transparently superimposed on the virtual reality scene, and the projection focal length of the near-eye display technology described in the embodiment of the present invention is used. Means that the projection lens in the near-eye display system projects the focal length of the projection display interface of the near-eye display technology, adjusts the projection focal length, changes the contrast and the angle of view, and causes the image in the projection display interface to be in the virtual reality scene. Position change to provide users with a higher quality visual experience

[0041] Further, the virtual reality scene in the display interface of the VR display screen is adjusted, the projection focal length of the near-eye display technology is adjusted, and the image in the projection display interface is changed in the virtual reality scene. Display effects, including:

[0042] combining the virtual reality scene in the display interface of the VR display screen to adjust the projection focal length of the near-eye display technology

Transforming a projection distance of the projection display interface of the near-eye display technology onto a display interface of the VR display screen; [0043] according to the projection distance, the image in the projection display interface of the near-eye display technology is positionally changed in the virtual reality scene to change the display effect.

[0044] In the embodiment of the present invention, the projection focal length has a corresponding relationship with the projection distance and the virtual reality scene, and the user uses the projection mirror in the near-eye display system to project the projection display interface of the near-eye display technology at the same position, the virtual The realistic scene is unchanged, and the projection distance of the projection display interface of the near-eye display technology is transformed by adjusting the projection focal length, so that the image in the projection display interface of the near-eye display technology is transformed in the virtual reality scene. That is, the image in the projection display interface of the near-eye display technology is farther or closer to the perspective of the human eye in the virtual reality scene, wherein the ratio between the projection distance and the virtual reality scene is called a projection ratio. The projection ratio has a corresponding relationship with the projection display interface in the near-eye display technology. The smaller the projection ratio is, the same projection distance is displayed, and the width of the virtual reality scene is larger, and those skilled in the art can It is understood that the projection focal length and the projection distance and the virtual image in the embodiment of the present invention Correspondence between the real scene is not particularly limited, range of values than the projection is not particularly limited as long as the implementation of the invention can be thought.

[0045] Further, in the virtual reality scene in the display interface combined with the VR display screen, adjusting a projection focal length of the near-eye display technology, and changing an image in the projection display interface in the virtual reality scene Before the step of displaying the effect, the method further comprises: presetting the correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene.

[0046] In the embodiment of the present invention, the correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene may be preset, based on the projection focal length of the preset near-eye display technology. Corresponding relationship between the display effects of the images in the virtual reality scene in the projection display interface, adjusting the projection focal length of the near-eye display technology, changing the contrast and the angle of view, so that the images in the projection display interface are in the virtual reality scene The display effect in the change. A person skilled in the art can understand that the correspondence between the projection focal length of the preset near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene is not specifically limited, as long as the present invention can be implemented. The idea can be.

[0047] It should be noted that the ideal near-eye display technology should provide a transparent display interface, has high definition, does not hinder the real world sense of the end user, can be realized by maximally increasing the contrast of the optical system, and near-eye display Multiple elements in the technology can affect the contrast, such as: Optical design aperture The numerical value, the image processing algorithm, the filling factor of the display device, and the like, wherein the aperture value is a ratio of a focal length of the projection lens to a diameter of the incident through hole, and the larger the aperture value, the higher the contrast, but the balance is required to be balanced with the angle of view. It will be understood by those skilled in the art that the embodiments of the present invention do not consider the influence of a plurality of elements in the near-eye display technology on the contrast, as long as the idea of the present invention can be implemented.

The display control method provided by the embodiment of the present invention projects the projection display interface of the near-eye display technology to the display interface of the VR display screen, so that the projection display interface is transparently superimposed on the display interface of the VR display screen. Adjusting the projection focal length of the near-eye display technology, changing the contrast and the angle of view, thereby changing the display effect of the image in the projection display interface in the virtual reality scene, and providing the user with a higher quality visual experience.

[0049] Embodiment 2:

2 is a schematic structural view showing an embodiment of a display control device according to the present invention, which is described in detail as follows:

The display control device of the embodiment of the present invention includes: a projection display interface module 21, and a control display interface module 22, wherein

[0052] a projection display interface module 21, configured to project a projection display interface of the near-eye display technology to a display interface of the VR display screen, and superimpose the projection display interface on the display interface of the VR display screen;

[0053] a control display interface module 22, configured to combine a virtual reality scene in the display interface of the VR display screen, adjust a projection focal length of the near-eye display technology, and change an image in the projection display interface in the virtual reality The display effect in the scene.

[0054] The technology for Near Eye Display (NED) described in the embodiments of the present invention is mainly realized by a near-eye display system (also referred to as a head-mounted display), and has the characteristics of being sturdy and portable, and can be single-purpose. The prism type helmet display may also be a single-purpose eyepiece type helmet display. It can be understood by those skilled in the art that the type and form of the near-eye display system are not specifically limited in the embodiment of the present invention, as long as the idea of the present invention can be implemented. .

[0055] The display interface described in the embodiment of the present invention includes two, one is a projection display interface of the near-eye display technology, the other is a display interface of the VR helmet display, and the projection display interface module 21 projects the projection display interface of the near-eye display technology. The display interface of the VR display screen, that is, the projection display interface module 21 projects the projection display interface of the near-eye display technology to the display interface of the VR helmet display, so that the projection display interface of the near-eye display technology is transparently superimposed on the VR In the display interface of the display. [0056] The virtual reality scene described in the embodiment of the present invention exists in the display interface of the VR display screen, and is a simulation of a natural scene by using a three-dimensional computer graphics technology and a wide-angle stereoscopic display technology, and uses a near-eye display system. The projection mirror projects a projection display interface of the near-eye display technology to a display interface of the VR display screen, the projection mirror includes a plurality of lens groups, wherein each lens group includes a plurality of zoom projection lenses having positive refractive power, or Multiple zoom projection lenses with negative refractive power. It can be understood by those skilled in the art that the number of the lens groups included in the projection mirror, the number of the zoom projection lenses included in each lens group, and the order of arrangement of the lens groups are not specifically limited, as long as the present invention can be implemented. The idea can be.

[0057] A specific embodiment includes, in order from the object, a first lens group having positive refractive power, a second lens group having negative refractive power, a third lens group having positive refractive power, and positive refractive power. The fourth lens group. When zooming from the wide-angle end state to the telephoto end state, the distance between the first lens group and the second lens group increases, the distance between the second lens group and the third lens group decreases, and the The distance between the three lens group and the fourth lens group changes.

[0058] In the embodiment of the present invention, the virtual reality scene exists in the display interface of the VR display screen, and the projection display interface is transparently superimposed on the virtual reality scene, and the projection focal length of the near-eye display technology described in the embodiment of the present invention is used. Means that the projection lens in the near-eye display system projects the focal length of the projection display interface of the near-eye display technology, and the control display interface module 22 adjusts the projection focal length, changes the contrast and the angle of view, so that the image in the projection display interface is in the Position change in the virtual reality scene to provide users with a higher quality visual experience.

[0059] Further, the control display interface module 22 includes:

[0060] adjusting a projection focus module for combining a virtual reality scene in a display interface of the VR display screen, adjusting a projection focal length of the near-eye display technology, and transforming the projection display interface of the near-eye display technology to a display interface of the VR display screen Projection distance

[0061] The sub-control display interface module is configured to perform position conversion on the image in the projection display interface of the near-eye display technology according to the projection distance to change the display effect.

[0062] In the embodiment of the present invention, the projection focal length has a corresponding relationship with the projection distance and the virtual reality scene, and the user uses the projection mirror in the near-eye display system to project the projection display interface of the near-eye display technology at the same position, the virtual The real scene is unchanged, and the projection focal length module is adjusted in combination with the display interface of the VR display. a virtual reality scene, by adjusting a projection focal length to transform a projection distance of the projection display interface projection of the near-eye display technology, and the sub-control display interface module causes an image in the projection display interface of the near-eye display technology according to the projection distance Performing a positional transformation in the virtual reality scene, that is, making an image in the projection display interface of the near-eye display technology farther or closer to a perspective of the human eye in the virtual reality scene, wherein the projection distance and the virtual distance The ratio between the actual scenes is called a projection ratio, and the projection ratio has a corresponding relationship with the projection display interface in the near-eye display technology. The smaller the projection ratio is, the same projection distance is illustrated, and the virtual reality scene is presented. The larger the width, the person skilled in the art can understand that the correspondence between the projection focal length and the projection distance and the virtual reality scene is not specifically limited in the embodiment of the present invention, and the numerical range of the projection ratio is not specifically limited, as long as the present invention can be realized. The idea of the invention can be.

[0063] Further, the display control device further includes:

And a preset correspondence relationship module, configured to preset a correspondence between a projection focal length of the near-eye display technology and a display effect of the image in the projection display interface in the virtual reality scene.

[0065] The display control device further includes:

[0066] a first sub-control display interface module, configured to adjust the near-eye display technology based on a correspondence between a projection focal length of a preset near-eye display technology and a display effect of an image in a projection display interface in a virtual reality scene The projection focal length changes the display effect of the image in the projection display interface in the virtual reality scene.

[0067] a first sub-control display interface module, configured to adjust the near-eye display technology based on a correspondence between a projection focal length of a preset near-eye display technology and a display effect of an image in a projection display interface in a virtual reality scene The projection focal length changes the display effect of the image in the projection display interface in the virtual reality scene.

In the embodiment of the present invention, the first sub-control display interface module may preset the correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene, the first sub-control The display interface module adjusts a projection focal length of the near-eye display technology to change a contrast and a viewing angle based on a correspondence between a projection focal length of a preset near-eye display technology and a display effect of an image in the projection display interface in a virtual reality scene. Thereby, the display effect of the image in the projection display interface in the virtual reality scene is changed. Those skilled in the art can understand that the embodiment of the present invention The correspondence relationship between the projection focal length of the preset near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene is not particularly limited as long as the idea of the present invention can be achieved.

[0069] It should be noted that the ideal near-eye display technology should provide a transparent display interface with high definition, does not hinder the real world sense of the end user, can be achieved by maximizing the contrast of the optical system, and near-eye display. A plurality of elements in the technology can affect the contrast, such as: an aperture value of an optical design, an image processing algorithm, a fill factor of a display device, etc., wherein the aperture value is a focal length of the projection lens and a diameter of the incident through hole. The ratio, the larger the aperture value, the higher the contrast, but the balance of the angle of view, and those skilled in the art can understand that the embodiment of the present invention does not consider the influence of multiple elements in the near-eye display technology on the contrast, as long as it can be realized. The idea of the present invention is sufficient.

According to the display control device provided by the embodiment of the present invention, the projection display interface module projects the projection display interface of the near-eye display technology to the display interface of the VR display screen, so that the projection display interface is transparently superimposed on the VR display screen. In the display interface, the control display interface module combines the virtual reality scene in the display interface of the VR display screen, adjusts the projection focal length of the near-eye display technology, changes the contrast and the angle of view, thereby changing the image in the projection display interface. The display effect in the virtual reality scene provides the user with a higher quality visual experience.

The above is only the preferred embodiment of the present invention, and is not intended to limit the invention, and any modifications, equivalents, and improvements made within the spirit and scope of the present invention should be included in the present invention. Within the scope of protection of the invention.

Claims

Claim

[Claim 1] A display control method, wherein the display control method includes the following steps: projecting a projection display interface of a near-eye display technology to a display interface of a VR display screen, and superimposing the projection display interface on the display interface In the display interface of the VR display;

Combining the virtual reality scene in the display interface of the VR display screen, adjusting the projection focal length of the near-eye display technology, and changing the display effect of the image in the projection display interface in the virtual reality scene.

[Claim 2] The display control method according to claim 1, wherein the projection display interface of the near-eye display technology is transparently superimposed on the display interface of the VR display screen.

The display control method according to claim 2, wherein the virtual reality scene in the display interface of the VR display screen is combined with the projection focal length of the near-eye display technology, and the The step of projecting the display effect of the image in the virtual reality scene in the display interface includes:

Combining the virtual reality scene in the display interface of the VR display screen, adjusting the projection focal length of the near-eye display technology, and transforming the projection distance of the projection display interface of the near-eye display technology onto the display interface of the VR display screen;

And according to the projection distance, the image in the projection display interface of the near-eye display technology is positionally changed in the virtual reality scene to change the display effect.

The display control method according to claim 1, wherein in the virtual reality scene in the display interface combined with the VR display screen, the projection focal length of the near-eye display technology is adjusted, and the Before the step of displaying the effect of the image in the virtual reality scene in the projection display interface, the method further includes:

The correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene is set in advance.

[Claim 5] The display control method according to claim 4, wherein a correspondence between the projection focal length of the near-eye display technology and the display effect of the image in the projection display interface in the virtual reality scene is set in advance After the step of the relationship, the method further includes: a projection focal length based on the preset near-eye display technology and an image in the projection display interface Corresponding relationship between the display effects in the virtual reality scene, adjusting the projection focal length of the near-eye display technology, and changing the display effect of the image in the projection display interface in the virtual reality scene.

A display control device, comprising: a projection display interface module, configured to project a projection display interface of a near-eye display technology to a display interface of a VR display screen, and superimpose the projection display interface on the display interface In the display interface of the VR display;

Controlling a display interface module, configured to combine a virtual reality scene in the display interface of the VR display screen, adjust a projection focal length of the near-eye display technology, and change a display of an image in the projection display interface in the virtual reality scene effect.

The display control device according to claim 6, wherein the projection display interface of the near-eye display technology is transparently superimposed on the display interface of the VR display screen.

The display control device according to claim 2, wherein the control display interface module comprises:

Adjusting a projection focal length module for combining a virtual reality scene in a display interface of the VR display screen, adjusting a projection focal length of the near-eye display technology, and transforming a projection distance of the projection display interface of the near-eye display technology onto a display interface of the VR display screen;

The sub-control display interface module is configured to perform position conversion on the image in the projection display interface of the near-eye display technology according to the projection distance to change the display effect.

The display control device according to claim 6, wherein the display control device further comprises:

The preset correspondence module is configured to preset a correspondence between a projection focal length of the near-eye display technology and a display effect of the image in the projection display interface in the virtual reality scene. The display control device according to claim 9, wherein the display control device further comprises:

a first sub-control display interface module for pairing between a projection focal length based on a preset near-eye display technology and a display effect of an image in the projection display interface in a virtual reality scene It should be noted that the projection focal length of the near-eye display technology is adjusted to change the display effect of the image in the projection display interface in the virtual reality scene.