WO2016060293A1 - Image information display device and control method therefor - Google Patents

Abstract

The present invention relates to a glass-type image information display device capable of displaying image information, and a control method therefor, the device comprising: a main body comprising a plurality of glass display units respectively corresponding to both eyes of a user; a detection unit for detecting a peripheral situation of the main body; a memory including information on a prioritized eye and a non-prioritized eye of the user; and a control unit for displaying image information related to multimedia content and image information related to at least one of functions executable in the image information display device on at least one of the plurality of display units, wherein, if a preset function is executed, the control unit displays image information related to the function on a display unit corresponding to the prioritized eye of the user according to the detection result of the peripheral situation of the main body, and the preset function includes a navigation function and a function related to the navigation function.

Description

Image information display device and control method thereof

The present invention relates to a glass type image information display apparatus capable of displaying image information and a method of controlling the apparatus.

With the rapid development of the information age, image information display devices continue to develop in newer forms. For example, if the image information display device is conventionally displayed in a form of displaying information on a fixed device such as a TV or a monitor, it is now light and small enough to be carried by a user, and thus, in various forms such as a mobile terminal or a notebook. It has been developed.

In addition, at present, the image information display device has become smaller and has evolved into a wearable form that a user can wear like a watch or glasses. Accordingly, various devices such as smart watches are emerging, and accordingly, technology for displaying image information has been developed day by day.

On the other hand, displays capable of displaying image information are also being developed in new forms thanks to the development of these technologies. For example, the current display may be manufactured in a transparent form through which objects located on the back of the display may be seen, and thus may be implemented in the form of glasses. Such a glass-type image information display device can not only display image information according to a user's selection, but also allow the user to visually check the external environment through the display.

On the other hand, such a glass-type image information display device, as described above can recognize the external environment through the display, it can provide a variety of functions using the same. Accordingly, there is an active research into a method of displaying image information more effectively in the glass type image information display apparatus.

SUMMARY OF THE INVENTION An object of the present invention is to provide an image information display apparatus and a method of controlling the apparatus that can display image information more effectively based on an external environment in a glass type image information display apparatus.

According to an aspect of the present invention to achieve the above or another object, the image information display device according to an embodiment of the present invention, the front portion and the rear portion, is formed to be transparent to reflect the objects located on the rear side and the user A main body including a plurality of glass display units respectively corresponding to both eyes, a sensing unit detecting a situation around the main body, a memory including information about the superior and non-eligible eyes of the user, and at least one of the plurality of display units. The controller may further include a controller configured to display image information related to multimedia content and image information related to at least one of functions executable on the image information display apparatus. Based on the results of detecting the situation of the current user to determine the situation of the user, Depending on the result of the determination to the image information related to the function in which the execution characterized in that displayed on the display unit corresponding to within the user's advantage.

According to an embodiment, the controller may determine whether the user's position is moved based on a result of sensing the surrounding situation of the main body, and according to the determination result, the image information related to the function is stored in the user's superiority. The preset function is displayed on a corresponding display unit, wherein the preset function is a function related to the navigation function and the navigation function.

In one embodiment, the sensing unit includes a camera that receives an image outside the main body, and the control unit is configured to determine the situation of the user based on a degree that an image received from the camera is changed within a predetermined time. It is characterized by.

In one embodiment, the sensing unit further comprises at least one sensor for detecting the movement of the user, the control unit, in the state where the user's position is moved, to the user's movement detected from the sensing unit It is characterized by determining the situation of the user based on.

According to an embodiment of the present disclosure, if the detected movement of the user is less than a predetermined level, the controller determines that the user is moving by using a vehicle and based on whether the user is a driver of the vehicle. And displaying image information related to the function on a display unit corresponding to the user's superiority.

According to an embodiment, the controller may determine whether the user is a driver driving the vehicle based on whether the vehicle in which the user rides is a preset vehicle.

In one embodiment, the control unit, through the vehicle control unit for controlling the overall driving of the vehicle means for detecting the position of the driver's seat of the vehicle, the user based on the position of the driver's seat and the position of the main body the transportation It is characterized by determining whether the driver is driving the means.

According to an embodiment of the present disclosure, the function related to the navigation function may include a function of displaying information about a feature around a user's current location.

According to an embodiment, the preset function may include a function executed by a preset event, wherein the preset event occurs when a message is received or a call is received.

According to an embodiment of the present disclosure, when the preset event occurs, the controller evaluates the importance of the generated event and based on the evaluated importance, the image information related to the generated event corresponds to the superiority of the user. It is characterized by displaying on the display unit.

According to an embodiment of the present disclosure, when the preset event is reception of a message, the controller may evaluate the importance based on text included in the message.

According to an embodiment of the present disclosure, the control unit searches whether the text included in the message includes a preset word, and when the at least one preset word is searched for, adding the importance scores differently matched to each word. Based on the evaluation of the importance of the message.

According to an embodiment of the present disclosure, when the preset event is a call, the controller may evaluate the importance based on the telephone number of the received call.

According to an embodiment of the present disclosure, the controller may detect surrounding situations of different main bodies according to the executed function.

In one embodiment, the preset function includes a function of displaying notification information for notifying the user when an object approaching the user is detected within a predetermined distance, and the controller controls the environment around the main body. As a result of the detection, based on the illuminance around the main body below a preset level and at least one of the regions where the main body is located, notification information for notifying the approach of the object is displayed on the display unit corresponding to the superiority of the user. Characterized in that.

According to an embodiment of the present disclosure, the controller may classify the type of the multimedia content and display image information related to the multimedia content in a display unit corresponding to the user's superiority according to the type of the multimedia content.

According to an embodiment of the present disclosure, in a state in which image information related to the multimedia content is displayed on all of the display units, when a predetermined event occurs, the control unit corresponds to notification information of the generated event within a user's superiority. It is characterized by displaying on the display unit.

The control unit may determine the position of the image information displayed on the display unit corresponding to the superiority, based on a result of detecting a situation around the user.

The control unit may display the image information in an area other than a display area in which preset objects are identifiably displayed among objects displayed on the display unit corresponding to the superiority.

According to an aspect of the present invention to achieve the above or another object, the control method of the image information display apparatus according to an embodiment of the present invention, the step of determining whether or not to execute a predetermined function, and the predetermined function is executed And determining a situation of a user by detecting a situation around the main body of the image information display device, and based on the determined situation of the user, image information related to the execution of the preset function is stored in the plurality of glasses. And displaying on a display unit corresponding to the superiority of the user among the display units.

The effects of the image information display device and control method thereof according to the present invention will be described below.

According to at least one of the embodiments of the present invention, the present invention determines whether the image information to be displayed on the display unit should be recognized by the user sooner, so that the image information is output to the specific display unit, so that the user It is advantageous in that image information can be recognized more quickly and accurately.

In addition, according to at least one of the embodiments of the present invention, the present invention senses the surrounding situation, and based on the detected surrounding situation to output image information related to a predetermined function or event on a specific display, the user It is advantageous in that image information can be recognized quickly and accurately.

1 is a block diagram showing a block configuration of an image information display apparatus according to an embodiment of the present invention.

2 is an exemplary diagram illustrating an example in which an image information display apparatus according to an exemplary embodiment of the present invention is implemented in a glass type.

3 is a flowchart illustrating an operation of displaying image information based on a currently performed function and a sensed surrounding situation by an image information display apparatus according to an exemplary embodiment.

4 is a flowchart illustrating an operation of evaluating the importance of an event generated and displaying image information according to the image information display apparatus according to an exemplary embodiment of the present invention.

5 is a flowchart illustrating an operation process of detecting an ambient situation and displaying image information according to the image information display apparatus according to an exemplary embodiment of the present invention.

6 is an exemplary view illustrating an example in which image information is displayed in the image information display apparatus according to an exemplary embodiment of the present invention.

7 is an exemplary view showing another example in which image information is displayed in the image information display apparatus according to the embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, and the same or similar components will be given the same or similar reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, but are not limited to the technical spirit disclosed herein by the accompanying drawings, all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

The image information display device described herein includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant, a portable multimedia player, a navigation, and a slate PC. PCs, tablet PCs, ultrabooks, wearable devices, such as smartwatches, glass glasses, head mounted displays, or smart A smart lens or the like.

1 is a block diagram showing a block configuration of an image information display device according to an exemplary embodiment of the present invention.

Referring to FIG. 1, an image information display apparatus 100 according to an exemplary embodiment may include a display 130, a detector 120, a memory 140, and the like. In addition, the components shown in FIG. 1 are not essential in implementing an image information display apparatus according to an exemplary embodiment of the present invention, and thus, the image information display apparatus described in the present specification may have more components than those listed above. May have For example, although not shown, the image information display apparatus according to an embodiment of the present invention may further include a sound output unit, a wireless communication unit, and the like. Alternatively, on the contrary, it may have fewer components than described above.

More specifically, the display unit 130 among the components displays (outputs) information processed by the image information display apparatus 100. For example, the display unit 130 may display execution screen information of an application program driven by the image information display apparatus 100 or user interface (UI) and graphical user interface (GUI) information according to the execution screen information. Can be.

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image. The stereoscopic display unit may be a three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), a projection method (holographic method).

The display 130 may be provided in plural. When the image information display apparatus 100 according to the exemplary embodiment of the present invention is manufactured in a glass type, the first and second display units corresponding to both eyes of the user may be provided. 132 and 134 may be implemented. In this case, the display 130 may display the same image information on the first and second display units 132 and 134 or display different image information, respectively, under the control of the controller 110. Alternatively, the image information may be displayed only in any one of the control unit 110.

The sensor 120 may include at least one sensor for sensing the surrounding environment information surrounding the image information display apparatus 100 or a user's input. For example, the detector 120 may include a location sensor, and the location sensor may detect the location of the current image information display device 100. Representative examples of such position sensing sensors include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, the mobile terminal may acquire the location of the image information display apparatus 100 using a signal transmitted from a GPS satellite. As another example, the image information display apparatus 100 may obtain the position of the image information display apparatus 100 based on the information of the WIFI module and the wireless access point (AP) that transmits or receives the wireless signal. The location information sensor is not limited to a component that directly calculates or acquires the location of the image information display apparatus 100.

Meanwhile, the sensing unit 120 may include an acceleration sensor, a magnetic sensor, a gravity sensor, a gyroscope sensor, a motion sensor, a motion sensor, and an optical sensor. , For example, a camera). On the other hand, the image information display apparatus 100 disclosed in the present disclosure may utilize a combination of information detected by at least two or more of these sensors.

The memory 140 may store a program for the operation of the controller 110, and may temporarily store input / output data (eg, a still image, a video, etc.). The memory 140 may store data relating to sound of various patterns output from the image information display apparatus 100. In addition, the memory 140 may store a plurality of application programs or applications that are driven by the image information display apparatus 100, data for operating the image information display apparatus 100, and instructions. At least some of these applications may be downloaded from an external server via wireless communication. In addition, at least some of these applications may be used for the basic functions of the image information display apparatus 100 (for example, a function of adjusting the size and resolution of the image information such as a moving image or a still image, a focal length, etc.) It may exist on the image information display device 100 from the time of shipment. On the other hand, the application program is stored in the memory 140, installed on the image information display apparatus 100, and driven to perform an operation (or function) of the image information display apparatus 100 by the controller 110. Can be.

The memory 140 may include a storage medium of a type such as a flash memory type, a hard disk type, a card type memory (eg, SD or XD memory, etc.). In addition, the projection apparatus 100 may be operated in connection with a web storage that performs a storage function of the memory 140 on the Internet.

In addition to the operation related to the application program, the controller 110 typically controls the overall operation of the screen information display apparatus 100. The controller 110 processes at least one of the display units 132 and 134 by using the above-described components to process signals, data, information, and the like, which are input or output, or to drive an application program stored in the memory 140. It is possible to display a single function or to provide a function appropriate to a user with respect to displayed image information.

The controller 110 may display image information corresponding to a function selected by a user on at least one of the display units 132 and 134. The controller 110 may display image information on the selected function only on all or one of the display units 132 and 134 based on the function selected by the user.

Alternatively, the controller 110 may select a display unit to display the image information according to the type of the function selected by the user. That is, when a function selected by a user is a function that is preset to be displayed on both the display units 132 and 134, the controller 110 may output image information about the selected function to both the display units 132 and 134. have. For example, when the function selected by the user is a function of playing a multimedia content such as a movie or a drama, the controller 110 may output image information about the multimedia content to both the display units 132 and 134. However, if the function selected by the user is not a function of playing the multimedia content, the controller 110 may display image information corresponding to the currently selected function on only one of the display units 132 and 134.

Here, the multimedia content may be preset by the user or may be preset when the image information display apparatus 100 according to the embodiment of the present invention is shipped. For example, content that a user can comfortably enjoy for interest, such as a movie or a game, may be preset as the multimedia content.

The controller 110 may evaluate the importance of the image information to be displayed on the display units 132 and 134 so that the image information is displayed on a specific display unit among the display units 132 and 134. For example, if the image information to be displayed on the display units 132 and 134 is not a function of playing the multimedia content, the controller 110 confirms the image information to be displayed on the display units 132 and 134 by the user. It is also possible to determine whether or not to and to display the image information related to the selected function according to the determined result on the particular display unit.

In this case, the controller 110 may determine whether the image information to be displayed on the display units 132 and 134 should be checked by the user, and the surrounding situation of the image information display apparatus 100 and the currently selected function. The result of detecting is available. That is, if it is determined that the user is moving as a result of sensing the environment around the user, the controller 110 must check the function for displaying the current location of the user or a function related thereto. Can be determined as information to be recognized. In this case, the controller 110 may allow the image information to be displayed on a specific display unit among the display units 132 and 134 in the case of the image information determined to be recognized by the user.

More preferably, the controller 110 may display the image information determined to be recognized by the user on a display unit corresponding to the user's superiority. This is because, when the image information display apparatus 100 according to the exemplary embodiment of the present invention has a glass shape, when the image information is displayed on the display unit at the position corresponding to the upper eye, the user may recognize the information more quickly and accurately.

In this case, the term “right yuan” refers to the eyes of the user's binocular that they use more consciously or unconsciously than the other. Accordingly, the visual information recognized through the superior eye can be recognized faster and more accurately than the visual information recognized through the unbiased eye. Such superiority may be different for each person, and the controller 110 may receive a test result according to a preset method or use the result of detecting the superiority of the user using a test application stored in the memory 140. . The detected superiority information may be stored in the memory 140, and may be provided to the controller 110 when requested by the controller 110.

The controller 110 may select a display unit corresponding to the user's superiority using information on the user's superiority stored in the memory 140. Accordingly, the controller 110 may display the image information determined to be recognized by the user in a display unit corresponding to the user's superiority.

The controller 110 may determine image information that the user must recognize based on a function that is currently executed in the image information display apparatus 100. For example, if a function to be executed based on a user's selection or a result of sensing an environment around the user is one of preset functions, the controller 110 must recognize the image information related to the function. It can also determine with image information. The controller 110 may display the image information on the display unit corresponding to the user's superiority.

The preset functions may be, for example, a function that outputs information that a user must recognize. For example, these features provide information about the user's current location or other information related to the current location (e.g. navigation-related features such as displaying navigation or features around the user's location). And so on. Alternatively, the present invention may be a function for recognizing an object approaching a certain distance or the like and informing the user of the object. These functions may be previously selected by the user, or may be preset in advance from the factory when the image information display apparatus 100 according to an exemplary embodiment of the present invention is provided.

Meanwhile, even if the function to be executed is one of the preset functions, the controller 110 may display the image information based on a result of detecting the user's surrounding environment (the display unit corresponding to the user's edge). Of course, you can make it appear). For example, when the navigation function is performed according to the user's selection, if the user's location moves while there is little user's movement as a result of sensing the user's surroundings, the control unit 110 controls that the user transports the vehicle. It can be determined to move by means. In this case, although the navigation function is a function included in the preset function, the controller 110 may not display image information related to the navigation function on the display unit corresponding to the user's superiority. In addition, in the case of a function for notifying that there is an object approaching the user within a predetermined distance, the controller 110 detects the surrounding environment of the user, and when the illuminance is lower than a predetermined level (that is, in a dark area where the illuminance is lower than a predetermined level). The notification information may be displayed on the display unit corresponding to the user's edge.

Although not shown, the sound output unit may output audio data related to image information currently displayed on the display units 132 and 134 under the control of the controller 110. The sound output unit may include a connection port that may be connected to a connectable sound output device, for example, an earphone or the like, and the sound data transmitted through the connection port may be controlled by the controller 110. Volume may be output through the connected sound output device according to.

In addition, although not shown, the image information display apparatus 100 according to an exemplary embodiment of the present invention may further include a communication module capable of performing a communication function with another external device or a preset external server. For example, the communication module uses the communication module such as Bluetooth, WIFI (Wireless-Fidelity), infrared communication, near field communication (NFC), and the like to communicate the image information display device 100 with the wireless communication system. ) And other mobile terminals. The short range wireless communication network may be short range wireless personal area networks.

Here, the other mobile terminal is a wearable device capable of exchanging (or interworking) data with the image information display apparatus 100 according to the present invention, for example, a smartwatch, a smart glasses ( smart glass, head mounted display (HMD).

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of the image information display apparatus 100 according to various embodiments described below. In addition, the operation, control, or control method of the image information display apparatus 100 may be implemented by driving at least one application program stored in the memory 140. In addition, the following various embodiments may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

2 is an exemplary diagram illustrating an example in which an image information display apparatus according to an exemplary embodiment of the present invention is implemented in a glass type.

The image information providing apparatus 200 according to an exemplary embodiment of the present invention may be manufactured in the form of glasses as shown in FIG. 2 and may be configured to be worn on the head of a human body. And it may be provided with a frame portion (case, housing, etc.) for this. In addition, the frame portion 201 may be formed of a flexible material to facilitate wearing.

The frame part 201 is supported by the head and provides a space in which various components are mounted. As illustrated, electronic components such as the control module 280, the sound output module 252, and the like may be mounted in the frame unit. In addition, the frame unit 201 may include a plurality of display units 251a and 251b disposed at positions corresponding to the left eye and the right eye, respectively. In addition, the display units 251a and 251b have light transmittance and may output image information.

The image information refers to a virtual graphic object generated by the glass type image information providing apparatus 200 or received from an external device. For example, the virtual object may mean an application, an icon corresponding to the icon, content, or a UI in a call mode. This may be generated by the controller 110 or received from an eyeglass terminal such as a smart phone. In this case, since the display units 251a and 251b have light transmittance, the user may see the external environment through the display units 251a and 251b.

According to an embodiment, the display units 251a and 251b may display an external environment and output information on any external object constituting the external environment. For example, the external object may be a business card, a person or an external device that can communicate with each other, or a building or a building that becomes a landmark of a specific region.

The control module 280 is configured to control various electronic components included in the glass type image information providing apparatus 200. The control module 280 may be understood as a configuration corresponding to the controller 110 described above. In this figure, the control module 280 is illustrated to be installed in the frame portion 201 on the head. However, the position of the control module 280 is not limited thereto.

The display units 251a and 251b may be implemented in the form of a head mounted display (HMD). The HMD type is a display method mounted on the head and showing an image directly in front of the user's eyes. Accordingly, when the user wears the glass type image information providing apparatus 200, an image may be directly provided in front of the user's eyes through at least one of the display units 251a and 251b.

Meanwhile, the display units 251a and 251b may project an image to the eyes of a user using a prism. In addition, the prism can be formed translucent so that the user can see the projected image and the general field of view (the range the user looks through the eye) together.

As such, the image output through the display units 251a and 251b may be viewed by overlapping with the general field of view. The glass-type image information providing apparatus 200 may provide an augmented reality (AR) that displays a virtual image by superimposing a virtual image on a real image or a background using the characteristics of the display.

The camera 221 is disposed adjacent to at least one of the left eye and the right eye, and is formed to capture an image of the front. Since the camera 221 is located adjacent to the eye, the camera 221 may acquire a scene viewed by the user as an image. The camera 221 may be installed in the frame unit 201, and may be provided in plural to acquire a stereoscopic image.

The glass type image information providing apparatus 200 may include a user input unit 223 manipulated to receive a control command. The user input unit 223 may be adopted in any manner as long as it is a tactile manner in which the user operates while having a tactile feeling such as touch or push.

In addition, the glass type image information providing apparatus 200 may include a microphone (not shown) that receives sound and processes the sound into electrical voice data, and a sound output module 252 that outputs sound. The sound output module 252 may be configured to transmit sound in a general sound output method or a bone conduction method. When the sound output module 252 is implemented in a bone conduction manner, when the user wears the glass type image information providing apparatus 200, the sound output module 252 is in close contact with the head and vibrates the skull to transmit sound. Done. In addition, the glass-type image information providing apparatus 200 may receive a voice signal of the user through the microphone and analyze the same, thereby performing a function according to the voice signal of the user.

In the following description, for convenience, it is assumed that the image information providing apparatus 200 according to the embodiment of the present invention has a glass type, that is, a form of glasses as described above. Hereinafter, embodiments related to a control method that can be implemented in the image information display device configured as described above will be described with reference to the accompanying drawings. It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

3 is a flowchart illustrating an operation of displaying image information based on a currently performed function and a sensed surrounding situation by an image information display apparatus according to an exemplary embodiment.

Referring to FIG. 3, the controller 110 of the image information display apparatus 100 according to an exemplary embodiment may display image information according to a function selected by a user on at least one of the display units 132 and 134. There is (S300). For example, when the user selects a multimedia content such as a movie or a game, the controller 110 may display image information related to the multimedia content selected by the user on at least one of the display units 132 and 134 in operation S300. .

Meanwhile, the controller 110 may detect whether any one of the preset functions is executed in the image information display apparatus 100 (S302). For example, when the user executes a function different from the function currently performed on the current image information display apparatus 100 in step S302, or a specific event (for example, receiving or presetting a message) When a change in the surrounding environment occurs, a function corresponding to the occurrence of the event may be detected.

In operation S302, the controller 110 may determine whether the executed function is one of preset functions as a function of displaying image information that the user must recognize. Based on the determination result of step S302, image information related to the executed function may be displayed on the display unit corresponding to the user's superiority among the display units 132 and 134 (S304).

On the other hand, in step S304, the controller 110 may determine the position of the image information displayed on the display unit corresponding to the dominant position based on the result of detecting the situation around the user. That is, the controller 110 may allow the image information to be displayed in an area other than a display area in which preset objects are identifiably displayed among the objects reflected in the display unit corresponding to the superiority. The preset thing may be variously determined according to a user's selection or a predetermined bar. For example, the preset object may be an object, such as a traffic light or a sign, among objects reflected through the display unit corresponding to the superiority.

For example, the controller 110 may recognize these objects by using the result detected by the detector 120. For example, the detector 120 may recognize an object corresponding to a traffic light or a sign from an image input through a camera. Herein, when there is an object on which letters and the like are displayed from the image input through the camera, the controller 110 may recognize this as a sign or the like. In addition, the controller 110 may recognize when there is an object displaying a specific symbol such as a pedestrian display or a stop display, or when an object in which red, blue, or yellow is arranged in a line is detected as a traffic light. .

In this state, the controller 110 may know a position where objects corresponding to the traffic light or sign are displayed on the display unit corresponding to the upper edge. In this case, the controller 110 may display the image information in another area except for a location where objects such as a traffic light or a sign are displayed on the display unit corresponding to the upper eye. Accordingly, in the present invention, it is possible to prevent a situation in which the user cannot confirm important information such as a sign or a traffic light by the displayed image information.

Meanwhile, in the above description, only the traffic light or the sign is described as an example of the object that the control unit 110 recognizes. However, this is only an embodiment of the present invention and may be recognized in various ways. For example, the controller 110 may recognize various objects detected as a result of the detection of the sensor 120 using a database for recognizing a shape of the object. The objects may be preset by a user, or may be obtained from the manufacturer of the image information display apparatus 100 according to an exemplary embodiment of the present disclosure or from a manufacturer who manufactures the image information display apparatus 100 according to an exemplary embodiment of the present disclosure. In the case where the image information is previously set as an area excluded from the area where the image information can be displayed, the controller 110 may cause the image information to be output to an area other than the area where the objects are displayed.

Meanwhile, in the above description, only image information is displayed in an area other than the area in which the preset objects are displayed. However, the size of the displayed image information may be adjusted. That is, the controller 110 may display the image information of a smaller size by adjusting the size of the region where the image information is displayed if the region where the image information is displayed is insufficient by the region where the objects are displayed. Of course.

On the other hand, in step S304, the control unit 110 evaluates the importance of the image information related to the executed function or the generated event based on a preset criterion based on the currently generated event, and the related image information is based on the evaluated result. It may be displayed on the display unit corresponding to the superiority of. As described above, the operation of the controller 110 evaluating the importance of the image information related to the currently generated event will be described in detail with reference to FIG. 4.

On the other hand, in step S304, even if the control unit 110 of the image information display device 100 according to an embodiment of the present invention, even if any one of the preset functions are executed, the image information display device 100 The user's situation may be determined based on the surrounding situation, and the image information may be displayed on a specific display unit according to a result of the user's situation being determined. In this case, for example, in step S304, the controller 110 may further detect a surrounding situation and determine a state of the user whether the user is moving or stopped based on the detected surrounding situation. If the user is moving, the user may determine whether the user is moving through a vehicle such as a vehicle or whether the user is running or walking. According to the result of determining the user's situation, image information related to a function currently executed may be displayed on the display unit corresponding to the user's superiority. Hereinafter, an operation process of detecting the surrounding situation and displaying image information on a specific display unit will be described in more detail with reference to FIG. 5.

4 is a flowchart illustrating an operation of evaluating the importance of an event generated and displaying image information according to the image information display apparatus according to an exemplary embodiment of the present invention.

As described above, the control unit 110 of the image information display apparatus 100 according to an embodiment of the present invention not only performs any one of the functions preset in step S302, When an event occurs, it has been described that image information can be displayed on a display unit corresponding to the user's superiority based on the generated event. 4 illustrates an operation process of evaluating the importance of an event generated by the controller 110 of the image information display apparatus 100 according to an exemplary embodiment of the present disclosure.

Referring to FIG. 4, when an event occurs, the controller 110 may detect this (S400). For example, the event detected at step S400 may be various. That is, the reception of a call or the reception of a message related to a short messaging service (SMS), a social network service (SNS), or the like, or generation of alarm information indicating that a predetermined time has been reached or a specific location has been reached, and Such an event may include a low battery or generation of notification information for notifying a predetermined schedule.

The controller 110 may detect the occurrence of such an event in step S400. In addition, the controller 110 may determine whether a function executed by a currently generated event is a preset function (S402). For example, when an event such as a call incoming or a message is received, the controller 110 may determine that a call function or an SMS or SNS function corresponds to the generated event. The controller 110 may determine whether a function corresponding to the generated event is a preset function. If the function is not a preset function, the controller 110 may display image information related to the event on at least one of the display units 132 and 134 (S410). .

On the other hand, if it is determined in step S402 that the function executed by the currently generated event corresponds to the preset functions, the control unit 110 proceeds to step S304 of FIG. 3 and the image related to the currently generated event. The information may be displayed on the display unit corresponding to the superiority of the user among the display units 132 and 134.

Herein, the controller 110 further evaluates the importance of the currently occurring event, and only when the evaluated importance is equal to or greater than a preset level, the image information related to the event is displayed in a specific display unit (the display unit corresponding to the user's superiority). It may be displayed on (S406). These criteria may be set differently for each type of event. For example, when an event currently occurring is a call reception, the telephone number information of the incoming call may be a criterion for evaluating the importance of the event, or when the event is a reception of a message, the content included in the message is Can be a criterion for evaluating the importance of an event. As a result of the importance evaluation in step S406, if the evaluated importance is more than a predetermined level, the process may proceed to step S304 of FIG. 3 and display on the display unit corresponding to the user's superiority.

That is, the controller 110 may evaluate the importance of the incoming call higher than the preset level in the case of a predetermined telephone number (for example, a telephone number stored in advance). In this case, the controller 110 may display the image information related to the incoming call only on the display unit corresponding to the user's superiority only in the call stored in advance at the step S304.

Alternatively, when the message is received, the controller 110 may evaluate the importance of the received message according to whether a preset word is included in the content of the received message. That is, for example, when a message includes words such as 'important', 'urgent', 'must', 'immediately contacted', the controller 110 may determine the message as a message of high importance, This may be displayed on the display unit corresponding to the superiority of the user in step S304. Here, the words for evaluating the importance of the message may be set by the user in advance, and may be set to match different importance scores for each word. In this case, in step S406, the controller 110 searches for preset words among the words included in the message, adds importance scores corresponding to the retrieved words, and based on the summed score, It may be determined whether the importance level is above a predetermined level. When the evaluated importance is equal to or greater than a preset level, the controller 110 proceeds to step S304 of FIG. 3 and corresponds to the user's superiority among the display units 132 and 134 for image information indicating the content of the received message. It can be displayed on the display unit.

Meanwhile, according to the above-described description, in step S304, the user's state is determined by further considering the result of sensing the surrounding situation of the image information display apparatus 100, and specific image information related to the currently executed function or event is displayed. It was mentioned that it may be indicated in the wealth. This surrounding situation can be various. For example, the current position and movement state may be such a surrounding situation. Alternatively, the degree of movement of the user's body as a result of detecting the movement of the user may be the surrounding situation of the image information display apparatus 100. In addition, the surrounding illuminance may be the surrounding situation of the image information display apparatus 100.

In addition, when the function executed by the user's selection or the currently generated event is one of preset functions, the controller 110 may detect whether a specific condition is satisfied according to the function. Here, the specific condition may be a specific situation (for example, a user's position movement or illuminance) around the image information display apparatus 100 corresponding to a specific function, or an importance (eg, determined according to a preset criterion). For example, the importance assessed from the event that occurred.

Based on the detected result, image information related to the executed function may be displayed on a specific display unit. For example, if the function to be executed is a navigation function, the controller 110 may display the image information display device 100 based on a state in which a current position is moved and whether the user is in a vehicle. It is possible to determine whether the vehicle moves in the state of boarding the vehicle, or the user walks or jumps. The controller 110 may display image information related to the navigation function on the display unit corresponding to the user's superiority based on the determined result. Alternatively, the controller 110 may display a brightness (illuminance) around the current image information display apparatus 100 when the currently executed function is a function of displaying a notification object to the user when there is an object approaching within a preset distance. Based on the location of the current user, the notification information may be displayed on the display unit corresponding to the superiority of the user.

FIG. 5 illustrates an operation process in which the image information display device according to an exemplary embodiment of the present invention detects a surrounding situation and displays image information accordingly. In the following description, for convenience of explanation, it is assumed that a function currently executed is a navigation function, and the navigation function is preset as a function for outputting information that the user must recognize by the user in advance.

As such, when the navigation function is executed, the controller 110 may detect whether the user location is moving (S500). This is because, unlike the user simply searching for navigation information of a specific region, when the user's location moves, it may be determined that the user is actually moving toward a specific destination, and thus the navigation information should be provided more quickly and accurately. . Accordingly, when the navigation function is executed, the controller 110 determines the user's situation according to the detection result of the detection unit 120 and displays the image information related to the navigation function according to the determined result. Can be determined. For example, the controller 110 displays the display unit on at least one of the first display unit 132 or the second display unit 134 according to the determination result, or designates one display unit corresponding to the user's superiority. It is also possible to display image information related to the navigation function on the display unit. Such a position movement may be detected through a location information module such as a GPS, or may be detected by a sensor provided in the image information display apparatus 100. For example, the controller 110 may determine that the user moves when the image received from the optical sensor, that is, the camera 221 changes more than a predetermined level within a predetermined time.

As a result of the sensing of step S500, if the location of the user is not moved, the controller 110 may determine that the navigation information does not need to be displayed on the display unit corresponding to the user's superiority. Accordingly, when the position of the user is in the stopped state, the controller 110 may display image information related to the navigation function on at least one of the display units 132 and 134 (S508).

Accordingly, the controller 110 may display image information related to the navigation function on one of the display units 132 and 134 according to the user's selection of the display unit corresponding to the non-right eye and the display unit corresponding to the non-right eye. Can be. This is because the user does not need to be provided with navigation information more quickly and accurately as described above, so that it is displayed on the display unit desired by the user according to the user's selection.

On the other hand, if the location of the user is moving as a result of the detection of step S500, the controller 110 may display image information related to the navigation function on the display unit corresponding to the user's superiority. Alternatively, the controller 110 may detect whether the user is moving through a vehicle such as a vehicle, even if the user is moved.

The controller 110 may determine whether the user is using a vehicle such as a vehicle based on the user's movement. To this end, when the user's location is moving, the controller 110 may detect whether there is a movement of a predetermined level or more from the user (S502). That is, when the user walks or runs directly, the control unit 110 controls the movement of the user based on a detection result of an optical sensor (for example, an internal camera), an inertial sensor, or a gravity sensor provided in the detection unit 120. It can be detected. Based on the detected result, it may be determined whether the user is actually in a state of moving and directly moving to a specific destination.

In this case, the controller 110 may output the navigation information on the display unit corresponding to the user's superiority, so that the user may recognize the navigation information more quickly and accurately. Here, the navigation information may mean image information of a navigation function itself or a function of displaying a function related to the navigation function, that is, a function of displaying information about a feature around a user's location, for example. .

However, if, as a result of the user's motion detection, the user's movement is less than a predetermined level, the controller 110 may determine that the user moves to a specific destination by using a vehicle such as a vehicle. In this case, the controller 110 may determine that the user uses public transportation such as a bus or subway, and thus may determine that the user does not need to receive navigation information more quickly and accurately. In this case, the controller 110 may proceed to step S508 to display the navigation information on at least one of the display units 132 and 134 according to a user's selection.

In the above description, it is assumed that the current position and movement state of the image information display apparatus 100 and the user's movement when the navigation function is executed are previously set as surrounding conditions corresponding to the navigation function. However, this is only an example to help explain the present invention, and the present invention is not limited thereto, and of course, various other surroundings may be detected more or less. That is, for example, the controller 110 displays the image information related to the navigation function in the user's superiority using only one of the user's location movement detection result (step S500) or the user's motion detection result (step S502). Of course, it can also be displayed in wealth.

In addition, based on a result of sensing other surrounding conditions not mentioned in the above description, the image information related to the navigation function may be displayed on the display unit corresponding to the user's superiority. In other words, instead of detecting the user's movement, the controller 110 may determine whether the user is in a preset vehicle. In this case, when it is determined that the user is in a vehicle preset by the user, for example, a vehicle that the user directly drives, the controller 110 may provide navigation information to the user even if the user's movement is less than a predetermined level. It may be displayed on the display unit corresponding to the superiority of.

In the above description, the operation of the image information display apparatus 100 according to an exemplary embodiment of the present invention has been described in detail with reference to a flowchart.

In the following description, an example of displaying such navigation information on one of the display units 132 and 134 based on the position movement state of the user and the movement of the user will be described with reference to the exemplary view.

6 is an exemplary view illustrating an example in which image information is displayed in the image information display apparatus according to an exemplary embodiment of the present invention. In the following description, it is assumed that a function of displaying a content of a message received by a preset function and a navigation function are included, and a case in which the left eye of the user's eyes is the superior eye of the user will be described as an example. .

Referring to FIG. 6, when the user moves on foot, FIG. 6 illustrates a case where an event currently occurring in the image information display apparatus 100 according to an exemplary embodiment of the present invention or a function according to a user's selection is performed. It is an exemplary figure which shows the case where image information related to a function or an event is displayed.

In this case, the controller 110 may display image information related to the function selected by the user and the generated event on at least one of the display units 132 and 134. FIG. 6A illustrates image information related to a function selected by a user, and FIG. 6B illustrates image information related to an generated event.

First, referring to FIG. 6A, the controller 110 of the image information display apparatus 100 according to an exemplary embodiment of the present invention may perform a function executed by a user's selection, that is, functions in which a navigation function is preset. In case of, the surrounding situation can be further detected. As a result of detecting the surrounding situation, when the position of the user is moving and when a movement of a certain level or more is detected from the user (because the user is moving on foot), the controller 110 of FIG. As shown in FIG. 2, the image information 600 related to the navigation function may be displayed on the display unit 132 corresponding to the user's superiority, that is, the user's left eye.

On the other hand, even if the function related to the currently generated event is one of the preset functions, the control unit 110 is required to meet the specific conditions related to the function to display the image information related to the event in the uppermost of the user, that is, It may be displayed on the display unit 132 corresponding to the left eye.

When an event in which a message is received occurs as shown in FIG. 6B, the controller 110 may receive the received message even though the function of displaying the content of the received message is one of preset functions. The importance of the message can be evaluated based on the content of. Then, based on the evaluated importance, it may be determined whether to display the message on the display unit 132 corresponding to the user's superiority.

That is, the control unit 110 is a word of the text included in the received message, if the word set in advance of high importance, that is, words such as 'immediately', 'contact', 'urgent', 'important' This may not be displayed on the display unit 132 corresponding to the user's superiority, so that the content of the received message 610 corresponds to the right eye of the user, as shown in FIG. The display unit 134 may be displayed.

7 illustrates an example in which image information is displayed based on a result of sensing a user's state even when the same function is performed in the image information display apparatus according to an exemplary embodiment of the present invention. In the following description of FIG. 7, it is assumed that a navigation function is included as a preset function, and a case in which the left eye of the user's eyes is the superior eye of the user will be described as an example.

Referring to FIG. 6A, when the navigation function is executed, the controller 110 of the image information display apparatus 100 according to an embodiment of the present invention may move the user's position and the user's movement ( For example, the image information related to the navigation information is displayed on the display unit 132 corresponding to the user's superiority based on the state of moving by foot.

However, as shown in FIG. 7, when the user is in the vehicle, the controller 110 may display image information related to the navigation function based on a result of detecting the user's movement in the display unit corresponding to the user's superiority ( 132 may determine whether to display. That is, the control unit 110 is a case where the navigation function is executed by the user, even if the position of the user is moving, as shown in (a) of FIG. 7, when the user boards the vehicle, the navigation is performed. Image information related to a function may be displayed on any one of the display units 132 and 134 according to a user's selection. Accordingly, the image information related to the navigation function may be displayed on the display unit 134 corresponding to the user's non-comfort, that is, the right eye, as shown in FIG. 7B. This is because, as shown in (a) of FIG. 7, when the user boards the vehicle, the user's movement may be sensed below a preset level. In this case, the controller 110 may determine that the user does not need to receive navigation information more quickly and accurately.

On the other hand, even when the user is in the vehicle, when the user is a driver driving the vehicle, the controller 110 displays the image information related to the navigation function corresponding to the user's superior, that is, the left eye It may be displayed on the unit 132. For example, the controller 110 may be configured to drive the vehicle when the user is a vehicle in which the user is preset as a driver or when the user is seated in the driver's seat based on a camera inside the vehicle. It can be judged that.

In this case, the controller 110 cooperates with a control unit (not shown) of the vehicle to detect the position of the driver's seat of the vehicle, and the user may detect the driver's seat of the vehicle from the position of the main body and the position of the driver's seat of the image information display apparatus 100. It is possible to determine whether or not to board. Alternatively, the controller 110 may detect a user's movement from an image input at a predetermined time interval through a camera inside the vehicle, and determine whether the user is a driver of the vehicle based on the detected user's movement. If the user wearing the image information display apparatus 100 is a driver of a vehicle, the controller 110 displays image information related to the navigation function on the display unit 132 corresponding to the user's superior eye, that is, the left eye. You can also mark FIG. 7C illustrates an example in which the image information 700 related to the navigation function is displayed on the display unit 132 corresponding to the user's superiority, that is, the left eye in this case.

Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. In particular, in the embodiment of the present invention, the navigation function and the event in which the message is received are mainly described as examples, but the present invention is not limited thereto. That is, the present invention can also be used to notify when there is an object close to the user. In this case, the control unit 110 is a user when the ambient illumination is below a certain level (for example, late time) or when the user passes through a predetermined area (for example, an area where the user passes by walking or the like when returning home). In the case where an object close to the target is detected within a predetermined distance, notification information for notifying the user may be displayed on the display unit corresponding to the user's superiority so that the user can recognize the object more quickly.

In addition, in the exemplary embodiment of the present invention, a specific function capable of displaying image information in the user's superiority is set as an example. However, these functions may be added or excluded as much as the user selects. . In addition, in the embodiment of the present invention, the location movement state and the user's movement state as an example of the detected surrounding situation, but this is only the surrounding situation related to the navigation function, not all functions detect this. That is, various different surrounding situations can be detected according to the functions to be set, and accordingly, it can be determined whether image information related to the function should be displayed in the user's superiority.

Meanwhile, in the above description, the image information to be displayed on the display unit corresponding to the user's superiority is determined based on the function selected by the user or the function generated by the event. Of course, it may be determined according to the displayed content. That is, for example, if the multimedia content selected by the user is content that the user can immerse, such as a movie or a game (hereinafter referred to as immersive content), the controller 110 displays the immersive content in the display units 132 and 134. All or at least one may be indicated. However, if the content selected by the user is not immersive content such as schedule notification or local information (hereinafter, referred to as non-immersive content), the controller 110 may display it on a display unit corresponding to the user's superiority.

The immersive content or the non-immersive content may be preset by the user or may be preset when the image information display apparatus 100 according to the embodiment of the present invention is shipped. For example, multimedia content such as a movie or a game may be set as the immersive content, and image information related to other contents except for the immersive content may be set as non-immersive content.

Meanwhile, when the immersive content is displayed on the display units 132 and 134, the controller 110 displays notification information related to the event in the display unit corresponding to the user's superiority when a preset event occurs. Can be marked on. For example, as described above, the controller 110 may display notification information for notifying when a message is received, when a call is received, or when an event such as a specific object approaches within a predetermined distance occurs. The notification information may be displayed on a display unit corresponding to the superiority of the user, and a sound signal may be further output together with the notification information or before the notification information. The preset event may be preset by the user, or may be preset from the time of shipment of the image information display apparatus 100 according to an exemplary embodiment of the present invention.

Meanwhile, in the above description, when the navigation function or the function related to the navigation function is executed in the image information display device 100, the control unit 110 determines the image information related to the function based on the result of the user's situation. The display on the display unit corresponding to the superiority of the user has been described as an example. However, the present invention is not limited thereto. That is, in addition to the above-described navigation function or a function related thereto, various other functions may be selected depending on the user's selection.

For example, a message function or the like may be selected as the function. In this case, the control unit 110 corresponds to the user's priority in the image information associated with the application for creating the received message or the content of the message, based on the result of determining the current user's situation at the time of receiving or sending the message. Of course, it can also be displayed on the display unit. In this case, unlike shown in FIG. 6B, the content 610 of the received message may be displayed on the display unit 132 corresponding to the user's superiority.

The present invention described above can be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like. This also includes implementations in the form of carrier waves (eg, transmission over the Internet). In addition, the computer may include the controller 180 of the terminal. The above detailed description, therefore, is not to be taken in a limiting sense in all respects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims (20)

1. In the image information display device,

   A main body having a front part and a rear part, the main body including a plurality of glass display parts respectively formed to be transparent so that objects located at the rear part side thereof are reflected;

   A detector configured to detect a situation around the main body;

   A memory containing information about the user's superior and non-eligibility; And,

   A control unit for displaying at least one of image information related to multimedia content and image information related to at least one of functions executable in the image information display apparatus, on at least one of the plurality of display units;

   The control unit,

   When the preset function is executed, the current user's situation is determined according to the result of detecting the situation around the main body, and the image information related to the executed function is included in the user's superiority according to the result of the user's situation. The image information display apparatus characterized by displaying on a display part.
2. The method of claim 1, wherein the control unit,

   It is determined whether or not the position of the user is moved based on a result of detecting the surrounding situation of the main body, and according to the determination result, image information related to the function is displayed on the display unit corresponding to the user's superiority

   The preset function,

   And a navigation function and a function related to the navigation function.
3. The method of claim 2,

   The detection unit,

   It includes a camera for receiving an image outside the main body,

   The control unit,

   And determining the situation of the user based on the degree to which the image received from the camera is changed within a predetermined time.
4. The method of claim 2,

   The detection unit,

   Further comprising at least one sensor for detecting the movement of the user,

   The control unit,

   And when the position of the user is moved, determining the situation of the user based on the movement of the user sensed by the sensing unit.
5. The method of claim 4, wherein the control unit,

   If the detected movement of the user is less than a predetermined level, it is determined that the user is moving by using a vehicle,

   And image information related to the function is displayed on a display unit corresponding to the user's superiority based on whether the user is a driver of the vehicle.
6. The method of claim 5, wherein the control unit,

   And determining whether the user is a driver driving the transportation means based on whether the vehicle on which the user rides is a preset vehicle.
7. The method of claim 5, wherein the control unit,

   Detecting a driver's seat position of the vehicle through a vehicle control unit controlling overall driving of the vehicle, and determining whether the user is a driver driving the vehicle based on the position of the driver's seat and the position of the main body; An image information display device.
8. The method of claim 1, wherein the function related to the navigation function is:

   And a function for displaying information about a feature around a user's current location.
9. The method of claim 1,

   The preset function,

   Contains functions executed by preset events,

   The preset event,

   An image information display apparatus, which occurs when a message is received or a call is received.
10. The method of claim 9, wherein the control unit,

    When the preset event occurs, the importance of the generated event is evaluated, and based on the evaluated importance, image information related to the generated event is displayed on a display unit corresponding to the superiority of the user. Image information display device.
11. The method of claim 10, wherein the control unit,

    And when the preset event is reception of a message, evaluating the importance based on text included in the message.
12. The method of claim 11, wherein the control unit,

    Searching for whether a predetermined word is included in the text included in the message, and evaluating the importance of the message based on a result of summing different importance scores matched with each word when at least one preset word is found. An image information display device.
13. The method of claim 10, wherein the control unit,

    And when the preset event is a call, the importance is evaluated based on the telephone number of the received call.
14. The method of claim 1, wherein the control unit,

    And an ambient condition of the main body is differently detected according to a function currently executed in the image information display device.
15. The method of claim 1,

    The preset function,

    When the detection of the object approaching the user within a certain distance, it includes a function for displaying the notification information for notifying the user,

    The control unit,

    As a result of sensing the environment around the main body, notification information for notifying the approach of the object is based on the user's superiority based on at least one of the illuminance around the main body and at least one of an area where the main body is located. And display on a display unit.
16. The method of claim 1, wherein the control unit,

    And classifying the type of the multimedia content and displaying image information related to the multimedia content on a display unit corresponding to the user's superiority according to the type of the multimedia content.
17. The method of claim 1, wherein the control unit,

    In a state in which image information related to the multimedia content is displayed on all of the display units, when a predetermined event occurs, notification information on the generated event is displayed on a display unit corresponding to the user's superiority. Information display device.
18. The method of claim 1, wherein the control unit,

    And determining the position of the image information displayed on the display unit corresponding to the upper eye based on the result of detecting the situation around the user.
19. The method of claim 18, wherein the control unit,

    And displaying the image information in an area other than a display area in which preset objects are distinguishably displayed among objects reflected in the display unit corresponding to the upper eye.
20. In the method for controlling the image information display device having a plurality of glass display unit,

    Determining whether to execute a preset function;

    Determining a situation of a user by detecting a situation around the main body of the image information display apparatus when the preset function is executed; And,

    And displaying the image information related to the execution of the preset function on a display unit corresponding to the user's superiority among the plurality of glass display units, based on the determined situation of the user. Control method of the device.

Images