WO2014014155A1 - A head mounted dipslay and method of outputting a content using the same - Google Patents
A head mounted dipslay and method of outputting a content using the same Download PDFInfo
- Publication number
- WO2014014155A1 WO2014014155A1 PCT/KR2012/006344 KR2012006344W WO2014014155A1 WO 2014014155 A1 WO2014014155 A1 WO 2014014155A1 KR 2012006344 W KR2012006344 W KR 2012006344W WO 2014014155 A1 WO2014014155 A1 WO 2014014155A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- hmd
- state
- digital device
- content
- display unit
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 239000003550 marker Substances 0.000 claims description 71
- 238000004891 communication Methods 0.000 claims description 67
- 238000005562 fading Methods 0.000 claims 2
- 230000000875 corresponding effect Effects 0.000 description 31
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/02—Viewing or reading apparatus
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
Definitions
- the present invention relates to a method of outputting a content using a head mounted display (HMD), and more particularly, to a method of outputting a currently displayed content of a digital device to an HMD.
- HMD head mounted display
- a head mounted display means a sort of an image display device wearable on a head like glasses to enable an image to be viewed.
- a digital device tends to have its lightness in weight and its compactness, various kinds of wearable computers are being developed and the HMD is being widely used.
- the HMD is combined with such a technology as an augmented reality technology, an N-screen technology and the like over a simple display function, thereby providing a user with a variety of convenience.
- the HMD is usable by being linked with various kinds of digital devices.
- the HMD is linked with a digital device via network to output a content of the corresponding digital device.
- the HMD receives a user input for the digital device or is able to perform a job interoperable with the corresponding digital device.
- the present invention is directed to a head mounted display and method of outputting a content using the same that substantially obviate one or more of the problems due to limitations and disadvantages of the related art.
- An object of the present invention is to provide a head mounted display and method of outputting a content using the same, by which a user can be provided with an optimal-state content displayed on a display device interoperating with a head mounted display (HMD).
- HMD head mounted display
- one object of the present invention is to provide a method of displaying a content appropriately in accordance with a use status of a user wearing a head mounted display (HMD), e.g., eyes of the HMD wearing user.
- HMD head mounted display
- Another object of the present invention is to provide a head mounted display and method of outputting a content using the same, by which a user can be provided with convenience in a manner that a content output switching between a head mounted display (HMD) and a digital device interoperating with the head mounted display is automatically performed without a manual input performed by the user.
- HMD head mounted display
- a method of outputting a content using an HMD may include the steps of performing a pairing with a digital device having at least one display unit configured to display the content, detecting a location state of the paired digital device, and outputting the content currently displayed on the digital device to the HMD, wherein the location state includes a first state in which a display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region.
- a method of outputting a content using an HMD may include the steps of detecting at least one marker located within a preset view angle region of the HMD, the at least one marker comprising an identifier indicating content information, detecting a location state of the marker, the location state including a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region, if the location state of the marker is switched into the second state from the first state, receiving the content corresponding to the marker from a server, and outputting the received content to the HMD, wherein if the location state of the marker is switched into the first state from the second state, the outputting step includes the step of terminating an output of the content.
- an HMD head mounted display
- the present invention may include a processor controlling an operation of the HMD, a display unit outputting an image based on a command given by the processor, and a communication unit transceiving data with at least one digital device based on the command given by the processor, wherein the processor performs a pairing with a digital device having at least one display unit configured to display the content, wherein the processor detects a location state of the paired digital device, wherein the processor outputs the content currently displayed on the digital device to the display unit of the HMD based on the detected location state, and wherein the location state includes a first state in which the display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region.
- an HMD head mounted display
- the present invention may include a processor controlling an operation of the HMD, a display unit outputting an image based on a command given by the processor, and a communication unit transceiving data with at least one digital device based on the command given by the processor, wherein the processor detects at least one marker located within a preset view angle region of the HMD, wherein the at least one marker includes an identifier indicating content information, wherein the processor detects a location state of the marker, wherein the location state includes a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region, wherein if the location state of the marker is switched into the second state from the first state, the processor receives the content corresponding to the marker from a server, wherein the processor outputs the received content to the HMD, and wherein if the location
- the present invention provides the following effects or advantages.
- the present invention enables a content, which is displayed on a display device currently interoperating with an HMD, to move seamlessly into the HMD in accordance with a use environment of a user, thereby providing the user with convenience.
- a content currently displayed on the corresponding digital device is automatically displayed on the HMD, whereby the user can be provided with the content on the HMD.
- the HMD does not perform a content display, whereby the user can be exactly provided with the content of the digital device without interference via a display of the HMD.
- a triggering for determining whether a content currently displayed on a digital device will be outputted to an HMD is automatically switched based on eyes of a user, the user can be persistently provided with the content of the digital device without performing a separate user input.
- the corresponding external device when user’s eyes through an HMD face another external device having a display unit, the corresponding external device is enabled to output a content, whereby the user can be provided with the content through various resources capable of displaying contents.
- FIG. 1 is a diagram of an HMD according to an embodiment to the present invention, a user wearing the HMD, and a digital device interoperating with the HMD;
- FIG. 2 is a block diagram of an HMD according to an embodiment of the present invention.
- FIG. 3 is a flowchart for a content outputting method using an HMD according to one embodiment of the present invention
- FIG. 4 is a flowchart for a content outputting method using an HMD according to another embodiment of the present invention.
- FIGs. 5 to 7 are diagrams for one detailed examples of outputting a content using an HMD of the present invention.
- FIGs. 8 to 10 are diagrams for another detailed examples of outputting a content using an HMD of the present invention.
- FIG. 11 is a flowchart for a content outputting method using an HMD according to a further embodiment of the present invention.
- FIG. 12 and FIG. 13 are diagrams for further detailed examples of outputting a content using an HMD of the present invention.
- terminologies used in the present specification are selected from general terminologies used currently and widely in consideration of functions in the present invention, they may be changed in accordance with intentions of technicians engaged in the corresponding fields, customs, advents of new technologies and the like. Occasionally, some terminologies may be arbitrarily selected by the applicant(s). In this case, the meanings of the arbitrarily selected terminologies shall be described in the corresponding part of the detailed description of the invention. Therefore, terminologies used in the present specification need to be construed based on the substantial meanings of the corresponding terminologies and the overall matters disclosed in the present specification rather than construed as simple names of the terminologies.
- FIG. 1 shows an HMD 100 according to an embodiment to the present invention, a user 10 wearing the HMD, and a digital device 200 interoperating with the HMD 100.
- the digital device 200 may be able to output various kinds of contents 1.
- the digital device 200 may be able to output various kinds of multimedia contents including a live broadcast, a movie, a music, a drama, a webpage, a game, and application and the like.
- the digital device 200 includes at least one display unit 220.
- the content 1 outputted from the digital device 200 may be displayed on the display unit 220.
- the digital device 200 may include a communication unit (not shown in the drawing). And, data can be transceived between the HMD 100 and other external devices via the communication unit.
- the digital device 200 may include various kinds of electronic devices each of which includes a display unit and a communication unit.
- the digital device 200 may include such a device, which is capable of image display and data communication, as a PC, a PDA (personal digital assistant), a notebook computer, a tablet PC, a television and the like.
- the HMD 100 may be configured to work by interoperating with the digital device 200. For the interoperation between the HMD 100 and the digital device 200, a separate pairing or communication connection may be performed. This paring or communication connecting job may be performed in response to a user input performed on the HMD 100 or the digital device 200. For instance, the HMD 100 may be able to provide a separate button or user interface for the pairing or communication connection with the digital device 200. Hence, a user may be able to attempt the paring or communication connection between the HMD 10 and the digital device 200 via a user input using the button or user interface.
- the HMD 100 is capable of image display using the included display unit.
- the HMD 100 may be able to display a user interface of its own, a response to a user input and the like.
- the HMD 100 may be able to display various kinds of contents by interoperating with the digital device 200 connected by a network 300.
- the HMD 100 may be able to have a view angle region 102 in a preset range.
- This view angle region 102 is a preset region corresponding to a view of the user wearing the HMD 100 and may include a section covering a predetermined angle range in front direction of the HMD 100.
- the HMD 100 may be able to detect whether the digital device 200 interoperating with the HMD 100 is located in the view angle region 102 of the HMD 100.
- the HMD 100 may be able to detect a location state of the interoperating digital device 200.
- the location state may include a first state having the display unit 220 of the digital device 200 located in the view angle region 102 of the HMD 100 and a second state having the display unit 220 of the digital device 200 located outside the view angle region 102 of the HMD 100.
- the network 300 of the present invention may include wire/wireless networks that enable communications between the HMD 100 and the digital device 200.
- available wireless networks may include NFC (near field communication), Zigbee, Infrared communication, Bluetooth, Wi-Fi and the like, by which the present invention may be non-limited.
- communications between the HMD 100 and the digital device 200 may be performed using one of the above-enumerated networks 300 or a combination thereof.
- FIG. 2 is a block diagram of an HMD according to an embodiment of the present invention.
- an HMD 100 may include a processor 110, a display unit 120, an audio output unit 130, a communication unit 140, a sensor unit 150, a storage unit 160 and a power unit 180.
- the display unit 120 outputs an image to a display screen.
- the display unit 120 may be able to output an image based on a content executed in the processor 110 or a control command given by the processor 110.
- the display unit 120 may be able to display an image based on a control command given by an external device (e.g., a digital device) interoperating with the HMD 100.
- the display unit 120 may be able to display a content currently executed by the digital device interoperating with the HMD 100.
- the HMD 100 receives data from the digital device via the communication unit 140 and may be then able to output a corresponding image based on the received data.
- the audio output unit 130 may include such an audio output means as a speaker, an earphone and the like.
- the audio output unit 130 may be able to output audio based on a content executed in the processor 110 or a control command given by the processor 110 as well.
- the audio output unit 130 may be able to output audio based on a control command given by the digital device interoperating with the HMD 100.
- the audio output unit 130 may be able to output audio based on a content currently executed by the digital device interoperating with the HMD 100.
- the audio output unit 130 may be optionally provided to the HMD 100.
- the communication unit 140 may be able to transmit and receive data by performing communications with an external device by various protocols.
- the communication unit 140 accesses a network by wire/wireless and may be then able to transmit and receive digital data such as contents and the like.
- the HMD 100 may be able to perform a pairing and communication connection with a digital device using the communication unit 140 and may be then able to transceive data with the connected digital device.
- the communication unit 140 may be able to include a plurality of antennas. Using a plurality of the antennas, the HMD 100 may be able to detect a location state of a digital device communication-connected with the HMD 100.
- the HMD 100 may be able to detect whether a display unit of the digital device connected with the HMD 100 is located in a view angle region of the HMD 100.
- the sensor unit 150 may be able to forward a user input or an environment recognized by the HMD 100 to the processor 110 using a plurality of sensors installed in the HMD 100.
- the sensor unit 150 may be able to include a plurality of sensing means.
- a plurality of the sensing means may include a gravity sensor, a geomagnetic sensor, a motion sensor, a gyro sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, an olfactory sensor, a temperature sensor, a depth sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a GPS (global positioning system) sensor, a touch sensor and the like.
- the sensor unit 150 is a common name of one of the various sensing means mentioned in the above description.
- the sensor unit 150 senses valorous inputs and user’s environment and may be then able to forward a sensing result to the processor 100 to perform a corresponding action or operation.
- the above-mentioned sensors may be included as separate elements in the HMD 100 or may be included in a manner of being integrated into at least one element.
- the sensor unit 150 may include an image photographing sensor (not shown in the drawing).
- the image photographing sensor detects an image within a preset view angle image and may be then able to provide the detected image to the processor 110.
- the processor 110 may be able to detect whether a digital device (or, a display unit of the corresponding digital device) interoperating with the HMD 100 is present within the view angle region of the HMD 100.
- the image photographing sensor may be substituted with an infrared sensor or the like for the purpose of the present invention.
- the storage unit 160 of the present invention may be able to store various digital data including video, audio, photos, moving pictures, applications and the like.
- the storage unit 160 may include such a digital data storage space as a flash memory, a random access memory (RAM), a solid state drive (SSD) and the like.
- the storage unit 160 may be able to temporarily store data received from a digital device via the communication unit 140. In doing so, the storage unit 160 may be used for the buffering to output the data or content received from the digital device to the HMD 100.
- the storage unit 160 may be optionally provided to the HMD 100.
- the power unit 170 is the power source connected to a battery in a device or an external power source and may be able to supply power to the HMD 100.
- the processor 110 of the present invention may be able to execute the contents received via data communications, the contents saved in the storage unit 160 and the like. Moreover, the processor 110 may be able to activate various applications and to process the data inside the device. In addition, the processor (or, main control unit) 110 may be able to control various units of the HMD 100 mentioned in the above description and data transmissions and receptions between the units.
- the separately illustrated blocks indicate elements of the device logically and discriminatively. Therefore, the elements of the device mentioned in the above description may be installed in a manner of being integrated into one chip or a plurality of chips by the design of the device.
- FIG. 3 is a flowchart for a content outputting method using an HMD according to one embodiment of the present invention.
- the steps shown in FIG. 3 may be controlled by the processor 110 of the HMD 100 shown in FIG. 2.
- an HMD of the present invention may be able to perform a communication connection with a digital device [S310].
- the communication connection may be performed in repose to a user input performed on the HMD or the digital device.
- the HMD may be able to provide a separate button or user interface for the communication connection with the digital device.
- a user may be able to perform the communication connection between the HMD and the digital device by performing a user input using the button or the user interface.
- the HMD Before the communication connection between the HMD and the digital device is performed, the HMD may be paired with the digital device. If the HMD of the present invention performs the communication connection with the digital device, the HMD may be able to transceive data with the digital device while a session is open.
- the HMD of the present invention may be able to detect a location state of the connected digital device [S320].
- the location state may include a first state having the display unit of the digital device located in a preset view angle region of the HMD and a second state having the display unit of the digital device located outside the view angle region of the HMD.
- the view angle region is a preset region corresponding to eyes of a user who is wearing the HMD and may include a section within a predetermined angle range in front direction of the HMD.
- the HMD may be able to detect a location state of a digital device using a plurality of antennas.
- the HMD may be able to perform transceive data with the digital device via a plurality of the antennas provided to the HMD.
- it may be able to detect relative locations and directions between the HMD and the digital device connected with the HMD.
- the present invention even if a direction (e.g., an azimuth angle) having the digital device located therein is changing while a distance between the digital device is maintained constant, it may be able to accurately detect a location state of the digital device using a plurality of the antennas provided to the HMD.
- a direction e.g., an azimuth angle
- the present invention may be able to detect a location state of the digital device using an image photographing sensor.
- the image photographing sensor detects an image within the preset view angle region of the HMD and may be then able to provide the detected image to the processor of the HMD.
- the processor may be able to detect whether a digital device (or, a display unit of the corresponding digital device) connected with the HMD is present within the view angle region of the HMD.
- the digital device connected with the HMD may be able to output a preset light pattern and the HMD is then able to detect the light pattern outputted from the digital device.
- the light pattern may include at least one of a temporal pattern and a spatial pattern.
- the light pattern may be outputted from the display unit of the digital device.
- the HMD may be able to detect the light pattern outputted from the digital device via the image photographing sensor. Otherwise, i.e., if the digital device connected with the HMD is not present within the view angle region of the HMD, the light pattern outputted from the digital device may not be detected via the image photographing sensor. Meanwhile, when a light pattern is outputted via the display unit of the digital device according to the embodiment of the present invention, even if the display unit of the corresponding digital device does not face a user despite that the digital device is present within the view angle region, the light pattern may not be detected.
- an HMD of the present invention may be able to detect a location state of the digital device.
- the light pattern may be outputted via the display unit of the digital device, by which the present invention may be non-limited.
- the digital device may be able to output a light pattern of itself irrespective of whether the digital device has performed the communication connection with the HMD.
- the HMD of the present invention may be able to output a content currently displayed on the digital device to the HMD based on the detected location state of the digital device.
- the HMD preferentially determines whether the display unit of the corresponding digital device is present within the view angle region of the HMD [S330]. If the display unit of the digital device is present within the view angle region, the HMD of the present invention may not output the currently displayed content of the digital device [S340]. On the contrary, if the display unit of the digital device is not present within the view angle region, the HMD of the present invention may be able to output the currently displayed content of the digital device [S342]. To this end, the HMD receives the currently displayed content of the digital device from the digital device and may be then able to output the received content to the display unit of the HMD.
- the HMD may be able to trigger whether to output a content of the digital device in accordance with a location state relative to that of the digital device.
- the HMD in the first state in which the display unit of the digital device is located within the view angle region of the HMD, the HMD does not output a currently displayed content of the digital device.
- the HMD in the second state in which the display unit of the digital device is not located within the view angle region of the HMD, the HMD may be able to output a currently displayed content of the digital device.
- the user in the second state in which a location of the digital device deviates from the view of the user wearing the HMD, the user may be able to be provided with the content of the digital device via the HMD.
- the user in the first state in which a location of the digital device lies within the view of the user wearing the HMD, the user may be able to be provided with the content via the digital device without interference via the display of the HMD.
- an HMD may be able to trigger whether to output a content of the digital device.
- the HMD may be able to output the content of the digital device.
- the HMD may be able to terminate the output of the content of the digital device.
- the HMD of the present invention determines whether the communication connection with the digital device is ongoing [S350]. If the communication connection with the digital device is ongoing, the HMD goes back to the step S320 and then detects a location state of the paired digital device. If the communication connection between the HMD and the digital device is terminated, the HMD may terminate the content output of the digital device.
- an HMD may be able to detect a real-time location state of a digital device while a communication connection is established between the HMD and the digital device. Based on the detected location state, it may be able to determine whether a content currently displayed by the digital device will be outputted to the HMD. If the detected location state is switched, it may be able to adjust whether to output the content of the digital device to the HMD based on the switched location state. If the communication connection with the digital device is terminated, the HMD may be able to terminate both of the job of detecting the location state of the digital device and the job of outputting the content of the digital device.
- FIG. 4 is a flowchart for a content outputting method using an HMD according to another embodiment of the present invention.
- the processor 110 of the HMD 100 shown in FIG. 2 may be able to control the operations of the respective steps mentioned in the following.
- details of the same or similar parts of the former embodiment described with reference to FIG. 3 shall be omitted.
- an HMD of the present invention performs a pairing with a digital device [S410]. Subsequently, the HMD may be able to detect a location state of the paired digital device [S420].
- the detailed embodiments of the steps S410 and S420 are identical to those of the former steps S310 and S320 described with reference to FIG. 3. Yet, in the embodiment of the step S420, the HMD may be able to detect the location state of the paired digital device despite that a communication connection with the digital device is not performed yet. To this end, according to one embodiment of the present invention, the HMD may be able to detect the location state of the corresponding digital device based on whether a light pattern outputted from the digital device is detected.
- the HMD preferentially determines whether the display unit of the corresponding digital device is present within the view angle region of the HMD based on the detected location state of the digital device [S430]. If the display unit of the digital device is present within the view angle region, the HMD of the present invention may not establish the communication connection with the digital device [S440]. On the contrary, if the display unit of the digital device is not present within the view angle region, the HMD may be able to establish the communication connection with the digital device [S442]. If the HMD establishes the communication connection with the digital device, it may be able to receive a currently displayed content of the digital device from the digital device [S444]. The HMD of the present invention may be then able to output the received content [S446].
- the HMD may be able to trigger whether to establish the communication connection with the digital device in accordance with a location state relative to that of the digital device.
- a location state relative to that of the digital device.
- the communication connection between the HMD and the digital device is established.
- the communication connection between the HMD and the digital device is not established.
- the switched location state after a detected location state of a digital device has been switched, if the switched location state is maintained over a preset time, it may be able to trigger whether to establish a communication connection between an HMD and the digital device.
- the location state of the digital device is switched into a second state from a first state in which the communication connection between the HMD and the digital device is not established, when the location state of the digital device is maintained in the second state over the preset time, it may be able to establish the communication connection between the HMD and the digital device.
- the HMD may be able to terminate the communication connection between the HMD and the digital device.
- the HMD of the present invention determines whether the HMD is being paired with the digital device is ongoing [S450]. If the HMD is being paired with the digital device, the HMD goes back to the step S420 and then detects a location state of the paired digital device. If the pairing between the HMD and the digital device is terminated, the HMD may terminate the content output of the digital device.
- an HMD may be able to detect a real-time location state of a digital device while paired with the digital device. Based on the detected location state, it may be able to determine whether to establish a communication connection between the HMD and the digital device. If the detected location state is switched, it may be able to adjust whether to establish the communication connection between the HMD and the digital device based on the switched location state. If the pairing with the digital device is terminated, the HMD may be able to terminate both of the job of detecting the location state of the digital device and the job of outputting the content of the digital device.
- FIGs. 5 to 7 are diagrams for one detailed examples of outputting a content 1 using an HMD 100 of the present invention.
- an HMD 100 is being paired with a digital device 200.
- it may be able to control an output of a content 1 of the HMD 100 based on a location state of a digital device 200 with reference to the HMD 100, i.e., relative locations and directions between the HMD 100 and the digital device 200.
- FIG. 5 and FIG. 6 show a case that the location state of the digital device 200 is switched into a second state [FIG. 5 (b)] from a first state [FIG. 5 (a)] according to an embodiment of the present invention. In doing so, the content 1 currently displayed on the digital device 200 moves to the HMD 100 and may be then displayed on the HMD 100.
- a user 10 is able to watch the content 1 displayed on a display unit 220 of the digital device 200 while wearing the HMD 100 of the present invention.
- the display unit 220 of the digital device 200 may be located within a view angle region 102 of the HMD 100.
- the HMD 100 does not output the content 1.
- the HMD 100 may be in a state that a communication connection with the digital device 200 is not established.
- the user 10 may look at a different spot instead of looking at the display unit 220 of the digital device 200.
- the display unit 220 of the digital device 200 may be located outside the view angle region 102 of the HMD 100.
- the HMD 100 may be able to output the content 1.
- the HMD 100 has already established the communication connection with the digital device 200.
- the HMD 100 receives the content 1 from the digital device 200 via a network 300 by real time and may be then able to output the received content 1.
- the digital device 200 may stop displaying the content 1 in the second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
- an appropriate feedback may be provided on the HMD 100.
- the HMD 100 may be able to provide a vibration feedback.
- the HMD 100 may be able to output the content 1 by fade-in.
- the HMD 100 may be able to output the content 1 after a preset time.
- the HMD 100 may be able to output the content 1 after duration of the preset time from a time in which the location state of the digital device 200 was switched.
- the digital device 200 may be able to stop an output of the content 1 during the preset time from the time in which the location state of the digital device 200 was switched. After duration of the preset time, the digital device 200 may continue to output the content 1. For instance, if the content 1 is a video content and the location state of the digital device 200 is switched from the first state into the second state, the digital device 200 may be able to pause the output of the video content during a preset time.
- the HMD 100 when the location state of the digital device 200 is switched from the first state to the second state, the HMD 100 may be able to output the content 1 in a manner that the content 1 slides to move. In doing so, the HMD 100 enables the content 1 to slide to move into a center region from a side in which the display unit 220 of the display device 200 deviating from the view angle region 102 is located. For instance, if the digital device 200 in the first state deviates from the view angle region 102 of the HMD 100 and then enters the second state [Fig.
- the HMD 100 enables the content 1 to be displayed in a manner that the content 1 slides to move to a center region from a left side in which the digital device 200 deviating from the view angle region 102 is located [FIG. 6 (b)].
- the center region is the region situated at a central part of a frame displayed by the display unit and may include a preset region situated at a central part of the view angle region 102.
- FIG. 7 shows that a location state of a digital device 200 is switched to a first state [FIG. 7 (b)] from a second state [FIG. 7 (a)] according to an embodiment of the present invention.
- an HMD 100 may be able to terminate an output of a currently displayed content 1.
- the digital device 200 if the digital device 200 pauses a display of the contents 1 in the second state, the digital device 200 may be able to resume the paused display of the content 1 in the first state. Therefore, the content 1 displayed on the HMD 100 may be displayed by moving into the digital device 200.
- a user 10 may look at a different spot instead of looking at a display unit 220 of a digital device 200 while wearing an HMD 100.
- the HMD 100 may be able to output a content 1.
- the HMD 100 may have established a communication connection with the digital device 200.
- the HMD 100 receives the content 1 from the digital device 200 by real time via a network 300 and may be then able to output the received content 1.
- the digital device 200 may pause a display of the content 1 in a second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
- the user 10 may look at the display unit 220 of the digital device 200 while wearing the HMD 100. In doping so, the display unit 220 of the digital device 200 may be located within the view angle region 102 of the HMD 100. According to an embodiment of the present invention, if the display unit 220 of the digital device 200 is located within the view angle region 102 of the HMD 100, the HMD 100 may not output the content 1. According to one embodiment of the present invention, in FIG. 7 (b), the HMD 100 may not have established a communication connection with the digital device 200. Meanwhile, according to an embodiment of the present invention, if the digital device 200 pauses a display of the content 1, the digital device 200 may resume the display of the content 1.
- FIG. 8 shows that a location state of a digital device 200 is switched to a first state [FIG. 8 (b)] from a second state [FIG. 8 (a)] according to another embodiment of the present invention.
- the digital device 200 may be able to display a content 1 in both of the first state and the second state.
- an HMD 100 may be able to adjust whether to output the content 1 based on whether the digital device 200 located within the view angle region 102 of the HMD 100 displays the same content 1 of the HMD 100.
- a user 10 may look at a different spot instead of looking at a display unit 220 of a digital device 200 while wearing an HMD 100.
- the HMD 100 may be able to output a content 1.
- the display device 200 is displaying the content 1 in a second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
- the user 10 may look at the display unit 220 of the digital device 200 while wearing the HMD 100.
- the digital device 200 having entered the view angle region 102 of the HMD 100 is displaying the content 1.
- the content 1 currently displayed by the digital device 200 may be identical to or different from the content 1 currently outputted by the HMD 100.
- the content 1 currently displayed by the digital device 200 may be identical to the content 1 currently outputted by the HMD 100.
- the content 1 currently displayed by the digital device 200 may not be identical to the content 1 currently outputted by the HMD 100.
- the content 1 is a webpage
- a webpage change in response to a URL access change of the digital device 200 may not be delivered to the HMD 100 yet.
- the HMD 100 determines whether the content 1 displayed by the digital device having entered the view angle region 102 is identical to the content 1 currently outputted by the HMD 100. If the content 1 displayed by the digital device is identical to the content 1 currently outputted by the HMD 100, referring to FIG. 8 (b), the HMD 100 may be able to avoid the overlapping of the display of the content 1 by terminating the output of the content 1. Otherwise, i.e., if the content 1 displayed by the digital device is not identical to the content 1 currently outputted by the HMD 100, the HMD 100 may not terminate the output of the content 1.
- the location state of the digital device 200 when the location state of the digital device 200 is switched into a first state, in which the location state is located within the view angle region 102 of the HMDD, into a second state in which the location state is located outside the view angle region 102 of the HMD 100, an appropriate feedback may be provided on the HMD 100. For instance, if the location state of the digital device 200 is switched into the first state from the second state, the HMD 100 may be able to provide a vibration feedback. For another instance, if the location state of the digital device 200 is switched into the first state from the second state, the HMD 100 may be able to fade out the content 1.
- FIG. 9 shows another embodiment of outputting a content 1 using an HMD 100 of the present invention.
- a location state of a digital device 200 is determined based on a location of the digital device 200 and a direction of a display unit 220 of the digital device 200.
- the location state may be determined based on whether the display unit 220 of the digital device 200 is located within a view angle region 102 of an HMD 100.
- it may be able to detect the location state of the According to one embodiment of the present invention, based on whether a light pattern 5 outputted by the digital device 200 is detected.
- the display unit 220 of the digital device 200 may be enabled to face the HMD 100. In doing so, the HMD 100 may be able to detect the light pattern 5 outputted by the digital device 200. If the light pattern 5 is detected, the HMD 100 recognizes a location state of the digital device 200 as a first state and does not output the content 1 of the digital device 200 correspondingly.
- the digital device shown in FIG. 9 (a) may be inverted.
- the display unit 220 of the digital device 200 may be set not to face the HMD 100.
- the HMD 100 may not be able to detect the light pattern 5 outputted by the digital device 200.
- the HMD 100 may recognize the location state of the digital device 200 shown in FIG. 9 (b), in which the light pattern 5 is not detected, as a second state. Hence, the HMD 100 may be able to output the content 1 of the digital device 200.
- FIG. 10 shows a further embodiment of outputting a content 1 using an HMD 100 of the present invention.
- a display unit 220 of a digital device 200 in a second state in which a display unit 220 of a digital device 200 is not located within a view angle region 102 of an HMD 100, it may be able to detect whether a display unit 222 of at least one external device 202 is present in the view angle region 102. If it is detected that detect the display unit 222 of the at least one external device 202 is present in the view angle region 102, the display unit 222 of the corresponding external device 202 may be able to output a content 1 of the digital device 200.
- the display unit 220 of the digital device 200 may be located outside the view angle region 102 of the HMD 100.
- the HMD 100 may be able to output the content of the digital device 200, of which details are mentioned in the foregoing description with reference to FIG. 7 (a).
- the external device 202 may be located within the view angle region 102 of the HMD 100.
- the HMD 100 may be able to detect the display unit 222 of the external device 202 located within the view angle region 102.
- the content 1 may be outputted to the display unit 222 of the corresponding external device 202.
- the detected external device 202 may be able to establish a communication connection with the digital device 200.
- the external device 202 may be able to receive the content 1 from the digital device 200 using the network 300. And, the received content 1 may be outputted to the display unit 222 of the external device 202.
- FIGs. 11 to 13 show further embodiments of the present invention.
- FIG. 11 is a flowchart for a content outputting method using an HMD according to a further embodiment of the present invention.
- the processor 110 of the HMD 100 shown in FIG. 2 may be able to control the following operations of the respective steps shown in FIG. 1. Details of the same or similar parts in the former embodiment described with reference to FIG. 3 shall be omitted in the description of the present embodiment with reference to FIG. 11.
- an HMD of the present invention detects a first marker located within a view angle region of the HMD [S1110].
- a marker of the present invention is the identifier indicating content information and may include one of a bar code, a QR code, an RFID, a color code, an image code and the like.
- the HMD may be able to detect a location state of the first marker [S1120].
- the location state of the present invention may include a first sate having the first marker located within a preset view angle region of the HMD and a second state having the first marker not located within the view angle region.
- the HMD may be able to detect the location state of the first marker using an image photographing sensor.
- the image photographing sensor detects an image within the preset view angle region and may then provide the detected image to a processor of the HMD.
- the processor may be able to detect whether the first marker is present within the view angle region of the HMD based on the image detected by the image photographing sensor.
- the HMD may be able to determine whether to output a content corresponding to the first marker. To this end, based on the detected location state of the first marker, the HMD determines whether the first marker is located within the view angle region of the HMD [S1130]. If the first marker is located within the view angle region of the HMD, the HMD does not output the content corresponding to the first marker [S1140]. Otherwise, i.e., if the first marker is not located within the view angle region of the HMD, the HMD may be able to receive the content corresponding to the first marker [S1142]. In dong so, the HMD may be able to receive the content from a server via the network. Once the content is received from the server, the HMD outputs the received content [S1144].
- the HMD keeps determining whether a marker within the view angle region is detected. In dong so, the HMD may be able to determine whether a second marker different from the first marker is detected within the view angle region [S1150]. If the second marker is not detected, the HMD goes back to the step S1120 and then continues the content output operation in accordance with the location state of the first marker. In particular, based on the location state of the first marker, the HMD may be able to trigger whether to output the content corresponding to the first marker. If the second marker is detected, the HMD terminates the content output operation in accordance with the location state of the first marker.
- the HMD may be able to detect the location state of the newly detected second marker and may be then able to perform a content output in accordance with the location state of the second marker by the same method mentioned in the foregoing description of the embodiment with reference to FIG. 11.
- FIG. 12 and FIG. 13 show a detailed method of outputting a content using an HMD in accordance with the former embodiment shown in FIG. 11.
- a user 10 may be able to watch a content 1 including a marker 5 while wearing an HMD 100.
- the content 1 may include an analog content instead of a digital content.
- the content 1 may include a partial or whole region of a book, a magazine, a newspaper, a photo or the like.
- the content 1 may include the marker 5 indicating the information on the corresponding content 1.
- the marker is located within a view angle region 102 of the HMD 100. And, the HMD 100 does not output the content 1.
- the user 10 may look at a different spot other than the content 1 while wearing the HMD 100.
- the marker 5 included in the content 1 may be located outside the view angle region 102 of the HMD 100.
- a location state of the marker 5 may be switched from a first state [FIG. 12] to a second state [FIG. 13 (a)].
- the HMD 100 may be able to output the content 1 corresponding to the marker 5.
- the HMD 100 receives the content 1 corresponding to the marker 5 from a server (not shown in the drawing) via a network 300 and may be then able to output the received content.
- the user 10 may be able to look at the content 1 again while wearing the HMD 100.
- the marker 5 included in the content 1 may be located within the view angle region of the HMD 100.
- the location state of the marker 5 may be switched from the second state [FIG. 13 (a)] to the first state [FIG. 13 (b)].
- the HMD 100 may be able to terminate the output of the content 1 corresponding to the marker 5.
- the HDM 100 may be able to adjust whether to output the content 1 based on whether the content 1 located with the view angle region 102 of the HMD 100 is identical to the content 1 currently outputted by the HMD 100.
- the HMD 100 determines whether the content 1 having entered the view angle region 102 is identical to the content 1 currently outputted by the HMD 100. If the content 1 having entered the view angle region n102 is identical to the content 1 currently outputted by the HMD 100, referring to FIG. 13 (b), the HMD 100 may be able to avoid the overlapping of the display of the content 1 by terminating the output of the content 1. Otherwise, i.e., if the content 1 having entered the view angle region 102 is not identical to the content 1 currently outputted by the HMD 100, the HMD 100 may not terminate the output of the content 1.
- a location state of a digital device may be determined based on eyes of a user who wears an HMD.
- the HMD of the present invention may further include an image photographing sensor configured to detect a position of the pupil of the user wearing the HMD and may be able to track eyes of the corresponding user using the image photographing sensor. Therefore, the location state of the digital device of the present invention may be determined based on whether a display unit of the digital device is located within a view angle region of the user wearing the HMD.
- the view angle region may include a region within a predetermined range corresponding to the eyes of the user wearing the HMD.
- the location state of the digital device may include a third state in which the display unit of the digital device is located within the view angle region of the user wearing the HMD and a fourth state in which the display unit of the digital device is not located within the view angle region of the user wearing the HMD.
- a location state of a marker may be also determined based on the eyes of the user wearing the HMD in the manner mentioned in the above description.
- HMD mentioned in the description of the present invention may be changeable with or replaceable by various devices for the purposes of the present invention.
- HMD of the present invention may include such a device, which is capable of providing a display by being put on a user, as EMD (eye mounted display), eyeglass, eyepiece, eyewear, HWD (head worn display) and the like.
- EMD eye mounted display
- eyeglass eyepiece
- eyewear eyewear
- HWD head worn display
- the HMD may be non-limited by the terminologies used for the description of the present invention.
- the present invention may be applicable to electronic devices entirely or in part.
Abstract
The present invention relates to a method of outputting a content using a head mounted display (HMD), and more particularly, to a method of outputting a currently displayed content of a digital device to an HMD. The present invention includes performing a pairing with a digital device having at least one display unit configured to display the content, detecting a location state of the paired digital device, and outputting the content displayed on the digital device to the HMD, wherein the location state comprises a first state in which a display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region.
Description
The present invention relates to a method of outputting a content using a head mounted display (HMD), and more particularly, to a method of outputting a currently displayed content of a digital device to an HMD.
A head mounted display (hereinafter abbreviated HMD) means a sort of an image display device wearable on a head like glasses to enable an image to be viewed. As a digital device tends to have its lightness in weight and its compactness, various kinds of wearable computers are being developed and the HMD is being widely used. The HMD is combined with such a technology as an augmented reality technology, an N-screen technology and the like over a simple display function, thereby providing a user with a variety of convenience.
The HMD is usable by being linked with various kinds of digital devices. The HMD is linked with a digital device via network to output a content of the corresponding digital device. And, the HMD receives a user input for the digital device or is able to perform a job interoperable with the corresponding digital device.
Accordingly, the present invention is directed to a head mounted display and method of outputting a content using the same that substantially obviate one or more of the problems due to limitations and disadvantages of the related art.
An object of the present invention is to provide a head mounted display and method of outputting a content using the same, by which a user can be provided with an optimal-state content displayed on a display device interoperating with a head mounted display (HMD).
In particular, one object of the present invention is to provide a method of displaying a content appropriately in accordance with a use status of a user wearing a head mounted display (HMD), e.g., eyes of the HMD wearing user.
Another object of the present invention is to provide a head mounted display and method of outputting a content using the same, by which a user can be provided with convenience in a manner that a content output switching between a head mounted display (HMD) and a digital device interoperating with the head mounted display is automatically performed without a manual input performed by the user.
Technical tasks obtainable from the present invention are non-limited the above-mentioned technical task. And, other unmentioned technical tasks can be clearly understood from the following description by those having ordinary skill in the technical field to which the present invention pertains.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a method of outputting a content using an HMD (head mounted display) according to one embodiment of the present invention may include the steps of performing a pairing with a digital device having at least one display unit configured to display the content, detecting a location state of the paired digital device, and outputting the content currently displayed on the digital device to the HMD, wherein the location state includes a first state in which a display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region.
To further achieve these and other advantages and in accordance with the purpose of the present invention, a method of outputting a content using an HMD (head mounted display) according to another embodiment of the present invention may include the steps of detecting at least one marker located within a preset view angle region of the HMD, the at least one marker comprising an identifier indicating content information, detecting a location state of the marker, the location state including a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region, if the location state of the marker is switched into the second state from the first state, receiving the content corresponding to the marker from a server, and outputting the received content to the HMD, wherein if the location state of the marker is switched into the first state from the second state, the outputting step includes the step of terminating an output of the content.
To further achieve these and other advantages and in accordance with the purpose of the present invention, an HMD (head mounted display) according to another embodiment of the present invention may include a processor controlling an operation of the HMD, a display unit outputting an image based on a command given by the processor, and a communication unit transceiving data with at least one digital device based on the command given by the processor, wherein the processor performs a pairing with a digital device having at least one display unit configured to display the content, wherein the processor detects a location state of the paired digital device, wherein the processor outputs the content currently displayed on the digital device to the display unit of the HMD based on the detected location state, and wherein the location state includes a first state in which the display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region.
To further achieve these and other advantages and in accordance with the purpose of the present invention, an HMD (head mounted display) according to a further embodiment of the present invention may include a processor controlling an operation of the HMD, a display unit outputting an image based on a command given by the processor, and a communication unit transceiving data with at least one digital device based on the command given by the processor, wherein the processor detects at least one marker located within a preset view angle region of the HMD, wherein the at least one marker includes an identifier indicating content information, wherein the processor detects a location state of the marker, wherein the location state includes a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region, wherein if the location state of the marker is switched into the second state from the first state, the processor receives the content corresponding to the marker from a server, wherein the processor outputs the received content to the HMD, and wherein if the location state of the marker is switched into the first state from the second state, the processor terminates an output of the content.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
Accordingly, the present invention provides the following effects or advantages.
First of all, the present invention enables a content, which is displayed on a display device currently interoperating with an HMD, to move seamlessly into the HMD in accordance with a use environment of a user, thereby providing the user with convenience.
In particular, if eyes of a user, who wears an HMD, do not face a digital device interoperating with the HMD, a content currently displayed on the corresponding digital device is automatically displayed on the HMD, whereby the user can be provided with the content on the HMD.
Secondly, if eyes of a user, who wears an HMD, face a digital device interoperating with the HMD, the HMD does not perform a content display, whereby the user can be exactly provided with the content of the digital device without interference via a display of the HMD.
Thirdly, according to the present invention, since a triggering for determining whether a content currently displayed on a digital device will be outputted to an HMD is automatically switched based on eyes of a user, the user can be persistently provided with the content of the digital device without performing a separate user input.
Finally, according to another embodiment of the present invention, when user’s eyes through an HMD face another external device having a display unit, the corresponding external device is enabled to output a content, whereby the user can be provided with the content through various resources capable of displaying contents.
Effects obtainable from the present invention may be non-limited by the above mentioned effect. And, other unmentioned effects can be clearly understood from the following description by those having ordinary skill in the technical field to which the present invention pertains.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
In the drawings:
FIG. 1 is a diagram of an HMD according to an embodiment to the present invention, a user wearing the HMD, and a digital device interoperating with the HMD;
FIG. 2 is a block diagram of an HMD according to an embodiment of the present invention;
FIG. 3 is a flowchart for a content outputting method using an HMD according to one embodiment of the present invention;
FIG. 4 is a flowchart for a content outputting method using an HMD according to another embodiment of the present invention;
FIGs. 5 to 7 are diagrams for one detailed examples of outputting a content using an HMD of the present invention;
FIGs. 8 to 10 are diagrams for another detailed examples of outputting a content using an HMD of the present invention;
FIG. 11 is a flowchart for a content outputting method using an HMD according to a further embodiment of the present invention; and
FIG. 12 and FIG. 13 are diagrams for further detailed examples of outputting a content using an HMD of the present invention.
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
First of all, although terminologies used in the present specification are selected from general terminologies used currently and widely in consideration of functions in the present invention, they may be changed in accordance with intentions of technicians engaged in the corresponding fields, customs, advents of new technologies and the like. Occasionally, some terminologies may be arbitrarily selected by the applicant(s). In this case, the meanings of the arbitrarily selected terminologies shall be described in the corresponding part of the detailed description of the invention. Therefore, terminologies used in the present specification need to be construed based on the substantial meanings of the corresponding terminologies and the overall matters disclosed in the present specification rather than construed as simple names of the terminologies.
FIG. 1 shows an HMD 100 according to an embodiment to the present invention, a user 10 wearing the HMD, and a digital device 200 interoperating with the HMD 100.
Referring to FIG. 1, the digital device 200 may be able to output various kinds of contents 1. For instance, the digital device 200 may be able to output various kinds of multimedia contents including a live broadcast, a movie, a music, a drama, a webpage, a game, and application and the like. The digital device 200 includes at least one display unit 220. The content 1 outputted from the digital device 200 may be displayed on the display unit 220. Meanwhile, the digital device 200 may include a communication unit (not shown in the drawing). And, data can be transceived between the HMD 100 and other external devices via the communication unit. According to the present invention, the digital device 200 may include various kinds of electronic devices each of which includes a display unit and a communication unit. For instance, the digital device 200 may include such a device, which is capable of image display and data communication, as a PC, a PDA (personal digital assistant), a notebook computer, a tablet PC, a television and the like.
The HMD 100 may be configured to work by interoperating with the digital device 200. For the interoperation between the HMD 100 and the digital device 200, a separate pairing or communication connection may be performed. This paring or communication connecting job may be performed in response to a user input performed on the HMD 100 or the digital device 200. For instance, the HMD 100 may be able to provide a separate button or user interface for the pairing or communication connection with the digital device 200. Hence, a user may be able to attempt the paring or communication connection between the HMD 10 and the digital device 200 via a user input using the button or user interface.
The HMD 100 is capable of image display using the included display unit. For instance, the HMD 100 may be able to display a user interface of its own, a response to a user input and the like. And, the HMD 100 may be able to display various kinds of contents by interoperating with the digital device 200 connected by a network 300. According to the embodiment of the present invention, the HMD 100 may be able to have a view angle region 102 in a preset range. This view angle region 102 is a preset region corresponding to a view of the user wearing the HMD 100 and may include a section covering a predetermined angle range in front direction of the HMD 100.
According to the embodiment of the present invention, the HMD 100 may be able to detect whether the digital device 200 interoperating with the HMD 100 is located in the view angle region 102 of the HMD 100. In particular, the HMD 100 may be able to detect a location state of the interoperating digital device 200. In the present invention, the location state may include a first state having the display unit 220 of the digital device 200 located in the view angle region 102 of the HMD 100 and a second state having the display unit 220 of the digital device 200 located outside the view angle region 102 of the HMD 100.
Meanwhile, the network 300 of the present invention may include wire/wireless networks that enable communications between the HMD 100 and the digital device 200. In particular, available wireless networks may include NFC (near field communication), Zigbee, Infrared communication, Bluetooth, Wi-Fi and the like, by which the present invention may be non-limited. According to the present invention, communications between the HMD 100 and the digital device 200 may be performed using one of the above-enumerated networks 300 or a combination thereof.
FIG. 2 is a block diagram of an HMD according to an embodiment of the present invention.
Referring to FIG. 2, an HMD 100 according to the present invention may include a processor 110, a display unit 120, an audio output unit 130, a communication unit 140, a sensor unit 150, a storage unit 160 and a power unit 180.
First of all, the display unit 120 outputs an image to a display screen. In particular, the display unit 120 may be able to output an image based on a content executed in the processor 110 or a control command given by the processor 110. According to an embodiment of the present invention, the display unit 120 may be able to display an image based on a control command given by an external device (e.g., a digital device) interoperating with the HMD 100. For instance, the display unit 120 may be able to display a content currently executed by the digital device interoperating with the HMD 100. In doing so, the HMD 100 receives data from the digital device via the communication unit 140 and may be then able to output a corresponding image based on the received data.
The audio output unit 130 may include such an audio output means as a speaker, an earphone and the like. The audio output unit 130 may be able to output audio based on a content executed in the processor 110 or a control command given by the processor 110 as well. According to the embodiment of the present invention, the audio output unit 130 may be able to output audio based on a control command given by the digital device interoperating with the HMD 100. For instance, the audio output unit 130 may be able to output audio based on a content currently executed by the digital device interoperating with the HMD 100. According to the present invention, the audio output unit 130 may be optionally provided to the HMD 100.
The communication unit 140 may be able to transmit and receive data by performing communications with an external device by various protocols. The communication unit 140 accesses a network by wire/wireless and may be then able to transmit and receive digital data such as contents and the like. According to the present invention, the HMD 100 may be able to perform a pairing and communication connection with a digital device using the communication unit 140 and may be then able to transceive data with the connected digital device. Meanwhile, according to one embodiment of the present invention, the communication unit 140 may be able to include a plurality of antennas. Using a plurality of the antennas, the HMD 100 may be able to detect a location state of a digital device communication-connected with the HMD 100. In particular, using time differences, phase differences and the like of the signals transceived via a plurality of the antennas provided to the HMD 100, the HMD 100 may be able to detect whether a display unit of the digital device connected with the HMD 100 is located in a view angle region of the HMD 100.
The sensor unit 150 may be able to forward a user input or an environment recognized by the HMD 100 to the processor 110 using a plurality of sensors installed in the HMD 100. In this case, the sensor unit 150 may be able to include a plurality of sensing means. For example, a plurality of the sensing means may include a gravity sensor, a geomagnetic sensor, a motion sensor, a gyro sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, an olfactory sensor, a temperature sensor, a depth sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a GPS (global positioning system) sensor, a touch sensor and the like. The sensor unit 150 is a common name of one of the various sensing means mentioned in the above description. The sensor unit 150 senses valorous inputs and user’s environment and may be then able to forward a sensing result to the processor 100 to perform a corresponding action or operation. The above-mentioned sensors may be included as separate elements in the HMD 100 or may be included in a manner of being integrated into at least one element.
According to another embodiment of the present invention, the sensor unit 150 may include an image photographing sensor (not shown in the drawing). The image photographing sensor detects an image within a preset view angle image and may be then able to provide the detected image to the processor 110. According to one embodiment of the present invention, based on the image detected via the image photographing sensor, the processor 110 may be able to detect whether a digital device (or, a display unit of the corresponding digital device) interoperating with the HMD 100 is present within the view angle region of the HMD 100. In this case, the image photographing sensor may be substituted with an infrared sensor or the like for the purpose of the present invention.
The storage unit 160 of the present invention may be able to store various digital data including video, audio, photos, moving pictures, applications and the like. The storage unit 160 may include such a digital data storage space as a flash memory, a random access memory (RAM), a solid state drive (SSD) and the like. According to an embodiment of the present invention, the storage unit 160 may be able to temporarily store data received from a digital device via the communication unit 140. In doing so, the storage unit 160 may be used for the buffering to output the data or content received from the digital device to the HMD 100. According to the present invention, the storage unit 160 may be optionally provided to the HMD 100.
The power unit 170 is the power source connected to a battery in a device or an external power source and may be able to supply power to the HMD 100.
The processor 110 of the present invention may be able to execute the contents received via data communications, the contents saved in the storage unit 160 and the like. Moreover, the processor 110 may be able to activate various applications and to process the data inside the device. In addition, the processor (or, main control unit) 110 may be able to control various units of the HMD 100 mentioned in the above description and data transmissions and receptions between the units.
In the block diagram of the HMD 100 shown in FIG. 2, the separately illustrated blocks indicate elements of the device logically and discriminatively. Therefore, the elements of the device mentioned in the above description may be installed in a manner of being integrated into one chip or a plurality of chips by the design of the device.
FIG. 3 is a flowchart for a content outputting method using an HMD according to one embodiment of the present invention. In the following description, the steps shown in FIG. 3 may be controlled by the processor 110 of the HMD 100 shown in FIG. 2.
Referring to FIG. 3, an HMD of the present invention may be able to perform a communication connection with a digital device [S310]. In this case, the communication connection may be performed in repose to a user input performed on the HMD or the digital device. For instance, the HMD may be able to provide a separate button or user interface for the communication connection with the digital device. In dong so, a user may be able to perform the communication connection between the HMD and the digital device by performing a user input using the button or the user interface. Before the communication connection between the HMD and the digital device is performed, the HMD may be paired with the digital device. If the HMD of the present invention performs the communication connection with the digital device, the HMD may be able to transceive data with the digital device while a session is open.
Subsequently, the HMD of the present invention may be able to detect a location state of the connected digital device [S320]. According to the present invention, the location state may include a first state having the display unit of the digital device located in a preset view angle region of the HMD and a second state having the display unit of the digital device located outside the view angle region of the HMD. According to the present invention, the view angle region is a preset region corresponding to eyes of a user who is wearing the HMD and may include a section within a predetermined angle range in front direction of the HMD.
According to one embodiment of the present invention, the HMD may be able to detect a location state of a digital device using a plurality of antennas. In particular, the HMD may be able to perform transceive data with the digital device via a plurality of the antennas provided to the HMD. In dong so, using time differences, phase differences and the like of signals transceived via a plurality of the antennas, it may be able to detect relative locations and directions between the HMD and the digital device connected with the HMD. According to the present invention, even if a direction (e.g., an azimuth angle) having the digital device located therein is changing while a distance between the digital device is maintained constant, it may be able to accurately detect a location state of the digital device using a plurality of the antennas provided to the HMD.
According to another embodiment of the present invention, it may be able to detect a location state of the digital device using an image photographing sensor. In particular, while the HMD establishes a communication connection with the digital device, the image photographing sensor detects an image within the preset view angle region of the HMD and may be then able to provide the detected image to the processor of the HMD. Based on the image detected by the image photographing sensor, the processor may be able to detect whether a digital device (or, a display unit of the corresponding digital device) connected with the HMD is present within the view angle region of the HMD. For instance, the digital device connected with the HMD may be able to output a preset light pattern and the HMD is then able to detect the light pattern outputted from the digital device. In dong so, the light pattern may include at least one of a temporal pattern and a spatial pattern. Moreover, according to the embodiment of the present invention, the light pattern may be outputted from the display unit of the digital device.
If the digital device connected with the HMD is present within the view angle region of the HMD, the HMD may be able to detect the light pattern outputted from the digital device via the image photographing sensor. Otherwise, i.e., if the digital device connected with the HMD is not present within the view angle region of the HMD, the light pattern outputted from the digital device may not be detected via the image photographing sensor. Meanwhile, when a light pattern is outputted via the display unit of the digital device according to the embodiment of the present invention, even if the display unit of the corresponding digital device does not face a user despite that the digital device is present within the view angle region, the light pattern may not be detected. In particular, when a user is in a situation that the display unit of the digital device is not viewable, the HMD may be unable to detect the light pattern. Therefore, based on whether a light pattern of a digital device is detected within a view angle region, an HMD of the present invention may be able to detect a location state of the digital device.
When the digital device performs the communication connection with the HMD according to the embodiment of the present invention, the light pattern may be outputted via the display unit of the digital device, by which the present invention may be non-limited. Alternatively, according to the present invention, the digital device may be able to output a light pattern of itself irrespective of whether the digital device has performed the communication connection with the HMD.
Subsequently, the HMD of the present invention may be able to output a content currently displayed on the digital device to the HMD based on the detected location state of the digital device. To this end, based on the detected location state of the digital device, the HMD preferentially determines whether the display unit of the corresponding digital device is present within the view angle region of the HMD [S330]. If the display unit of the digital device is present within the view angle region, the HMD of the present invention may not output the currently displayed content of the digital device [S340]. On the contrary, if the display unit of the digital device is not present within the view angle region, the HMD of the present invention may be able to output the currently displayed content of the digital device [S342]. To this end, the HMD receives the currently displayed content of the digital device from the digital device and may be then able to output the received content to the display unit of the HMD.
Thus, according to the embodiment of the present invention, while the HMD is connected with the digital device, the HMD may be able to trigger whether to output a content of the digital device in accordance with a location state relative to that of the digital device. In particular, in the first state in which the display unit of the digital device is located within the view angle region of the HMD, the HMD does not output a currently displayed content of the digital device. On the other hand, in the second state in which the display unit of the digital device is not located within the view angle region of the HMD, the HMD may be able to output a currently displayed content of the digital device. Hence, in the second state in which a location of the digital device deviates from the view of the user wearing the HMD, the user may be able to be provided with the content of the digital device via the HMD. On the other hand, in the first state in which a location of the digital device lies within the view of the user wearing the HMD, the user may be able to be provided with the content via the digital device without interference via the display of the HMD.
Meanwhile, according to another embodiment of the present invention, after a detected location state of a digital device has been switched, if the switched location state is maintained over a preset time preriod, an HMD may be able to trigger whether to output a content of the digital device. In particular, if the location state of the digital device is switched into a second state from a first state in which the content of the digital device is not outputted, when the location state of the digital device is maintained in the second state over the preset time, the HMD may be able to output the content of the digital device. Moreover, if the location state of the digital device is switched into the first state from the second state in which the content of the digital device is outputted, when the location state of the digital device is maintained in the first state over a preset time, the HMD may be able to terminate the output of the content of the digital device.
Subsequently, the HMD of the present invention determines whether the communication connection with the digital device is ongoing [S350]. If the communication connection with the digital device is ongoing, the HMD goes back to the step S320 and then detects a location state of the paired digital device. If the communication connection between the HMD and the digital device is terminated, the HMD may terminate the content output of the digital device.
In particular, an HMD according to the present invention may be able to detect a real-time location state of a digital device while a communication connection is established between the HMD and the digital device. Based on the detected location state, it may be able to determine whether a content currently displayed by the digital device will be outputted to the HMD. If the detected location state is switched, it may be able to adjust whether to output the content of the digital device to the HMD based on the switched location state. If the communication connection with the digital device is terminated, the HMD may be able to terminate both of the job of detecting the location state of the digital device and the job of outputting the content of the digital device.
FIG. 4 is a flowchart for a content outputting method using an HMD according to another embodiment of the present invention. According to the present invention, the processor 110 of the HMD 100 shown in FIG. 2 may be able to control the operations of the respective steps mentioned in the following. In the following description of the embodiment with reference to FIG. 4, details of the same or similar parts of the former embodiment described with reference to FIG. 3 shall be omitted.
Referring to FIG. 4, an HMD of the present invention performs a pairing with a digital device [S410]. Subsequently, the HMD may be able to detect a location state of the paired digital device [S420]. The detailed embodiments of the steps S410 and S420 are identical to those of the former steps S310 and S320 described with reference to FIG. 3. Yet, in the embodiment of the step S420, the HMD may be able to detect the location state of the paired digital device despite that a communication connection with the digital device is not performed yet. To this end, according to one embodiment of the present invention, the HMD may be able to detect the location state of the corresponding digital device based on whether a light pattern outputted from the digital device is detected.
Subsequently, based on the detected location state of the digital device, it may be able to determine whether to establish a communication connection between the HMD and the digital device. To this end, the HMD preferentially determines whether the display unit of the corresponding digital device is present within the view angle region of the HMD based on the detected location state of the digital device [S430]. If the display unit of the digital device is present within the view angle region, the HMD of the present invention may not establish the communication connection with the digital device [S440]. On the contrary, if the display unit of the digital device is not present within the view angle region, the HMD may be able to establish the communication connection with the digital device [S442]. If the HMD establishes the communication connection with the digital device, it may be able to receive a currently displayed content of the digital device from the digital device [S444]. The HMD of the present invention may be then able to output the received content [S446].
Thus, according to the embodiment of the present invention, while the HMD and the digital device are paired with each other, the HMD may be able to trigger whether to establish the communication connection with the digital device in accordance with a location state relative to that of the digital device. In particular, in the first state in which the display unit of the digital device is located within the view angle region of the HMD, the communication connection between the HMD and the digital device is established. On the other hand, in the second state in which the display unit of the digital device is not located within the view angle region of the HMD, the communication connection between the HMD and the digital device is not established. Once the communication between the HMD and the digital device is established, the HMD receives a currently activated content of the digital device by real time and may be then able to output the received content.
Meanwhile, according to another embodiment of the present invention, after a detected location state of a digital device has been switched, if the switched location state is maintained over a preset time, it may be able to trigger whether to establish a communication connection between an HMD and the digital device. In particular, if the location state of the digital device is switched into a second state from a first state in which the communication connection between the HMD and the digital device is not established, when the location state of the digital device is maintained in the second state over the preset time, it may be able to establish the communication connection between the HMD and the digital device. Moreover, if the location state of the digital device is switched into the first state from the second state in which the communication connection between the HMD and the digital device is established, when the location state of the digital device is maintained in the first state over a preset time, the HMD may be able to terminate the communication connection between the HMD and the digital device.
Subsequently, the HMD of the present invention determines whether the HMD is being paired with the digital device is ongoing [S450]. If the HMD is being paired with the digital device, the HMD goes back to the step S420 and then detects a location state of the paired digital device. If the pairing between the HMD and the digital device is terminated, the HMD may terminate the content output of the digital device.
In particular, an HMD according to the present invention may be able to detect a real-time location state of a digital device while paired with the digital device. Based on the detected location state, it may be able to determine whether to establish a communication connection between the HMD and the digital device. If the detected location state is switched, it may be able to adjust whether to establish the communication connection between the HMD and the digital device based on the switched location state. If the pairing with the digital device is terminated, the HMD may be able to terminate both of the job of detecting the location state of the digital device and the job of outputting the content of the digital device.
FIGs. 5 to 7 are diagrams for one detailed examples of outputting a content 1 using an HMD 100 of the present invention. In the embodiments shown in FIGs. 5 to 7, an HMD 100 is being paired with a digital device 200. Referring to FIGs. 5 to 7, it may be able to control an output of a content 1 of the HMD 100 based on a location state of a digital device 200 with reference to the HMD 100, i.e., relative locations and directions between the HMD 100 and the digital device 200.
First of all, FIG. 5 and FIG. 6 show a case that the location state of the digital device 200 is switched into a second state [FIG. 5 (b)] from a first state [FIG. 5 (a)] according to an embodiment of the present invention. In doing so, the content 1 currently displayed on the digital device 200 moves to the HMD 100 and may be then displayed on the HMD 100.
In particular, referring to FIG. 5 (a), a user 10 is able to watch the content 1 displayed on a display unit 220 of the digital device 200 while wearing the HMD 100 of the present invention. In doing so, the display unit 220 of the digital device 200 may be located within a view angle region 102 of the HMD 100. According to an embodiment of the present invention, if the display unit 220 of the digital device 200 is present within the view angle region 102 of the HMD 100, the HMD 100 does not output the content 1. According to one embodiment of the present invention, in FIG. 5 (a), the HMD 100 may be in a state that a communication connection with the digital device 200 is not established.
Meanwhile, referring to FIG. 5 (b), according to an embodiment of the present invention, while a user 10 is wearing the HMD 100, the user 10 may look at a different spot instead of looking at the display unit 220 of the digital device 200. In doing so, the display unit 220 of the digital device 200 may be located outside the view angle region 102 of the HMD 100. Thus, if the display unit 220 of the digital device 200 is present outside the digital device 200, the HMD 100 may be able to output the content 1. According to one embodiment of the present invention, in FIG. 5 (b), the HMD 100 has already established the communication connection with the digital device 200. Hence, the HMD 100 receives the content 1 from the digital device 200 via a network 300 by real time and may be then able to output the received content 1. Meanwhile, according to the embodiment of the present invention, the digital device 200 may stop displaying the content 1 in the second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
According to the embodiment of the present invention, when the location state of the digital device 200 is switched from the first state, in which the location state is located within the view angle region 102 of the HMDD, into the second state in which the location state is located outside the view angle region 102 of the HMD 100, an appropriate feedback may be provided on the HMD 100. For instance, if the location state of the digital device 200 is switched into the second state from the first state, the HMD 100 may be able to provide a vibration feedback. For another instance, if the location state of the digital device 200 is switched into the second state from the first state, the HMD 100 may be able to output the content 1 by fade-in. For another instance, the HMD 100 may be able to output the content 1 after a preset time. In particular, the HMD 100 may be able to output the content 1 after duration of the preset time from a time in which the location state of the digital device 200 was switched. Moreover, the digital device 200 may be able to stop an output of the content 1 during the preset time from the time in which the location state of the digital device 200 was switched. After duration of the preset time, the digital device 200 may continue to output the content 1. For instance, if the content 1 is a video content and the location state of the digital device 200 is switched from the first state into the second state, the digital device 200 may be able to pause the output of the video content during a preset time.
Meanwhile, according to another embodiment of the present invention shown in FIG. 6, when the location state of the digital device 200 is switched from the first state to the second state, the HMD 100 may be able to output the content 1 in a manner that the content 1 slides to move. In doing so, the HMD 100 enables the content 1 to slide to move into a center region from a side in which the display unit 220 of the display device 200 deviating from the view angle region 102 is located. For instance, if the digital device 200 in the first state deviates from the view angle region 102 of the HMD 100 and then enters the second state [Fig. 6 (a)], the HMD 100 enables the content 1 to be displayed in a manner that the content 1 slides to move to a center region from a left side in which the digital device 200 deviating from the view angle region 102 is located [FIG. 6 (b)]. In this case, the center region is the region situated at a central part of a frame displayed by the display unit and may include a preset region situated at a central part of the view angle region 102.
FIG. 7 shows that a location state of a digital device 200 is switched to a first state [FIG. 7 (b)] from a second state [FIG. 7 (a)] according to an embodiment of the present invention. In this case, an HMD 100 may be able to terminate an output of a currently displayed content 1. According to another embodiment of the present invention, if the digital device 200 pauses a display of the contents 1 in the second state, the digital device 200 may be able to resume the paused display of the content 1 in the first state. Therefore, the content 1 displayed on the HMD 100 may be displayed by moving into the digital device 200.
In particular, according to an embodiment of the present invention, referring to FIG. 7 (a), a user 10 may look at a different spot instead of looking at a display unit 220 of a digital device 200 while wearing an HMD 100. Thus, if the display unit 220 of the digital device 200 is located outside the view angle region 102 of the HMD 100, the HMD 100 may be able to output a content 1. According to one embodiment of the present invention, in FIG. 7 (a), the HMD 100 may have established a communication connection with the digital device 200. Hence, the HMD 100 receives the content 1 from the digital device 200 by real time via a network 300 and may be then able to output the received content 1. Meanwhile, according to an embodiment of the present invention, the digital device 200 may pause a display of the content 1 in a second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
Referring to FIG. 7 (b), the user 10 may look at the display unit 220 of the digital device 200 while wearing the HMD 100. In doping so, the display unit 220 of the digital device 200 may be located within the view angle region 102 of the HMD 100. According to an embodiment of the present invention, if the display unit 220 of the digital device 200 is located within the view angle region 102 of the HMD 100, the HMD 100 may not output the content 1. According to one embodiment of the present invention, in FIG. 7 (b), the HMD 100 may not have established a communication connection with the digital device 200. Meanwhile, according to an embodiment of the present invention, if the digital device 200 pauses a display of the content 1, the digital device 200 may resume the display of the content 1.
FIG. 8 shows that a location state of a digital device 200 is switched to a first state [FIG. 8 (b)] from a second state [FIG. 8 (a)] according to another embodiment of the present invention. According to the embodiment shown in FIG. 8, the digital device 200 may be able to display a content 1 in both of the first state and the second state. According to one embodiment of the present invention, an HMD 100 may be able to adjust whether to output the content 1 based on whether the digital device 200 located within the view angle region 102 of the HMD 100 displays the same content 1 of the HMD 100.
Referring to FIG. 8 (a), a user 10 may look at a different spot instead of looking at a display unit 220 of a digital device 200 while wearing an HMD 100. Thus, if the display unit 220 of the digital device 200 is located outside the view angle region 102 of the HMD 100, the HMD 100 may be able to output a content 1. According to the embodiment shown in FIG. 8, the display device 200 is displaying the content 1 in a second state in which the digital device 200 is located outside the view angle region 102 of the HMD 100.
In this case, referring to FIG. 8 (b), the user 10 may look at the display unit 220 of the digital device 200 while wearing the HMD 100. In doing so, the digital device 200 having entered the view angle region 102 of the HMD 100 is displaying the content 1. The content 1 currently displayed by the digital device 200 may be identical to or different from the content 1 currently outputted by the HMD 100. In particular, if data are transmitted and received between the digital device 200 and the HMD 100 by real time, the content 1 currently displayed by the digital device 200 may be identical to the content 1 currently outputted by the HMD 100. On the contrary, if data are not transmitted and received between the digital device 200 and the HMD 100 by real time, the content 1 currently displayed by the digital device 200 may not be identical to the content 1 currently outputted by the HMD 100. For instance, in case that the content 1 is a webpage, a webpage change in response to a URL access change of the digital device 200 may not be delivered to the HMD 100 yet.
Hence, the HMD 100 according to an embodiment of the present invention determines whether the content 1 displayed by the digital device having entered the view angle region 102 is identical to the content 1 currently outputted by the HMD 100. If the content 1 displayed by the digital device is identical to the content 1 currently outputted by the HMD 100, referring to FIG. 8 (b), the HMD 100 may be able to avoid the overlapping of the display of the content 1 by terminating the output of the content 1. Otherwise, i.e., if the content 1 displayed by the digital device is not identical to the content 1 currently outputted by the HMD 100, the HMD 100 may not terminate the output of the content 1.
Meanwhile, according to the embodiment of the present invention, when the location state of the digital device 200 is switched into a first state, in which the location state is located within the view angle region 102 of the HMDD, into a second state in which the location state is located outside the view angle region 102 of the HMD 100, an appropriate feedback may be provided on the HMD 100. For instance, if the location state of the digital device 200 is switched into the first state from the second state, the HMD 100 may be able to provide a vibration feedback. For another instance, if the location state of the digital device 200 is switched into the first state from the second state, the HMD 100 may be able to fade out the content 1.
FIG. 9 shows another embodiment of outputting a content 1 using an HMD 100 of the present invention. According to an embodiment of the present invention, a location state of a digital device 200 is determined based on a location of the digital device 200 and a direction of a display unit 220 of the digital device 200. In particular, the location state may be determined based on whether the display unit 220 of the digital device 200 is located within a view angle region 102 of an HMD 100. According to one embodiment of the present invention, it may be able to detect the location state of the According to one embodiment of the present invention, based on whether a light pattern 5 outputted by the digital device 200 is detected.
Referring to FIG. 9 (a), while the digital device 200 is located within the view angle region 102 of the HMD 100, the display unit 220 of the digital device 200 may be enabled to face the HMD 100. In doing so, the HMD 100 may be able to detect the light pattern 5 outputted by the digital device 200. If the light pattern 5 is detected, the HMD 100 recognizes a location state of the digital device 200 as a first state and does not output the content 1 of the digital device 200 correspondingly.
Meanwhile, referring to FIG. 9 (b), the digital device shown in FIG. 9 (a) may be inverted. In particular, despite that the digital device 200 is located within the view angle region 102 of the HMD 100, the display unit 220 of the digital device 200 may be set not to face the HMD 100. In dong so, the HMD 100 may not be able to detect the light pattern 5 outputted by the digital device 200. According to an embodiment of the present invention, the HMD 100 may recognize the location state of the digital device 200 shown in FIG. 9 (b), in which the light pattern 5 is not detected, as a second state. Hence, the HMD 100 may be able to output the content 1 of the digital device 200.
FIG. 10 shows a further embodiment of outputting a content 1 using an HMD 100 of the present invention. According to an embodiment of the present invention, in a second state in which a display unit 220 of a digital device 200 is not located within a view angle region 102 of an HMD 100, it may be able to detect whether a display unit 222 of at least one external device 202 is present in the view angle region 102. If it is detected that detect the display unit 222 of the at least one external device 202 is present in the view angle region 102, the display unit 222 of the corresponding external device 202 may be able to output a content 1 of the digital device 200.
For instance, referring to FIG. 10 (a), the display unit 220 of the digital device 200 may be located outside the view angle region 102 of the HMD 100. In this case, the HMD 100 may be able to output the content of the digital device 200, of which details are mentioned in the foregoing description with reference to FIG. 7 (a).
Meanwhile, in the second state in which display unit 220 of the digital device 200 is located outside the view angle region 102 of the HMD 100, referring to FIG. 10 (b), the external device 202 may be located within the view angle region 102 of the HMD 100. In particular, the HMD 100 may be able to detect the display unit 222 of the external device 202 located within the view angle region 102. Thus, if the display unit 222 of the external device 202 is detected within the view angle region 102, the content 1 may be outputted to the display unit 222 of the corresponding external device 202. To this end, the detected external device 202 may be able to establish a communication connection with the digital device 200. Once the communication connection is established between the external device 202 and the digital device 200, the external device 202 may be able to receive the content 1 from the digital device 200 using the network 300. And, the received content 1 may be outputted to the display unit 222 of the external device 202.
FIGs. 11 to 13 show further embodiments of the present invention.
In particular, FIG. 11 is a flowchart for a content outputting method using an HMD according to a further embodiment of the present invention. According to the present invention, the processor 110 of the HMD 100 shown in FIG. 2 may be able to control the following operations of the respective steps shown in FIG. 1. Details of the same or similar parts in the former embodiment described with reference to FIG. 3 shall be omitted in the description of the present embodiment with reference to FIG. 11.
Referring to FIG. 11, an HMD of the present invention detects a first marker located within a view angle region of the HMD [S1110]. In particular, a marker of the present invention is the identifier indicating content information and may include one of a bar code, a QR code, an RFID, a color code, an image code and the like.
Subsequently, the HMD may be able to detect a location state of the first marker [S1120]. The location state of the present invention may include a first sate having the first marker located within a preset view angle region of the HMD and a second state having the first marker not located within the view angle region. According to an embodiment of the present invention, the HMD may be able to detect the location state of the first marker using an image photographing sensor. In particular, the image photographing sensor detects an image within the preset view angle region and may then provide the detected image to a processor of the HMD. The processor may be able to detect whether the first marker is present within the view angle region of the HMD based on the image detected by the image photographing sensor.
Subsequently, based on the detected location state of the first marker, the HMD may be able to determine whether to output a content corresponding to the first marker. To this end, based on the detected location state of the first marker, the HMD determines whether the first marker is located within the view angle region of the HMD [S1130]. If the first marker is located within the view angle region of the HMD, the HMD does not output the content corresponding to the first marker [S1140]. Otherwise, i.e., if the first marker is not located within the view angle region of the HMD, the HMD may be able to receive the content corresponding to the first marker [S1142]. In dong so, the HMD may be able to receive the content from a server via the network. Once the content is received from the server, the HMD outputs the received content [S1144].
Subsequently, the HMD keeps determining whether a marker within the view angle region is detected. In dong so, the HMD may be able to determine whether a second marker different from the first marker is detected within the view angle region [S1150]. If the second marker is not detected, the HMD goes back to the step S1120 and then continues the content output operation in accordance with the location state of the first marker. In particular, based on the location state of the first marker, the HMD may be able to trigger whether to output the content corresponding to the first marker. If the second marker is detected, the HMD terminates the content output operation in accordance with the location state of the first marker. In doing so, the HMD may be able to detect the location state of the newly detected second marker and may be then able to perform a content output in accordance with the location state of the second marker by the same method mentioned in the foregoing description of the embodiment with reference to FIG. 11.
FIG. 12 and FIG. 13 show a detailed method of outputting a content using an HMD in accordance with the former embodiment shown in FIG. 11.
Referring to FIG. 12, a user 10 may be able to watch a content 1 including a marker 5 while wearing an HMD 100. In this case, the content 1 may include an analog content instead of a digital content. And, the content 1 may include a partial or whole region of a book, a magazine, a newspaper, a photo or the like. The content 1 may include the marker 5 indicating the information on the corresponding content 1. According to an embodiment of the present invention, the marker is located within a view angle region 102 of the HMD 100. And, the HMD 100 does not output the content 1.
Referring to FIG. 13 (a), according to an embodiment of the present invention, the user 10 may look at a different spot other than the content 1 while wearing the HMD 100. In doing so, the marker 5 included in the content 1 may be located outside the view angle region 102 of the HMD 100. In particular, a location state of the marker 5 may be switched from a first state [FIG. 12] to a second state [FIG. 13 (a)]. Thus, if the marker is located outside the view angle region 102 of the HMD 100, the HMD 100 may be able to output the content 1 corresponding to the marker 5. In particular, the HMD 100 receives the content 1 corresponding to the marker 5 from a server (not shown in the drawing) via a network 300 and may be then able to output the received content.
Meanwhile, referring to FIG. 13 (b), the user 10 may be able to look at the content 1 again while wearing the HMD 100. In dong so, the marker 5 included in the content 1 may be located within the view angle region of the HMD 100. In particular, the location state of the marker 5 may be switched from the second state [FIG. 13 (a)] to the first state [FIG. 13 (b)]. Thus, if the marker 5 reenters the view angle region 102 of the HMD 100, the HMD 100 may be able to terminate the output of the content 1 corresponding to the marker 5.
Meanwhile, according to one embodiment of the present invention, the HDM 100 may be able to adjust whether to output the content 1 based on whether the content 1 located with the view angle region 102 of the HMD 100 is identical to the content 1 currently outputted by the HMD 100. In particular, the HMD 100 determines whether the content 1 having entered the view angle region 102 is identical to the content 1 currently outputted by the HMD 100. If the content 1 having entered the view angle region n102 is identical to the content 1 currently outputted by the HMD 100, referring to FIG. 13 (b), the HMD 100 may be able to avoid the overlapping of the display of the content 1 by terminating the output of the content 1. Otherwise, i.e., if the content 1 having entered the view angle region 102 is not identical to the content 1 currently outputted by the HMD 100, the HMD 100 may not terminate the output of the content 1.
According to the present invention, a location state of a digital device may be determined based on eyes of a user who wears an HMD. The HMD of the present invention may further include an image photographing sensor configured to detect a position of the pupil of the user wearing the HMD and may be able to track eyes of the corresponding user using the image photographing sensor. Therefore, the location state of the digital device of the present invention may be determined based on whether a display unit of the digital device is located within a view angle region of the user wearing the HMD. In this case, the view angle region may include a region within a predetermined range corresponding to the eyes of the user wearing the HMD. In particular, according to the present invention, the location state of the digital device may include a third state in which the display unit of the digital device is located within the view angle region of the user wearing the HMD and a fourth state in which the display unit of the digital device is not located within the view angle region of the user wearing the HMD. Meanwhile, according to an embodiment of the present invention, a location state of a marker may be also determined based on the eyes of the user wearing the HMD in the manner mentioned in the above description.
HMD mentioned in the description of the present invention may be changeable with or replaceable by various devices for the purposes of the present invention. For instance, HMD of the present invention may include such a device, which is capable of providing a display by being put on a user, as EMD (eye mounted display), eyeglass, eyepiece, eyewear, HWD (head worn display) and the like. And, the HMD may be non-limited by the terminologies used for the description of the present invention.
As mentioned in the foregoing description, all the related matters are described in BEST MODE for embodiments of the present invention.
As mentioned in the foregoing description, the present invention may be applicable to electronic devices entirely or in part.
While the present invention has been described and illustrated herein with reference to the preferred embodiments thereof, it will be apparent to those skilled in the art that various modifications and variations can be made therein without departing from the spirit and scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.
Claims (30)
- A method of outputting a content using an HMD (head mounted display), the method comprising:performing a pairing with a digital device having at least one display unit configured to display the content;detecting a location state of the paired digital device, wherein the location state comprises a first state in which a display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the preset view angle region; andoutputting the content that is currently displayed in the digital device to the HMD based on the detected location state.
- The method of claim 1, the outputting step further comprising outputting the content to the HMD if the detected location state is the second state.
- The method of claim 2, the outputting step further comprising the steps of:establishing a communication connection with the digital device;receiving the content currently displayed on the communication connected digital device; andoutputting the received content to the HMD.
- The method of claim 1, the outputting step further comprising the step of determining whether to output the content to the HMD if the detected location state is switched and the switched location state continues over a preset time.
- The method of claim 1, the method further comprising:if the detected location state is switched between the first state and the second state, providing a vibration feedback on the HMD.
- The method of claim 1, the outputting step comprising the step of fading in the content if the detected location state is switched from the first state to the second state.
- The method of claim 1, the outputting step comprising the step of fading out the content if the detected location state is switched from the second state to the first state.
- The method of claim 1, further comprising the step of if the detected location state is switched from the second state to the first state, determining whether the content currently displayed in the digital device is identical to the content currently outputted to the HMD, wherein if the content currently displayed in the digital device is identical to the content currently outputted to the HMD, the outputting step comprises terminating the output to the HMD.
- The method of claim 1, the outputting step comprising the step of if the detected location state is switched from the first state to the second state, outputting the content in a manner that the content slides to move into a center region from a side in which the display unit of the digital device deviating from the location of the view angle region.
- The method of claim 1, wherein if the content comprises a video content and the detected location state is switched from the first state to the second state, an output of the video content of the digital device is paused for a preset time period.
- The method of claim 1, the step of detecting the location state of the digital device further comprising the step of detecting the location state using signals transceived with the digital device via a plurality of antennas included in the HMD.
- The method of claim 1, the step of detecting the location state of the digital device, further comprising the step of detecting the location state based on whether a light pattern outputted by the paired digital device is detected.
- The method of claim 1, further comprising the steps of:if the detected location state is the second state, detecting whether a display unit of at least one external device is present within the view angle region; andif the display unit of the at least one external device is detected within the view angle region, outputting the content to the display unit of the corresponding external device.
- The method of claim 1, wherein the location state comprises a third state in which the display unit of the digital device is located within a view angle region of a user wearing the HMD and a fourth state in which the display unit of the digital device is not located within the view angle region of a user wearing the HMD.
- A method of outputting a content using an HMD (head mounted display), comprising the steps of:detecting at least one marker located within a preset view angle region of the HMD, the at least one marker comprising an identifier indicating content information;detecting a location state of the marker, the location state comprising a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region;if the location state of the marker is switched from the first state to the second state, receiving the content corresponding to the marker from a server; andoutputting the received content to the HMD,wherein if the location state of the marker is switched from second state to the first state, the outputting step comprises the step of terminating an output of the content.
- An HMD (head mounted display) comprising:a processor configured to control an operation of the HMD;a display unit configured to output an image based on a command given by the processor; anda communication unit configured to transceive data with at least one digital device based on the command given by the processor,wherein the processor is further configured to:perform a pairing with a digital device having at least one display unit configured to display the content,detect a location state of the paired digital device, the location state comprising a first state in which the display unit of the digital device is located within a preset view angle region of the HMD and a second state in which the display unit of the digital device is not located within the view angle region, andoutput the content currently displayed in the digital device to the display unit of the HMD based on the detected location state.
- The HMD of claim 16, wherein if the detected location state is the second state, the content is outputted to the display unit of the HMD.
- The HMD of claim 17, wherein the HMD establishes a communication connection with the digital device, receives the content currently displayed on the communication connected digital device, and outputs the received content to the display unit of the HMD.
- The HMD of claim 16, wherein if the detected location state is switched and the switched location state continues over a preset time, it is determined whether the content will be outputted to the HMD.
- The HMD of claim 16, wherein if the detected location state is switched between the first state and the second state, a vibration feedback is provided to the HMD.
- The HMD of claim 16, wherein if the detected location state is switched from the first state to the second state, the content is faded in.
- The HMD of claim 16, wherein if the detected location state is switched from the second state to the first state, the content is faded out.
- The HMD of claim 16, wherein if the detected location state is switched from the second state to the first state, the processor determines whether the content currently displayed in the digital device is identical to the content currently outputted to the HMD and wherein if the content currently displayed in the digital device is identical to the content currently outputted to the HMD, the processor terminates output to the HMD.
- The HMD of claim 16, wherein if the detected location state is switched from first state to the second state, the content is outputted in a manner that the content slides to move into a center region from a side in which the display unit of the digital device deviating from the location of the view angle region.
- The HMD of claim 16, wherein if the content comprises a video content and the detected location state is switched from the first state to the second state, an output of the video content of the digital device is paused for a preset time period.
- The HMD of claim 16, wherein the communication unit comprises a plurality of antennas and wherein the processor detects the location state using signals transceived with the digital device via a plurality of antennas included in the HMD.
- The HMD of claim 16, wherein the location state is detected based on whether a light pattern outputted by the paired digital device is detected.
- The HMD of claim 16, wherein if the detected location state is the second state, it is detected whether a display unit of at least one external device is present within the view angle region and wherein if the display unit of the at least one external device is detected within the view angle region, the content is outputted to the display unit of the corresponding external device.
- The HMD of claim 16, wherein the location state comprises a third state in which the display unit of the digital device is located within a view angle region of a user wearing the HMD and a fourth state in which the display unit of the digital device is not located within the view angle region of a user wearing the HMD.
- An HMD (head mounted display) comprising:a processor configured to control an operation of the HMD;a display unit configured to output an image based on a command given by the processor; anda communication unit configured to transceive data with at least one digital device based on the command given by the processor,wherein the processor is further configured to:detect at least one marker located within a preset view angle region of the HMD, the at least one marker comprising an identifier indicating content information,detect a location state of the marker, the location state comprising a first state in which the marker is located within the preset view angle region of the HMD and a second state in which the marker is not located within the preset view angle region,receive the content corresponding to the marker from a server, if the location state of the marker is switched from the first state to the second stat, andoutput the received content to the HMD,wherein if the location state of the marker is switched from the second state to the first state, the processor terminates output of the content.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12881212.0A EP2872945B1 (en) | 2012-07-16 | 2012-08-09 | A head mounted dipslay and method of outputting a content using the same |
EP17197917.2A EP3309601B1 (en) | 2012-07-16 | 2012-08-09 | A head mounted dipslay and method of outputting a content using the same |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2012-0077352 | 2012-07-16 | ||
KR1020120077352A KR101861380B1 (en) | 2012-07-16 | 2012-07-16 | A Method of Providing Contents Using Head Mounted Display and a Head Mounted Display Thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014014155A1 true WO2014014155A1 (en) | 2014-01-23 |
Family
ID=48094858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2012/006344 WO2014014155A1 (en) | 2012-07-16 | 2012-08-09 | A head mounted dipslay and method of outputting a content using the same |
Country Status (4)
Country | Link |
---|---|
US (3) | US8427396B1 (en) |
EP (2) | EP2872945B1 (en) |
KR (1) | KR101861380B1 (en) |
WO (1) | WO2014014155A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018117757A1 (en) * | 2016-12-23 | 2018-06-28 | Samsung Electronics Co., Ltd. | Method and device for managing thumbnail of three-dimensional contents |
CN115633244A (en) * | 2022-10-17 | 2023-01-20 | 元化智能科技(深圳)有限公司 | Image data transmission method and image data transmission apparatus |
Families Citing this family (145)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9158116B1 (en) | 2014-04-25 | 2015-10-13 | Osterhout Group, Inc. | Temple and ear horn assembly for headworn computer |
US9965681B2 (en) | 2008-12-16 | 2018-05-08 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9952664B2 (en) | 2014-01-21 | 2018-04-24 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150277120A1 (en) | 2014-01-21 | 2015-10-01 | Osterhout Group, Inc. | Optical configurations for head worn computing |
US9229233B2 (en) | 2014-02-11 | 2016-01-05 | Osterhout Group, Inc. | Micro Doppler presentations in head worn computing |
US9715112B2 (en) | 2014-01-21 | 2017-07-25 | Osterhout Group, Inc. | Suppression of stray light in head worn computing |
US20150205111A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | Optical configurations for head worn computing |
US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9366867B2 (en) | 2014-07-08 | 2016-06-14 | Osterhout Group, Inc. | Optical systems for see-through displays |
US9400390B2 (en) | 2014-01-24 | 2016-07-26 | Osterhout Group, Inc. | Peripheral lighting for head worn computing |
US20180048750A1 (en) * | 2012-06-15 | 2018-02-15 | Muzik, Llc | Audio/video wearable computer system with integrated projector |
KR101969351B1 (en) * | 2012-09-10 | 2019-04-16 | 엘지전자 주식회사 | Head mounted display and method for controlling output of the same |
US9791921B2 (en) * | 2013-02-19 | 2017-10-17 | Microsoft Technology Licensing, Llc | Context-aware augmented reality object commands |
KR102063076B1 (en) * | 2013-07-10 | 2020-01-07 | 엘지전자 주식회사 | The mobile device and controlling method thereof, the head mounted display and controlling method thereof |
KR102081934B1 (en) * | 2013-08-28 | 2020-02-26 | 엘지전자 주식회사 | Head mounted display device and method for controlling the same |
US20150062158A1 (en) | 2013-08-28 | 2015-03-05 | Qualcomm Incorporated | Integration of head mounted displays with public display devices |
WO2015031168A1 (en) * | 2013-08-28 | 2015-03-05 | Qualcomm Incorporated | Dynamic display markers |
KR102105520B1 (en) * | 2013-11-12 | 2020-04-28 | 삼성전자주식회사 | Apparatas and method for conducting a display link function in an electronic device |
US9448621B2 (en) * | 2013-12-20 | 2016-09-20 | Nokia Technologies Oy | Causation of display of information on a see through display |
EP2894508A1 (en) * | 2013-12-31 | 2015-07-15 | Thomson Licensing | Method for displaying a content through either a head mounted display device or a display device, corresponding head mounted display device and computer program product |
US9575321B2 (en) | 2014-06-09 | 2017-02-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9671613B2 (en) | 2014-09-26 | 2017-06-06 | Osterhout Group, Inc. | See-through computer display systems |
US20150228119A1 (en) | 2014-02-11 | 2015-08-13 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9829707B2 (en) | 2014-08-12 | 2017-11-28 | Osterhout Group, Inc. | Measuring content brightness in head worn computing |
US9366868B2 (en) | 2014-09-26 | 2016-06-14 | Osterhout Group, Inc. | See-through computer display systems |
US20160019715A1 (en) | 2014-07-15 | 2016-01-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US10684687B2 (en) | 2014-12-03 | 2020-06-16 | Mentor Acquisition One, Llc | See-through computer display systems |
US11227294B2 (en) | 2014-04-03 | 2022-01-18 | Mentor Acquisition One, Llc | Sight information collection in head worn computing |
US20150277118A1 (en) | 2014-03-28 | 2015-10-01 | Osterhout Group, Inc. | Sensor dependent content position in head worn computing |
US9939934B2 (en) | 2014-01-17 | 2018-04-10 | Osterhout Group, Inc. | External user interface for head worn computing |
US10191279B2 (en) | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US10254856B2 (en) | 2014-01-17 | 2019-04-09 | Osterhout Group, Inc. | External user interface for head worn computing |
US9841599B2 (en) | 2014-06-05 | 2017-12-12 | Osterhout Group, Inc. | Optical configurations for head-worn see-through displays |
US9529195B2 (en) | 2014-01-21 | 2016-12-27 | Osterhout Group, Inc. | See-through computer display systems |
US9448409B2 (en) | 2014-11-26 | 2016-09-20 | Osterhout Group, Inc. | See-through computer display systems |
US9594246B2 (en) | 2014-01-21 | 2017-03-14 | Osterhout Group, Inc. | See-through computer display systems |
US9810906B2 (en) | 2014-06-17 | 2017-11-07 | Osterhout Group, Inc. | External user interface for head worn computing |
US9299194B2 (en) | 2014-02-14 | 2016-03-29 | Osterhout Group, Inc. | Secure sharing in head worn computing |
US10001645B2 (en) * | 2014-01-17 | 2018-06-19 | Sony Interactive Entertainment America Llc | Using a second screen as a private tracking heads-up display |
US10649220B2 (en) | 2014-06-09 | 2020-05-12 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9746686B2 (en) | 2014-05-19 | 2017-08-29 | Osterhout Group, Inc. | Content position calibration in head worn computing |
US11103122B2 (en) | 2014-07-15 | 2021-08-31 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9494800B2 (en) | 2014-01-21 | 2016-11-15 | Osterhout Group, Inc. | See-through computer display systems |
US11737666B2 (en) | 2014-01-21 | 2023-08-29 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US11892644B2 (en) | 2014-01-21 | 2024-02-06 | Mentor Acquisition One, Llc | See-through computer display systems |
US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
US9651784B2 (en) | 2014-01-21 | 2017-05-16 | Osterhout Group, Inc. | See-through computer display systems |
US9766463B2 (en) | 2014-01-21 | 2017-09-19 | Osterhout Group, Inc. | See-through computer display systems |
US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
US9523856B2 (en) | 2014-01-21 | 2016-12-20 | Osterhout Group, Inc. | See-through computer display systems |
US9811159B2 (en) | 2014-01-21 | 2017-11-07 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150205135A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
US9310610B2 (en) | 2014-01-21 | 2016-04-12 | Osterhout Group, Inc. | See-through computer display systems |
US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
US9538915B2 (en) | 2014-01-21 | 2017-01-10 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9846308B2 (en) | 2014-01-24 | 2017-12-19 | Osterhout Group, Inc. | Haptic systems for head-worn computers |
US9852545B2 (en) | 2014-02-11 | 2017-12-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9401540B2 (en) | 2014-02-11 | 2016-07-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US20150241963A1 (en) | 2014-02-11 | 2015-08-27 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9691181B2 (en) * | 2014-02-24 | 2017-06-27 | Sony Interactive Entertainment Inc. | Methods and systems for social sharing head mounted display (HMD) content with a second screen |
US20150245163A1 (en) * | 2014-02-25 | 2015-08-27 | Sony Corporation | Proximity detection of candidate companion display device in same room as primary display using wi-fi or bluetooth signal strength |
US9483997B2 (en) * | 2014-03-10 | 2016-11-01 | Sony Corporation | Proximity detection of candidate companion display device in same room as primary display using infrared signaling |
JP2015176186A (en) * | 2014-03-13 | 2015-10-05 | ソニー株式会社 | Information processing apparatus, information processing method and information processing system |
KR102374584B1 (en) * | 2014-03-21 | 2022-03-16 | 삼성전자주식회사 | Method and device for displaying image |
US20160187651A1 (en) | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
WO2015163529A1 (en) * | 2014-04-23 | 2015-10-29 | Lg Electronics Inc. | Head mounted display device displaying thumbnail image and method of controlling therefor |
KR102246553B1 (en) | 2014-04-24 | 2021-04-30 | 엘지전자 주식회사 | Hmd and method for controlling the same |
WO2015163539A1 (en) * | 2014-04-24 | 2015-10-29 | Lg Electronics Inc. | Head mounted display and method for controlling the same |
US20150309534A1 (en) | 2014-04-25 | 2015-10-29 | Osterhout Group, Inc. | Ear horn assembly for headworn computer |
US9651787B2 (en) | 2014-04-25 | 2017-05-16 | Osterhout Group, Inc. | Speaker assembly for headworn computer |
US9423842B2 (en) | 2014-09-18 | 2016-08-23 | Osterhout Group, Inc. | Thermal management for head-worn computer |
US9672210B2 (en) | 2014-04-25 | 2017-06-06 | Osterhout Group, Inc. | Language translation with head-worn computing |
US10853589B2 (en) | 2014-04-25 | 2020-12-01 | Mentor Acquisition One, Llc | Language translation with head-worn computing |
US20160137312A1 (en) | 2014-05-06 | 2016-05-19 | Osterhout Group, Inc. | Unmanned aerial vehicle launch system |
KR102257621B1 (en) * | 2014-05-19 | 2021-05-28 | 엘지전자 주식회사 | The Apparatus and Method for Head Mounted Display Device displaying Thumbnail image |
KR102229890B1 (en) * | 2014-05-30 | 2021-03-19 | 삼성전자주식회사 | Method for processing data and an electronic device thereof |
US10663740B2 (en) | 2014-06-09 | 2020-05-26 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US9092898B1 (en) | 2014-07-03 | 2015-07-28 | Federico Fraccaroli | Method, system and apparatus for the augmentation of radio emissions |
KR102251710B1 (en) * | 2014-11-04 | 2021-05-14 | 넥시스 주식회사 | System, method and computer readable medium for managing content of external device using wearable glass device |
US10719950B2 (en) * | 2014-08-05 | 2020-07-21 | Sony Corporation | Head mount display (HMD) operated with mobile device for transforming reference coordinate systems for providing screen information |
DE202015009948U1 (en) | 2014-08-11 | 2021-11-04 | Vr Coaster Gmbh & Co. Kg | Amusement ride |
KR102232419B1 (en) * | 2014-08-26 | 2021-03-26 | 엘지전자 주식회사 | Wearable display device and controlling method thereof |
KR102271833B1 (en) * | 2014-09-01 | 2021-07-01 | 삼성전자주식회사 | Electronic device, controlling method thereof and recording medium |
KR102243656B1 (en) * | 2014-09-26 | 2021-04-23 | 엘지전자 주식회사 | Mobile device, head mounted display and system |
TR201901086T4 (en) * | 2014-10-06 | 2019-02-21 | Koninklijke Philips Nv | Settlement system. |
KR102265086B1 (en) * | 2014-11-07 | 2021-06-15 | 삼성전자 주식회사 | Virtual Environment for sharing of Information |
US9684172B2 (en) | 2014-12-03 | 2017-06-20 | Osterhout Group, Inc. | Head worn computer display systems |
GB2533098B (en) * | 2014-12-09 | 2016-12-14 | Ibm | Automated management of confidential data in cloud environments |
USD743963S1 (en) | 2014-12-22 | 2015-11-24 | Osterhout Group, Inc. | Air mouse |
USD751552S1 (en) | 2014-12-31 | 2016-03-15 | Osterhout Group, Inc. | Computer glasses |
USD753114S1 (en) | 2015-01-05 | 2016-04-05 | Osterhout Group, Inc. | Air mouse |
US9933985B2 (en) * | 2015-01-20 | 2018-04-03 | Qualcomm Incorporated | Systems and methods for managing content presentation involving a head mounted display and a presentation device |
KR102274743B1 (en) * | 2015-01-30 | 2021-07-08 | 삼성전자주식회사 | Electronic device and method for processing a display area in electronic device |
KR101564964B1 (en) * | 2015-02-05 | 2015-11-02 | 계명대학교 산학협력단 | Electrical stimulating head mounted display device reducing motion sickness in virtual reality |
US20160239985A1 (en) | 2015-02-17 | 2016-08-18 | Osterhout Group, Inc. | See-through computer display systems |
US10878775B2 (en) | 2015-02-17 | 2020-12-29 | Mentor Acquisition One, Llc | See-through computer display systems |
CN107533225B (en) * | 2015-03-04 | 2020-07-14 | 脸谱科技有限责任公司 | Sparse projection for virtual reality systems |
US10591729B2 (en) * | 2015-05-29 | 2020-03-17 | Kyocera Corporation | Wearable device |
US10139966B2 (en) | 2015-07-22 | 2018-11-27 | Osterhout Group, Inc. | External user interface for head worn computing |
JP6686319B2 (en) * | 2015-08-04 | 2020-04-22 | 富士通株式会社 | Image projection device and image display system |
JP6529383B2 (en) * | 2015-08-11 | 2019-06-12 | 京セラ株式会社 | Wearable device and output system |
EP3342189B1 (en) | 2015-08-24 | 2020-10-14 | PCMS Holdings, Inc. | Systems and methods for enhancing augmented reality experience with dynamic output mapping |
US9865091B2 (en) * | 2015-09-02 | 2018-01-09 | Microsoft Technology Licensing, Llc | Localizing devices in augmented reality environment |
GB2542434A (en) | 2015-09-21 | 2017-03-22 | Figment Productions Ltd | A System for Providing a Virtual Reality Experience |
WO2017062289A1 (en) | 2015-10-08 | 2017-04-13 | Pcms Holdings, Inc. | Methods and systems of automatic calibration for dynamic display configurations |
CN105657438A (en) * | 2015-11-09 | 2016-06-08 | 乐视致新电子科技(天津)有限公司 | Method and apparatus for processing panoramic live video resource |
US10850116B2 (en) | 2016-12-30 | 2020-12-01 | Mentor Acquisition One, Llc | Head-worn therapy device |
US10591728B2 (en) | 2016-03-02 | 2020-03-17 | Mentor Acquisition One, Llc | Optical systems for head-worn computers |
US10667981B2 (en) | 2016-02-29 | 2020-06-02 | Mentor Acquisition One, Llc | Reading assistance system for visually impaired |
US9880441B1 (en) | 2016-09-08 | 2018-01-30 | Osterhout Group, Inc. | Electrochromic systems for head-worn computer systems |
US9826299B1 (en) | 2016-08-22 | 2017-11-21 | Osterhout Group, Inc. | Speaker systems for head-worn computer systems |
CN105847627B (en) * | 2016-03-30 | 2018-11-23 | 北京小米移动软件有限公司 | A kind of method and apparatus of display image data |
US10684478B2 (en) | 2016-05-09 | 2020-06-16 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
US10824253B2 (en) | 2016-05-09 | 2020-11-03 | Mentor Acquisition One, Llc | User interface systems for head-worn computers |
US9910284B1 (en) | 2016-09-08 | 2018-03-06 | Osterhout Group, Inc. | Optical systems for head-worn computers |
US10466491B2 (en) | 2016-06-01 | 2019-11-05 | Mentor Acquisition One, Llc | Modular systems for head-worn computers |
US10210661B2 (en) | 2016-04-25 | 2019-02-19 | Microsoft Technology Licensing, Llc | Location-based holographic experience |
US10748339B2 (en) | 2016-06-03 | 2020-08-18 | A Big Chunk Of Mud Llc | System and method for implementing computer-simulated reality interactions between users and publications |
KR20180002255A (en) * | 2016-06-29 | 2018-01-08 | 엘지전자 주식회사 | Glass type mobile terminal |
US10690936B2 (en) | 2016-08-29 | 2020-06-23 | Mentor Acquisition One, Llc | Adjustable nose bridge assembly for headworn computer |
JP2018036993A (en) * | 2016-09-02 | 2018-03-08 | オリンパス株式会社 | Display system, portable information device, wearable terminal, information display method, and program |
USD840395S1 (en) | 2016-10-17 | 2019-02-12 | Osterhout Group, Inc. | Head-worn computer |
JP2018078475A (en) * | 2016-11-10 | 2018-05-17 | 富士通株式会社 | Control program, control method, and control device |
USD864959S1 (en) | 2017-01-04 | 2019-10-29 | Mentor Acquisition One, Llc | Computer glasses |
JP6792699B2 (en) * | 2017-03-13 | 2020-11-25 | 三井化学株式会社 | Eyewear |
US11696629B2 (en) | 2017-03-22 | 2023-07-11 | A Big Chunk Of Mud Llc | Convertible satchel with integrated head-mounted display |
US10578869B2 (en) | 2017-07-24 | 2020-03-03 | Mentor Acquisition One, Llc | See-through computer display systems with adjustable zoom cameras |
US11409105B2 (en) | 2017-07-24 | 2022-08-09 | Mentor Acquisition One, Llc | See-through computer display systems |
US10422995B2 (en) | 2017-07-24 | 2019-09-24 | Mentor Acquisition One, Llc | See-through computer display systems with stray light management |
US10969584B2 (en) | 2017-08-04 | 2021-04-06 | Mentor Acquisition One, Llc | Image expansion optic for head-worn computer |
US20190129607A1 (en) * | 2017-11-02 | 2019-05-02 | Samsung Electronics Co., Ltd. | Method and device for performing remote control |
JP7035510B2 (en) * | 2017-12-22 | 2022-03-15 | セイコーエプソン株式会社 | Display system and control method of display system |
KR102013154B1 (en) * | 2018-02-02 | 2019-08-22 | 강근원 | A content service method using head-mounted display for long distance movement and a program thereof |
US10748021B2 (en) | 2018-05-11 | 2020-08-18 | Samsung Electronics Co., Ltd. | Method of analyzing objects in images recorded by a camera of a head mounted device |
CN116243486A (en) * | 2018-06-25 | 2023-06-09 | 麦克赛尔株式会社 | Head-mounted display, head-mounted display collaboration system and method thereof |
CN113273184A (en) | 2018-11-30 | 2021-08-17 | Pcms控股公司 | Method of mirroring 3D objects to a light field display |
US10852819B2 (en) * | 2019-01-11 | 2020-12-01 | Dell Products, L.P. | Systems and methods for eye-gaze tracking (EGT) handoff |
JP6997129B2 (en) * | 2019-03-28 | 2022-01-17 | ファナック株式会社 | Control system |
EP4158446A1 (en) * | 2020-05-27 | 2023-04-05 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for controlling display of content |
KR102290328B1 (en) * | 2020-11-16 | 2021-08-18 | 코리아에프티 주식회사 | Video output device |
JP7140890B1 (en) * | 2021-06-18 | 2022-09-21 | 株式会社ドワンゴ | Viewer terminal, viewer terminal control method, viewer terminal control program, and recording medium |
DE102021206568A1 (en) | 2021-06-24 | 2022-12-29 | Siemens Healthcare Gmbh | Display device for displaying a graphical representation of an augmented reality |
US11935201B2 (en) * | 2022-04-28 | 2024-03-19 | Dell Products Lp | Method and apparatus for using physical devices in extended reality environments |
CN115942322B (en) * | 2023-02-15 | 2023-06-06 | 北京秒信科技有限公司 | Harassment short message interception method and system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0767056A (en) * | 1993-06-15 | 1995-03-10 | Olympus Optical Co Ltd | Head mount display system |
JP2000347596A (en) * | 1998-08-31 | 2000-12-15 | Semiconductor Energy Lab Co Ltd | Portable information processing system |
JP2011166631A (en) * | 2010-02-14 | 2011-08-25 | Brother Industries Ltd | Communication system and head-mounted display |
US20110285704A1 (en) | 2010-02-03 | 2011-11-24 | Genyo Takeda | Spatially-correlated multi-display human-machine interface |
JP2012078224A (en) * | 2010-10-01 | 2012-04-19 | Olympus Corp | Image generation system, program, and information storage medium |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1995005620A1 (en) * | 1993-08-12 | 1995-02-23 | Seiko Epson Corporation | Head mount type image display device and information processor equipped with the device |
US6061064A (en) * | 1993-08-31 | 2000-05-09 | Sun Microsystems, Inc. | System and method for providing and using a computer user interface with a view space having discrete portions |
JP2000194726A (en) * | 1998-10-19 | 2000-07-14 | Sony Corp | Device, method and system for processing information and providing medium |
JP4178697B2 (en) | 1999-11-18 | 2008-11-12 | ソニー株式会社 | Portable information processing terminal, information input / output system, and information input / output method |
US7215322B2 (en) * | 2001-05-31 | 2007-05-08 | Siemens Corporate Research, Inc. | Input devices for augmented reality applications |
US7190331B2 (en) * | 2002-06-06 | 2007-03-13 | Siemens Corporate Research, Inc. | System and method for measuring the registration accuracy of an augmented reality system |
JP2004127024A (en) * | 2002-10-03 | 2004-04-22 | Canon Inc | Device and method for protecting content for compound reality feeling system |
US7331929B2 (en) * | 2004-10-01 | 2008-02-19 | General Electric Company | Method and apparatus for surgical operating room information display gaze detection and user prioritization for control |
JP2006267604A (en) * | 2005-03-24 | 2006-10-05 | Canon Inc | Composite information display device |
US8179423B2 (en) * | 2005-08-22 | 2012-05-15 | Ricoh Company, Ltd. | Image display system, an image display method, a coding method, and a printed matter for stereoscopic viewing |
US20070233759A1 (en) | 2006-03-28 | 2007-10-04 | The Regents Of The University Of California | Platform for seamless multi-device interactive digital content |
JP2009245390A (en) * | 2008-03-31 | 2009-10-22 | Brother Ind Ltd | Display processor and display processing system |
JP5156571B2 (en) * | 2008-10-10 | 2013-03-06 | キヤノン株式会社 | Image processing apparatus and image processing method |
EP2356809A2 (en) * | 2008-12-10 | 2011-08-17 | Siemens Aktiengesellschaft | Method for transmitting an image from a first control unit to a second control unit and output unit |
US20120075167A1 (en) * | 2010-09-29 | 2012-03-29 | Eastman Kodak Company | Head-mounted display with wireless controller |
JPWO2012049795A1 (en) * | 2010-10-12 | 2014-02-24 | パナソニック株式会社 | Display processing apparatus, display method, and program |
US8576276B2 (en) | 2010-11-18 | 2013-11-05 | Microsoft Corporation | Head-mounted display device which provides surround video |
KR20120064557A (en) * | 2010-12-09 | 2012-06-19 | 한국전자통신연구원 | Mixed reality display platform for presenting augmented 3d stereo image and operation method thereof |
US9217867B2 (en) * | 2011-03-24 | 2015-12-22 | Seiko Epson Corporation | Head-mounted display device and control method for the head-mounted display device |
US9583032B2 (en) * | 2012-06-05 | 2017-02-28 | Microsoft Technology Licensing, Llc | Navigating content using a physical object |
-
2012
- 2012-07-16 KR KR1020120077352A patent/KR101861380B1/en active IP Right Grant
- 2012-08-09 EP EP12881212.0A patent/EP2872945B1/en active Active
- 2012-08-09 EP EP17197917.2A patent/EP3309601B1/en active Active
- 2012-08-09 WO PCT/KR2012/006344 patent/WO2014014155A1/en active Application Filing
- 2012-08-16 US US13/587,527 patent/US8427396B1/en active Active
-
2013
- 2013-03-25 US US13/850,108 patent/US8730131B2/en active Active
-
2014
- 2014-03-10 US US14/203,315 patent/US9423619B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0767056A (en) * | 1993-06-15 | 1995-03-10 | Olympus Optical Co Ltd | Head mount display system |
JP2000347596A (en) * | 1998-08-31 | 2000-12-15 | Semiconductor Energy Lab Co Ltd | Portable information processing system |
US20110285704A1 (en) | 2010-02-03 | 2011-11-24 | Genyo Takeda | Spatially-correlated multi-display human-machine interface |
JP2011166631A (en) * | 2010-02-14 | 2011-08-25 | Brother Industries Ltd | Communication system and head-mounted display |
JP2012078224A (en) * | 2010-10-01 | 2012-04-19 | Olympus Corp | Image generation system, program, and information storage medium |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018117757A1 (en) * | 2016-12-23 | 2018-06-28 | Samsung Electronics Co., Ltd. | Method and device for managing thumbnail of three-dimensional contents |
US11140317B2 (en) | 2016-12-23 | 2021-10-05 | Samsung Electronics Co., Ltd. | Method and device for managing thumbnail of three-dimensional contents |
CN115633244A (en) * | 2022-10-17 | 2023-01-20 | 元化智能科技(深圳)有限公司 | Image data transmission method and image data transmission apparatus |
Also Published As
Publication number | Publication date |
---|---|
EP2872945A4 (en) | 2016-02-17 |
EP3309601A1 (en) | 2018-04-18 |
US9423619B2 (en) | 2016-08-23 |
EP3309601B1 (en) | 2019-03-20 |
US8730131B2 (en) | 2014-05-20 |
US8427396B1 (en) | 2013-04-23 |
EP2872945B1 (en) | 2017-12-13 |
US20140191929A1 (en) | 2014-07-10 |
KR20140010715A (en) | 2014-01-27 |
EP2872945A1 (en) | 2015-05-20 |
KR101861380B1 (en) | 2018-05-28 |
US20140015736A1 (en) | 2014-01-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014014155A1 (en) | A head mounted dipslay and method of outputting a content using the same | |
WO2015005537A1 (en) | Mobile device, head mounted display and method of controlling therefor | |
US10176783B2 (en) | Interactive wearable and portable smart devices | |
WO2015111790A1 (en) | Smart watch, display device and method of controlling therefor | |
WO2015046676A1 (en) | Head-mounted display and method of controlling the same | |
WO2019088793A1 (en) | Electronic device and screen sharing method using same | |
WO2018128472A1 (en) | Virtual reality experience sharing | |
WO2015030301A1 (en) | Smartwatch and control method thereof | |
WO2014069776A1 (en) | Head mounted display and method of outputting audio signal using the same | |
WO2015046677A1 (en) | Head-mounted display and method of controlling the same | |
WO2015046674A1 (en) | Head-mounted display and method of controlling the same | |
WO2015030304A1 (en) | Portable device supporting videotelephony of a head mounted display and method of controlling therefor | |
EP3504883A1 (en) | Output device outputting audio signal and control method thereof | |
WO2014181918A1 (en) | Smart watch and method for controlling the same | |
WO2014104473A1 (en) | Head mounted display and method of video communication using the same | |
EP2883103A1 (en) | Head mounted display for adjusting audio output and video output in relation to each other and method for controlling the same | |
WO2015105236A1 (en) | A head mounted display and method of controlling thereof | |
WO2018048130A1 (en) | Content playback method and electronic device supporting same | |
WO2017057965A1 (en) | Device and method for controlling mobile terminal | |
WO2016104873A1 (en) | Digital device and method of controlling therefor | |
EP3069190A1 (en) | Head mounted display and method of controlling therefor | |
WO2016080565A1 (en) | Wearable device and control method therefor | |
WO2021261829A1 (en) | Brightness adjustment method and hmd device | |
WO2013129860A1 (en) | Mobile terminal and network system | |
WO2021172941A1 (en) | Image streaming method and electronic device supporting same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12881212 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012881212 Country of ref document: EP |