WO2014197231A3 - Switching mode of operation in a head mounted display - Google Patents

Switching mode of operation in a head mounted display Download PDF

Info

Publication number
WO2014197231A3
WO2014197231A3 PCT/US2014/039411 US2014039411W WO2014197231A3 WO 2014197231 A3 WO2014197231 A3 WO 2014197231A3 US 2014039411 W US2014039411 W US 2014039411W WO 2014197231 A3 WO2014197231 A3 WO 2014197231A3
Authority
WO
WIPO (PCT)
Prior art keywords
hmd
region
user
scene
display
Prior art date
Application number
PCT/US2014/039411
Other languages
French (fr)
Other versions
WO2014197231A2 (en
Inventor
Steven Osman
Xiadong Mao
Jeffrey Roger Stafford
Original Assignee
Sony Computer Entertainment Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc. filed Critical Sony Computer Entertainment Inc.
Priority to CN201480035753.4A priority Critical patent/CN105324738B/en
Priority to EP14733441.1A priority patent/EP3005031B1/en
Priority to JP2016518342A priority patent/JP6126305B2/en
Publication of WO2014197231A2 publication Critical patent/WO2014197231A2/en
Publication of WO2014197231A3 publication Critical patent/WO2014197231A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Abstract

Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.
PCT/US2014/039411 2013-06-07 2014-05-23 Switching mode of operation in a head mounted display WO2014197231A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201480035753.4A CN105324738B (en) 2013-06-07 2014-05-23 The switching operation modes in head-mounted display
EP14733441.1A EP3005031B1 (en) 2013-06-07 2014-05-23 Switching mode of operation in a head mounted display
JP2016518342A JP6126305B2 (en) 2013-06-07 2014-05-23 Operation mode switching in head mounted displays

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361832758P 2013-06-07 2013-06-07
US61/832,758 2013-06-07
US14/206,219 2014-03-12
US14/206,219 US10019057B2 (en) 2013-06-07 2014-03-12 Switching mode of operation in a head mounted display

Publications (2)

Publication Number Publication Date
WO2014197231A2 WO2014197231A2 (en) 2014-12-11
WO2014197231A3 true WO2014197231A3 (en) 2015-01-22

Family

ID=52005034

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/039411 WO2014197231A2 (en) 2013-06-07 2014-05-23 Switching mode of operation in a head mounted display

Country Status (5)

Country Link
US (1) US10019057B2 (en)
EP (1) EP3005031B1 (en)
JP (2) JP6126305B2 (en)
CN (1) CN105324738B (en)
WO (1) WO2014197231A2 (en)

Families Citing this family (176)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9965681B2 (en) 2008-12-16 2018-05-08 Osterhout Group, Inc. Eye imaging in head worn computing
US9952664B2 (en) 2014-01-21 2018-04-24 Osterhout Group, Inc. Eye imaging in head worn computing
US9298007B2 (en) 2014-01-21 2016-03-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9229233B2 (en) 2014-02-11 2016-01-05 Osterhout Group, Inc. Micro Doppler presentations in head worn computing
US9080868B2 (en) * 2013-09-06 2015-07-14 Wesley W. O. Krueger Mechanical and fluid system and method for the prevention and control of motion sickness, motion-induced vision sickness, and other variants of spatial disorientation and vertigo
US10099030B2 (en) 2013-09-06 2018-10-16 Iarmourholdings, Inc. Mechanical and fluid system and method for the prevention and control of motion sickness, motion-induced vision sickness, and other variants of spatial disorientation and vertigo
KR102165818B1 (en) 2013-09-10 2020-10-14 삼성전자주식회사 Method, apparatus and recovering medium for controlling user interface using a input image
US9841599B2 (en) 2014-06-05 2017-12-12 Osterhout Group, Inc. Optical configurations for head-worn see-through displays
US9594246B2 (en) 2014-01-21 2017-03-14 Osterhout Group, Inc. See-through computer display systems
US10254856B2 (en) 2014-01-17 2019-04-09 Osterhout Group, Inc. External user interface for head worn computing
US9299194B2 (en) 2014-02-14 2016-03-29 Osterhout Group, Inc. Secure sharing in head worn computing
US10684687B2 (en) 2014-12-03 2020-06-16 Mentor Acquisition One, Llc See-through computer display systems
US11103122B2 (en) 2014-07-15 2021-08-31 Mentor Acquisition One, Llc Content presentation in head worn computing
US9746686B2 (en) 2014-05-19 2017-08-29 Osterhout Group, Inc. Content position calibration in head worn computing
US9575321B2 (en) 2014-06-09 2017-02-21 Osterhout Group, Inc. Content presentation in head worn computing
US9829707B2 (en) 2014-08-12 2017-11-28 Osterhout Group, Inc. Measuring content brightness in head worn computing
US10649220B2 (en) 2014-06-09 2020-05-12 Mentor Acquisition One, Llc Content presentation in head worn computing
US20160019715A1 (en) 2014-07-15 2016-01-21 Osterhout Group, Inc. Content presentation in head worn computing
US10191279B2 (en) 2014-03-17 2019-01-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9939934B2 (en) 2014-01-17 2018-04-10 Osterhout Group, Inc. External user interface for head worn computing
US11892644B2 (en) 2014-01-21 2024-02-06 Mentor Acquisition One, Llc See-through computer display systems
US9532715B2 (en) 2014-01-21 2017-01-03 Osterhout Group, Inc. Eye imaging in head worn computing
US20150205135A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
US9740280B2 (en) 2014-01-21 2017-08-22 Osterhout Group, Inc. Eye imaging in head worn computing
US11487110B2 (en) 2014-01-21 2022-11-01 Mentor Acquisition One, Llc Eye imaging in head worn computing
US11669163B2 (en) 2014-01-21 2023-06-06 Mentor Acquisition One, Llc Eye glint imaging in see-through computer display systems
US9766463B2 (en) 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
US9494800B2 (en) 2014-01-21 2016-11-15 Osterhout Group, Inc. See-through computer display systems
US9836122B2 (en) 2014-01-21 2017-12-05 Osterhout Group, Inc. Eye glint imaging in see-through computer display systems
US9651788B2 (en) 2014-01-21 2017-05-16 Osterhout Group, Inc. See-through computer display systems
US9753288B2 (en) 2014-01-21 2017-09-05 Osterhout Group, Inc. See-through computer display systems
US11737666B2 (en) 2014-01-21 2023-08-29 Mentor Acquisition One, Llc Eye imaging in head worn computing
US9401540B2 (en) 2014-02-11 2016-07-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
US20150241964A1 (en) 2014-02-11 2015-08-27 Osterhout Group, Inc. Eye imaging in head worn computing
US20160187651A1 (en) 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
US10853589B2 (en) 2014-04-25 2020-12-01 Mentor Acquisition One, Llc Language translation with head-worn computing
US9651787B2 (en) 2014-04-25 2017-05-16 Osterhout Group, Inc. Speaker assembly for headworn computer
US9741169B1 (en) 2014-05-20 2017-08-22 Leap Motion, Inc. Wearable augmented reality devices with object detection and tracking
KR102236203B1 (en) * 2014-05-27 2021-04-05 삼성전자주식회사 Method for providing service and an electronic device thereof
US10663740B2 (en) 2014-06-09 2020-05-26 Mentor Acquisition One, Llc Content presentation in head worn computing
US10007350B1 (en) 2014-06-26 2018-06-26 Leap Motion, Inc. Integrated gestural interaction and multi-user collaboration in immersive virtual reality environments
DE202014103729U1 (en) 2014-08-08 2014-09-09 Leap Motion, Inc. Augmented reality with motion detection
US9699436B2 (en) * 2014-09-16 2017-07-04 Microsoft Technology Licensing, Llc Display with eye-discomfort reduction
JP2016090773A (en) * 2014-11-04 2016-05-23 株式会社ソニー・コンピュータエンタテインメント Head-mounted display and brightness adjustment method
FR3029649B1 (en) * 2014-12-03 2016-12-23 Commissariat Energie Atomique METHOD FOR CALIBRATING AN INCREASED REALITY VISUAL RESTITUTION SYSTEM COMPRISING AT LEAST ONE PARTIALLY TRANSPARENT DISPLAY DEVICE, IN RELATION TO ITS USER, AND ASSOCIATED SYSTEM
US9684172B2 (en) 2014-12-03 2017-06-20 Osterhout Group, Inc. Head worn computer display systems
USD751552S1 (en) 2014-12-31 2016-03-15 Osterhout Group, Inc. Computer glasses
US9740282B1 (en) * 2015-01-05 2017-08-22 Amazon Technologies, Inc. Gaze direction tracking
US10656720B1 (en) 2015-01-16 2020-05-19 Ultrahaptics IP Two Limited Mode switching for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments
US20160210780A1 (en) * 2015-01-20 2016-07-21 Jonathan Paulovich Applying real world scale to virtual content
US10181219B1 (en) * 2015-01-21 2019-01-15 Google Llc Phone control and presence in virtual reality
US9999835B2 (en) * 2015-02-05 2018-06-19 Sony Interactive Entertainment Inc. Motion sickness monitoring and application of supplemental sound to counteract sickness
US20160239985A1 (en) 2015-02-17 2016-08-18 Osterhout Group, Inc. See-through computer display systems
US10055887B1 (en) * 2015-02-19 2018-08-21 Google Llc Virtual/augmented reality transition system and method
US9779554B2 (en) 2015-04-10 2017-10-03 Sony Interactive Entertainment Inc. Filtering and parental control methods for restricting visual activity on a head mounted display
US9690374B2 (en) * 2015-04-27 2017-06-27 Google Inc. Virtual/augmented reality transition system and method
US10115303B2 (en) 2015-05-05 2018-10-30 Razer (Asia-Pacific) Pte. Ltd. Methods for controlling a headset device, headset devices, computer readable media, and infrared sensors
JP6356915B2 (en) * 2015-06-12 2018-07-11 株式会社ソニー・インタラクティブエンタテインメント Control device, control method and program
US9898865B2 (en) * 2015-06-22 2018-02-20 Microsoft Technology Licensing, Llc System and method for spawning drawing surfaces
US11003246B2 (en) 2015-07-22 2021-05-11 Mentor Acquisition One, Llc External user interface for head worn computing
WO2017015093A1 (en) * 2015-07-17 2017-01-26 Osterhout Group, Inc. External user interface for head worn computing
EP3326023B1 (en) * 2015-07-20 2020-02-26 Magic Leap, Inc. Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system
US9857871B2 (en) 2015-09-04 2018-01-02 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US10545714B2 (en) 2015-09-04 2020-01-28 Samsung Electronics Co., Ltd. Dual screen head mounted display
CN108027694B (en) * 2015-09-04 2021-12-28 史克威尔·艾尼克斯有限公司 Recording medium, content providing apparatus, and control method
KR102136241B1 (en) * 2015-09-29 2020-07-22 바이너리브이알, 인크. Head-mounted display with facial expression detection
US11332061B2 (en) 2015-10-26 2022-05-17 Atnomity Ltd. Unmanned carrier for carrying urban manned vehicles
DE102016120427A1 (en) 2015-10-26 2017-04-27 Active Knowledge Ltd. Use video review to alert an occupant of a vehicle of an impending event that will cause a sudden decrease in ride comfort
US10710608B2 (en) 2015-10-26 2020-07-14 Active Knowledge Ltd. Provide specific warnings to vehicle occupants before intense movements
US10717406B2 (en) 2015-10-26 2020-07-21 Active Knowledge Ltd. Autonomous vehicle having an external shock-absorbing energy dissipation padding
US10059347B2 (en) 2015-10-26 2018-08-28 Active Knowledge Ltd. Warning a vehicle occupant before an intense movement
US9851561B2 (en) * 2015-12-23 2017-12-26 Intel Corporation Head-mounted device with rear-facing camera
JP6725248B2 (en) * 2015-12-28 2020-07-15 株式会社バンダイナムコエンターテインメント Game device and program
TWI688879B (en) * 2016-01-22 2020-03-21 宏達國際電子股份有限公司 Method, virtual reality system, and computer-readable recording medium for real-world interaction in virtual reality environment
US20170230640A1 (en) * 2016-02-05 2017-08-10 Samsung Electronics Co., Ltd. Portable image device with external display
US10477157B1 (en) * 2016-03-02 2019-11-12 Meta View, Inc. Apparatuses, methods and systems for a sensor array adapted for vision computing
JP2017183825A (en) * 2016-03-28 2017-10-05 京セラ株式会社 Head-mounted display
JP2017183829A (en) * 2016-03-28 2017-10-05 京セラ株式会社 Head-mounted display
US20170287215A1 (en) * 2016-03-29 2017-10-05 Google Inc. Pass-through camera user interface elements for virtual reality
US10372205B2 (en) 2016-03-31 2019-08-06 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10192528B2 (en) 2016-03-31 2019-01-29 Sony Interactive Entertainment Inc. Real-time user adaptive foveated rendering
US10401952B2 (en) 2016-03-31 2019-09-03 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10169846B2 (en) 2016-03-31 2019-01-01 Sony Interactive Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
US10019131B2 (en) * 2016-05-10 2018-07-10 Google Llc Two-handed object manipulations in virtual reality
US10748339B2 (en) 2016-06-03 2020-08-18 A Big Chunk Of Mud Llc System and method for implementing computer-simulated reality interactions between users and publications
JP6389208B2 (en) * 2016-06-07 2018-09-12 株式会社カプコン GAME PROGRAM AND GAME DEVICE
JP6668170B2 (en) * 2016-06-07 2020-03-18 株式会社ソニー・インタラクティブエンタテインメント Information processing apparatus, information processing method, and computer program
CN106200908B (en) * 2016-06-28 2019-03-08 联想(北京)有限公司 A kind of control method and electronic equipment
US10482662B2 (en) * 2016-06-30 2019-11-19 Intel Corporation Systems and methods for mixed reality transitions
US10471353B2 (en) * 2016-06-30 2019-11-12 Sony Interactive Entertainment America Llc Using HMD camera touch button to render images of a user captured during game play
US10191541B2 (en) * 2016-06-30 2019-01-29 Sony Interactive Entertainment Inc. Augmenting virtual reality content with real world content
CN106101637A (en) * 2016-07-12 2016-11-09 姜正红 A kind of multiple solutions that realizes in virtual environment shows and the visual system of feature operation
EP4220280A1 (en) 2016-09-28 2023-08-02 Magic Leap, Inc. Face model capture by a wearable device
US9824206B1 (en) * 2016-09-29 2017-11-21 International Business Machines Corporation Eye gazing passcode generation crossing augmented reality (AR) and virtual reality (VR) devices
US9871774B1 (en) 2016-09-29 2018-01-16 International Business Machines Corporation Secured file transfer management on augmented reality (AR) and virtual reality (VR) devices
US10565777B2 (en) * 2016-09-30 2020-02-18 Sony Interactive Entertainment Inc. Field of view (FOV) throttling of virtual reality (VR) content in a head mounted display
CN106412563A (en) * 2016-09-30 2017-02-15 珠海市魅族科技有限公司 Image display method and apparatus
US10845891B2 (en) * 2016-09-30 2020-11-24 Disney Enterprises, Inc. Displaying proximate keys in a virtual reality environment
IL265734B (en) 2016-10-05 2022-09-01 Magic Leap Inc Periocular test for mixed reality calibration
US10032314B2 (en) 2016-10-11 2018-07-24 Microsoft Technology Licensing, Llc Virtual reality headset
US10168857B2 (en) * 2016-10-26 2019-01-01 International Business Machines Corporation Virtual reality for cognitive messaging
CN106529973A (en) * 2016-11-02 2017-03-22 深圳市幻实科技有限公司 Anti-counterfeiting method and apparatus based on augmented reality
WO2018127782A1 (en) * 2017-01-03 2018-07-12 Xing Zhou Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
US20180190029A1 (en) * 2017-01-05 2018-07-05 Honeywell International Inc. Head mounted combination for industrial safety and guidance
JP6654158B2 (en) * 2017-01-23 2020-02-26 ティフォン インコーポレーテッドＴｙｆｆｏｎ Ｉｎｃ． Image providing system, image providing method, and image providing program
US11096004B2 (en) * 2017-01-23 2021-08-17 Nokia Technologies Oy Spatial audio rendering point extension
US10531219B2 (en) 2017-03-20 2020-01-07 Nokia Technologies Oy Smooth rendering of overlapping audio-object interactions
KR102595762B1 (en) 2017-03-22 2023-10-30 어 빅 청크 오브 머드 엘엘씨 Convertible satchel bag with integrated head-mounted display
WO2018176235A1 (en) * 2017-03-28 2018-10-04 深圳市柔宇科技有限公司 Head-mounted display device and display switching method therefor
IL269533B2 (en) * 2017-03-28 2023-11-01 Magic Leap Inc Augmeted reality system with spatialized audio tied to user manipulated virtual object
US10475243B2 (en) * 2017-03-31 2019-11-12 Intel Corporation Transition between virtual reality and real world
JP6654275B1 (en) * 2017-04-11 2020-02-26 ドルビー ラボラトリーズ ライセンシング コーポレイション Layered extended entertainment experience
US10688396B2 (en) * 2017-04-28 2020-06-23 Sony Interactive Entertainment Inc. Second screen virtual window into VR environment
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
US11074036B2 (en) 2017-05-05 2021-07-27 Nokia Technologies Oy Metadata-free audio-object interactions
JP6580624B2 (en) * 2017-05-11 2019-09-25 株式会社コロプラ Method for providing virtual space, program for causing computer to execute the method, and information processing apparatus for executing the program
CN107368184B (en) 2017-05-12 2020-04-14 阿里巴巴集团控股有限公司 Password input method and device in virtual reality scene
CN108881706B (en) * 2017-05-16 2023-10-10 北京三星通信技术研究有限公司 Method and device for controlling operation of multimedia equipment
CN106950701A (en) * 2017-05-19 2017-07-14 深圳市帝泰光电有限公司 A kind of seamless enhancing multi-mode MR systems of environment
CN110663011B (en) * 2017-05-23 2024-04-12 交互数字Vc控股公司 System and method for prioritizing AR information based on persistence of real life objects in user views
US10394315B2 (en) * 2017-05-25 2019-08-27 Acer Incorporated Content-aware virtual reality systems and related methods
US10747386B2 (en) 2017-06-01 2020-08-18 Samsung Electronics Co., Ltd. Systems and methods for window control in virtual reality environment
TWI622808B (en) * 2017-06-13 2018-05-01 群光電子股份有限公司 Head Mounted Display Device
US10748340B1 (en) 2017-07-31 2020-08-18 Apple Inc. Electronic device with coordinated camera and display operation
US10627635B2 (en) * 2017-08-02 2020-04-21 Microsoft Technology Licensing, Llc Transitioning into a VR environment and warning HMD users of real-world physical obstacles
US10178457B1 (en) * 2017-08-03 2019-01-08 Facebook Technologies, Llc Audio output assembly for a head-mounted display
US11351453B2 (en) * 2017-09-12 2022-06-07 Sony Interactive Entertainment LLC Attention-based AI determination of player choices
US10556185B2 (en) * 2017-09-29 2020-02-11 Sony Interactive Entertainment America Llc Virtual reality presentation of real world space
US11395087B2 (en) 2017-09-29 2022-07-19 Nokia Technologies Oy Level-based audio-object interactions
KR101875550B1 (en) * 2017-10-18 2018-07-06 주식회사 한컴지엠디 System for providing virtual reality content
CN107918955A (en) * 2017-11-15 2018-04-17 百度在线网络技术（北京）有限公司 Augmented reality method and apparatus
CN109814413A (en) * 2017-11-21 2019-05-28 宏碁股份有限公司 Head-mounted display apparatus, electronic system and corresponding control methods
US10726626B2 (en) 2017-11-22 2020-07-28 Google Llc Interaction between a viewer and an object in an augmented reality environment
IL311004A (en) 2018-01-17 2024-04-01 Magic Leap Inc Display systems and methods for determining registration between a display and a user's eyes
KR20200110771A (en) 2018-01-18 2020-09-25 삼성전자주식회사 Augmented Reality Content Adjustment Method and Device
CN110115842B (en) * 2018-02-06 2023-01-13 日本聚逸株式会社 Application processing system, application processing method, and application processing program
US10845601B1 (en) * 2018-02-07 2020-11-24 Apple Inc. AR/VR controller with event camera
US10726765B2 (en) 2018-02-15 2020-07-28 Valve Corporation Using tracking of display device to control image display
CN113426098A (en) 2018-03-07 2021-09-24 奇跃公司 Visual tracking of peripheral devices
US11417296B2 (en) * 2018-03-13 2022-08-16 Sony Corporation Information processing device, information processing method, and recording medium
JP7014007B2 (en) * 2018-03-29 2022-02-01 コベルコ建機株式会社 Remote control system for work machines
GB2579760B (en) 2018-03-29 2023-03-22 Displaylink Uk Ltd Position error measurement in an extended reality mobile display device
US10942564B2 (en) 2018-05-17 2021-03-09 Sony Interactive Entertainment Inc. Dynamic graphics rendering based on predicted saccade landing point
US11262839B2 (en) 2018-05-17 2022-03-01 Sony Interactive Entertainment Inc. Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
CN110547759A (en) * 2018-05-31 2019-12-10 托比股份公司 Robust converged signals
US20210089638A1 (en) * 2018-06-12 2021-03-25 Hewlett-Packard Development Company, L.P. Gesture based accesses
US20190385372A1 (en) * 2018-06-15 2019-12-19 Microsoft Technology Licensing, Llc Positioning a virtual reality passthrough region at a known distance
EP3818430B1 (en) * 2018-07-03 2022-09-07 Telefonaktiebolaget Lm Ericsson (Publ) Portable electronic device for mixed reality headset
US10540824B1 (en) 2018-07-09 2020-01-21 Microsoft Technology Licensing, Llc 3-D transitions
US11567336B2 (en) 2018-07-24 2023-01-31 Magic Leap, Inc. Display systems and methods for determining registration between display and eyes of user
WO2020051509A2 (en) 2018-09-07 2020-03-12 Ocelot Laboratories Llc Transitioning between imagery and sounds of a virtual environment and a real environment
JP6659789B2 (en) * 2018-09-10 2020-03-04 グリー株式会社 Virtual image display program, virtual image display device, and virtual image display method
US10740918B2 (en) * 2018-09-12 2020-08-11 Dell Products, L.P. Adaptive simultaneous localization and mapping (SLAM) using world-facing cameras in virtual, augmented, and mixed reality (xR) applications
US10855978B2 (en) * 2018-09-14 2020-12-01 The Toronto-Dominion Bank System and method for receiving user input in virtual/augmented reality
US10777012B2 (en) * 2018-09-27 2020-09-15 Universal City Studios Llc Display systems in an entertainment environment
US10810825B2 (en) * 2018-10-11 2020-10-20 Igt Systems and methods for providing safety and security features for users of immersive video devices
CN111309142A (en) * 2018-12-11 2020-06-19 托比股份公司 Method and device for switching input modality of display device
CN109547773B (en) * 2018-12-12 2021-01-08 维沃移动通信有限公司 Control method and electronic device
WO2020203831A1 (en) * 2019-03-29 2020-10-08 株式会社ソニー・インタラクティブエンタテインメント Boundary setting device, boundary setting method, and program
US10992926B2 (en) * 2019-04-15 2021-04-27 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a real scene in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
JP7391950B2 (en) * 2019-04-23 2023-12-05 マクセル株式会社 head mounted display device
JP6835916B2 (en) * 2019-07-18 2021-02-24 グリー株式会社 Game processing program, game processing device and game processing method
KR102641117B1 (en) 2019-08-26 2024-02-27 삼성전자주식회사 Method and apparatus of augmenting image
CA3058447A1 (en) * 2019-10-10 2021-04-10 Spacecard Inc. A system for generating and displaying interactive mixed-reality video on mobile devices
EP3839699A1 (en) * 2019-12-19 2021-06-23 Koninklijke KPN N.V. Augmented virtuality self view
CN115053203A (en) * 2020-02-24 2022-09-13 Oppo广东移动通信有限公司 Display control method and device for head-mounted device, and computer storage medium
US20210264007A1 (en) * 2020-02-25 2021-08-26 Lenovo (Singapore) Pte. Ltd. Authentication method for head-mounted display
FR3111446A1 (en) * 2020-06-19 2021-12-17 Orange Method, device and system for immersing a user in a virtual reality application
US11705762B2 (en) 2020-06-25 2023-07-18 Sony Interactive Entertainment LLC Method for game console operation based on detection of change in controller state
CN112462937B (en) * 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 Local perspective method and device of virtual reality equipment and virtual reality equipment
US11514875B1 (en) * 2021-07-07 2022-11-29 Htc Corporation Method for mitigating dizziness, electronic device, and computer readable medium
CA3225228A1 (en) * 2021-07-09 2023-01-12 Colin Guinn Extended-reality projectile-firing gaming system and method
US11813537B2 (en) * 2021-07-09 2023-11-14 Gel Blaster, Inc. Smart target co-witnessing hit attribution system and method
US20230298221A1 (en) * 2022-03-15 2023-09-21 Zeality Inc. Method and system for controlling access to virtual and real-world environments for head mounted device
US11935201B2 (en) * 2022-04-28 2024-03-19 Dell Products Lp Method and apparatus for using physical devices in extended reality environments
JP2024034133A (en) * 2022-08-31 2024-03-13 株式会社Ｊｖｃケンウッド Providing device and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105482A1 (en) * 2000-05-26 2002-08-08 Lemelson Jerome H. System and methods for controlling automatic scrolling of information on a display or screen
US20100110368A1 (en) * 2008-11-02 2010-05-06 David Chaum System and apparatus for eyeglass appliance platform
US20120050141A1 (en) * 2010-08-25 2012-03-01 Border John N Switchable head-mounted display
US20120086624A1 (en) * 2010-10-12 2012-04-12 Eldon Technology Limited Variable Transparency Heads Up Displays

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6522325B1 (en) * 1998-04-02 2003-02-18 Kewazinga Corp. Navigable telepresence method and system utilizing an array of cameras
JPH11309269A (en) * 1998-04-27 1999-11-09 Sony Corp Game device, simulation apparatus and game imade display method
JP2000242195A (en) * 1999-02-24 2000-09-08 Sony Corp Display controller and display control method, and provision medium
JP4378118B2 (en) * 2003-06-27 2009-12-02 学校法人早稲田大学 3D image presentation device
US20120200601A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with state triggered eye control interaction with advertising facility
JP5664006B2 (en) * 2010-08-09 2015-02-04 カシオ計算機株式会社 Light source control device and program
US9213405B2 (en) * 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
US8625847B2 (en) * 2011-03-21 2014-01-07 Blackberry Limited Login method based on direction of gaze
JP2013044836A (en) * 2011-08-23 2013-03-04 Canon Inc Video display device
JP5808985B2 (en) * 2011-09-05 2015-11-10 任天堂株式会社 Information processing program, information processing apparatus, information processing system, and information processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105482A1 (en) * 2000-05-26 2002-08-08 Lemelson Jerome H. System and methods for controlling automatic scrolling of information on a display or screen
US20100110368A1 (en) * 2008-11-02 2010-05-06 David Chaum System and apparatus for eyeglass appliance platform
US20120050141A1 (en) * 2010-08-25 2012-03-01 Border John N Switchable head-mounted display
US20120086624A1 (en) * 2010-10-12 2012-04-12 Eldon Technology Limited Variable Transparency Heads Up Displays

Also Published As

Publication number Publication date
CN105324738B (en) 2018-12-18
JP2017182809A (en) 2017-10-05
EP3005031B1 (en) 2019-07-31
CN105324738A (en) 2016-02-10
JP2016526237A (en) 2016-09-01
JP6545744B2 (en) 2019-07-17
US20140361976A1 (en) 2014-12-11
US10019057B2 (en) 2018-07-10
JP6126305B2 (en) 2017-05-10
WO2014197231A2 (en) 2014-12-11
EP3005031A2 (en) 2016-04-13

Similar Documents

Publication Publication Date Title
WO2014197231A3 (en) Switching mode of operation in a head mounted display
WO2015047453A3 (en) Interactions of virtual objects with surfaces
MX2018008945A (en) Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking.
JP2016504615A5 (en)
WO2014197338A3 (en) Head mounted display based on optical prescription of a user
WO2015060936A8 (en) Improved provision of contextual data to a computing device using eye tracking technology
GB2533520A (en) Gaze-controlled interface method and system
WO2013043288A3 (en) Wearable computer with superimposed controls and instructions for external device
WO2013077978A3 (en) Method of using eye-tracking to center image content in a display
WO2015047599A3 (en) Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
GB2510527A (en) Interestingness scoring of areas of interest included in a display element
NZ735754A (en) Display system and method
WO2014106823A3 (en) Extramissive spatial imaging digital eye glass for virtual or augmediated vision
WO2014100250A3 (en) Devices, systems and methods of capturing and displaying appearances
MX357057B (en) User interface navigation.
EP2648086A3 (en) Object control method performed in device including transparent display, the device, and computer readable recording medium thereof
WO2012115964A3 (en) Managing workspaces in a user interface
JP2013168910A5 (en)
WO2014021602A3 (en) Wearable electronic device and method for controlling same
WO2014197873A3 (en) Transitioning gameplay on a head-mounted display
AR088237A1 (en) METHOD AND APPLIANCE TO CONTROL THE VISUAL REPRESENTATION OF INFORMATION ON A TRANSLATED SCREEN
WO2013012482A3 (en) Nose bridge sensor
WO2014125380A3 (en) Systems and methods of eye tracking calibration
WO2013153740A3 (en) Augmented reality system to selectively improve the visibility of the desired information
WO2014116466A3 (en) Mixed reality filtering

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480035753.4

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14733441

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 2016518342

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2014733441

Country of ref document: EP