US20120017147A1 - Methods and systems for interacting with projected user interface - Google Patents
Methods and systems for interacting with projected user interface Download PDFInfo
- Publication number
- US20120017147A1 US20120017147A1 US12/837,895 US83789510A US2012017147A1 US 20120017147 A1 US20120017147 A1 US 20120017147A1 US 83789510 A US83789510 A US 83789510A US 2012017147 A1 US2012017147 A1 US 2012017147A1
- Authority
- US
- United States
- Prior art keywords
- mobile device
- user interface
- image
- projected
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000004044 response Effects 0.000 claims abstract description 16
- 230000033001 locomotion Effects 0.000 claims description 52
- 239000011521 glass Substances 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 21
- 230000000875 corresponding effect Effects 0.000 claims description 10
- 238000003860 storage Methods 0.000 claims description 9
- 230000002596 correlated effect Effects 0.000 claims description 6
- 230000003993 interaction Effects 0.000 abstract description 21
- 230000008859 change Effects 0.000 abstract description 17
- 230000006870 function Effects 0.000 description 26
- 230000008569 process Effects 0.000 description 13
- 230000001133 acceleration Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000003825 pressing Methods 0.000 description 6
- 230000001413 cellular effect Effects 0.000 description 5
- 230000005484 gravity Effects 0.000 description 4
- 239000000872 buffer Substances 0.000 description 3
- 230000004424 eye movement Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000000284 resting effect Effects 0.000 description 3
- 238000010079 rubber tapping Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000009133 cooperative interaction Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1639—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being based on projection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0272—Details of the structure or mounting of specific components for a projector or beamer module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/54—Details of telephonic subscriber devices including functional features of a projector or beamer module assembly
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
- Telephone Function (AREA)
Abstract
Description
- The present application relates generally to computing device user interfaces, and more particularly to a user interface for hand held computing device for manipulating projected images.
- Wireless communication technologies have seen explosive growth over the past few years. This growth has been fueled by wireless services providing freedom of movement to the mobile public, and cutting the tether to hardwired communication systems. As a result of ever-increasing capabilities of mobile device applications, the popularity of mobile devices is expected to continue to grow. As mobile devices become more powerful and perform more functions, there is increasing demand for larger and more interactive display screens to support the increasing functionality of these devices. At the same time, users demand ever lighter and more portable mobile devices.
- The various aspects provide methods and system for a projected user interface for mobile devices. In an aspect, a method for providing a user interface for a mobile device includes projecting a user interface image, detecting a user input gesture, identifying functionality associated with the detected user input gesture, and changing the projected user interface image based on the interpreted gesture. In such a method, detecting a user input gesture may include receiving a touch event from a touch screen display, and correlating the received touch event to a particular touch gesture. Detecting a user input gesture may include receiving signals from orientation sensors within the mobile device, and correlating the received sensor signals to a hand gesture. The orientation sensors may include one or more accelerometers. Correlating the received sensor signals to a hand gesture may include recognizing the hand gesture as being one of a tilt of the mobile device, a turn of the mobile device, a rotation of the mobile device, and a rapid movement of the mobile device. In an aspect, the method may further include identifying a functionality corresponding to the correlated hand gesture, and implementing the identified functionality, in which changing the projected user interface image based on the interpreted gesture comprises changing the user interface image based upon the implemented functionality. Implementing the identified functionality may include accomplishing one of scrolling a list, moving an image object, changing a zoom factor applied to an image object displayed within the projected user interface image, selecting an object within the projected user interface image, copying an object displayed within the projected user interface image, deleting an object displayed within the projected user interface image, executing an application associated with an object displayed within the projected user interface image, and movement of a pointing icon displayed within the user interface image. Projecting a user interface image may include projecting an image that appears to be three dimensional when viewed with special 3-D glasses. The projected image may be configured so that image objects appear positioned about a surface of a sphere, and wherein changing the projected user interface image based on the interpreted gesture comprises changing the projected user interface image so that the sphere appears to rotate about one or two axes to position different image objects in a foreground position. In an aspect, the method may further include highlighting an image object located in a center of the projected user interface image, and selecting the highlighted image object in response to a user input. In an aspect, the method may further include establishing a communication link with a second mobile device, receiving a message from the second mobile device including information regarding changes to the user interface image based on the interpreted gesture, and changing the user interface image based on the information received from the second mobile device regarding changes to the user interface image. In an aspect, the method may further include adjusting an angle of the projected user interface image to maintain the projected image approximately steady within a limited angle of tilt or turn. In an aspect, the method may further include changing the projected user interface image to maintain image objects in an approximately constant position with respect to an external surface onto which the image is projected.
- In a further aspect, a mobile device may include a projector, such as a pico projector, coupled to a processor, in which the processor is configured with processor-executable instructions to perform operations including projecting a user interface image, detecting a user input gesture, identifying functionality associated with the detected user input gesture, and changing the projected user interface image based on the interpreted gesture. In an aspect, the mobile device may further include orientation sensors coupled to the processor, and the processor may be configured with processor-executable instructions to also perform some or all of the other operations of the above described methods.
- In a further aspect, a mobile device may include means for projecting a user interface image, means for detecting a user input gesture, means for identifying functionality associated with the detected user input gesture, and means for changing the projected user interface image based on the interpreted gesture. In an aspect, the mobile device may also include as means for performing some or all of the other operations of the above described methods.
- In a further aspect, a non-transitory processor-readable storage medium may have stored thereon processor-executable instructions configured to cause a processor of a mobile device to perform operations including projecting a user interface image, detecting a user input gesture, identifying functionality associated with the detected user input gesture, and changing the projected user interface image based on the interpreted gesture. In an aspect, the non-transitory processor-readable storage medium may also have stored thereon processor-executable instructions configured to cause a processor of a mobile device to perform some or all of the other operations of the above described methods.
- The accompanying drawings, which are incorporated herein and constitute part of this specification, illustrate exemplary aspects of the invention, and together with the general description given above and the detailed description given below, serve to explain the features of the invention.
-
FIG. 1 is an illustration of a mobile device projecting a mobile device user interface. -
FIGS. 2A-2C are illustrations of user interactions with a mobile device via a projected mobile device user interface using touch gestures. -
FIGS. 3A-3C are illustrations of user interactions with a mobile device via a projected mobile device user interface using touch gestures. -
FIGS. 4A-4D are illustrations of user interactions with a mobile device via a projected mobile device user interface using hand gestures. -
FIG. 5A-5C are illustrations of user interactions with a mobile device via a projected mobile device user interface using hand gestures. -
FIGS. 6A-6C are illustrations of user interactions with a mobile device via a projected mobile device user interface using hand gestures. -
FIGS. 7A-7B are illustrations of user interactions with a mobile device via a 3D projected mobile device user interface using hand gestures. -
FIGS. 8A-8B are illustrations of user interactions with a mobile device via a 3D projected mobile device user interface using hand gestures. -
FIGS. 9A-9B are illustrations of user interactions with a mobile device via a projected mobile device user interface from a second mobile device using hand gestures. -
FIG. 10 is an illustration of a user interaction with a mobile device via a projected user interface using hand gestures to select content. -
FIGS. 11A-11B are illustrations of user interactions with mobile device via a projected mobile device user interface using hand gestures to select contents. -
FIG. 12 is an illustration of a user interaction with a mobile device via a projected user interface using touch gestures to select content. -
FIG. 13 is a process flow diagram of an aspect method for interacting with projected mobile device user interface. -
FIG. 14 is a process flow diagram of an aspect method for selecting projected mobile device user interface content. -
FIG. 15 is a process flow diagram of an embodiment method for selecting a projected content using hand gestures. -
FIG. 16 is a process flow diagram of an aspect method for using one mobile device to interact with the projected mobile device user interface of another mobile device. -
FIGS. 17A and 17B are component block diagrams of a mobile device suitable for use with the various aspects. -
FIG. 18 is a cross-sectional view of a steerable projection assembly which may be implemented with a mobile device according to an aspect. - The various aspects will be described in detail with reference to the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. References made to particular examples and implementations are for illustrative purposes, and are not intended to limit the scope of the invention or the claims.
- The word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any implementation described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other implementations.
- The terms “mobile device” and “computing device” are used interchangeably herein to refer to any one or all of portable computing devices, personal mobile television receivers, cellular telephones, personal data assistants (PDA's), palm-top computers, wireless electronic mail receivers (e.g., the Blackberry® and Treo® devices), multimedia Internet enabled cellular telephones (e.g., the Blackberry Storm®), and similar personal electronic devices which include a programmable processor and memory, and a projector for projecting images onto a surface.
- As mobile devices become increasingly powerful and perform increasingly more sophisticated functions, the complexity of application options and the increased number of files may be stored on mobile devices create a demand for larger and more interactive displays to support such functionality. At the same time, user preferences for portability are causing mobile device manufacturers to create smaller and lighter devices. Smaller mobile devices means that the available real estate for a display screen is limited.
- To address these conflicting requirements for smaller devices with greater functionality, the various aspects provide methods and systems for projecting the user interface display onto an external surface, such as by the means of an integrated pico projector, and enabling users to interact with the mobile device through a user interface coupled to the projected image using intuitive gestures. By projecting the user interface display on an external surface, the mobile device can provide a larger display field enabling more content to be displayed that would be possible on the small screen of the mobile device. In the various aspects, a mobile device may project the user interface display onto an external surface, and detect and interpret finger and/or hand gestures of the user with the resulting interaction displayed on the projected user interface image. In various aspects, the projected user interface display may include the same content as presented on the mobile device physical display screen, or more content than is presented on the mobile device display screen.
- A variety of intuitive user interface gestures may be supported by the projected user interface. In some aspects or implementations, user interactions with the mobile device, such as pushing buttons (e.g., the arrow keys) or touching a touchscreen surface of the device (which are referred to herein as “touch gestures”), can be treated as user inputs which are reflected on the projected user interface display. Such capabilities may enable new forms of interactions with the mobile devices and their applications and stored files. For example, scrolling touch gestures may be configured to span more files than compatible with the small displays screen of the mobile device. As another example, touches to the touchscreen surface may cause the mobile device to project spots, such as virtual laser spots, on the projected image.
- In some aspects or implementations, movements of the mobile device may be interpreted as user interface gestures (which are referred to herein as “hand gestures”). For example, a rapid redirection of the mobile device to the left or the right may be detected by accelerometers within the device and interpreted as commands to shift the displayed image to the left or the right, or scroll a list. As another example, a rapid twist of the mobile device along a long axis may be interpreted as a command to scroll or increment a list, select a file, increase zoom, etc. Mobile devices may be equipped with three axis accelerometer which can sense the gravity gradient, and thus the spatial orientation of the mobile device, may interpret changes in the orientation (e.g., tilt angle or rotation angle) as user input commands, such as to scroll a list of left or right or up or down (depending upon the tilt or rotation angle), increase or decrease as zoom, position files within the display, etc. Such capabilities can also enable new forms of user interaction with applications for stored content. For example, lists of files may be organized on a virtual spherical surface which may be rotated around vertical and horizontal axes by tilting the mobile device (e.g., left or right and up or down) as if rolling a ball in virtual space.
- In some aspects, the projected user interface image is not adjusted for changes in the device orientation. In another aspect, the projected user interface image may be adjusted to maintain a particular orientation or displayed content while the device is moved or manipulated. In an aspect, the lens of the pico projector may be manipulated, such as with mechanical manipulators, in order to hold the projected image study on the external surface while the user performs hand gestures. In another aspect, the displayed image is adjusted (e.g., by moving objects in the image in the opposite direction of the movement of the display on the external surface) so that objects within the image appeared and remained steady on the surface. In this manner, displayed objects may appear to be fixed with respect to the external surface while the projection frame moves about on the surface in response to movements of the mobile device.
- In a further aspect, multiple mobile devices may interact with a user interface display projected by one of the mobile devices. In this manner, user input gestures, such as touches to arrow keys or a touchscreen, or hand gestures performed by manipulating the mobile devices, may cause the projecting mobile device adjusted projected image to reflect the user inputs from the other mobile devices. This capability may enable new forms of user interactions with projected images, such as using cellular telephones to generate virtual laser spots on the projected image, or manipulating their cellular telephones (e.g., tilting, rotating, waving or otherwise moving their telephones) in order to control or impact the displayed image.
- The various aspects have a number of useful applications beyond the following examples of user interface list selections and interacting with image objects projected on external surface. For example, the projected user interface of the various aspects may enable users to “surf the web” by projecting a web browser image on an external surface and receiving user inputs for selecting hyperlinks and otherwise navigating through Internet webpage connections via the various techniques described herein. The larger size display possible with a projection system compared to the physical display of a mobile device may enable users to view the entire webpage with readable font sizes, which is not possible on typical mobile device physical displays. Another useful application employs the projected user interface capability to support videoconference calls, leveraging the larger size image generated by a projector.
- An example of an aspect
mobile device 100 projecting a user interface display is illustrated inFIG. 1 . Amobile device 100 may include apico projector 102 coupled to a user interface system. Thepico projector 102 projects an image (illustrated by dashed lines 122) onto an external surface (e.g., a wall) in the form of a projectedframe 120 including image objects 118 (e.g., contact listings as shown in this example illustration). Themobile device 100 may also include adisplay screen 103 on which themobile device 100 may display a conventionaluser interface image 103 including the image objects 118. Since the projected image can be much larger, depending upon the distance to the external surface, the projected user interface image within the projectedframe 120 may encompass more image objects 118 then can be included within themobile device display 103. For example, in the example illustrated inFIG. 1 , the limited size of themobile device display 103 limits the number ofcontact image items 118 that can be displayed to six items, while the projectedframe 120 includes sufficient space to display 12 image objects 118. The additional image objects 118 supported by the projected user interface are indicated by dashedline 124. To view these additional contacts image objects 118 on the mobile device'sconventional display 103, the user would have to scroll through the contacts list, such as by implementing a flick gesture on the touch screen. Thus projecting the user interface display onto an external surface enables more content to be included within the display than is possible on many mobile devices. - With the user interface image projected onto an external surface, new methods for interfacing with the mobile device are enabled. For example,
FIGS. 2A , 2B, and 2C illustrate a user interacting with a list application (e.g., a series of photographs thumbnails, contact records, etc.) by manipulating atouchscreen 103 to cause the displayed contents to shift positions within the projectedframe 120. While not shown inFIGS. 2A , 2B, and 2C, the user may similarly interact with the mobile device by pressing arrow keys or other physical keys on the device. In a long list of objects, the projectedframe 120 may not be large enough to display more than a portion of the list contents. For example,FIG. 2A illustrates a list of image objects 118 in which onlyitems image object 8 is no visible as positioned below the projectedframe 120. To view other image objects 118 beyond the boundary of the projectedframe 120, a user may initiate afinger gesture 208, by placing afinger 202 on thetouch screen display 103 of themobile device 100. - A variety of different types of touch gestures that may be used to interact with the mobile device using the projected user interface.
FIG. 2A illustrates an example touch gesture in which asimple finger drag 208 across the surface of thetouch screen 103 is interpreted by the mobile device user interface to indicate a list scroll, such as moving the image objects 118 in the vertical direction is indicated by the dashedarrow 204. In a similar manner, a press of a down or up arrow key may indicate a list scroll. - The result of the example touch gesture illustrating in
FIG. 2A is illustrated inFIG. 2B . As the user traces the upward touch gesture with afinger 202 on thetouch screen 103, themobile device 100 may be configured to detect the touch event, interpret the touch gesture, implement the corresponding function, and revise the projected user interface display to reflect the change. In the illustrated example, the touch gesture is traced in an upward direction, so the image objects 118 move in an upward direction towards the upper boarders of the projectedframe 120. As theimage object 6 moves out of the projectedframe 120, thenext image object 9 enters the projectedframe 120 from the bottom boarder.FIG. 2C illustrates the result at the conclusion of the touch gesture. - In an aspect, the movement of the image objects 118 within the projected
frame 120 corresponds to the movement of the touch gesture, so the user receives feedback from the projected image. Thus, if the user were to reverse the direction of the touch gesture, the movement of the image objects 118 will similarly be reversed. To accomplish this, themobile device 100 may be configured to recognize and implement the touch gesture in a manner such that the speed and direction of movement of image objects 118 on the projectedframe 120 corresponds to the speed and direction of the user's touch gesture. In a further aspect, the speed of movement of image objects on the projected user interface display may be a multiple or fraction of the speed of the gesture, with the multiple or fraction determined as a user preference, a display parameter controlled in application, or a parameter determined by the mobile device operating system. - A
mobile device 100 may further be configured to implement different functions based on varying parameters of a touch gesture. For example, the speed in which a user traces a touch gesture may determine the type of scrolling function that may be implemented by themobile device 100. Themobile device 100 may be configured to interpret a fast touch gestures (e.g., a flick) to mean a fast scroll which may automatically scroll through the displayed content at a fast pace. In a further aspect, the user may have to touch the touch sensitive screen to stop the automatic scrolling. -
FIGS. 3A , 3B, and 3C illustrate another touch gesture for interacting with list items using a touch gesture in conjunction with a projected user interface according to an aspect. In the example illustrated inFIG. 3A , a user'sfinger 202 tracing atouch gesture 308 across the width of thetouch screen display 103 of themobile device 100 causes a list of image objects 118 to scroll laterally as shown byarrow 304. - As illustrated in
FIG. 3B , as the user's finger slides across thetouch screen display 103, the projected image objects 118 move in a coordinated matter (e.g., from left to right) to display thenext picture 118. Thus, when the user's finger is halfway across thetouch screen display 103, a portion of both image objects 4 and 5 are displayed. In this manner, the user can see the result of the touch gesture on the projected user interface image. The completion of the example touch gesture function is illustrated inFIG. 3C which shows the scroll to the right complete. - Another form of user input gestures that may be implemented on the various aspects is accomplished by moving the mobile device itself and a manner that can be sensed by accelerometers or other sensors within the device. Many models of smart phones currently available on the market include GPS receivers as well as accelerometers which can sense the orientation of the device in one or two dimensions. For example, several models of smart phones include accelerometers which enable the device to recognize when it is being held vertically or horizontally so that the processor can transform the displayed image from portrait to landscape mode as appropriate. By including three accelerometers, full 3-axis orientation information can be determined. Combining such 3-axis orientation information with the 3-axis location information provided by a GPS receiver can provide mobile devices with true 6-axis location and motion detection capability. Such 6-axis position/orientation information may be leveraged by the various aspects to recognize user input gestures associated with the orientation or movement of the mobile device.
-
FIGS. 4A through 4D , illustrate an aspect hand gesture suitable for interacting with a list of items displayed in a user interface image in a projectedframe 120. Similar to touch gestures, hand gestures enable users to interact with applications or files on the mobile device via the projected user interface. In such aspects, users move themobile device 100 manner that can be recognized as a user input. For example, while pointing themobile device 100 at an external surface on which projected images may be displayed, users may move themobile device 100 from side to side to scroll through the projected contents as illustrated inFIGS. 4A , 4B (or 4C), and 4D. As another example, users may tilt their mobile device up or down to scroll through a vertical list of contents as illustrated inFIGS. 5A , 5B, and 5C. As another example, users may rotate their mobile device in order to affect displayed content, such as to adjust a zoom setting as illustrated inFIGS. 6A-6D , or to scroll through a list or database as illustrated inFIGS. 7A-8B . - In order to enable mobile devices to recognize such hand gestures, they may be equipped and configured with sensors, such as accelerometers and a digital compass which can sense and measure such movements. For example, a mobile device may include three accelerometers, one for detecting accelerations along the “X” axis, another for detecting accelerations along the perpendicular “Y” axis, and a third for detecting accelerations along the perpendicular “Z” axis. When the
mobile device 100 is in a horizontal position, the accelerometers may detect the gravity vector based on the relative accelerations measured by the 3 perpendicular accelerometers. For example, when the mobile device is held still and in a horizontal orientation with respect to the surface of the earth, only the “Z” axis accelerometer may sense acceleration while the other accelerometers sense little or no acceleration. If the mobile device is then tilted out of the horizontal plane, this may be detected by an increase in the acceleration sensed by one or both of the “X” and “Y” axis accelerometers and a decrease in the acceleration sensed by the “Z” accelerometer. Also, a rapid movement of the mobile device in any direction may be sensed as momentary accelerations by any one or all of the three accelerometers. Methods for detecting orientations and motions of devices based on accelerometer signals are well known and may be implemented within the mobile device processor as part of the various aspects. - While the user interface image is projected onto an external surface, the mobile device processor may monitor signals received from sensors (e.g., accelerometers and/or a digital compass) to detect movements of the device. As part of this process, the mobile device processor may determine its resting orientation, which may serve as a starting point for detecting and interpreting hand gestures. By determining its resting position, the
mobile device 100 may be able to detect and implement a hand gesture to affect the projected contents. At any given position, accelerometers of amobile device 100 may be able to detect the position of themobile device 100 based on the forces of gravity. - Other sensors, such as a digital compass, may also be used to detect resting orientations and motions of
mobile devices 100. For example, a compass may be used to determine the change in direction in which themobile device 100 is pointing. - In the various aspects, the projected user interface image may be adjusted in response to detect movements. In some aspects, the projected user interface image may be held fixed with respect to the mobile device, so that as the user manipulates the mobile device, the projection on the external surface moves with it. In other aspects, the projected user interface image may be held fixed with respect to the external surface, such as by means of actuators tied to the projection lens and configured to manipulate the lens so as to study the projection with respect to the external surface. In still other aspects, a processor within the mobile device may be configured to adjust the projected image so that image objects appear fixed with respect to the external surface as the projected frame moves.
- In aspects in which the projected image is not adjusted for movement of the mobile device, the projection and images will move in a manner that users will expect, much like how a flashlight beam moves in response to movements of the flashlight.
- In aspects in which the projected image is maintained approximately steady on the external surface while the mobile device is manipulated may employ a steerable pico projector (i.e. a projector which can be steered such as by positioning servos) or a pico projector combined with steerable optics, such as illustrated in
FIG. 18 and described in more detail below. In such aspects, the mobile device processor senses movements or changes in the orientation of the device while projecting a user interface image on external surface, and steers the projected image in an effort to compensate for such movement. Thus, as a user aims the mobile device to the right, the steerable optics may steer the projection to the left so that the projection remains more or less steady on the external surface.FIGS. 4A-4C illustrate aspect methods using amobile device 100 equipped with more than one projectors. - Referring to
FIG. 4A , a user may perform a hand gesture to scroll through a horizontal list such as by turning themobile device 100, such as to the right as indicated by dotted arrow 408. The device processor processing signals from accelerometers and/or a compass may detect the change in orientation of themobile device 100, and steer the projection lens to redirect the projectedframe 120 so as to maintain a constant position on the external surface, such as illustrated inFIG. 4B . In alternative aspects which do not include steering of the projection lens, the user interface image may be processed to adjust the position and presentation of image objects consistent with the objects remaining fixed on the external surface as the projection beam moves. This alternative is illustrated inFIG. 4C , which illustrates how as theprojection frame 120 shifts to the right, the image objects, includingobjects projection frame 120 shifted as illustrated inFIG. 4C ,image object 4 is no longer visible,image object 5 is clipped so only a portion if visible, andimage object 6 is fully visible. - In addition to steering the projected frame 120 (as illustrated in
FIG. 4B ) or repositioning image objects within the projection (as illustrated inFIG. 4C ), the processor may also interpret the device movement as a command to scroll displayed list of image objects 118. Thus, as illustrated inFIG. 4B , the image objects 118 within the projectedframe 120 may scroll to the right, such thatimage object 5 scrolls out of the projectedframe 120 to the right while image optic for scrolls into the projectedframe 120 from the left. The scrolling of the image objects 118 may continue so long as the user continues to aim the mobile device to the right (or to the left). To stop the scrolling, the user may turn themobile device 100 back to the initial orientation, such as by moving it back along the dotted line andarrow 407. Thus, when themobile device 100 is returned to its initial orientation, the scrolling may stop at the currently displayedimage object 118 as illustrated inFIG. 4C . In a similar manner, a user may scroll the list in the opposite direction by turning the device in the opposite direction. Also, a similar scrolling of the list may be accomplished in the vertical direction by tilting the mobile device up or down in order to command the device to scroll the displayed image objects up or down while maintaining the position of theprojection frame 120 steady on the external surface. In a further aspect, the speed at which a scroll occurs may depend upon the angle that the mobile device is turned from its initial configuration, such as the greater the angle of the turn, the faster the scroll. - In aspects in which image objects are steadied on the external surface even as the projection moves, the processor of the device may be configured to adjust the projected image in response to detected movements of the mobile device. Specifically, the processor may reposition image objects within the projected image so they move within the projected frame in a manner that is equal and opposite to movements of the projected frame on the external surface. Thus, like a flashlight illuminating a tapestry, movement of the mobile device may cause the projected frame to move on the external surface in a manner that reveals image objects above or to the side of its initial position. Such an aspect may enable a user interface that enables users to inspect lists and arrays of image objects by maneuvering the mobile device to reveal them instead of requiring the user to scroll through the objects.
FIGS. 5A-5D illustrate aspect methods using amobile device 100 equipped with one projector. -
FIG. 5A illustrates an example in which a vertical list of image objects 118 (i.e., image obvious 5 through 9) extends beyond the area of the projectedframe 120. In an initial orientation illustrated inFIG. 5A , the projectedframe 120 includes image objects 5, 6, 7, whileimage object friend 120. To review the image objects below those present in the current projectedframe 120, a user may tilt themobile device 100, as shown in a cross-sectional view ininsert 502. The result of such a downward tilt from an initial orientation (illustrated as 100 a in insert 502) to a new orientation (illustrated as 100 b in insert 502) is illustrated inFIG. 5B , which shows the projectedframe 120 and a new, lower position on the external surface. In this new orientation, image objects 7, 8, and 9 are included in the projectedframe 120, while image objects 5 and 6 are no longer visible as lying (virtually) above the displayed portion of the list. Once the user has panned the projectedframe 120 to reveal a desired portion of the list of image objects 118, the user may execute another command, such as the pressing a button (e.g., arrow keys) or tapping of the touchscreen to lock the projected user interface image so that the projectedframe 120 may reposition of the external surface without further movements of the displayed image objects. This is illustrated inFIG. 5C , which illustrates an end condition in which a user has selected image objects 7, 8, and 9 by performing the downward tilt hand gesture illustrated inFIGS. 5A and 5B , locked the projection on the new list location and then move themobile device 100 to reposition the projectedframe 120 on the external surface. The locking of the projected user interface image may alternatively occur when the user begins to move themobile device 100 back to itsoriginal orientation 100 a. Thus in this example aspect, a downward tilt causes the list to scroll and a vertical manner, stopping when the user returns the mobile device to its original orientation. To scroll the list in the opposite direction (e.g., downward), the user may tilt themobile device 100 a few degrees. WhileFIGS. 5A-5C illustrate a hand gesture involving a vertical (i.e. up or down) tilt, similar functionality may be ascribed to left or right turns of the mobile device. In a further aspect, the speed of the vertical scroll may depend upon the angle of the tilt, such as the greater the tilt, the faster the scroll. - Other hand gestures may also be used to implement functionalities other than list scrolls when interacting with projected user interface displays. In an exemplary aspect shown in
FIGS. 6A-6D , the mobile device may be configured so that a rotating hand gesture may be used to control the zoom factor of projected user interface images. As illustrated inFIGS. 6A and 6B a user may perform a zoom-in hand gesture by rotating amobile device 100 from its initial orientation shown inFIG. 6A to the right (for example) in the direction of the line andarrow 608 to its second orientation shown inFIG. 6B . In response to this hand gesture, the displayedimage object 118 within the projectedframe 120 is increased in magnification as shown inFIG. 6B . In this aspect, themobile device 100 may detect the angle of rotation of the mobile device, such as based upon signals received from accelerometers, determine the angle of the new orientation, determine a zoom factor or rate of increase/decrease of zoom to apply to projected images based upon the determined angle, and adjust the projected user interface display by applying the determined zoom factor to the projected image. Thus, as illustrated inFIG. 6C , the larger the angle of rotation (or the longer the rotation is maintained), the greater the zoom factor applied to the image and the larger the image appears. When a desired image zoom factor or image size is achieved, the user may lock the current zoom factor, such as by touching a button (e.g., arrow keys) or touchscreen or by rotating the mobile device back to the initial orientation (e.g., horizontal), as illustrated inFIG. 6D . To reverse the change in the applied to zoom (i.e., zoom out), the user may rotate the mobile device in the opposite direction (e.g., rotating it to the left) which will cause the mobile device processor to apply a zoom factor in a similar manner. - In various aspects, other user input, such as voice commands, may also be used to interact with the projected user interface. For example, a
mobile device 100 may be configured to recognize user saying “zoom-in” as a command to magnify the projected image, which then will be reflected in the projected user interface image. - The new capabilities enabled by the various aspects may enable new types of interactions with files and applications executing on a mobile device.
FIGS. 7A and 7B illustrate an example of a new user interface display in which themobile device 100 projects a three dimensional (3D) image on an external surface and enable a user to interact with the 3D image using hand gestures executed on the mobile device. - The creation and projection of 3-D images is well now known, and the user may view the projected image in 3-D by wearing special 3-
D glasses 702. In addition to such true 3-D image generation, simulated 3-D images may also be used in the various aspects. Methods for generating a 3-D projection are well-known, such as recently demonstrated in the release of the movie Avatar. Also, technique used to generate a simulated 3-D image on a display screen may be used for generating a projected image that is rendered by a pico projector. In one method, two separate images intended for the left and right eye are generated, one image intended for the left eye and the other intended for the right eye, and the two images alternatively projected for short durations. 3-D glasses 702 are equipped with electronic light filters which alternatively block each eye in synch with the projection. The perceived result is the projected image is seen as being three dimensional. Thus in this aspect, the processor of themobile device 100 generates two versions of the projected user interface image, one with image objects positioned within the projection frame for the left eye and the other positioned with image objects positioned within the projection frame for the right eye, with the position of objects in the foreground shifted between the left and right images more than for image objects in the background. The generation of two images may be facilitated by providing two display buffers (e.g., left and right image buffers) within the processor or image rendering circuitry of the mobile device so two images can be alternatively projected simply by alternatively drawing from the left and right image buffers. In a further aspect, the mobile device may be equipped with two pico projectors, with one used to project images for the left eye and the other used for projecting images for the right eye. In such a configuration, the pico projectors may be alternatively energized or alternatively masked, such as with an electrically activated light filter in a manner similar to how the 3-D glasses 702 operate. In a further aspect, the processor of themobile device 100 may be configured to communicate with 3-D glasses 702, such as via a BlueTooth, WiFi, Zigbee, NFC or other wireless data link, to synchronize the active light filters in each lens with the projectors of the mobile device. - In a 3D projected user interface image, a row of image objects 118 may be shown, with a currently selected image object (shown as image object 3) positioned in the foreground with the rest of the image objects 118 at various distances in the background. This aspect, the scrolling (shown by arrow 704) of the image objects 118 in response to a
rotational hand gesture 708 may appear as if the images march forwards towards the center and then march backwards away from the center. Thus, after one scroll increment the projected user interface image may appear as illustrated inFIG. 7B . - Another new user interface enabled by the capabilities of the various aspects is a spherical array of data rather than a flat list or two-dimensional array as illustrated in
FIGS. 8A and 8B . In this aspect, amobile device 100 may project 3-D user interface image or an external surface which will appear, with the aid of 3-D glasses 702, in the shape of a sphere orglobe 802. As illustrated inFIG. 8A , themobile device 100 may project user interface image made up of many image objects 118, such as objects in a database, that appear in a spherical arrangement when viewed with 3-D glasses 702, such as glued to the surface of a largevirtual globe 802. In such a projected user interface image, the central image object (A) may be the currently selected or selectable object. To view or select other objects in the accessed database, a user may manipulate themobile device 100, such as by rotating (808) or tilting (810), which the mobile device processor uses as commands to rotate the sphere in the desired direction, so as to present the next image object (B) in the direction of rotation as the selected or selectable object. - In this aspect, a user can rapidly move through a large database by causing the
virtual globe 802 to rotate about the vertical axis 804 (as shown by dashed arrow 806), about the horizontal axis 805 (as shown by dashed arrow 807), or both simultaneously by appropriately rocking and pivoting the mobile device. Due to user familiarity with round surfaces, such as globes and bowling balls, this user interface enabled by the various aspects may prove intuitively easy to use and efficient for locating objects within an extensive database. Thus, users may “roll” through a database rather than “scroll” through lists of data. The position of objects on the virtual sphere may be tied to data relationships organizations, in a manner similar to how cities are position within countries and countries are position within continents on a globe. Further, the virtual size of theglobe 802 may be adjusted to that which is necessary to contain all the images on its surface. Thus, a globe presenting 12 image objects on its surface would be much smaller than a globe presenting 10,000 image objects on its surface. Alternatively, the size and/or spacing of image objects may be adjusted in order to fit all items in a selected database on the globe's surface. This alternative would allow for the same globe size to be used for presenting a database of 12 images and a database of 10,000 images. - To allow users to efficiently interact with the contents displayed in a spherical 3-D user interface projection, the
mobile device 100 may also be configured to recognize touch gestures. In the case of touch gestures, a user may use their fingers to interact with adatabase globe 802 by tracing touch gestures on themobile device 100 touch screen display, in a manner that appears to enable them to push the sphere in different directions with a finger. - In a further aspect, users may interact with 3D images by using
3D glasses 702 equipped withsensors 820 that can track eye movements. In this aspect, themobile device 100 may be configured to receive eye movement data detected by eye-trackingsensors 820 in the3D glasses 702 and interpret eye movement as commands for interacting with the projected display. For example, if a user looks at a particular image object projected on the sphere, the position of the user's eyes may be determined by the eye-trackingsensors 820 and communicated to themobile device 100, which may interpret the eye position as a user input command to roll the projected contents to bring that image object into the center of the projected image. Themobile device 100 may then execute this command by adjusting the projected user interface image to generate an animation of the globe rolling until the item focused on by the user is centered in the projected image. In an aspect, sensing of the position of the user's eyes can provide a closed loop control system for image movements, since the user's eyes will track an image object as it moves in the projected image. For example, the speed of animation of the projected user interface image may be correlated to the angle of the user's gaze from straight ahead. In this manner, the projected image may be rotated rapidly when the user looks at an image object near the periphery of the projected image (e.g., on a side of a database globe 802), and slow as the image object of interest rotates closer to center (i.e., straight ahead through the 3-D glasses 702). Thus, this embodiment may provide a highly intuitive user interface that requires virtually no training to use. - In a further aspect illustrated in
FIGS. 9A and 9B , more than onemobile device 100 may be configured to interact with a projected user interface. In this aspect, a firstmobile device 100 a may project the user interface display onto an external surface. This projected user interface image may be displayed in 2-D or 3-D in theprojection frame 120. A secondmobile device 100 b may be equipped with a wireless data link that can communicate with a firstmobile device 100 a, such as a Bluetooth communication link. In this manner, users of the secondmobile device 100 b may implement user interface gestures, such as a rotation of the mobile device (as indicated by arrow 908), with the resulting user interface commands being passed to the firstmobile device 100 a so that it can reflect the changes in the projected user interface display. In the case of a 3-D projected image, users of both mobile devices may wear 3-D glasses FIG. 9A the secondmobile device 100 b is rotated to the right as shown byarrow 908. This user input is communicated to the firstmobile device 100 a, which causes the displayed 3-D list to scroll as illustrated inFIG. 9B . - A wide variety of user interactions they be enabled by multiple mobile devices equipped to communicate user interface gestures corresponding to the projected user interface of the various aspects. In one example, a user may drag a finger across the touchscreen of the second
mobile device 100 b, which communicates the position of the user touches on the touchscreen to the firstmobile device 100 a, which then projects a bright light within the projectedframe 120 in position corresponding to the touch location on the second mobile device. Such a bright light may function as a virtual laser pointer, enabling a user of the second mobile device to participate in a presentation projected by the first mobile device. A number of mobile devices may cooperate in such a system, with each device being associated with a different color virtual laser spot. Mobile devices not equipped with touchscreens may also cooperate in a similar manner by communicating user inputs received via button presses, such as presses of arrow keys, to control virtual laser pointers. - In another aspect, the second mobile device may be equipped with a camera (see
FIG. 17 ) which may take a digital photograph of the projected user interface image. Enabling imaging of the projected user interface by other mobile devices, may enable completely new forms of interactions among mobile devices and users. - When enabling users to employ hand gestures to interact with projected content, a
mobile device 100 may be configured to allow the users to navigate through the contents of the projected display and selection particular items, objects or files. Selection of items when using hand gestures to navigate through a projected user interface may be accomplished using variety of methods. For example, a two phase approach may be used when selecting items using hand gestures. In such a two phase approach, amobile device 100 may highlight an item, such as by scrolling into the foreground, and a user may select the highlighted item, such as performing another user gesture (e.g., pressing a button, tapping the touchscreen display, shaking the device, etc.). - In an aspect illustrated in
FIG. 10 , amobile device 100 may be configured to automatically highlight projected contents that appear in particular portions (e.g., the center) of the projected user interface image. For example, themobile device 100 may be configured to automatically highlight anyimage object 118 that is presented in the center of the projectedframe 120. Thus, themobile device 100 may be configured to highlight thecenter image object 118 as the user scrolls up or down through a column of projected image objects 118. To select the highlighted object, a user may perform a second command, tracing a touch gesture on thetouch screen display 103, pressing afunction button 1002 on themobile device 100, or performing a hand gesture on themobile device 100. For example, whenimage object 8 is highlighted projected user interface image, the user may tap thetouch screen display 103 to finalize or confirm the selection. - In a further aspect illustrated in
FIGS. 11A and 11B , amobile device 100 may be configured to highlight contents anywhere in a projected field 120 (as compared to the center of the projected field) based on a user's hand gesture and allow the user to select the highlighted content. In this aspect, amobile device 100 may automatically highlight projected content based on the movement of themobile device 100 with respect to the direction in which themobile device 100 is pointing. Once a projected item is highlighted, the user may select that item by performing a touch gesture, hand gesture or by pressing a function key. For example, amobile device 100 may project image objects 118 on an external surface within aprojection field 120. Based on the angle of themobile device 100, themobile device 100 may be configured to highlight a particular portion of the projected image content. As shown inFIG. 11A , amobile device 100 may project contents on an external surface within aprojection field 120. Themobile device 100 may highlightimage object 8 based on the direction in which themobile device 100 is pointing. As the direction in which themobile device 100 is pointing changes, themobile device 100 may change the highlighted content. As shown inFIG. 11B , if themobile device 100 is tilted to point upwards from its initial orientation shown inFIG. 11A , themobile device 100 may highlightimage object 7 which is positioned aboveimage object 8 in the displayed list. The first and second orientations of themobile device 100 are illustrated in thehighlight 1104. - In a further aspect, the
mobile device 100 may be configured to change function performed in response to various touch or hand gestures, such as from highlighting to navigating (e.g., scroll) or vice versa, based on the distance themobile device 100 travels during a hand motion. In an aspect, themobile device 100 may be configured to determine the distance themobile device 100 moves in one direction during a hand gesture based upon sensor data. As the user moves themobile device 100 in one direction, themobile device 100 may highlight different projected items within the projectedfield 120. The highlighting of different projected contents may continue until a predetermined distance is traveled by themobile device 100 during the hand gesture. Any movement of themobile device 100 beyond the predetermined distance may be interpreted by themobile device 100 as a navigation command, such as a command to implement scroll or zoom functions. This predetermined distance at which function changes are implemented may be based on the size of the projectedfield 120, user preferences, application developer settings, or other configurable parameters. For example, the larger the size of the projected field, the larger the predetermined distance themobile device 100 may travel before it switched operations from selecting to scrolling function. - In a further aspect illustrated in
FIG. 12 , amobile device 100 may be configured to enable a user to select projected content by using touch gestures. For example, amobile device 100 may be configured to project amouse arrow 1202 or other suitable pointer in response to the user's touch event on thetouch screen display 103. The user may move the arrow by moving a finger on the touch screen to select items by placing themouse arrow 1202 on the item and performing a second action, such as double tapping on thetouch screen display 103 or pressing afunction key 1002. - An
overview method 1300 illustrating the various aspects for interacting with a projected user interface is illustrated inFIG. 13 . Inmethod 1300 andblock 1302, a mobile device processor may generate a user interface image, and project it onto an external surface inblock 1304. The mobile device processor may be configured with software to detect a user input gesture (e.g., touch gesture or hand gesture) performed by the user inblock 1306, and interpret the gesture inblock 1308. Inblock 1310, the mobile device processor may change the user interface image based on the interpreted gesture, such as to implement any of the changes in displayed content described above. This changed user interface image is then projected inblock 1304 to provide a continuous visual feedback to the user. The mobile device processor may continue to project the user interface while detecting and interpreting user inputs, and changing the projected user interface image accordingly in a continual process. - Further details of an
aspect method 1400 for implementing a projected user interface (UI) to enable a user to select a projected image object using a touch gesture is illustrated inFIG. 14 . Inmethod 1400 inblock 1302, a mobile device processor may generate a user interface image, and project it onto an external surface inblock 1304. The mobile device processor may be configured with software to detect touch events on the device'stouch screen display 103 inblock 1402, and measure the touch event parameters inblock 1404. Touch event parameters may include the location, speed of movement, direction of movement and pressure of the touch event. Indetermination block 1406, the processor determine whether the detected touch event is associated with a touch gestures, such as by comparing the measured touch event parameters to predefined parameters associated with various touch gestures to determine if there is a match. If the processor determines that the touch event is a touch gesture (i.e.,determination block 1406=“Yes”), the mobile device processor may determine the functionality associated with the touch gesture inblock 1308, change the user interface based on the determined touch gesture functionality inblock 1310, and project the changed user interface image by returning to block 1304. - If the processor determines that the touch event is not a touch gesture (i.e.,
determination block 1406=“No”), the mobile device processor may process the touch event as a selection input and change the projected user interface image to include a selection icon, such as amouse arrow 1202, inblock 1410. Inblock 1412, the mobile device may project the changed the projected user interface image to allow the user to view the location and follow the movement of the selection icon as it is projected on the external surface. In some cases the selection functionality may enable a user to maneuver the selection icon about on the projected user interface image before selecting an object. So, indetermination block 1414 the processor may determine if the next user input indicates a user selection of an image object. For example, a user selection input may be in the form of a tap or double tap of the touch screen, a particular traced pattern, or a button press. If the processor determines that the latest incremental user input is not a user selection (i.e.,determination block 1414=“No”), such as may be the case while a user positions the selection icon on the desired object or a user lifts a finger from the touchscreen display without selecting an item, the processor may determine whether the user's finger is still touching the touchscreen display such that a touch event is still in process indetermination block 1415. If the user's finger has left the touchscreen and no selection has been made (i.e.,determination block 1415=“No”), the processor may return to block 1304 to project the user interface image without an indication of the user touch (e.g., without a selection icon). If the user's finger is still touching the touchscreen and no selection has been made (i.e.,determination block 1415=“Yes”), the processor may continue the process of changing and projecting the user interface image may continue by returning to block 1410. If the mobile device processor detects a user selection input (i.e.,determination block 1414=“Yes”), the processor may implement the selected functionality or select an object inblock 1416, and change the user interface image on the selection functionality inblock 1418. The mobile device processor may project the changed user interface by returning to block 1304. -
FIG. 15 illustrates of anembodiment method 1500 for a projected user interface enabling users to select items using hand gestures. Inblock 1302, amobile device 100 may generate a user interface image, and project it onto an external surface inblock 1304. Inblock 1502, the mobile device processor may process sensor inputs in order to recognize when a user implements a hand gesture. As discussed above, and gestures may be recognized based upon inputs received from accelerometers and/or compass sensors reflecting movements, rotation so tilting of the device. Particular hand gestures may be right highest by comparing received sensor inputs to predetermined patterns of sensor signals that correspond to particular input gestures. Indetermination block 1504, the processor may compare the received sensor signals to determine whether the signals are consistent with an intended user input gesture. For example, the received signals may be compared to threshold values to determine if a sensed amount of movement is sufficient to be interpreted as a move gesture. As another example, the pattern of the sensor signals may be compared to predefined patterns corresponding to particular user input gestures to determine if there is a match. If the processor determines that the received signals are not associated with a hand gesture (i.e.,determination block 1504=“No”), themobile device 100 may continue to process received sensor signals by returning to block 1502. - When a user input gesture is recognized (i.e.,
determination block 1504=“Yes”), the processor may determine the functionality associated with the recognized gesture (e.g., a scroll command), processor may determine whether the functionality associated with the recognized gesture involves a movement (e.g., a scroll command or movement of a pointer icon within the projected image) or a file selection gesture (e.g., a button press, a double tap on the touchscreen, etc.) indetermination block 1506. If the processor determines that the recognized gesture is associated with a movement function (i.e.,determination block 1506=“Move”), the processor may implement the determined functionality, and change the user interface image accordingly inblock 1508. Inblock 1510, the mobile device processor may determine the content that is located at the center of the projected frame (or some other portion of the projected frame) after the user interface image is changed. The mobile device processor may further change the user interface image to highlight the content that is located in the center inblock 1512, and project the user interface image by returning to block 1304. - If the processor determines that the recognized gesture is associated with a selection function (i.e.,
determination block 1506=“Selection”), the processor may identify the content highlighted in the projected user interface image inblock 1504. Inblock 1516, the processor may implement the selection functionality corresponding to the recognized user input gesture. For example, the selection functionality may be a simple selection of a file or object for a subsequent action, copying of the selected object or file for pasting in another location, deleting or cutting the selected object or file, or activation of a selected application, the name but a few of the possible selection functionality may be implemented in the various aspects. Inblock 1518, the processor may change the user interface image based upon the selection functionality, such as to highlight or delete a selected file logic or implement a new display image associated with it activated application. The mobile device processor may then project be changed user interface image by returning to block 1304. - As described above, in some aspects multiple mobile devices may interact with each other in order to enable collaborative interactions with the projected user interface. An
aspect method 1600 for enabling a secondmobile device 100 b to interact with a user-interface projected by a firstmobile device 100 a is illustrated inFIG. 16 . Inblock 1302, a processor of the firstmobile device 100 a may generate a user interface image, and project the user interface on an external surface inblock 1304. A processor in a secondmobile device 100 b may receive a user input requesting interaction with the projected user interface inblock 1602. Inblock 1606, the processor of the secondmobile device 100 b may establish a communication link with the firstmobile device 100 a that is projecting the user interface image by sending a request to communicate to the first mobile device processor. The firstmobile device 100 a may receive the request to communicate from the second mobile device processor inblock 1608, and negotiate a communication link with the second mobile device processor inblocks block 1614, the second mobile device processor may detect user inputs, such as touch events on a touchscreen, button presses (e.g., arrow keys), or movements of the mobile device as described above, and determine the parameters of the received user inputs inblock 1616. The second mobile device processor may use the received user input parameters (e.g., the speed and direction of a touch gesture, angle or acceleration of the device, etc.) to recognize the intended user gesture inblock 1620. Inblock 1620, the second mobile device processor may determine the appropriate change to be made to the projected user interface image in response to the recognized user input gesture, such as the highlighting of an object, movement of an icon, scrolling of a list, etc. The second mobile device processor may send a message to the first mobile device communicating the determined appropriate change to be made to the projected user interface image inblock 1622. The first mobile device processor may receive the message inblock 1624, use the received message to change the user interface image inblock 1626, and project the changed user interface image based by returning to block 1304. In this manner, the projected user interface image projected by the firstmobile device 100 a reflects the user input gestures performed on the secondmobile device 100 b. WhileFIG. 16 illustrates a process involving two mobile devices, any number of mobile devices may interact with the projectingmobile device 100 a by implementingmethod 1600 or variations thereof. - In a further aspect, the projector may be configured to project user interface displays in a manner that affords users privacy so that only the user can see the projected image. In this aspect, the projector within the mobile device may be configured to project an image that can only be viewed by a person wearing special glasses, which may be similar to or the same as 3-D glasses. For example, the projector could project the user interface display for brief instances interspersed between periods of all white or a dummy image projection, and wear glasses which are configured to block the white or dummy image and permit viewing only of the instances of the user interface image. In this example, a user would be able to see the projected user interface image, while those not wearing such glasses would only see the white or dummy image. The time-controlled viewing technology for such glasses may be borrowed from 3-D display technologies. In a further example, the same technology as used to create 3-D images using two projectors and 3-D glasses discussed above may be used to create a private projected user-interface display by projecting a white screen in one projector while the other projector is projecting the user interface display for one eye or the other. In this aspect, a user not wearing 3-D glasses synchronized with the user's mobile device will see a white screen or very washed out projected image.
- Typical
mobile devices 1700 suitable for use with the various embodiments will have in common the components illustrated inFIG. 17A . Amobile device 1700 may includecircuit board 1780 of electronic components, some or all of which may be integrated into an on-chip system, that includes acontrol processor 1701 coupled tomemory 1702. Thecontrol processor 1701 may further be coupled to adigital signal processor 1711 and/or ananalog signal processor 1721, which also be coupled together. In some embodiments, thecontrol processor 1701 and adigital signal processor 1711 may be the same component or may be integrated into the same processor chip. Adisplay controller 1733 and atouchscreen controller 1743 may be coupled to thecontrol processor 1701 and to display ortouchscreen display 1703 within or connected to themobile device 1700. - The
control processor 1701 may also be coupled to removable memory 1722 (e.g., an SD memory or SIM card in the case of mobile computing devices) and/or toexternal memory 1704, such as one or more of a disk drive, CD drive, and a DVD drive. Thecontrol processor 1701 may also be coupled to a Universal Serial Bus (USB)controller 1712 which couples to aUSB port 1714. Also, apower supply 1770 may be coupled to thecircuit board 1780 through theUSB controller 1712 or through different electrical connections to provide power (e.g., DC power) to the various electronic components. - The
control processor 1701 may also be coupled to avideo encoder 1734, e.g., a phase alternating line (PAL) encoder, a sequential couleur a memoire (SECAM) encoder, or a national television system(s) committee (NTSC) encoder. Further, thevideo encoder 1734 may be coupled to avideo amplifier 1736 which may be coupled to thevideo encoder 1734 and the display ortouchscreen display 1703. Also, avideo port 1738 may be coupled to thevideo amplifier 1736 to enable connecting themobile device 1700 to an external monitor, television or other display (not shown). - In some embodiments, particularly mobile computing devices, the
control processor 1701 may be coupled to a radio frequency (RF)transceiver 1705, such as via ananalog signal processor 1721. TheRF transceiver 1705 may be coupled to anRF antenna 1704 for transmitting and receiving RF signals. TheRF transceiver 1705 may be configured to transmit and receive communication signals of one or more different wireless communication protocols including, for example, cellular telephone (e.g., G-3, UMTS, CDMA, etc.), WiFi, WiMax, and BlueTooth. - The
control processor 1701 may further be coupled to anetwork card 1706 which may be coupled to anetwork connector 1716 and/or theRF transceiver 1705 and configured to enable communications via an external network (e.g., local area networks, the Internet, an intranet, WiFi networks, BlueTooth networks, personal area network (PAN) etc.) Thenetwork card 1706 may be in the form of a separate chip or card, or may be implemented as part of thecontrol processor 1701 or the RF transceiver 1705 (or both) as a full solution communication chip. - A number of analog devices may be coupled to the
control processor 1701 via theanalog signal processor 1721, such as akeypad 1708 as shown inFIG. 17 . In other implementations, a keypad or keyboard may include its own processor so that the interface with thecontrol processor 1701 may be via direct connection (not shown), via a network connection (e.g., via the network card), or via theUSB port 1714. - In some implementations, a
digital camera 1748 may be coupled to thecontrol processor 1701. In an exemplary aspect, thedigital camera 1748 may be a charge-coupled device (CCD) camera or a complementary metal-oxide semiconductor (CMOS) camera. Thedigital camera 1748 may be built into themobile device 1700 or coupled to the device by an external cable. - In some implementations, an audio CODEC 1750 (e.g., a stereo CODEC) may be coupled to the
analog signal processor 1721 and configured to send sound signals to one ormore speakers 1754 via anaudio amplifier 1752. Theaudio CODEC 1750 may also be coupled to amicrophone amplifier 1756 which may be coupled to a microphone 1758 (e.g., via a microphone jack). Aheadphone jack 1759 may also be coupled to theaudio CODEC 1750 for outputting audio to headphones. - In some implementations, the
mobile device 1700 may include a separateRF receiver circuit 1760 which may be coupled to anantenna 1762 for receiving broadcast wireless communication signals. Thereceiver circuit 1760 may be configured to receive broadcast television signals (e.g., FLO TV broadcasts), and provide received signals to theDSP 1711 for processing. In some implementations, thereceiver circuit 1760 may be configured to receive FM radio signals, in which case the received signals may be passed to theAudio CODEC 1750 for processing. - The
mobile device 1700 of the various aspects may also include aprojector 1726, such as a pico projector, that is coupled to thecontrol processor 1701, such as via thevideo amplifier 1736 andvideo encoder 1734. As discussed above, theprojector 1726 may be configured to project images generated by the processor. - The
mobile device 1700 may also include threeaccelerometers control processor 1701. Theaccelerometers control processor 1701 may be configured to determine the spatial orientation of the mobile device (e.g., tilt angle and rotational angle) with respect to the Earth based upon the signals from each of theaccelerometers accelerometers FIG. 17A ) or as a single accelerometer chip 1713 (as illustrated inFIG. 17B ). Themobile device 1700 may also include adigital compass 1724 coupled to thecontrol processor 1701 and configured to detect a pointing direction with respect to the Earth's magnetic field. - The various components described above may be implemented in a mobile device configuration such as illustrated in
FIG. 17B . - In an aspect, processor-executable instructions for accomplishing one or more of the method operations described above may be stored in the
internal memory 1702,removable memory 1722 and/or non-volatile memory 1704 (e.g., as on a hard drive, CD drive, or other storage accessible via a network). Such processor-executable instructions may be executed by thecontrol processor 1701 in order to perform the methods described herein. - While
FIG. 17B illustrates a mobile computing device, other forms of computing devices, including personal computers and laptop computers, will typically also include aprocessor 1701 coupled tointernal memory 1702, and aprojector 1726. Thus,FIG. 17B is not intended to limit the scope of the claims to a mobile computing device in the particular illustrated form factor. - The
processor 1701 may be any programmable microprocessor, microcomputer or multiple processor chip or chips that can be configured by software instructions (applications) to perform a variety of functions, including the functions of the various embodiments described herein. In some mobile devices,multiple processors 1701 may be provided, such as one processor dedicated to wireless communication functions and one processor dedicated to running other applications. Typically, software applications may be stored in theinternal memory 1702 before they are accessed and loaded into theprocessor 1701. In some mobile devices, theprocessor 1701 may include internal memory sufficient to store the application software instructions. In some mobile devices, the secure memory may be in a separate memory chip coupled to theprocessor 1701. In manymobile devices 1700 theinternal memory 1702 may be a volatile or nonvolatile memory, such as flash memory, or a mixture of both. For the purposes of this description, a general reference to memory refers to all memory accessible by theprocessor 1701, includinginternal memory 1702, removable memory plugged into the mobile device, and memory within theprocessor 1701 itself. - The
processor 1701 may be any programmable microprocessor, microcomputer or multiple processor chip or chips that can be configured by software instructions (applications) to perform a variety of functions, including the functions of the various aspects described herein. In some mobile devices,multiple processors 1701 may be provided, such as one processor dedicated to wireless communication functions and one processor dedicated to running other applications. Typically, software applications may be stored in theinternal memory 1702 before they are accessed and loaded into theprocessor 1701. In some mobile devices, theprocessor 1701 may include internal memory sufficient to store the application software instructions. In some mobile devices, additional memory chips (e.g., a Secure Data (SD) card) may be plugged into thedevice 1700 and coupled to theprocessor 1701. In many mobile devices, theinternal memory 1702 may be a volatile or nonvolatile memory, such as flash memory, or a mixture of both. For the purposes of this description, a general reference to memory refers to all memory accessible by theprocessor 1701, includinginternal memory 1702, removable memory plugged into the mobile device, and memory within theprocessor 1701 itself, including the secure memory (not shown). - Various aspects may employ steerable optics to maintain the projected display on external surface generally stable while the mobile device is turned or tilted to accomplish hand gestures.
FIG. 18 illustrates an example of asteerable protection system 1800. Such asteerable projection system 1800 may include a focusing/redirectinglens 1802 positioned within alens frame 1804 that is coupled toactuators actuators FIG. 17 ). The focusing/redirectinglens 1802 may be positioned in front of apico projector 1810 so that projected light passes through the focusing/redirectinglens 1802. Theactuators processor 1701. By extending one actuator (e.g., actuator 1806) while retracting an opposite actuator (e.g., actuator 1808), the actuators may tilt thelens 1802 in such a manner to steer the projected image embedded by thepico projector 1810. In an implementation, as the mobile device processor recognizes movement of the device based on the information received from accelerometers and/or compass sensors, the processor may transmit control signals to theactuators actuators steerable projection system 1800 illustrated inFIG. 18 is merely one example of an image steering mechanism that may be used to steer the projected image, and other mechanisms may be implemented within the scope of the claims. - The foregoing method descriptions and the process flow diagrams are provided merely as illustrative examples and are not intended to require or imply that the steps of the various aspects must be performed in the order presented. As will be appreciated by one of skill in the art the order of steps in the foregoing aspects may be performed in any order. Words such as “thereafter,” “then,” “next,” etc. are not intended to limit the order of the steps; these words are simply used to guide the reader through the description of the methods. Further, any reference to claim elements in the singular, for example, using the articles “a,” “an” or “the” is not to be construed as limiting the element to the singular.
- The various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the aspects disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components in blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
- The hardware used to implement the various illustrative logics, logical blocks, modules, and circuits described in connection with the aspects disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but, in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
- In one or more exemplary aspects, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. The steps of a method or algorithm disclosed herein may be embodied in a processor-executable software module executed which may reside on a tangible or non-transitory computer-readable storage medium. Computer-readable storage media may be any available media that may be accessed by a computer. By way of example, and not limitation, such computer-readable media may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that may be used to carry or store desired program code in the form of instructions or data structures and that may be accessed by a computer. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above also can be included within the scope of computer-readable media. Additionally, the operations of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a machine readable medium and/or computer-readable medium, which may be incorporated into a computer program product.
- The preceding description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the following claims and the principles and novel features disclosed herein.
Claims (52)
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/837,895 US9134799B2 (en) | 2010-07-16 | 2010-07-16 | Interacting with a projected user interface using orientation sensors |
PCT/US2011/034106 WO2012009039A1 (en) | 2010-07-16 | 2011-04-27 | Methods and systems for interacting with projected user interface |
BR112013001019A BR112013001019A2 (en) | 2010-07-16 | 2011-04-27 | methods and systems for designing user interface interaction |
KR1020157000139A KR20150013934A (en) | 2010-07-16 | 2011-04-27 | Methods and systems for interacting with projected user interface |
CN201180034164.0A CN102985896B (en) | 2010-07-16 | 2011-04-27 | For the method and system mutual with project user interface |
EP11723781.8A EP2593848B1 (en) | 2010-07-16 | 2011-04-27 | Methods and systems for interacting with projected user interface |
KR1020137003937A KR101601657B1 (en) | 2010-07-16 | 2011-04-27 | Methods and systems for interacting with projected user interface |
JP2013519680A JP5689963B2 (en) | 2010-07-16 | 2011-04-27 | Method and system for interacting with a projected user interface |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/837,895 US9134799B2 (en) | 2010-07-16 | 2010-07-16 | Interacting with a projected user interface using orientation sensors |
Publications (2)
Publication Number | Publication Date |
---|---|
US20120017147A1 true US20120017147A1 (en) | 2012-01-19 |
US9134799B2 US9134799B2 (en) | 2015-09-15 |
Family
ID=44626707
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/837,895 Expired - Fee Related US9134799B2 (en) | 2010-07-16 | 2010-07-16 | Interacting with a projected user interface using orientation sensors |
Country Status (7)
Country | Link |
---|---|
US (1) | US9134799B2 (en) |
EP (1) | EP2593848B1 (en) |
JP (1) | JP5689963B2 (en) |
KR (2) | KR20150013934A (en) |
CN (1) | CN102985896B (en) |
BR (1) | BR112013001019A2 (en) |
WO (1) | WO2012009039A1 (en) |
Cited By (236)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090325607A1 (en) * | 2008-05-28 | 2009-12-31 | Conway David P | Motion-controlled views on mobile computing devices |
US20100045667A1 (en) * | 2008-08-22 | 2010-02-25 | Google Inc. | Navigation In a Three Dimensional Environment Using An Orientation Of A Mobile Device |
US20100188426A1 (en) * | 2009-01-27 | 2010-07-29 | Kenta Ohmori | Display apparatus, display control method, and display control program |
US20120026088A1 (en) * | 2010-08-01 | 2012-02-02 | T-Mobile Usa, Inc. | Handheld device with projected user interface and interactive image |
US20120075348A1 (en) * | 2010-09-24 | 2012-03-29 | Shunichi Kasahara | Information Processing Apparatus, Information Processing Terminal, Information Processing Method and Computer Program |
US20120075182A1 (en) * | 2010-08-24 | 2012-03-29 | Lg Electronics Inc. | Mobile terminal and displaying method thereof |
US20120098754A1 (en) * | 2009-10-23 | 2012-04-26 | Jong Hwan Kim | Mobile terminal having an image projector module and controlling method therein |
US20120127184A1 (en) * | 2010-11-19 | 2012-05-24 | Ricoh Company, Ltd. | Image projection apparatus, memory control apparatus, laser projector, and memory access method |
US20120133754A1 (en) * | 2010-11-26 | 2012-05-31 | Dongguk University Industry-Academic Cooperation Foundation | Gaze tracking system and method for controlling internet protocol tv at a distance |
US20120165074A1 (en) * | 2010-12-23 | 2012-06-28 | Microsoft Corporation | Effects of gravity on gestures |
US20120166993A1 (en) * | 2010-12-24 | 2012-06-28 | Anderson Glen J | Projection interface techniques |
US20120244803A1 (en) * | 2010-09-22 | 2012-09-27 | Tomohiro Sudou | Communication system, communication device, and communication method |
USD668261S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
USD668260S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
US20120249570A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC. | Highlighting in response to determining device transfer |
US20120249285A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC, a limited liability company of the State of Delaware | Highlighting in response to determining device transfer |
US8316319B1 (en) * | 2011-05-16 | 2012-11-20 | Google Inc. | Efficient selection of characters and commands based on movement-inputs at a user-inerface |
US20130086531A1 (en) * | 2011-09-29 | 2013-04-04 | Kabushiki Kaisha Toshiba | Command issuing device, method and computer program product |
US20130103446A1 (en) * | 2011-10-20 | 2013-04-25 | Microsoft Corporation | Information sharing democratization for co-located group meetings |
US20130120240A1 (en) * | 2011-11-10 | 2013-05-16 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling image display depending on movement of terminal |
US20130132895A1 (en) * | 2011-11-17 | 2013-05-23 | Prezi, Inc. | Grouping with frames to transform display elements within a zooming user interface |
US20130159928A1 (en) * | 2011-12-20 | 2013-06-20 | Wikipad, Inc. | Virtual multiple sided virtual rotatable user interface icon queue |
US20130176258A1 (en) * | 2010-09-02 | 2013-07-11 | Elliptic Laboratories As | Motion feedback |
US20130176346A1 (en) * | 2012-01-11 | 2013-07-11 | Fih (Hong Kong) Limited | Electronic device and method for controlling display on the electronic device |
US20130191776A1 (en) * | 2012-01-20 | 2013-07-25 | The Other Media Limited | Method of activating activatable content on an electronic device display |
US8532675B1 (en) | 2012-06-27 | 2013-09-10 | Blackberry Limited | Mobile communication device user interface for manipulation of data items in a physical space |
US20130246955A1 (en) * | 2012-03-14 | 2013-09-19 | Sony Network Entertainment International Llc | Visual feedback for highlight-driven gesture user interfaces |
US20130249811A1 (en) * | 2012-03-23 | 2013-09-26 | Microsoft Corporation | Controlling a device with visible light |
CN103366659A (en) * | 2012-03-26 | 2013-10-23 | 联想(北京)有限公司 | Display control method and related device |
US20130321268A1 (en) * | 2012-06-01 | 2013-12-05 | Microsoft Corporation | Control of remote applications using companion device |
US8613075B2 (en) | 2011-03-30 | 2013-12-17 | Elwha Llc | Selective item access provision in response to active item ascertainment upon device transfer |
US20130335640A1 (en) * | 2012-06-18 | 2013-12-19 | Ayako Watanabe | Information processing apparatus and conference system |
US8631357B2 (en) * | 2011-10-31 | 2014-01-14 | Apple Inc. | Dual function scroll wheel input |
US20140035851A1 (en) * | 2012-07-31 | 2014-02-06 | Samsung Electronics Co., Ltd. | Method for controlling user input and electronic device thereof |
CN103677628A (en) * | 2012-09-25 | 2014-03-26 | 三星电子株式会社 | Image processing apparatus and control method thereof |
US20140089850A1 (en) * | 2012-09-22 | 2014-03-27 | Tourwrist, Inc. | Systems and Methods of Using Motion Control to Navigate Panoramas and Virtual Tours |
US8713670B2 (en) | 2011-03-30 | 2014-04-29 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US20140118260A1 (en) * | 2011-06-20 | 2014-05-01 | Zte Corporation | Mobile terminal and method for moving cursor thereof |
US20140125590A1 (en) * | 2012-11-08 | 2014-05-08 | PlayVision Labs, Inc. | Systems and methods for alternative control of touch-based devices |
US8726366B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US20140137034A1 (en) * | 2011-06-01 | 2014-05-15 | Microsoft Corporation | Asynchronous handling of a user interface manipulation |
US8739275B2 (en) | 2011-03-30 | 2014-05-27 | Elwha Llc | Marking one or more items in response to determining device transfer |
US20140160076A1 (en) * | 2012-12-10 | 2014-06-12 | Seiko Epson Corporation | Display device, and method of controlling display device |
WO2014094820A1 (en) | 2012-12-17 | 2014-06-26 | Telecom Italia S.P.A. | Selection system for an interactive display |
CN103909864A (en) * | 2013-01-08 | 2014-07-09 | 沃尔沃汽车公司 | Vehicle display arrangement and vehicle comprising a vehicle display arrangement |
WO2014107182A1 (en) * | 2013-01-04 | 2014-07-10 | Intel Corporation | Multi-distance, multi-modal natural user interaction with computing devices |
US20140203999A1 (en) * | 2013-01-21 | 2014-07-24 | Samsung Electronics Co., Ltd. | Method and apparatus for arranging a plurality of icons on a screen |
US20140215390A1 (en) * | 2013-01-30 | 2014-07-31 | Rightware Oy | Method of and system for displaying a list of items on an electronic device |
US20140214597A1 (en) * | 2013-01-30 | 2014-07-31 | Wal-Mart Stores, Inc. | Method And System For Managing An Electronic Shopping List With Gestures |
US20140218326A1 (en) * | 2011-11-08 | 2014-08-07 | Sony Corporation | Transmitting device, display control device, content transmitting method, recording medium, and program |
US20140217874A1 (en) * | 2013-02-04 | 2014-08-07 | Hon Hai Precision Industry Co., Ltd. | Touch-sensitive device and control method thereof |
US8839411B2 (en) | 2011-03-30 | 2014-09-16 | Elwha Llc | Providing particular level of access to one or more items in response to determining primary control of a computing device |
US20140280003A1 (en) * | 2013-03-15 | 2014-09-18 | Imaginestics, Llc | Method of Gesture-Based Definition of an Object within an Image |
US20140298218A1 (en) * | 2013-03-28 | 2014-10-02 | Zoltán Gera | Automatic application of templates to content |
WO2014159577A1 (en) * | 2013-03-14 | 2014-10-02 | Ekso Bionics, Inc. | Machine to human interfaces for communication from a lower extremity orthotic |
US8863275B2 (en) | 2011-03-30 | 2014-10-14 | Elwha Llc | Access restriction in response to determining device transfer |
US20140313189A1 (en) * | 2013-04-19 | 2014-10-23 | Thales | Hybrid display system displaying information by superimposition on the exterior |
US20140337778A1 (en) * | 2013-05-09 | 2014-11-13 | Sap Ag | Navigation Framework for Visual Analytic Displays |
US20140342660A1 (en) * | 2013-05-20 | 2014-11-20 | Scott Fullam | Media devices for audio and video projection of media presentations |
US20140372911A1 (en) * | 2012-03-09 | 2014-12-18 | Tencent Technology (Shenzhen) Company Limited | Interactive interface display control method, instant communication tool and computer storage medium |
US8918861B2 (en) | 2011-03-30 | 2014-12-23 | Elwha Llc | Marking one or more items in response to determining device transfer |
US20140380250A1 (en) * | 2012-09-27 | 2014-12-25 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method and program |
US20150029223A1 (en) * | 2012-05-08 | 2015-01-29 | Sony Corporation | Image processing apparatus, projection control method, and program |
US20150046877A1 (en) * | 2013-08-07 | 2015-02-12 | The Coca-Cola Company | Dynamically Adjusting Ratios of Beverages in a Mixed Beverage |
US20150082238A1 (en) * | 2013-09-18 | 2015-03-19 | Jianzhong Meng | System and method to display and interact with a curve items list |
US20150082257A1 (en) * | 2013-09-17 | 2015-03-19 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US20150089453A1 (en) * | 2013-09-25 | 2015-03-26 | Aquifi, Inc. | Systems and Methods for Interacting with a Projected User Interface |
US20150127505A1 (en) * | 2013-10-11 | 2015-05-07 | Capital One Financial Corporation | System and method for generating and transforming data presentation |
US20150128095A1 (en) * | 2013-11-07 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Method, device and computer system for performing operations on objects in an object list |
CN104637393A (en) * | 2015-02-13 | 2015-05-20 | 广西科技大学鹿山学院 | Intelligent human-machine tellurion |
US20150156545A1 (en) * | 2012-01-04 | 2015-06-04 | Thomson Licensing | Method and system for providing media recommendations |
USD731531S1 (en) * | 2013-01-04 | 2015-06-09 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US20150160907A1 (en) * | 2013-12-11 | 2015-06-11 | Lenovo (Beijing) Co., Ltd. | Information processing method and electronic device |
US20150188776A1 (en) * | 2013-12-27 | 2015-07-02 | Kt Corporation | Synchronizing user interface across multiple devices |
USD733723S1 (en) * | 2012-02-24 | 2015-07-07 | Htc Corporation | Portion of a display screen with graphical user interface |
US20150208019A1 (en) * | 2014-01-20 | 2015-07-23 | Lenovo (Singapore) Pte. Ltd. | Image correction |
US9092136B1 (en) * | 2011-06-08 | 2015-07-28 | Rockwell Collins, Inc. | Projected button display system |
USD738894S1 (en) * | 2012-08-29 | 2015-09-15 | Samsung Electronics Co., Ltd. | Portable electronic device with a graphical user interface |
US20150278992A1 (en) * | 2014-03-28 | 2015-10-01 | Gerard Dirk Smits | Smart head-mounted projection system |
US20150278172A1 (en) * | 2014-03-31 | 2015-10-01 | NIIT Technologies Ltd | Simplifying identification of potential non-visibility of user interface components when responsive web pages are rendered by disparate devices |
US9153194B2 (en) | 2011-03-30 | 2015-10-06 | Elwha Llc | Presentation format selection based at least on device transfer determination |
US9158959B2 (en) | 2013-07-17 | 2015-10-13 | Motorola Solutions, Inc. | Palm identification and in-place personalized interactive display |
USD744515S1 (en) * | 2012-09-13 | 2015-12-01 | Sony Computer Entertainment Inc. | Display screen or portion thereof with animated graphical user interface for a portable information terminal |
US20150348324A1 (en) * | 2014-06-03 | 2015-12-03 | Robert L. Vaughn | Projecting a virtual image at a physical surface |
USD745031S1 (en) * | 2012-03-07 | 2015-12-08 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US20160004393A1 (en) * | 2014-07-01 | 2016-01-07 | Google Inc. | Wearable device user interface control |
CN105278688A (en) * | 2015-10-15 | 2016-01-27 | 联想(北京)有限公司 | Projection equipment and electronic equipment |
USD749622S1 (en) * | 2013-06-10 | 2016-02-16 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
US20160054807A1 (en) * | 2012-11-08 | 2016-02-25 | PlayVision Labs, Inc. | Systems and methods for extensions to alternative control of touch-based devices |
US20160054808A1 (en) * | 2013-09-04 | 2016-02-25 | Sk Telecom Co., Ltd. | Method and device for executing command on basis of context awareness |
US9294869B2 (en) | 2013-03-13 | 2016-03-22 | Aliphcom | Methods, systems and apparatus to affect RF transmission from a non-linked wireless client |
US9294539B2 (en) | 2013-03-14 | 2016-03-22 | Microsoft Technology Licensing, Llc | Cooperative federation of digital devices via proxemics and device micro-mobility |
US20160085403A1 (en) * | 2013-05-15 | 2016-03-24 | Sony Corporation | Display control device, display control method, and recording medium |
US20160088060A1 (en) * | 2014-09-24 | 2016-03-24 | Microsoft Technology Licensing, Llc | Gesture navigation for secondary user interface |
US9317111B2 (en) | 2011-03-30 | 2016-04-19 | Elwha, Llc | Providing greater access to one or more items in response to verifying device transfer |
US9319149B2 (en) | 2013-03-13 | 2016-04-19 | Aliphcom | Proximity-based control of media devices for media presentations |
USD754719S1 (en) * | 2013-11-15 | 2016-04-26 | Tencent Technology (Shenzhen) Company Limited | Display screen portion with animated graphical user interface |
US20160116983A1 (en) * | 2014-10-23 | 2016-04-28 | Samsung Electronics Co., Ltd. | User input method for use in portable device using virtual input area |
US9377533B2 (en) | 2014-08-11 | 2016-06-28 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US20160188205A1 (en) * | 2013-03-14 | 2016-06-30 | Sanjay K. Rao | Mobile IO Input and Output for Smartphones, Tablet, and Wireless Devices including Touch Screen, Voice, Pen, and Gestures |
US20160188195A1 (en) * | 2014-12-30 | 2016-06-30 | Innova Electronics, Inc. | Cellphone with projection capability |
US9381427B2 (en) | 2012-06-01 | 2016-07-05 | Microsoft Technology Licensing, Llc | Generic companion-messaging between media platforms |
USD761836S1 (en) * | 2015-01-08 | 2016-07-19 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with transitional graphical user interface |
USD765699S1 (en) | 2015-06-06 | 2016-09-06 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD768152S1 (en) * | 2013-09-20 | 2016-10-04 | ACCO Brands Corporation | Display screen including a graphical user interface |
EP3086217A1 (en) * | 2015-04-21 | 2016-10-26 | Samsung Electronics Co., Ltd. | Electronic device for displaying screen and control method thereof |
US20160320806A1 (en) * | 2012-06-12 | 2016-11-03 | Apple Inc. | Electronic Device with Wrapped Display |
USD771088S1 (en) * | 2014-01-06 | 2016-11-08 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9501171B1 (en) | 2012-10-15 | 2016-11-22 | Famous Industries, Inc. | Gesture fingerprinting |
US9501176B1 (en) | 2012-10-08 | 2016-11-22 | Gerard Dirk Smits | Method, apparatus, and manufacture for document writing and annotation with virtual ink |
USD775147S1 (en) * | 2013-06-09 | 2016-12-27 | Apple Inc. | Display screen or portion thereof with graphical user interface |
EP3001406A4 (en) * | 2013-05-21 | 2017-01-25 | Sony Corporation | Display control device, display control method, and recording medium |
EP3001407A4 (en) * | 2013-05-21 | 2017-01-25 | Sony Corporation | Display control device, display control method, and recording medium |
US9581883B2 (en) | 2007-10-10 | 2017-02-28 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US20170060393A1 (en) * | 2000-01-05 | 2017-03-02 | Apple Inc. | Time-based, non-constant translation of user interface objects between states |
US20170069255A1 (en) * | 2015-09-08 | 2017-03-09 | Microvision, Inc. | Virtual Touch Overlay On Touchscreen for Control of Secondary Display |
US9606710B1 (en) | 2014-03-31 | 2017-03-28 | Amazon Technologies, Inc. | Configuring movement-based user interface control |
US9632588B1 (en) * | 2011-04-02 | 2017-04-25 | Open Invention Network, Llc | System and method for redirecting content based on gestures |
US20170113441A1 (en) * | 2014-04-07 | 2017-04-27 | Sekisui Chemical Co., Ltd. | Intermediate film for laminated glass, and laminated glass |
WO2017087872A1 (en) * | 2015-11-20 | 2017-05-26 | Harman International Industries, Incorporated | Dynamic reconfigurable display knobs |
USD788795S1 (en) * | 2013-09-03 | 2017-06-06 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with animated graphical user interface |
US9678640B2 (en) | 2014-09-24 | 2017-06-13 | Microsoft Technology Licensing, Llc | View management architecture |
US20170185421A1 (en) * | 2015-12-28 | 2017-06-29 | Ssh Communications Security Oyj | User interfaces in a computer system |
EP3051345A4 (en) * | 2013-09-27 | 2017-08-09 | Hitachi Maxell, Ltd. | Video projection device |
US20170249015A1 (en) * | 2014-09-30 | 2017-08-31 | Hewlett-Packard Development Company, L.P. | Gesture based manipulation of three-dimensional images |
US9753126B2 (en) | 2015-12-18 | 2017-09-05 | Gerard Dirk Smits | Real time position sensing of objects |
US9769227B2 (en) | 2014-09-24 | 2017-09-19 | Microsoft Technology Licensing, Llc | Presentation of computing environment on multiple devices |
US9772889B2 (en) | 2012-10-15 | 2017-09-26 | Famous Industries, Inc. | Expedited processing and handling of events |
US9813673B2 (en) | 2016-01-20 | 2017-11-07 | Gerard Dirk Smits | Holographic video capture and telepresence system |
USD804521S1 (en) * | 2016-08-12 | 2017-12-05 | Facebook, Inc. | Display panel with a graphical user interface for a programmed computer system |
US9836117B2 (en) | 2015-05-28 | 2017-12-05 | Microsoft Technology Licensing, Llc | Autonomous drones for tactile feedback in immersive virtual reality |
US9846529B2 (en) | 2014-02-24 | 2017-12-19 | Lenovo (Beijing) Co., Ltd. | Method for processing information and electronic device |
US9860306B2 (en) | 2014-09-24 | 2018-01-02 | Microsoft Technology Licensing, Llc | Component-specific application presentation histories |
USD806741S1 (en) * | 2016-07-26 | 2018-01-02 | Google Llc | Display screen with animated graphical user interface |
US20180024597A1 (en) * | 2014-12-15 | 2018-01-25 | Thomson Licensing | Method and apparatus for remotely controlling an electronic device |
US9898864B2 (en) | 2015-05-28 | 2018-02-20 | Microsoft Technology Licensing, Llc | Shared tactile interaction and user safety in shared space multi-person immersive virtual reality |
US9911232B2 (en) | 2015-02-27 | 2018-03-06 | Microsoft Technology Licensing, Llc | Molding and anchoring physically constrained virtual environments to real-world environments |
USD815130S1 (en) * | 2016-10-28 | 2018-04-10 | Spotify Ab | Display screen or portion thereof with graphical user interface |
US9946076B2 (en) | 2010-10-04 | 2018-04-17 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
USD816701S1 (en) * | 2016-12-14 | 2018-05-01 | Mercury Studio LLC | Display screen with animated graphical user interface |
US20180122130A1 (en) * | 2016-10-28 | 2018-05-03 | Samsung Electronics Co., Ltd. | Image display apparatus, mobile device, and methods of operating the same |
US9965034B2 (en) | 2013-12-30 | 2018-05-08 | Immersion Corporation | Systems and methods for a haptically-enabled projected user interface |
US9972066B1 (en) * | 2016-03-16 | 2018-05-15 | Gopro, Inc. | Systems and methods for providing variable image projection for spherical visual content |
US10025684B2 (en) | 2014-09-24 | 2018-07-17 | Microsoft Technology Licensing, Llc | Lending target device resources to host device computing environment |
USD823337S1 (en) * | 2016-07-29 | 2018-07-17 | Ebay Inc. | Display screen or a portion thereof with animated graphical user interface |
USD823889S1 (en) * | 2016-07-29 | 2018-07-24 | Ebay Inc. | Display screen or a portion thereof with animated graphical user interface |
US10043282B2 (en) | 2015-04-13 | 2018-08-07 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
USD825594S1 (en) * | 2016-12-23 | 2018-08-14 | Beijing Bytedance Network Technology Co., Ltd. | Mobile terminal display screen with a graphical user interface |
US10067230B2 (en) | 2016-10-31 | 2018-09-04 | Gerard Dirk Smits | Fast scanning LIDAR with dynamic voxel probing |
US20180255290A1 (en) * | 2015-09-22 | 2018-09-06 | Fyusion, Inc. | System and method for generating combined embedded multi-view interactive digital media representations |
USD829743S1 (en) * | 2016-10-28 | 2018-10-02 | Spotify Ab | Display screen or portion thereof with transitional graphical user interface |
US20180349837A1 (en) * | 2017-05-19 | 2018-12-06 | Hcl Technologies Limited | System and method for inventory management within a warehouse |
USD835651S1 (en) * | 2016-12-28 | 2018-12-11 | Google Llc | Computer display screen or portion thereof with animated graphical user interface |
USD836648S1 (en) * | 2014-09-03 | 2018-12-25 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
US20190005146A1 (en) * | 2012-10-15 | 2019-01-03 | Famous Industries, Inc. | Manipulating Virtual Camera Dolly in Multi-Dimensional Space to Produce Visual Effect |
USD839302S1 (en) * | 2017-08-28 | 2019-01-29 | Adp, Llc | Display screen with animated graphical user interface |
US10209770B2 (en) * | 2012-11-09 | 2019-02-19 | Sony Corporation | Information processing apparatus and information processing method |
US10261183B2 (en) | 2016-12-27 | 2019-04-16 | Gerard Dirk Smits | Systems and methods for machine perception |
US10275532B2 (en) | 2013-01-24 | 2019-04-30 | Interdigital Ce Patent Holdings | Method and system for content discovery |
USD848458S1 (en) * | 2015-08-03 | 2019-05-14 | Google Llc | Display screen with animated graphical user interface |
USD849027S1 (en) * | 2015-08-03 | 2019-05-21 | Google Llc | Display screen with animated graphical user interface |
USD851663S1 (en) * | 2013-04-05 | 2019-06-18 | Thales Avionics, Inc. | Display screen or portion thereof with graphical user interface |
US10372289B2 (en) | 2015-12-31 | 2019-08-06 | Beijing Pico Technology Co., Ltd. | Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method |
US10379220B1 (en) | 2018-01-29 | 2019-08-13 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US10437447B1 (en) * | 2014-03-31 | 2019-10-08 | Amazon Technologies, Inc. | Magnet based physical model user interface control |
US10445934B1 (en) * | 2011-08-29 | 2019-10-15 | Amazon Technologies, Inc. | Augmented reality environment with environmental condition control |
US10448111B2 (en) | 2014-09-24 | 2019-10-15 | Microsoft Technology Licensing, Llc | Content projection |
USD864236S1 (en) | 2013-06-10 | 2019-10-22 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD864991S1 (en) * | 2017-03-27 | 2019-10-29 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with transitional graphical user interface |
US10473921B2 (en) | 2017-05-10 | 2019-11-12 | Gerard Dirk Smits | Scan mirror systems and methods |
USD866573S1 (en) * | 2017-05-03 | 2019-11-12 | Google Llc | Display screen or portion thereof with graphical user interface |
US20190361500A1 (en) * | 2018-05-24 | 2019-11-28 | Fu Tai Hua Industry (Shenzhen) Co., Ltd. | Electronic device and method for controlling user interface therein |
USD868804S1 (en) * | 2017-01-20 | 2019-12-03 | Twitter, Inc. | Display screen with a transitional graphical user interface |
US20190369555A1 (en) * | 2018-06-04 | 2019-12-05 | International Business Machines Corporation | Holographic user interface for mobile menu item selection |
USD872098S1 (en) | 2013-12-18 | 2020-01-07 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US10534502B1 (en) | 2015-02-18 | 2020-01-14 | David Graham Boyers | Methods and graphical user interfaces for positioning the cursor and selecting text on computing devices with touch-sensitive displays |
USD877175S1 (en) | 2018-06-04 | 2020-03-03 | Apple Inc. | Electronic device with graphical user interface |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10592010B1 (en) * | 2017-06-28 | 2020-03-17 | Apple Inc. | Electronic device system with input tracking and visual output |
US10635296B2 (en) | 2014-09-24 | 2020-04-28 | Microsoft Technology Licensing, Llc | Partitioned application presentation across devices |
USD882621S1 (en) | 2014-05-30 | 2020-04-28 | Apple Inc. | Display screen or portion thereof with graphical user interface |
EP2991323B1 (en) * | 2014-09-01 | 2020-04-29 | Samsung Electronics Co., Ltd. | Mobile device and method of projecting image by using the mobile device |
USD884721S1 (en) * | 2016-07-01 | 2020-05-19 | Visa International Service Association | Display screen or portion thereof with animated graphical user interface |
USD888733S1 (en) | 2015-08-03 | 2020-06-30 | Google Llc | Display screen with animated graphical user interface |
US10719224B1 (en) * | 2013-04-29 | 2020-07-21 | David Graham Boyers | Methods and graphical user interfaces for pointing and editing on computing devices with touch-sensitive displays |
USD891453S1 (en) * | 2018-09-07 | 2020-07-28 | 7hugs Labs SAS | Display screen with transitional graphical user interface |
US10754534B1 (en) * | 2018-02-13 | 2020-08-25 | Whatsapp Inc. | Vertical scrolling of album images |
USD900833S1 (en) | 2017-09-11 | 2020-11-03 | Apple Inc. | Electronic device with animated graphical user interface |
US10877780B2 (en) | 2012-10-15 | 2020-12-29 | Famous Industries, Inc. | Visibility detection using gesture fingerprinting |
US10895979B1 (en) | 2018-02-16 | 2021-01-19 | David Graham Boyers | Methods and user interfaces for positioning a selection, selecting, and editing, on a computing device running under a touch-based operating system, using gestures on a touchpad device |
US10908929B2 (en) | 2012-10-15 | 2021-02-02 | Famous Industries, Inc. | Human versus bot detection using gesture fingerprinting |
USD913306S1 (en) * | 2019-02-28 | 2021-03-16 | Amazon Technologies, Inc. | Display screen or portion thereof having a graphical user interface |
USD914050S1 (en) | 2017-06-04 | 2021-03-23 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD916815S1 (en) * | 2016-01-12 | 2021-04-20 | Google Llc | Display screen with graphical user interface for presenting user activity timeline in a colloquial style |
USD916814S1 (en) * | 2017-12-28 | 2021-04-20 | Facebook, Inc. | Display panel of a programmed computer system with a graphical user interface |
USD917518S1 (en) * | 2016-07-21 | 2021-04-27 | Visa International Service Association | Display screen or portion thereof with animated graphical user interface |
USD918938S1 (en) * | 2019-10-04 | 2021-05-11 | Google Llc | Display screen with animated graphical user interface |
US11016643B2 (en) | 2019-04-15 | 2021-05-25 | Apple Inc. | Movement of user interface object with user-specified content |
USD920989S1 (en) | 2012-01-11 | 2021-06-01 | Sony Corporation | Display panel or screen with transitional graphical user interface |
USD921661S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD921659S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD921660S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD924905S1 (en) * | 2018-04-13 | 2021-07-13 | Google Llc | Display screen with animated graphical user interface |
USD925587S1 (en) * | 2019-02-08 | 2021-07-20 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
WO2021163020A1 (en) * | 2020-02-10 | 2021-08-19 | Synaptics Incorporated | Non-contact gesture commands for touch screens |
US11150746B2 (en) * | 2018-06-28 | 2021-10-19 | Google Llc | Wearable electronic devices having user interface mirroring based on device position |
USD933699S1 (en) * | 2019-02-08 | 2021-10-19 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
US11195314B2 (en) | 2015-07-15 | 2021-12-07 | Fyusion, Inc. | Artificially rendering images using viewpoint interpolation and extrapolation |
US11202017B2 (en) | 2016-10-06 | 2021-12-14 | Fyusion, Inc. | Live style transfer on a mobile device |
USD938455S1 (en) * | 2018-05-10 | 2021-12-14 | Express Scripts Strategic Development, Inc. | Display screen with graphical user interface |
US20220082661A1 (en) * | 2019-05-31 | 2022-03-17 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Controlling method for electronic device, and electronic device |
US11288733B2 (en) * | 2018-11-14 | 2022-03-29 | Mastercard International Incorporated | Interactive 3D image projection systems and methods |
CN114422762A (en) * | 2021-12-25 | 2022-04-29 | 深圳市幕工坊科技有限公司 | Projection screen action control system |
US11320983B1 (en) * | 2018-04-25 | 2022-05-03 | David Graham Boyers | Methods and graphical user interfaces for positioning a selection, selecting, and editing, on a computing device running applications under a touch-based operating system |
USD952666S1 (en) | 2019-10-02 | 2022-05-24 | Javad Abbas Sajan | Display screen or portion thereof with graphical user interface |
WO2022111701A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Screen projection method and system |
USD954098S1 (en) * | 2019-11-18 | 2022-06-07 | Oneplus Technology (Shenzhen) Co., Ltd. | Display screen or portion thereof with animated graphical user interface |
US11386257B2 (en) | 2012-10-15 | 2022-07-12 | Amaze Software, Inc. | Efficient manipulation of surfaces in multi-dimensional space using energy agents |
US11435869B2 (en) | 2015-07-15 | 2022-09-06 | Fyusion, Inc. | Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations |
US20220284838A1 (en) * | 2021-03-05 | 2022-09-08 | Seiko Epson Corporation | Display control method and non-transitory computer-readable storage medium storing program |
US11488380B2 (en) | 2018-04-26 | 2022-11-01 | Fyusion, Inc. | Method and apparatus for 3-D auto tagging |
US11490061B2 (en) | 2013-03-14 | 2022-11-01 | Jawbone Innovations, Llc | Proximity-based control of media devices for media presentations |
USD978184S1 (en) * | 2020-01-27 | 2023-02-14 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
USD978185S1 (en) * | 2020-01-27 | 2023-02-14 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
USD983225S1 (en) * | 2020-01-27 | 2023-04-11 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
US11636637B2 (en) | 2015-07-15 | 2023-04-25 | Fyusion, Inc. | Artificially rendering images using viewpoint interpolation and extrapolation |
USD997953S1 (en) * | 2020-04-17 | 2023-09-05 | Magic Leap, Inc. | Display panel with a graphical user interface |
USD999237S1 (en) | 2018-10-29 | 2023-09-19 | Apple Inc. | Electronic device with graphical user interface |
US11776229B2 (en) | 2017-06-26 | 2023-10-03 | Fyusion, Inc. | Modification of multi-view interactive digital media representation |
US11783864B2 (en) | 2015-09-22 | 2023-10-10 | Fyusion, Inc. | Integration of audio into a multi-view interactive digital media representation |
USD1003306S1 (en) * | 2019-11-01 | 2023-10-31 | LINE Plus Corporation | Display panel with a graphical user interface |
US11807096B2 (en) * | 2015-04-22 | 2023-11-07 | Yazaki Corporation | Display device for vehicle |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
US11876948B2 (en) | 2017-05-22 | 2024-01-16 | Fyusion, Inc. | Snapshots at predefined intervals or angles |
US11956412B2 (en) | 2015-07-15 | 2024-04-09 | Fyusion, Inc. | Drone based capture of multi-view interactive digital media |
US11960533B2 (en) | 2017-01-18 | 2024-04-16 | Fyusion, Inc. | Visual search using multi-view interactive digital media representations |
Families Citing this family (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5601083B2 (en) * | 2010-08-16 | 2014-10-08 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
FI122844B (en) * | 2011-04-21 | 2012-07-31 | Kone Corp | INVITATION EQUIPMENT AND METHOD FOR GIVING A LIFT CALL |
SG2013082250A (en) * | 2012-11-12 | 2014-06-27 | Kone Corp | Method, call-giving device, elevator system and computer program product |
CN104076988B (en) * | 2013-03-27 | 2017-12-01 | 联想(北京)有限公司 | A kind of display methods, display control method and electronic equipment |
WO2015030795A1 (en) * | 2013-08-30 | 2015-03-05 | Hewlett Packard Development Company, L.P. | Touch input association |
KR102161510B1 (en) * | 2013-09-02 | 2020-10-05 | 엘지전자 주식회사 | Portable device and controlling method thereof |
CN103581727A (en) * | 2013-10-17 | 2014-02-12 | 四川长虹电器股份有限公司 | Gesture recognition interactive system based on smart television platform and interactive method thereof |
CN104657028B (en) * | 2013-11-18 | 2018-04-27 | 联想(北京)有限公司 | Information processing method and electronic equipment |
CN104714809B (en) * | 2013-12-11 | 2018-11-13 | 联想(北京)有限公司 | A kind of method and electronic equipment of information processing |
US10023427B2 (en) * | 2014-05-28 | 2018-07-17 | Otis Elevator Company | Touchless gesture recognition for elevator service |
KR20170009979A (en) * | 2014-05-28 | 2017-01-25 | 톰슨 라이센싱 | Methods and systems for touch input |
CN105204613B (en) * | 2014-06-27 | 2019-02-05 | 联想(北京)有限公司 | A kind of information processing method and wearable device |
US9710160B2 (en) * | 2014-10-21 | 2017-07-18 | International Business Machines Corporation | Boundless projected interactive virtual desktop |
USD784400S1 (en) * | 2014-11-04 | 2017-04-18 | Workplace Dynamics, LLC | Display screen or portion thereof with rating scale graphical user interface |
KR101599349B1 (en) * | 2014-12-08 | 2016-03-04 | (주)네오인터넷 | Playing method for mobile game based movements of mobile device |
US10635724B2 (en) | 2015-01-30 | 2020-04-28 | International Business Machines Corporation | Analysis of data utilization |
JP2016161869A (en) * | 2015-03-04 | 2016-09-05 | セイコーエプソン株式会社 | Display device and display control method |
US10088866B2 (en) * | 2015-03-18 | 2018-10-02 | Motorola Mobility Llc | Controlling the orientation of a device display based on usage context |
CN104777991B (en) * | 2015-04-22 | 2019-03-29 | 深圳市华拓科技有限公司 | A kind of remote interaction optical projection system based on mobile phone |
CN106155548A (en) * | 2015-04-24 | 2016-11-23 | 中兴通讯股份有限公司 | Method, electronic equipment and the system of a kind of projection arrangement switch controlling electronic equipment |
CN106293037B (en) * | 2015-06-12 | 2023-05-02 | 联想(北京)有限公司 | Interaction method and electronic equipment |
CN106293036B (en) * | 2015-06-12 | 2021-02-19 | 联想(北京)有限公司 | Interaction method and electronic equipment |
CN105677165A (en) * | 2015-12-31 | 2016-06-15 | 北京小鸟看看科技有限公司 | List switching method and device in three-dimensional immersive environment |
CN105653034A (en) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | Content switching method and device achieved in three-dimensional immersive environment |
CN106612423A (en) * | 2015-12-31 | 2017-05-03 | 北京数科技有限公司 | Touch control method and device for projection image |
US10509487B2 (en) * | 2016-05-11 | 2019-12-17 | Google Llc | Combining gyromouse input and touch input for navigation in an augmented and/or virtual reality environment |
CN106020484B (en) * | 2016-05-31 | 2019-03-22 | 宇龙计算机通信科技(深圳)有限公司 | A kind of application is freezed and defreezing method and application operating system |
CN106657951A (en) * | 2016-10-20 | 2017-05-10 | 北京小米移动软件有限公司 | Projection control method, device, mobile device and projector |
US10432559B2 (en) * | 2016-10-24 | 2019-10-01 | Snap Inc. | Generating and displaying customized avatars in electronic messages |
US10582145B2 (en) * | 2016-12-26 | 2020-03-03 | Sony Corporation | Projection system, projection device, and cradle |
CN109101172B (en) * | 2017-10-10 | 2021-07-09 | 北京仁光科技有限公司 | Multi-screen linkage system and interactive display method thereof |
JP6667564B2 (en) * | 2018-03-23 | 2020-03-18 | アイダエンジニアリング株式会社 | Servo press machine and setting method of servo press machine |
US10664047B2 (en) * | 2018-05-17 | 2020-05-26 | International Business Machines Corporation | Displaying visually aligned content of a mobile device |
CN108920043A (en) * | 2018-06-12 | 2018-11-30 | 珠海格力电器股份有限公司 | A kind of control method and electronic equipment of household appliance |
KR102155936B1 (en) * | 2018-09-03 | 2020-09-14 | 한양대학교 산학협력단 | Interaction apparatus using image projection |
CN109375834A (en) * | 2018-09-27 | 2019-02-22 | 东莞华贝电子科技有限公司 | The feedback method and projected keyboard of projected keyboard |
DE102020100072A1 (en) * | 2020-01-03 | 2021-07-08 | Bayerische Motoren Werke Aktiengesellschaft | Method and system for displaying a list as augmented reality |
USD977491S1 (en) * | 2020-02-26 | 2023-02-07 | Loop Now Technologies, Inc. | Display screen or a portion thereof with a graphical user interface |
CN114201129A (en) * | 2020-09-18 | 2022-03-18 | 比亚迪股份有限公司 | Screen projection method and device of intelligent equipment, storage medium and terminal |
CN114115691B (en) * | 2021-10-27 | 2023-07-07 | 荣耀终端有限公司 | Electronic equipment and interaction method and medium thereof |
Citations (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020033849A1 (en) * | 2000-09-15 | 2002-03-21 | International Business Machines Corporation | Graphical user interface |
US20020063855A1 (en) * | 2000-11-29 | 2002-05-30 | Williams John W. | Digital projection system for phones and personal digital assistants |
US6489934B1 (en) * | 2000-07-07 | 2002-12-03 | Judah Klausner | Cellular phone with built in optical projector for display of data |
US6764185B1 (en) * | 2003-08-07 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | Projector as an input and output device |
US20040207823A1 (en) * | 2003-04-16 | 2004-10-21 | Alasaarela Mikko Petteri | 2D/3D data projector |
US20050259618A1 (en) * | 2004-05-03 | 2005-11-24 | Motorola, Inc. | Controlling wireless mobile devices from a remote device |
US20060146015A1 (en) * | 2005-01-05 | 2006-07-06 | Nokia Corporation | Stabilized image projecting device |
US20070030455A1 (en) * | 2003-09-18 | 2007-02-08 | Mikio Inoue | Information communication terminal |
US20070040800A1 (en) * | 2005-08-18 | 2007-02-22 | Forlines Clifton L | Method for stabilizing and precisely locating pointers generated by handheld direct pointing devices |
US20070064199A1 (en) * | 2005-09-19 | 2007-03-22 | Schindler Jon L | Projection display device |
US20070143791A1 (en) * | 2005-12-20 | 2007-06-21 | Sony Ericsson Mobile Communications Ab | Mobile device display of multiple streamed data sources |
US20070190995A1 (en) * | 2006-02-13 | 2007-08-16 | Nokia Corporation | Remote control of a mobile device |
US20070205980A1 (en) * | 2004-04-08 | 2007-09-06 | Koninklijke Philips Electronics, N.V. | Mobile projectable gui |
US20070259657A1 (en) * | 2006-05-05 | 2007-11-08 | Mediatek Inc. | Systems and methods for remotely controlling mobile stations |
US20070265717A1 (en) * | 2006-05-10 | 2007-11-15 | Compal Communications Inc. | Portable communications device with image projecting capability and control method thereof |
US20070293194A1 (en) * | 2006-05-31 | 2007-12-20 | Samsung Electronics Co., Ltd. | Method for providing remote mobile device access and control |
US20080018591A1 (en) * | 2006-07-20 | 2008-01-24 | Arkady Pittel | User Interfacing |
US20080049192A1 (en) * | 2004-09-21 | 2008-02-28 | Hirotake Nozaki | Electronic Device |
US20090091710A1 (en) * | 2007-10-05 | 2009-04-09 | Huebner Kenneth J | Interactive projector system and method |
US20090143098A1 (en) * | 2007-12-04 | 2009-06-04 | Kabushiki Kaisha Toshiba | Electronic equipment |
US20090244490A1 (en) * | 2008-03-27 | 2009-10-01 | Sanyo Electric Co., Ltd. | Mobile Projector Apparatus and Method of Controlling the Same |
US20100085316A1 (en) * | 2008-10-07 | 2010-04-08 | Jong Hwan Kim | Mobile terminal and display controlling method therein |
US20100093399A1 (en) * | 2008-10-15 | 2010-04-15 | Lg Electronics Inc. | Image projection in a mobile communication terminal |
US20100099464A1 (en) * | 2008-10-22 | 2010-04-22 | Jong Hwan Kim | Mobile communication terminal and screen scrolling method thereof |
US20100099457A1 (en) * | 2008-10-16 | 2010-04-22 | Lg Electronics Inc. | Mobile communication terminal and power saving method thereof |
US20100105428A1 (en) * | 2008-10-24 | 2010-04-29 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
US20100103101A1 (en) * | 2008-10-27 | 2010-04-29 | Song Hyunyoung | Spatially-aware projection pen interface |
US20100188428A1 (en) * | 2008-10-15 | 2010-07-29 | Lg Electronics Inc. | Mobile terminal with image projection |
US20100210312A1 (en) * | 2009-02-05 | 2010-08-19 | Samsung Electronics Co., Ltd. | Method and system for controlling dual- processing of screen data in mobile terminal having projector function |
US20110102455A1 (en) * | 2009-11-05 | 2011-05-05 | Will John Temple | Scrolling and zooming of a portable device display with device motion |
US20110151936A1 (en) * | 2009-12-21 | 2011-06-23 | Samsung Electronics Co. Ltd. | Input key output method and apparatus of projector-enabled mobile terminal |
US20110183654A1 (en) * | 2010-01-25 | 2011-07-28 | Brian Lanier | Concurrent Use of Multiple User Interface Devices |
US20110191690A1 (en) * | 2010-02-03 | 2011-08-04 | Microsoft Corporation | Combined Surface User Interface |
US20110197147A1 (en) * | 2010-02-11 | 2011-08-11 | Apple Inc. | Projected display shared workspaces |
US20120038592A1 (en) * | 2010-08-11 | 2012-02-16 | Young Optics Inc. | Input/output device and human-machine interaction system and method thereof |
US20120098754A1 (en) * | 2009-10-23 | 2012-04-26 | Jong Hwan Kim | Mobile terminal having an image projector module and controlling method therein |
US8351983B2 (en) * | 2008-12-02 | 2013-01-08 | Lg Electronics Inc. | Mobile terminal for displaying an image on an external screen and controlling method thereof |
US8462262B2 (en) * | 2008-08-04 | 2013-06-11 | Lg Electronics Inc. | Portable terminal having a projection unit |
US8478366B2 (en) * | 2008-10-20 | 2013-07-02 | Lg Electronics Inc. | Mobile terminal |
US8485668B2 (en) * | 2010-05-28 | 2013-07-16 | Microsoft Corporation | 3D interaction for mobile device |
US8579442B2 (en) * | 2009-05-27 | 2013-11-12 | Transpacific Image, Llc | Advertisement content selection and presentation |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0549074A (en) | 1991-08-09 | 1993-02-26 | Fujitsu Ltd | Remote controller |
JP2000284879A (en) | 1999-01-29 | 2000-10-13 | Square Co Ltd | Game device, command input method in video game and computer readable recording medium for recording program for providing the same method |
US6544123B1 (en) | 1999-10-29 | 2003-04-08 | Square Co., Ltd. | Game apparatus, command input method for video game and computer-readable recording medium recording programs for realizing the same |
JP2004363930A (en) | 2003-06-04 | 2004-12-24 | Sony Corp | Television broadcast reception system, remote controller, and program information display method |
JP2005128506A (en) | 2003-09-30 | 2005-05-19 | Sanyo Electric Co Ltd | Portable projector |
JP5121121B2 (en) | 2005-02-22 | 2013-01-16 | オリンパスイメージング株式会社 | Video display device, video display method, and video display system |
JP2007241537A (en) | 2006-03-07 | 2007-09-20 | Seiko Epson Corp | Projection system, projection device, personal digital assistant, control method for projection system and its program |
US8462109B2 (en) | 2007-01-05 | 2013-06-11 | Invensense, Inc. | Controlling and accessing content using motion processing on mobile devices |
JP2009168887A (en) | 2008-01-11 | 2009-07-30 | Seiko Epson Corp | Portable image projector |
CN101533572A (en) | 2008-03-11 | 2009-09-16 | 禾瑞亚科技股份有限公司 | Laser projection pen with sensing-related capability of representing functional gesture |
-
2010
- 2010-07-16 US US12/837,895 patent/US9134799B2/en not_active Expired - Fee Related
-
2011
- 2011-04-27 KR KR1020157000139A patent/KR20150013934A/en not_active Application Discontinuation
- 2011-04-27 WO PCT/US2011/034106 patent/WO2012009039A1/en active Application Filing
- 2011-04-27 EP EP11723781.8A patent/EP2593848B1/en not_active Not-in-force
- 2011-04-27 JP JP2013519680A patent/JP5689963B2/en not_active Expired - Fee Related
- 2011-04-27 BR BR112013001019A patent/BR112013001019A2/en not_active Application Discontinuation
- 2011-04-27 CN CN201180034164.0A patent/CN102985896B/en not_active Expired - Fee Related
- 2011-04-27 KR KR1020137003937A patent/KR101601657B1/en not_active IP Right Cessation
Patent Citations (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6489934B1 (en) * | 2000-07-07 | 2002-12-03 | Judah Klausner | Cellular phone with built in optical projector for display of data |
US20020033849A1 (en) * | 2000-09-15 | 2002-03-21 | International Business Machines Corporation | Graphical user interface |
US20020063855A1 (en) * | 2000-11-29 | 2002-05-30 | Williams John W. | Digital projection system for phones and personal digital assistants |
US20040207823A1 (en) * | 2003-04-16 | 2004-10-21 | Alasaarela Mikko Petteri | 2D/3D data projector |
US6764185B1 (en) * | 2003-08-07 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | Projector as an input and output device |
US20070030455A1 (en) * | 2003-09-18 | 2007-02-08 | Mikio Inoue | Information communication terminal |
US20070205980A1 (en) * | 2004-04-08 | 2007-09-06 | Koninklijke Philips Electronics, N.V. | Mobile projectable gui |
US20050259618A1 (en) * | 2004-05-03 | 2005-11-24 | Motorola, Inc. | Controlling wireless mobile devices from a remote device |
US20080049192A1 (en) * | 2004-09-21 | 2008-02-28 | Hirotake Nozaki | Electronic Device |
US7883221B2 (en) * | 2004-09-21 | 2011-02-08 | Nikon Corporation | Electronic device |
US20060146015A1 (en) * | 2005-01-05 | 2006-07-06 | Nokia Corporation | Stabilized image projecting device |
US7284866B2 (en) * | 2005-01-05 | 2007-10-23 | Nokia Corporation | Stabilized image projecting device |
US20070040800A1 (en) * | 2005-08-18 | 2007-02-22 | Forlines Clifton L | Method for stabilizing and precisely locating pointers generated by handheld direct pointing devices |
US20070064199A1 (en) * | 2005-09-19 | 2007-03-22 | Schindler Jon L | Projection display device |
US20070143791A1 (en) * | 2005-12-20 | 2007-06-21 | Sony Ericsson Mobile Communications Ab | Mobile device display of multiple streamed data sources |
US20070190995A1 (en) * | 2006-02-13 | 2007-08-16 | Nokia Corporation | Remote control of a mobile device |
US20070259657A1 (en) * | 2006-05-05 | 2007-11-08 | Mediatek Inc. | Systems and methods for remotely controlling mobile stations |
US20070265717A1 (en) * | 2006-05-10 | 2007-11-15 | Compal Communications Inc. | Portable communications device with image projecting capability and control method thereof |
US20070293194A1 (en) * | 2006-05-31 | 2007-12-20 | Samsung Electronics Co., Ltd. | Method for providing remote mobile device access and control |
US20080018591A1 (en) * | 2006-07-20 | 2008-01-24 | Arkady Pittel | User Interfacing |
US20090091710A1 (en) * | 2007-10-05 | 2009-04-09 | Huebner Kenneth J | Interactive projector system and method |
US20090143098A1 (en) * | 2007-12-04 | 2009-06-04 | Kabushiki Kaisha Toshiba | Electronic equipment |
US20090244490A1 (en) * | 2008-03-27 | 2009-10-01 | Sanyo Electric Co., Ltd. | Mobile Projector Apparatus and Method of Controlling the Same |
US8462262B2 (en) * | 2008-08-04 | 2013-06-11 | Lg Electronics Inc. | Portable terminal having a projection unit |
US20100085316A1 (en) * | 2008-10-07 | 2010-04-08 | Jong Hwan Kim | Mobile terminal and display controlling method therein |
US20100093399A1 (en) * | 2008-10-15 | 2010-04-15 | Lg Electronics Inc. | Image projection in a mobile communication terminal |
US20100188428A1 (en) * | 2008-10-15 | 2010-07-29 | Lg Electronics Inc. | Mobile terminal with image projection |
US20100099457A1 (en) * | 2008-10-16 | 2010-04-22 | Lg Electronics Inc. | Mobile communication terminal and power saving method thereof |
US8478366B2 (en) * | 2008-10-20 | 2013-07-02 | Lg Electronics Inc. | Mobile terminal |
US20100099464A1 (en) * | 2008-10-22 | 2010-04-22 | Jong Hwan Kim | Mobile communication terminal and screen scrolling method thereof |
US20100105428A1 (en) * | 2008-10-24 | 2010-04-29 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
US20100103101A1 (en) * | 2008-10-27 | 2010-04-29 | Song Hyunyoung | Spatially-aware projection pen interface |
US8351983B2 (en) * | 2008-12-02 | 2013-01-08 | Lg Electronics Inc. | Mobile terminal for displaying an image on an external screen and controlling method thereof |
US20100210312A1 (en) * | 2009-02-05 | 2010-08-19 | Samsung Electronics Co., Ltd. | Method and system for controlling dual- processing of screen data in mobile terminal having projector function |
US8579442B2 (en) * | 2009-05-27 | 2013-11-12 | Transpacific Image, Llc | Advertisement content selection and presentation |
US20120098754A1 (en) * | 2009-10-23 | 2012-04-26 | Jong Hwan Kim | Mobile terminal having an image projector module and controlling method therein |
US20110102455A1 (en) * | 2009-11-05 | 2011-05-05 | Will John Temple | Scrolling and zooming of a portable device display with device motion |
US20110151936A1 (en) * | 2009-12-21 | 2011-06-23 | Samsung Electronics Co. Ltd. | Input key output method and apparatus of projector-enabled mobile terminal |
US20110183654A1 (en) * | 2010-01-25 | 2011-07-28 | Brian Lanier | Concurrent Use of Multiple User Interface Devices |
US20110191690A1 (en) * | 2010-02-03 | 2011-08-04 | Microsoft Corporation | Combined Surface User Interface |
US20110197147A1 (en) * | 2010-02-11 | 2011-08-11 | Apple Inc. | Projected display shared workspaces |
US8485668B2 (en) * | 2010-05-28 | 2013-07-16 | Microsoft Corporation | 3D interaction for mobile device |
US20120038592A1 (en) * | 2010-08-11 | 2012-02-16 | Young Optics Inc. | Input/output device and human-machine interaction system and method thereof |
Cited By (381)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170060393A1 (en) * | 2000-01-05 | 2017-03-02 | Apple Inc. | Time-based, non-constant translation of user interface objects between states |
US10962867B2 (en) | 2007-10-10 | 2021-03-30 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US9581883B2 (en) | 2007-10-10 | 2017-02-28 | Gerard Dirk Smits | Method, apparatus, and manufacture for a tracking camera or detector with fast asynchronous triggering |
US8948788B2 (en) | 2008-05-28 | 2015-02-03 | Google Inc. | Motion-controlled views on mobile computing devices |
US20090325607A1 (en) * | 2008-05-28 | 2009-12-31 | Conway David P | Motion-controlled views on mobile computing devices |
US20100045667A1 (en) * | 2008-08-22 | 2010-02-25 | Google Inc. | Navigation In a Three Dimensional Environment Using An Orientation Of A Mobile Device |
US8847992B2 (en) * | 2008-08-22 | 2014-09-30 | Google Inc. | Navigation in a three dimensional environment using an orientation of a mobile device |
US20100188426A1 (en) * | 2009-01-27 | 2010-07-29 | Kenta Ohmori | Display apparatus, display control method, and display control program |
US8624927B2 (en) * | 2009-01-27 | 2014-01-07 | Sony Corporation | Display apparatus, display control method, and display control program |
US20120098754A1 (en) * | 2009-10-23 | 2012-04-26 | Jong Hwan Kim | Mobile terminal having an image projector module and controlling method therein |
US9762757B2 (en) * | 2009-10-23 | 2017-09-12 | Lg Electronics Inc. | Mobile terminal having an image projector module and controlling method therein |
US20120026088A1 (en) * | 2010-08-01 | 2012-02-02 | T-Mobile Usa, Inc. | Handheld device with projected user interface and interactive image |
US20120075182A1 (en) * | 2010-08-24 | 2012-03-29 | Lg Electronics Inc. | Mobile terminal and displaying method thereof |
US20130176258A1 (en) * | 2010-09-02 | 2013-07-11 | Elliptic Laboratories As | Motion feedback |
US9201545B2 (en) * | 2010-09-02 | 2015-12-01 | Elliptic Laboratories As | Motion feedback |
US20120244803A1 (en) * | 2010-09-22 | 2012-09-27 | Tomohiro Sudou | Communication system, communication device, and communication method |
US20120075348A1 (en) * | 2010-09-24 | 2012-03-29 | Shunichi Kasahara | Information Processing Apparatus, Information Processing Terminal, Information Processing Method and Computer Program |
US9946076B2 (en) | 2010-10-04 | 2018-04-17 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
US20120127184A1 (en) * | 2010-11-19 | 2012-05-24 | Ricoh Company, Ltd. | Image projection apparatus, memory control apparatus, laser projector, and memory access method |
US8884975B2 (en) * | 2010-11-19 | 2014-11-11 | Ricoh Company, Ltd. | Image projection apparatus, memory control apparatus, laser projector, and memory access method |
US20120133754A1 (en) * | 2010-11-26 | 2012-05-31 | Dongguk University Industry-Academic Cooperation Foundation | Gaze tracking system and method for controlling internet protocol tv at a distance |
US8786547B2 (en) * | 2010-12-23 | 2014-07-22 | Microsoft Corporation | Effects of gravity on gestures |
US20120165074A1 (en) * | 2010-12-23 | 2012-06-28 | Microsoft Corporation | Effects of gravity on gestures |
US8839134B2 (en) * | 2010-12-24 | 2014-09-16 | Intel Corporation | Projection interface techniques |
US20120166993A1 (en) * | 2010-12-24 | 2012-06-28 | Anderson Glen J | Projection interface techniques |
USD668260S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
USD668261S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
US20120249570A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC. | Highlighting in response to determining device transfer |
US8863275B2 (en) | 2011-03-30 | 2014-10-14 | Elwha Llc | Access restriction in response to determining device transfer |
US8839411B2 (en) | 2011-03-30 | 2014-09-16 | Elwha Llc | Providing particular level of access to one or more items in response to determining primary control of a computing device |
US8613075B2 (en) | 2011-03-30 | 2013-12-17 | Elwha Llc | Selective item access provision in response to active item ascertainment upon device transfer |
US20120249285A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC, a limited liability company of the State of Delaware | Highlighting in response to determining device transfer |
US8615797B2 (en) | 2011-03-30 | 2013-12-24 | Elwha Llc | Selective item access provision in response to active item ascertainment upon device transfer |
US9153194B2 (en) | 2011-03-30 | 2015-10-06 | Elwha Llc | Presentation format selection based at least on device transfer determination |
US8745725B2 (en) * | 2011-03-30 | 2014-06-03 | Elwha Llc | Highlighting in response to determining device transfer |
US8739275B2 (en) | 2011-03-30 | 2014-05-27 | Elwha Llc | Marking one or more items in response to determining device transfer |
US8726367B2 (en) * | 2011-03-30 | 2014-05-13 | Elwha Llc | Highlighting in response to determining device transfer |
US9317111B2 (en) | 2011-03-30 | 2016-04-19 | Elwha, Llc | Providing greater access to one or more items in response to verifying device transfer |
US8918861B2 (en) | 2011-03-30 | 2014-12-23 | Elwha Llc | Marking one or more items in response to determining device transfer |
US8713670B2 (en) | 2011-03-30 | 2014-04-29 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US8726366B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US10338689B1 (en) * | 2011-04-02 | 2019-07-02 | Open Invention Network Llc | System and method for redirecting content based on gestures |
US11281304B1 (en) | 2011-04-02 | 2022-03-22 | Open Invention Network Llc | System and method for redirecting content based on gestures |
US9632588B1 (en) * | 2011-04-02 | 2017-04-25 | Open Invention Network, Llc | System and method for redirecting content based on gestures |
US10884508B1 (en) | 2011-04-02 | 2021-01-05 | Open Invention Network Llc | System and method for redirecting content based on gestures |
US11720179B1 (en) * | 2011-04-02 | 2023-08-08 | International Business Machines Corporation | System and method for redirecting content based on gestures |
US8316319B1 (en) * | 2011-05-16 | 2012-11-20 | Google Inc. | Efficient selection of characters and commands based on movement-inputs at a user-inerface |
US20140137034A1 (en) * | 2011-06-01 | 2014-05-15 | Microsoft Corporation | Asynchronous handling of a user interface manipulation |
US9600166B2 (en) * | 2011-06-01 | 2017-03-21 | Microsoft Technology Licensing, Llc | Asynchronous handling of a user interface manipulation |
US9092136B1 (en) * | 2011-06-08 | 2015-07-28 | Rockwell Collins, Inc. | Projected button display system |
US20140118260A1 (en) * | 2011-06-20 | 2014-05-01 | Zte Corporation | Mobile terminal and method for moving cursor thereof |
US10445934B1 (en) * | 2011-08-29 | 2019-10-15 | Amazon Technologies, Inc. | Augmented reality environment with environmental condition control |
US20130086531A1 (en) * | 2011-09-29 | 2013-04-04 | Kabushiki Kaisha Toshiba | Command issuing device, method and computer program product |
US20130103446A1 (en) * | 2011-10-20 | 2013-04-25 | Microsoft Corporation | Information sharing democratization for co-located group meetings |
US9659280B2 (en) | 2011-10-20 | 2017-05-23 | Microsoft Technology Licensing Llc | Information sharing democratization for co-located group meetings |
US8631357B2 (en) * | 2011-10-31 | 2014-01-14 | Apple Inc. | Dual function scroll wheel input |
US9436289B2 (en) * | 2011-11-08 | 2016-09-06 | Sony Corporation | Transmitting device, display control device, content transmitting method, recording medium, and program |
US20140218326A1 (en) * | 2011-11-08 | 2014-08-07 | Sony Corporation | Transmitting device, display control device, content transmitting method, recording medium, and program |
US20130120240A1 (en) * | 2011-11-10 | 2013-05-16 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling image display depending on movement of terminal |
US10228832B2 (en) | 2011-11-17 | 2019-03-12 | Prezi, Inc. | Grouping with frames to transform display elements within a zooming user interface |
US20130132895A1 (en) * | 2011-11-17 | 2013-05-23 | Prezi, Inc. | Grouping with frames to transform display elements within a zooming user interface |
US9207951B2 (en) * | 2011-11-17 | 2015-12-08 | Prezi, Inc. | Grouping with frames to transform display elements within a zooming user interface |
US8812987B2 (en) * | 2011-12-20 | 2014-08-19 | Wikipad, Inc. | Virtual multiple sided virtual rotatable user interface icon queue |
US20130159928A1 (en) * | 2011-12-20 | 2013-06-20 | Wikipad, Inc. | Virtual multiple sided virtual rotatable user interface icon queue |
US20150156545A1 (en) * | 2012-01-04 | 2015-06-04 | Thomson Licensing | Method and system for providing media recommendations |
USD920989S1 (en) | 2012-01-11 | 2021-06-01 | Sony Corporation | Display panel or screen with transitional graphical user interface |
US20130176346A1 (en) * | 2012-01-11 | 2013-07-11 | Fih (Hong Kong) Limited | Electronic device and method for controlling display on the electronic device |
US20130191776A1 (en) * | 2012-01-20 | 2013-07-25 | The Other Media Limited | Method of activating activatable content on an electronic device display |
USD733723S1 (en) * | 2012-02-24 | 2015-07-07 | Htc Corporation | Portion of a display screen with graphical user interface |
USD781902S1 (en) | 2012-03-07 | 2017-03-21 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD745031S1 (en) * | 2012-03-07 | 2015-12-08 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US20140372911A1 (en) * | 2012-03-09 | 2014-12-18 | Tencent Technology (Shenzhen) Company Limited | Interactive interface display control method, instant communication tool and computer storage medium |
US20130246955A1 (en) * | 2012-03-14 | 2013-09-19 | Sony Network Entertainment International Llc | Visual feedback for highlight-driven gesture user interfaces |
US10503373B2 (en) * | 2012-03-14 | 2019-12-10 | Sony Interactive Entertainment LLC | Visual feedback for highlight-driven gesture user interfaces |
US20130249811A1 (en) * | 2012-03-23 | 2013-09-26 | Microsoft Corporation | Controlling a device with visible light |
CN103366659A (en) * | 2012-03-26 | 2013-10-23 | 联想(北京)有限公司 | Display control method and related device |
US10366537B2 (en) * | 2012-05-08 | 2019-07-30 | Sony Corporation | Image processing apparatus, projection control method, and program |
US20150029223A1 (en) * | 2012-05-08 | 2015-01-29 | Sony Corporation | Image processing apparatus, projection control method, and program |
US20130321268A1 (en) * | 2012-06-01 | 2013-12-05 | Microsoft Corporation | Control of remote applications using companion device |
US9381427B2 (en) | 2012-06-01 | 2016-07-05 | Microsoft Technology Licensing, Llc | Generic companion-messaging between media platforms |
US10025478B2 (en) | 2012-06-01 | 2018-07-17 | Microsoft Technology Licensing, Llc | Media-aware interface |
US9170667B2 (en) | 2012-06-01 | 2015-10-27 | Microsoft Technology Licensing, Llc | Contextual user interface |
US9690465B2 (en) * | 2012-06-01 | 2017-06-27 | Microsoft Technology Licensing, Llc | Control of remote applications using companion device |
US9798457B2 (en) | 2012-06-01 | 2017-10-24 | Microsoft Technology Licensing, Llc | Synchronization of media interactions using context |
US10248301B2 (en) | 2012-06-01 | 2019-04-02 | Microsoft Technology Licensing, Llc | Contextual user interface |
US10156869B2 (en) * | 2012-06-12 | 2018-12-18 | Apple Inc. | Electronic device with wrapped display |
US20160320806A1 (en) * | 2012-06-12 | 2016-11-03 | Apple Inc. | Electronic Device with Wrapped Display |
US9292096B2 (en) * | 2012-06-18 | 2016-03-22 | Ricoh Company, Limited | Conference projection system with gesture-based image transmitting unit |
US20130335640A1 (en) * | 2012-06-18 | 2013-12-19 | Ayako Watanabe | Information processing apparatus and conference system |
US8532675B1 (en) | 2012-06-27 | 2013-09-10 | Blackberry Limited | Mobile communication device user interface for manipulation of data items in a physical space |
US9864443B2 (en) * | 2012-07-31 | 2018-01-09 | Samsung Electronics Co., Ltd. | Method for controlling user input and electronic device thereof |
US20140035851A1 (en) * | 2012-07-31 | 2014-02-06 | Samsung Electronics Co., Ltd. | Method for controlling user input and electronic device thereof |
USD738894S1 (en) * | 2012-08-29 | 2015-09-15 | Samsung Electronics Co., Ltd. | Portable electronic device with a graphical user interface |
USD745547S1 (en) * | 2012-09-13 | 2015-12-15 | Sony Computer Entertainment Inc. | Display screen or portion thereof with animated graphical user interface for a portable information terminal |
USD744515S1 (en) * | 2012-09-13 | 2015-12-01 | Sony Computer Entertainment Inc. | Display screen or portion thereof with animated graphical user interface for a portable information terminal |
USD745548S1 (en) * | 2012-09-13 | 2015-12-15 | Sony Computer Entertainment Inc. | Display screen or portion thereof with animated graphical user interface for a portable information terminal |
US20140089850A1 (en) * | 2012-09-22 | 2014-03-27 | Tourwrist, Inc. | Systems and Methods of Using Motion Control to Navigate Panoramas and Virtual Tours |
US20140085238A1 (en) * | 2012-09-25 | 2014-03-27 | Samsung Electronics Co., Ltd. | Image processing apparatus and control method thereof |
CN103677628A (en) * | 2012-09-25 | 2014-03-26 | 三星电子株式会社 | Image processing apparatus and control method thereof |
US20140380250A1 (en) * | 2012-09-27 | 2014-12-25 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method and program |
US9501176B1 (en) | 2012-10-08 | 2016-11-22 | Gerard Dirk Smits | Method, apparatus, and manufacture for document writing and annotation with virtual ink |
US9772889B2 (en) | 2012-10-15 | 2017-09-26 | Famous Industries, Inc. | Expedited processing and handling of events |
US10908929B2 (en) | 2012-10-15 | 2021-02-02 | Famous Industries, Inc. | Human versus bot detection using gesture fingerprinting |
US11386257B2 (en) | 2012-10-15 | 2022-07-12 | Amaze Software, Inc. | Efficient manipulation of surfaces in multi-dimensional space using energy agents |
US9501171B1 (en) | 2012-10-15 | 2016-11-22 | Famous Industries, Inc. | Gesture fingerprinting |
US10521249B1 (en) | 2012-10-15 | 2019-12-31 | Famous Industries, Inc. | Gesture Fingerprinting |
US20190005146A1 (en) * | 2012-10-15 | 2019-01-03 | Famous Industries, Inc. | Manipulating Virtual Camera Dolly in Multi-Dimensional Space to Produce Visual Effect |
US9652076B1 (en) | 2012-10-15 | 2017-05-16 | Famous Industries, Inc. | Gesture fingerprinting |
US10877780B2 (en) | 2012-10-15 | 2020-12-29 | Famous Industries, Inc. | Visibility detection using gesture fingerprinting |
US20160054807A1 (en) * | 2012-11-08 | 2016-02-25 | PlayVision Labs, Inc. | Systems and methods for extensions to alternative control of touch-based devices |
US10108271B2 (en) | 2012-11-08 | 2018-10-23 | Cuesta Technology Holdings, Llc | Multi-modal input control of touch-based devices |
US20190025936A1 (en) * | 2012-11-08 | 2019-01-24 | Cuesta Technology Holdings, Llc | Systems and methods for extensions to alternative control of touch-based devices |
US20140125590A1 (en) * | 2012-11-08 | 2014-05-08 | PlayVision Labs, Inc. | Systems and methods for alternative control of touch-based devices |
US9671874B2 (en) * | 2012-11-08 | 2017-06-06 | Cuesta Technology Holdings, Llc | Systems and methods for extensions to alternative control of touch-based devices |
US11237638B2 (en) | 2012-11-08 | 2022-02-01 | Cuesta Technology Holdings, Llc | Systems and methods for extensions to alternative control of touch-based devices |
US9658695B2 (en) * | 2012-11-08 | 2017-05-23 | Cuesta Technology Holdings, Llc | Systems and methods for alternative control of touch-based devices |
US10209770B2 (en) * | 2012-11-09 | 2019-02-19 | Sony Corporation | Information processing apparatus and information processing method |
US10528124B2 (en) * | 2012-11-09 | 2020-01-07 | Sony Corporation | Information processing apparatus, information processing method, and computer-readable recording medium |
US11036286B2 (en) * | 2012-11-09 | 2021-06-15 | Sony Corporation | Information processing apparatus, information processing method, and computer-readable recording medium |
US20190138084A1 (en) * | 2012-11-09 | 2019-05-09 | Sony Corporation | Information processing apparatus, information processing method, and computer-readable recording medium |
US9904414B2 (en) * | 2012-12-10 | 2018-02-27 | Seiko Epson Corporation | Display device, and method of controlling display device |
US20140160076A1 (en) * | 2012-12-10 | 2014-06-12 | Seiko Epson Corporation | Display device, and method of controlling display device |
US10409455B2 (en) | 2012-12-17 | 2019-09-10 | Telecom Italia S.P.A. | Selection system for an interactive display |
WO2014094820A1 (en) | 2012-12-17 | 2014-06-26 | Telecom Italia S.P.A. | Selection system for an interactive display |
USD731531S1 (en) * | 2013-01-04 | 2015-06-09 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
WO2014107182A1 (en) * | 2013-01-04 | 2014-07-10 | Intel Corporation | Multi-distance, multi-modal natural user interaction with computing devices |
CN104854537A (en) * | 2013-01-04 | 2015-08-19 | 英特尔公司 | Multi-distance, multi-modal natural user interaction with computing devices |
US9213412B2 (en) | 2013-01-04 | 2015-12-15 | Intel Corporation | Multi-distance, multi-modal natural user interaction with computing devices |
US20140191940A1 (en) * | 2013-01-08 | 2014-07-10 | Volvo Car Corporation | Vehicle display arrangement and vehicle comprising a vehicle display arrangement |
CN103909864A (en) * | 2013-01-08 | 2014-07-09 | 沃尔沃汽车公司 | Vehicle display arrangement and vehicle comprising a vehicle display arrangement |
US20140203999A1 (en) * | 2013-01-21 | 2014-07-24 | Samsung Electronics Co., Ltd. | Method and apparatus for arranging a plurality of icons on a screen |
US20160188280A1 (en) * | 2013-01-21 | 2016-06-30 | Samsung Electronics Co., Ltd. | Method and apparatus for arranging a plurality of icons on a screen |
US10963209B2 (en) | 2013-01-21 | 2021-03-30 | Samsung Electronics Co., Ltd. | Method and apparatus for arranging a plurality of icons on a screen |
US20150355816A1 (en) * | 2013-01-21 | 2015-12-10 | Samsung Electronics Co., Ltd. | Method and apparatus for arranging a plurality of icons on a screen |
US10275532B2 (en) | 2013-01-24 | 2019-04-30 | Interdigital Ce Patent Holdings | Method and system for content discovery |
US9449340B2 (en) * | 2013-01-30 | 2016-09-20 | Wal-Mart Stores, Inc. | Method and system for managing an electronic shopping list with gestures |
US20140215390A1 (en) * | 2013-01-30 | 2014-07-31 | Rightware Oy | Method of and system for displaying a list of items on an electronic device |
US20140214597A1 (en) * | 2013-01-30 | 2014-07-31 | Wal-Mart Stores, Inc. | Method And System For Managing An Electronic Shopping List With Gestures |
US20140217874A1 (en) * | 2013-02-04 | 2014-08-07 | Hon Hai Precision Industry Co., Ltd. | Touch-sensitive device and control method thereof |
US9319149B2 (en) | 2013-03-13 | 2016-04-19 | Aliphcom | Proximity-based control of media devices for media presentations |
US9294869B2 (en) | 2013-03-13 | 2016-03-22 | Aliphcom | Methods, systems and apparatus to affect RF transmission from a non-linked wireless client |
US9774653B2 (en) | 2013-03-14 | 2017-09-26 | Microsoft Technology Licensing, Llc | Cooperative federation of digital devices via proxemics and device micro-mobility |
US20160188205A1 (en) * | 2013-03-14 | 2016-06-30 | Sanjay K. Rao | Mobile IO Input and Output for Smartphones, Tablet, and Wireless Devices including Touch Screen, Voice, Pen, and Gestures |
US11457356B2 (en) * | 2013-03-14 | 2022-09-27 | Sanjay K Rao | Gestures including motions performed in the air to control a mobile device |
CN105142581A (en) * | 2013-03-14 | 2015-12-09 | 埃克苏仿生公司 | Machine to human interfaces for communication from a lower extremity orthotic |
US11490061B2 (en) | 2013-03-14 | 2022-11-01 | Jawbone Innovations, Llc | Proximity-based control of media devices for media presentations |
US10391016B2 (en) | 2013-03-14 | 2019-08-27 | Ekso Bionics, Inc. | Machine to human interfaces for communication from a lower extremity orthotic |
WO2014159577A1 (en) * | 2013-03-14 | 2014-10-02 | Ekso Bionics, Inc. | Machine to human interfaces for communication from a lower extremity orthotic |
US9294539B2 (en) | 2013-03-14 | 2016-03-22 | Microsoft Technology Licensing, Llc | Cooperative federation of digital devices via proxemics and device micro-mobility |
US20140280003A1 (en) * | 2013-03-15 | 2014-09-18 | Imaginestics, Llc | Method of Gesture-Based Definition of an Object within an Image |
US9384281B2 (en) * | 2013-03-15 | 2016-07-05 | Imaginestics, Llc | Method of gesture-based definition of an object within an image |
US20140298218A1 (en) * | 2013-03-28 | 2014-10-02 | Zoltán Gera | Automatic application of templates to content |
US9436673B2 (en) * | 2013-03-28 | 2016-09-06 | Prezi, Inc | Automatic application of templates to content |
USD851663S1 (en) * | 2013-04-05 | 2019-06-18 | Thales Avionics, Inc. | Display screen or portion thereof with graphical user interface |
US20140313189A1 (en) * | 2013-04-19 | 2014-10-23 | Thales | Hybrid display system displaying information by superimposition on the exterior |
US9569893B2 (en) * | 2013-04-19 | 2017-02-14 | Thales | Hybrid display system displaying information by superimposition on the exterior |
US11914857B1 (en) * | 2013-04-29 | 2024-02-27 | David Graham Boyers | Methods and graphical user interfaces for pointing and editing on computing devices with touch-sensitive displays |
US10719224B1 (en) * | 2013-04-29 | 2020-07-21 | David Graham Boyers | Methods and graphical user interfaces for pointing and editing on computing devices with touch-sensitive displays |
US11042286B1 (en) | 2013-04-29 | 2021-06-22 | David Graham Boyers | Methods and graphical user interfaces for pointing and editing on computing devices with touch-sensitive displays |
US11397524B1 (en) * | 2013-04-29 | 2022-07-26 | David Graham Boyers | Methods and graphical user interfaces for pointing and editing on computing devices with touch-sensitive displays |
US9274686B2 (en) * | 2013-05-09 | 2016-03-01 | Sap Se | Navigation framework for visual analytic displays |
US20140337778A1 (en) * | 2013-05-09 | 2014-11-13 | Sap Ag | Navigation Framework for Visual Analytic Displays |
US20160085403A1 (en) * | 2013-05-15 | 2016-03-24 | Sony Corporation | Display control device, display control method, and recording medium |
US9940009B2 (en) * | 2013-05-15 | 2018-04-10 | Sony Corporation | Display control device for scrolling of content based on sensor data |
US20140342660A1 (en) * | 2013-05-20 | 2014-11-20 | Scott Fullam | Media devices for audio and video projection of media presentations |
WO2014193687A3 (en) * | 2013-05-20 | 2015-10-29 | Aliphcom | Media devices for audio and video projection of media presentations |
JPWO2014188797A1 (en) * | 2013-05-21 | 2017-02-23 | ソニー株式会社 | Display control device, display control method, and recording medium |
EP3001407A4 (en) * | 2013-05-21 | 2017-01-25 | Sony Corporation | Display control device, display control method, and recording medium |
EP3001406A4 (en) * | 2013-05-21 | 2017-01-25 | Sony Corporation | Display control device, display control method, and recording medium |
USD775147S1 (en) * | 2013-06-09 | 2016-12-27 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD956061S1 (en) | 2013-06-09 | 2022-06-28 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD789969S1 (en) | 2013-06-09 | 2017-06-20 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD808401S1 (en) | 2013-06-09 | 2018-01-23 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD860233S1 (en) | 2013-06-09 | 2019-09-17 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD749622S1 (en) * | 2013-06-10 | 2016-02-16 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD864236S1 (en) | 2013-06-10 | 2019-10-22 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
US9158959B2 (en) | 2013-07-17 | 2015-10-13 | Motorola Solutions, Inc. | Palm identification and in-place personalized interactive display |
US20150046877A1 (en) * | 2013-08-07 | 2015-02-12 | The Coca-Cola Company | Dynamically Adjusting Ratios of Beverages in a Mixed Beverage |
US10384925B2 (en) * | 2013-08-07 | 2019-08-20 | The Coca-Cola Company | Dynamically adjusting ratios of beverages in a mixed beverage |
USD788795S1 (en) * | 2013-09-03 | 2017-06-06 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with animated graphical user interface |
US20160054808A1 (en) * | 2013-09-04 | 2016-02-25 | Sk Telecom Co., Ltd. | Method and device for executing command on basis of context awareness |
US10198081B2 (en) * | 2013-09-04 | 2019-02-05 | Sk Telecom Co., Ltd. | Method and device for executing command on basis of context awareness |
US10678424B2 (en) | 2013-09-17 | 2020-06-09 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US10963156B2 (en) | 2013-09-17 | 2021-03-30 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US9933933B2 (en) * | 2013-09-17 | 2018-04-03 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US20150082257A1 (en) * | 2013-09-17 | 2015-03-19 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US11068152B2 (en) | 2013-09-17 | 2021-07-20 | Lg Electronics Inc. | Mobile terminal and control method thereof |
US20150082238A1 (en) * | 2013-09-18 | 2015-03-19 | Jianzhong Meng | System and method to display and interact with a curve items list |
USD768152S1 (en) * | 2013-09-20 | 2016-10-04 | ACCO Brands Corporation | Display screen including a graphical user interface |
US20150089453A1 (en) * | 2013-09-25 | 2015-03-26 | Aquifi, Inc. | Systems and Methods for Interacting with a Projected User Interface |
US9942529B2 (en) | 2013-09-27 | 2018-04-10 | Hitachi Maxell, Ltd. | Image projection device |
EP3051345A4 (en) * | 2013-09-27 | 2017-08-09 | Hitachi Maxell, Ltd. | Video projection device |
US20150127505A1 (en) * | 2013-10-11 | 2015-05-07 | Capital One Financial Corporation | System and method for generating and transforming data presentation |
US20150128095A1 (en) * | 2013-11-07 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Method, device and computer system for performing operations on objects in an object list |
USD754719S1 (en) * | 2013-11-15 | 2016-04-26 | Tencent Technology (Shenzhen) Company Limited | Display screen portion with animated graphical user interface |
US20150160907A1 (en) * | 2013-12-11 | 2015-06-11 | Lenovo (Beijing) Co., Ltd. | Information processing method and electronic device |
US9563393B2 (en) * | 2013-12-11 | 2017-02-07 | Lenovo (Beijing) Co., Ltd. | Information processing method and electronic device |
USD872098S1 (en) | 2013-12-18 | 2020-01-07 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD942987S1 (en) | 2013-12-18 | 2022-02-08 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US20150188776A1 (en) * | 2013-12-27 | 2015-07-02 | Kt Corporation | Synchronizing user interface across multiple devices |
US10656715B2 (en) | 2013-12-30 | 2020-05-19 | Immersion Corporation | Systems and methods for a haptically-enabled projected user interface |
US9965034B2 (en) | 2013-12-30 | 2018-05-08 | Immersion Corporation | Systems and methods for a haptically-enabled projected user interface |
USD771088S1 (en) * | 2014-01-06 | 2016-11-08 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9369658B2 (en) * | 2014-01-20 | 2016-06-14 | Lenovo (Singapore) Pte. Ltd. | Image correction of surface projected image |
US20150208019A1 (en) * | 2014-01-20 | 2015-07-23 | Lenovo (Singapore) Pte. Ltd. | Image correction |
US9846529B2 (en) | 2014-02-24 | 2017-12-19 | Lenovo (Beijing) Co., Ltd. | Method for processing information and electronic device |
US9810913B2 (en) * | 2014-03-28 | 2017-11-07 | Gerard Dirk Smits | Smart head-mounted projection system |
US10061137B2 (en) | 2014-03-28 | 2018-08-28 | Gerard Dirk Smits | Smart head-mounted projection system |
US20150278992A1 (en) * | 2014-03-28 | 2015-10-01 | Gerard Dirk Smits | Smart head-mounted projection system |
US20150278172A1 (en) * | 2014-03-31 | 2015-10-01 | NIIT Technologies Ltd | Simplifying identification of potential non-visibility of user interface components when responsive web pages are rendered by disparate devices |
US10437447B1 (en) * | 2014-03-31 | 2019-10-08 | Amazon Technologies, Inc. | Magnet based physical model user interface control |
US9792267B2 (en) * | 2014-03-31 | 2017-10-17 | NIIT Technologies Ltd | Simplifying identification of potential non-visibility of user interface components when responsive web pages are rendered by disparate devices |
US9606710B1 (en) | 2014-03-31 | 2017-03-28 | Amazon Technologies, Inc. | Configuring movement-based user interface control |
US20170113441A1 (en) * | 2014-04-07 | 2017-04-27 | Sekisui Chemical Co., Ltd. | Intermediate film for laminated glass, and laminated glass |
USD882621S1 (en) | 2014-05-30 | 2020-04-28 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD892155S1 (en) | 2014-05-30 | 2020-08-04 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US9972131B2 (en) * | 2014-06-03 | 2018-05-15 | Intel Corporation | Projecting a virtual image at a physical surface |
US20150348324A1 (en) * | 2014-06-03 | 2015-12-03 | Robert L. Vaughn | Projecting a virtual image at a physical surface |
US20160004393A1 (en) * | 2014-07-01 | 2016-01-07 | Google Inc. | Wearable device user interface control |
US9377533B2 (en) | 2014-08-11 | 2016-06-28 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
US10324187B2 (en) | 2014-08-11 | 2019-06-18 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
EP2991323B1 (en) * | 2014-09-01 | 2020-04-29 | Samsung Electronics Co., Ltd. | Mobile device and method of projecting image by using the mobile device |
USD836648S1 (en) * | 2014-09-03 | 2018-12-25 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
US9860306B2 (en) | 2014-09-24 | 2018-01-02 | Microsoft Technology Licensing, Llc | Component-specific application presentation histories |
US9678640B2 (en) | 2014-09-24 | 2017-06-13 | Microsoft Technology Licensing, Llc | View management architecture |
US10025684B2 (en) | 2014-09-24 | 2018-07-17 | Microsoft Technology Licensing, Llc | Lending target device resources to host device computing environment |
US9769227B2 (en) | 2014-09-24 | 2017-09-19 | Microsoft Technology Licensing, Llc | Presentation of computing environment on multiple devices |
US10448111B2 (en) | 2014-09-24 | 2019-10-15 | Microsoft Technology Licensing, Llc | Content projection |
US10824531B2 (en) | 2014-09-24 | 2020-11-03 | Microsoft Technology Licensing, Llc | Lending target device resources to host device computing environment |
US10635296B2 (en) | 2014-09-24 | 2020-04-28 | Microsoft Technology Licensing, Llc | Partitioned application presentation across devices |
US10277649B2 (en) | 2014-09-24 | 2019-04-30 | Microsoft Technology Licensing, Llc | Presentation of computing environment on multiple devices |
US20160088060A1 (en) * | 2014-09-24 | 2016-03-24 | Microsoft Technology Licensing, Llc | Gesture navigation for secondary user interface |
US20180007104A1 (en) | 2014-09-24 | 2018-01-04 | Microsoft Corporation | Presentation of computing environment on multiple devices |
US10268277B2 (en) * | 2014-09-30 | 2019-04-23 | Hewlett-Packard Development Company, L.P. | Gesture based manipulation of three-dimensional images |
US20170249015A1 (en) * | 2014-09-30 | 2017-08-31 | Hewlett-Packard Development Company, L.P. | Gesture based manipulation of three-dimensional images |
US20160116983A1 (en) * | 2014-10-23 | 2016-04-28 | Samsung Electronics Co., Ltd. | User input method for use in portable device using virtual input area |
US9727131B2 (en) * | 2014-10-23 | 2017-08-08 | Samsung Electronics Co., Ltd. | User input method for use in portable device using virtual input area |
US20180024597A1 (en) * | 2014-12-15 | 2018-01-25 | Thomson Licensing | Method and apparatus for remotely controlling an electronic device |
US20160188195A1 (en) * | 2014-12-30 | 2016-06-30 | Innova Electronics, Inc. | Cellphone with projection capability |
USD761836S1 (en) * | 2015-01-08 | 2016-07-19 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with transitional graphical user interface |
CN104637393A (en) * | 2015-02-13 | 2015-05-20 | 广西科技大学鹿山学院 | Intelligent human-machine tellurion |
US10534502B1 (en) | 2015-02-18 | 2020-01-14 | David Graham Boyers | Methods and graphical user interfaces for positioning the cursor and selecting text on computing devices with touch-sensitive displays |
US11163422B1 (en) | 2015-02-18 | 2021-11-02 | David Graham Boyers | Methods and graphical user interfaces for positioning a selection and selecting text on computing devices with touch-sensitive displays |
US9911232B2 (en) | 2015-02-27 | 2018-03-06 | Microsoft Technology Licensing, Llc | Molding and anchoring physically constrained virtual environments to real-world environments |
US10157469B2 (en) | 2015-04-13 | 2018-12-18 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
US10043282B2 (en) | 2015-04-13 | 2018-08-07 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
US10325376B2 (en) | 2015-04-13 | 2019-06-18 | Gerard Dirk Smits | Machine vision for ego-motion, segmenting, and classifying objects |
EP3086217A1 (en) * | 2015-04-21 | 2016-10-26 | Samsung Electronics Co., Ltd. | Electronic device for displaying screen and control method thereof |
US20160313963A1 (en) * | 2015-04-21 | 2016-10-27 | Samsung Electronics Co., Ltd. | Electronic device for displaying screen and control method thereof |
US10216469B2 (en) * | 2015-04-21 | 2019-02-26 | Samsung Electronics Co., Ltd. | Electronic device for displaying screen according to user orientation and control method thereof |
US11807096B2 (en) * | 2015-04-22 | 2023-11-07 | Yazaki Corporation | Display device for vehicle |
US9898864B2 (en) | 2015-05-28 | 2018-02-20 | Microsoft Technology Licensing, Llc | Shared tactile interaction and user safety in shared space multi-person immersive virtual reality |
US9836117B2 (en) | 2015-05-28 | 2017-12-05 | Microsoft Technology Licensing, Llc | Autonomous drones for tactile feedback in immersive virtual reality |
USD789396S1 (en) | 2015-06-06 | 2017-06-13 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD877769S1 (en) | 2015-06-06 | 2020-03-10 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD765699S1 (en) | 2015-06-06 | 2016-09-06 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD888756S1 (en) | 2015-06-06 | 2020-06-30 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD863342S1 (en) | 2015-06-06 | 2019-10-15 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD789960S1 (en) | 2015-06-06 | 2017-06-20 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD783668S1 (en) | 2015-06-06 | 2017-04-11 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
USD784398S1 (en) | 2015-06-06 | 2017-04-18 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
US11776199B2 (en) | 2015-07-15 | 2023-10-03 | Fyusion, Inc. | Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations |
US11632533B2 (en) | 2015-07-15 | 2023-04-18 | Fyusion, Inc. | System and method for generating combined embedded multi-view interactive digital media representations |
US11956412B2 (en) | 2015-07-15 | 2024-04-09 | Fyusion, Inc. | Drone based capture of multi-view interactive digital media |
US11195314B2 (en) | 2015-07-15 | 2021-12-07 | Fyusion, Inc. | Artificially rendering images using viewpoint interpolation and extrapolation |
US11636637B2 (en) | 2015-07-15 | 2023-04-25 | Fyusion, Inc. | Artificially rendering images using viewpoint interpolation and extrapolation |
US11435869B2 (en) | 2015-07-15 | 2022-09-06 | Fyusion, Inc. | Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations |
USD849027S1 (en) * | 2015-08-03 | 2019-05-21 | Google Llc | Display screen with animated graphical user interface |
USD888733S1 (en) | 2015-08-03 | 2020-06-30 | Google Llc | Display screen with animated graphical user interface |
USD848458S1 (en) * | 2015-08-03 | 2019-05-14 | Google Llc | Display screen with animated graphical user interface |
US20170069255A1 (en) * | 2015-09-08 | 2017-03-09 | Microvision, Inc. | Virtual Touch Overlay On Touchscreen for Control of Secondary Display |
US11095869B2 (en) * | 2015-09-22 | 2021-08-17 | Fyusion, Inc. | System and method for generating combined embedded multi-view interactive digital media representations |
US20180255290A1 (en) * | 2015-09-22 | 2018-09-06 | Fyusion, Inc. | System and method for generating combined embedded multi-view interactive digital media representations |
US11783864B2 (en) | 2015-09-22 | 2023-10-10 | Fyusion, Inc. | Integration of audio into a multi-view interactive digital media representation |
CN105278688A (en) * | 2015-10-15 | 2016-01-27 | 联想(北京)有限公司 | Projection equipment and electronic equipment |
US10606378B2 (en) | 2015-11-20 | 2020-03-31 | Harman International Industries, Incorporated | Dynamic reconfigurable display knobs |
WO2017087872A1 (en) * | 2015-11-20 | 2017-05-26 | Harman International Industries, Incorporated | Dynamic reconfigurable display knobs |
US11714170B2 (en) | 2015-12-18 | 2023-08-01 | Samsung Semiconuctor, Inc. | Real time position sensing of objects |
US9753126B2 (en) | 2015-12-18 | 2017-09-05 | Gerard Dirk Smits | Real time position sensing of objects |
US10502815B2 (en) | 2015-12-18 | 2019-12-10 | Gerard Dirk Smits | Real time position sensing of objects |
US10274588B2 (en) | 2015-12-18 | 2019-04-30 | Gerard Dirk Smits | Real time position sensing of objects |
US20170185421A1 (en) * | 2015-12-28 | 2017-06-29 | Ssh Communications Security Oyj | User interfaces in a computer system |
US10642455B2 (en) * | 2015-12-28 | 2020-05-05 | Ssh Communications Security Oyj | User interfaces in a computer system |
US10372289B2 (en) | 2015-12-31 | 2019-08-06 | Beijing Pico Technology Co., Ltd. | Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method |
USD916815S1 (en) * | 2016-01-12 | 2021-04-20 | Google Llc | Display screen with graphical user interface for presenting user activity timeline in a colloquial style |
US10477149B2 (en) | 2016-01-20 | 2019-11-12 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US9813673B2 (en) | 2016-01-20 | 2017-11-07 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US10084990B2 (en) | 2016-01-20 | 2018-09-25 | Gerard Dirk Smits | Holographic video capture and telepresence system |
US10740869B2 (en) | 2016-03-16 | 2020-08-11 | Gopro, Inc. | Systems and methods for providing variable image projection for spherical visual content |
US9972066B1 (en) * | 2016-03-16 | 2018-05-15 | Gopro, Inc. | Systems and methods for providing variable image projection for spherical visual content |
USD885421S1 (en) * | 2016-07-01 | 2020-05-26 | Visa International Service Association | Display screen or portion thereof with animated graphical user interface |
USD884721S1 (en) * | 2016-07-01 | 2020-05-19 | Visa International Service Association | Display screen or portion thereof with animated graphical user interface |
USD917518S1 (en) * | 2016-07-21 | 2021-04-27 | Visa International Service Association | Display screen or portion thereof with animated graphical user interface |
USD847855S1 (en) | 2016-07-26 | 2019-05-07 | Google Llc | Display screen with animated graphical user interface |
USD806741S1 (en) * | 2016-07-26 | 2018-01-02 | Google Llc | Display screen with animated graphical user interface |
USD823889S1 (en) * | 2016-07-29 | 2018-07-24 | Ebay Inc. | Display screen or a portion thereof with animated graphical user interface |
USD875778S1 (en) | 2016-07-29 | 2020-02-18 | Ebay Inc. | Display screen or a portion thereof with animated graphical user interface |
USD823337S1 (en) * | 2016-07-29 | 2018-07-17 | Ebay Inc. | Display screen or a portion thereof with animated graphical user interface |
USD804521S1 (en) * | 2016-08-12 | 2017-12-05 | Facebook, Inc. | Display panel with a graphical user interface for a programmed computer system |
US11202017B2 (en) | 2016-10-06 | 2021-12-14 | Fyusion, Inc. | Live style transfer on a mobile device |
USD829743S1 (en) * | 2016-10-28 | 2018-10-02 | Spotify Ab | Display screen or portion thereof with transitional graphical user interface |
USD815130S1 (en) * | 2016-10-28 | 2018-04-10 | Spotify Ab | Display screen or portion thereof with graphical user interface |
US10810789B2 (en) * | 2016-10-28 | 2020-10-20 | Samsung Electronics Co., Ltd. | Image display apparatus, mobile device, and methods of operating the same |
US20180122130A1 (en) * | 2016-10-28 | 2018-05-03 | Samsung Electronics Co., Ltd. | Image display apparatus, mobile device, and methods of operating the same |
US10067230B2 (en) | 2016-10-31 | 2018-09-04 | Gerard Dirk Smits | Fast scanning LIDAR with dynamic voxel probing |
US10935659B2 (en) | 2016-10-31 | 2021-03-02 | Gerard Dirk Smits | Fast scanning lidar with dynamic voxel probing |
US10451737B2 (en) | 2016-10-31 | 2019-10-22 | Gerard Dirk Smits | Fast scanning with dynamic voxel probing |
USD816701S1 (en) * | 2016-12-14 | 2018-05-01 | Mercury Studio LLC | Display screen with animated graphical user interface |
USD825594S1 (en) * | 2016-12-23 | 2018-08-14 | Beijing Bytedance Network Technology Co., Ltd. | Mobile terminal display screen with a graphical user interface |
US10261183B2 (en) | 2016-12-27 | 2019-04-16 | Gerard Dirk Smits | Systems and methods for machine perception |
US11709236B2 (en) | 2016-12-27 | 2023-07-25 | Samsung Semiconductor, Inc. | Systems and methods for machine perception |
US10564284B2 (en) | 2016-12-27 | 2020-02-18 | Gerard Dirk Smits | Systems and methods for machine perception |
USD900148S1 (en) * | 2016-12-28 | 2020-10-27 | Google Llc | Computer display screen or portion thereof with animated graphical user interface |
USD835651S1 (en) * | 2016-12-28 | 2018-12-11 | Google Llc | Computer display screen or portion thereof with animated graphical user interface |
US11960533B2 (en) | 2017-01-18 | 2024-04-16 | Fyusion, Inc. | Visual search using multi-view interactive digital media representations |
USD868804S1 (en) * | 2017-01-20 | 2019-12-03 | Twitter, Inc. | Display screen with a transitional graphical user interface |
USD924913S1 (en) | 2017-01-20 | 2021-07-13 | Twitter, Inc. | Display screen with transitional graphical user interface |
USD864991S1 (en) * | 2017-03-27 | 2019-10-29 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with transitional graphical user interface |
USD866573S1 (en) * | 2017-05-03 | 2019-11-12 | Google Llc | Display screen or portion thereof with graphical user interface |
US10473921B2 (en) | 2017-05-10 | 2019-11-12 | Gerard Dirk Smits | Scan mirror systems and methods |
US11067794B2 (en) | 2017-05-10 | 2021-07-20 | Gerard Dirk Smits | Scan mirror systems and methods |
US20180349837A1 (en) * | 2017-05-19 | 2018-12-06 | Hcl Technologies Limited | System and method for inventory management within a warehouse |
US11876948B2 (en) | 2017-05-22 | 2024-01-16 | Fyusion, Inc. | Snapshots at predefined intervals or angles |
USD945451S1 (en) * | 2017-06-04 | 2022-03-08 | Apple Inc. | Display screen or portion thereof with graphical user interface |
USD914050S1 (en) | 2017-06-04 | 2021-03-23 | Apple Inc. | Display screen or portion thereof with graphical user interface |
US11776229B2 (en) | 2017-06-26 | 2023-10-03 | Fyusion, Inc. | Modification of multi-view interactive digital media representation |
US10592010B1 (en) * | 2017-06-28 | 2020-03-17 | Apple Inc. | Electronic device system with input tracking and visual output |
USD839302S1 (en) * | 2017-08-28 | 2019-01-29 | Adp, Llc | Display screen with animated graphical user interface |
USD900833S1 (en) | 2017-09-11 | 2020-11-03 | Apple Inc. | Electronic device with animated graphical user interface |
USD956088S1 (en) | 2017-09-11 | 2022-06-28 | Apple Inc. | Electronic device with animated graphical user interface |
US10591605B2 (en) | 2017-10-19 | 2020-03-17 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
US10935989B2 (en) | 2017-10-19 | 2021-03-02 | Gerard Dirk Smits | Methods and systems for navigating a vehicle including a novel fiducial marker system |
USD916814S1 (en) * | 2017-12-28 | 2021-04-20 | Facebook, Inc. | Display panel of a programmed computer system with a graphical user interface |
US10725177B2 (en) | 2018-01-29 | 2020-07-28 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US10379220B1 (en) | 2018-01-29 | 2019-08-13 | Gerard Dirk Smits | Hyper-resolved, high bandwidth scanned LIDAR systems |
US10754534B1 (en) * | 2018-02-13 | 2020-08-25 | Whatsapp Inc. | Vertical scrolling of album images |
US10895979B1 (en) | 2018-02-16 | 2021-01-19 | David Graham Boyers | Methods and user interfaces for positioning a selection, selecting, and editing, on a computing device running under a touch-based operating system, using gestures on a touchpad device |
USD924905S1 (en) * | 2018-04-13 | 2021-07-13 | Google Llc | Display screen with animated graphical user interface |
US11320983B1 (en) * | 2018-04-25 | 2022-05-03 | David Graham Boyers | Methods and graphical user interfaces for positioning a selection, selecting, and editing, on a computing device running applications under a touch-based operating system |
US11967162B2 (en) | 2018-04-26 | 2024-04-23 | Fyusion, Inc. | Method and apparatus for 3-D auto tagging |
US11488380B2 (en) | 2018-04-26 | 2022-11-01 | Fyusion, Inc. | Method and apparatus for 3-D auto tagging |
USD938455S1 (en) * | 2018-05-10 | 2021-12-14 | Express Scripts Strategic Development, Inc. | Display screen with graphical user interface |
USD989122S1 (en) | 2018-05-10 | 2023-06-13 | Express Scripts Strategic Development, Inc. | Display screen with a transitional graphical user interface |
US20190361500A1 (en) * | 2018-05-24 | 2019-11-28 | Fu Tai Hua Industry (Shenzhen) Co., Ltd. | Electronic device and method for controlling user interface therein |
US10969827B2 (en) * | 2018-05-24 | 2021-04-06 | Fu Tai Hua Industry (Shenzhen) Co., Ltd. | Electronic device and method for controlling user interface therein |
US20190369555A1 (en) * | 2018-06-04 | 2019-12-05 | International Business Machines Corporation | Holographic user interface for mobile menu item selection |
USD962269S1 (en) | 2018-06-04 | 2022-08-30 | Apple Inc. | Electronic device with animated graphical user interface |
USD877175S1 (en) | 2018-06-04 | 2020-03-03 | Apple Inc. | Electronic device with graphical user interface |
US11150746B2 (en) * | 2018-06-28 | 2021-10-19 | Google Llc | Wearable electronic devices having user interface mirroring based on device position |
USD891453S1 (en) * | 2018-09-07 | 2020-07-28 | 7hugs Labs SAS | Display screen with transitional graphical user interface |
USD999237S1 (en) | 2018-10-29 | 2023-09-19 | Apple Inc. | Electronic device with graphical user interface |
US11288733B2 (en) * | 2018-11-14 | 2022-03-29 | Mastercard International Incorporated | Interactive 3D image projection systems and methods |
USD921661S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD921659S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD921660S1 (en) * | 2018-11-26 | 2021-06-08 | Google Llc | Display screen with transitional graphical user interface |
USD974403S1 (en) | 2019-02-08 | 2023-01-03 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
USD925587S1 (en) * | 2019-02-08 | 2021-07-20 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
USD966319S1 (en) | 2019-02-08 | 2022-10-11 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
USD933699S1 (en) * | 2019-02-08 | 2021-10-19 | Wayne Fueling Systems Llc | Display screen with animated graphical user interface |
USD913306S1 (en) * | 2019-02-28 | 2021-03-16 | Amazon Technologies, Inc. | Display screen or portion thereof having a graphical user interface |
US11016643B2 (en) | 2019-04-15 | 2021-05-25 | Apple Inc. | Movement of user interface object with user-specified content |
US20220082661A1 (en) * | 2019-05-31 | 2022-03-17 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Controlling method for electronic device, and electronic device |
US11947045B2 (en) * | 2019-05-31 | 2024-04-02 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Controlling method for electronic device, and electronic device |
USD952666S1 (en) | 2019-10-02 | 2022-05-24 | Javad Abbas Sajan | Display screen or portion thereof with graphical user interface |
USD918938S1 (en) * | 2019-10-04 | 2021-05-11 | Google Llc | Display screen with animated graphical user interface |
USD1003306S1 (en) * | 2019-11-01 | 2023-10-31 | LINE Plus Corporation | Display panel with a graphical user interface |
USD954098S1 (en) * | 2019-11-18 | 2022-06-07 | Oneplus Technology (Shenzhen) Co., Ltd. | Display screen or portion thereof with animated graphical user interface |
USD1010671S1 (en) | 2020-01-27 | 2024-01-09 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
USD983225S1 (en) * | 2020-01-27 | 2023-04-11 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
USD978185S1 (en) * | 2020-01-27 | 2023-02-14 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
USD978184S1 (en) * | 2020-01-27 | 2023-02-14 | Google Llc | Display screen or portion thereof with transitional graphical user interface |
WO2021163020A1 (en) * | 2020-02-10 | 2021-08-19 | Synaptics Incorporated | Non-contact gesture commands for touch screens |
US11726653B2 (en) | 2020-02-10 | 2023-08-15 | Synaptics Incorporated | Non-contact gesture commands for touch screens |
US11256413B2 (en) | 2020-02-10 | 2022-02-22 | Synaptics Incorporated | Non-contact gesture commands for touch screens |
US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
USD997953S1 (en) * | 2020-04-17 | 2023-09-05 | Magic Leap, Inc. | Display panel with a graphical user interface |
US20240004603A1 (en) * | 2020-11-30 | 2024-01-04 | Huawei Technologies Co., Ltd. | Projection method and system |
WO2022111701A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Screen projection method and system |
US20220284838A1 (en) * | 2021-03-05 | 2022-09-08 | Seiko Epson Corporation | Display control method and non-transitory computer-readable storage medium storing program |
CN114422762A (en) * | 2021-12-25 | 2022-04-29 | 深圳市幕工坊科技有限公司 | Projection screen action control system |
Also Published As
Publication number | Publication date |
---|---|
CN102985896B (en) | 2016-06-22 |
CN102985896A (en) | 2013-03-20 |
BR112013001019A2 (en) | 2017-10-31 |
KR101601657B1 (en) | 2016-03-21 |
KR20130069730A (en) | 2013-06-26 |
EP2593848A1 (en) | 2013-05-22 |
KR20150013934A (en) | 2015-02-05 |
EP2593848B1 (en) | 2018-08-01 |
JP5689963B2 (en) | 2015-03-25 |
JP2013535724A (en) | 2013-09-12 |
WO2012009039A1 (en) | 2012-01-19 |
US9134799B2 (en) | 2015-09-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9134799B2 (en) | Interacting with a projected user interface using orientation sensors | |
KR102227087B1 (en) | Wearable glass-type device and control method of the wearable glass-type device | |
US10021297B2 (en) | Mobile terminal and control method thereof | |
US9207859B2 (en) | Method and mobile terminal for displaying fixed objects independent of shifting background images on a touchscreen | |
US10854169B2 (en) | Systems and methods for virtual displays in virtual, mixed, and augmented reality | |
US8762846B2 (en) | Method and system for adaptive viewport for a mobile device based on viewing angle | |
US8860672B2 (en) | User interface with z-axis interaction | |
KR101758164B1 (en) | Mobile twrminal and 3d multi-angle view controlling method thereof | |
EP2770724B1 (en) | Apparatus and method for positioning image area using image sensor location | |
KR101674957B1 (en) | Mobile terminal and method for controlling thereof | |
US9678574B2 (en) | Computing system utilizing three-dimensional manipulation command gestures | |
KR102251541B1 (en) | Mobile terminal and method for controlling the same | |
RU2623201C2 (en) | Mobile display device | |
KR20140133361A (en) | display apparatus and user interface screen providing method thereof | |
JP2014503927A (en) | Mobile device for displaying 3D video including a plurality of layers and display method thereof | |
JP7080711B2 (en) | Electronic devices, control methods, programs, and storage media for electronic devices | |
JP2006146440A (en) | Electronic equipment and information display selection method | |
CN115617158A (en) | Techniques for manipulating computer graphics objects | |
KR101622695B1 (en) | Mobile terminal and control method for the mobile terminal | |
CN111782053A (en) | Model editing method, device, equipment and storage medium | |
US20230013539A1 (en) | Remote landmark rendering for extended reality interfaces | |
JP2016081302A (en) | Display control apparatus, control method thereof, program, and recording medium | |
KR20100079893A (en) | Camera module of mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: QUALCOMM INCORPORATED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MARK, JOHN LIAM;REEL/FRAME:024698/0900 Effective date: 20100712 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20190915 |