CN103502910A - 激光二极管模式 - Google Patents

激光二极管模式 Download PDF

Info

Publication number
CN103502910A
CN103502910A CN201280020122.6A CN201280020122A CN103502910A CN 103502910 A CN103502910 A CN 103502910A CN 201280020122 A CN201280020122 A CN 201280020122A CN 103502910 A CN103502910 A CN 103502910A
Authority
CN
China
Prior art keywords
computing equipment
equipment
surrounding environment
laser diode
pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201280020122.6A
Other languages
English (en)
Other versions
CN103502910B (zh
Inventor
D·易
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN103502910A publication Critical patent/CN103502910A/zh
Application granted granted Critical
Publication of CN103502910B publication Critical patent/CN103502910B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means

Abstract

本发明描述了激光二极管模式技术。在一个或多个实现中，使得计算设备的一个或多个激光二极管在低于发射激光阈值的情况下操作，以照亮计算设备的物理周围环境的至少一部分。由计算设备的相机来捕捉所照亮物理周围环境的一个或多个图像，并且根据所捕捉的一个或多个图像来识别一个或多个输入以供与计算设备所显示的用户界面进行交互。

Description

激光二极管模式
背景技术
可供用户与计算设备进行交互的设备的数量正不断增长。例如，与计算设备交互最初使用文本来执行。因此，用户通常使用键盘输入文本并查看计算设备同样以文本方式的输出。
这些技术随后被发展到图形用户界面，在其中用户可与诸如鼠标等光标控制设备交互。技术继续发展，图形用户界面被配置来识别用户作出的姿势以向计算设备提供输入。例如，姿势可被用来选择对象，与视频游戏交互等等。然而，这些技术面对着由于其中使用这些技术的环境而造成的限制，这可限制识别输入的能力。因此，这些限制会制约计算设备可支持的输入的数量和类型。
发明内容
描述了激光二极管模式技术。在一个或多个实现中，使得计算设备的一个或多个激光二极管在低于发射激光阈值的情况下操作，以照亮计算设备的物理周围环境的至少一部分。由计算设备的相机来捕捉所照亮物理周围环境的一个或多个图像，并且根据所捕捉的一个或多个图像来识别一个或多个输入以供与计算设备所显示的用户界面进行交互。
在一个或多个实现中，一种由计算设备实现的方法包括按自发模式来操作一个或多个激光二极管以使用非相干光来照亮该计算设备的物理周围环境的至少一部分，以及按相干模式来操作一个或多个激光二极管以使用相干光来将图案投影到物理周围环境中，该图案可被用来确定该一个或多个激光二极管与物理周围环境中的一个或多个物体之间的距离。
在一个或多个实现中，一种装置包括相机、一个或多个激光二极管以及一个或多个模块。该一个或多个模块被配置成按第一模式操作以使得该一个或多个激光二极管在低于发射激光阈值的情况下操作来输出光来照亮相机的物理周围环境的至少一部分，并使得该相机捕捉所照亮物理周围环境的一个或多个图像。该一个或多个模块还被配置成按第二模式操作以使该一个或多个激光二极管在高于发射激光阈值的情况下操作来使得输出被安排成图案的相干光并使得相机捕捉该相干光图案在物理周围环境中的至少一个图像，以确定物理周围环境中的一个或多个物体的深度。
提供本发明内容以便以简化形式介绍将在以下具体实施方式中进一步描述的一些概念。本发明内容不旨在标识出所要求保护的主题的关键特征或必要特征，也不旨在用于帮助确定所要求保护的主题的范围。
附图说明
参考附图来描述具体实施方式。在附图中，附图标记最左边的数字标识该附图标记首次出现的附图。在说明书和附图的不同实例中使用相同的附图标记可指示相似或相同的项目。
图1是示例实现中的可用于采用本文描述的激光二极管模式技术的环境的图示。
图2示出了示例系统，它将图1激光模式模块更详细地示出为被配置成使得激光二极管按多个模式操作。
图3是示出一示例实现中的过程的流程图，其中各激光二极管按不同的模式操作以提供照明或相干光。
图4是示出一示例实现中的过程的流程图，其中从所捕捉的被在低于发射激光阈值的情况下操作的激光二极管照亮的物理环境的图像中识别各输入。
图5示出了示例系统，它示出了参考图1描述的计算设备的各个配置。
图6示出了可被实现为参考图1、2以及5描述的任何类型的便携式和/或计算机设备来实现本文描述的激光二极管模式技术的各实施例的示例设备的各个组件。
具体实施方式
概览
可以被用来与计算设备交互的输入技术已经从通常使用键盘实现的文本输入技术发展到可使用相机捕捉的姿势。例如，相机可以检测用户的方位或一个或多个身体部位，并根据检测到的方位来识别姿势。这一姿势随后可被用来与计算设备所输出的用户界面进行交互。
然而，在其中采用该计算设备的环境可极大地变化，从照明条件良好的环境（例如，办公室）到相对黑暗的环境（诸如用户在家玩视频游戏时通常采用的那些环境）。因此，因为这些环境可极大地变化，所以按成本高效的方式来配置相机以识别这些环境中的每一个内的姿势是困难的。
然而，本文描述了可被用来照亮环境以使得相机能够捕捉图像的技术，其中从这些图像中可识别姿势。例如，本发明技术可利用一个或多个激光二极管来在低于发射激光阈值的情况下操作各二极管，使得各激光二极管作为发光二极管（LED）来操作。另外，该光可被设置以使得它对人眼不可见（例如，在近红外波长处），从而最小化该光对物理环境的侵扰。相机随后可捕捉使用该光照亮的图像，从而提高使用图像来识别各姿势和其他物体的能力。
此外，这些技术可以利用可被计算设备用于其他目的的激光二极管。例如，计算设备可包括被配置成按照图案将相干（例如，激光）光投影到物理环境的激光二极管。这一图案随后可被用来通过由相机或其他传感器捕捉该图案的图像来确定物理环境中各物体的深度。在该示例中，激光二极管可被配置成支持多个模式，以通过在高于发射激光阈值的情况下操作来按深度感测模式操作并通过在低于发射激光阈值的情况下操作来按照明模式操作。以此方式，激光二极管可被用于多个目的，从而节省了计算设备的成本。对激光二极管模式的进一步讨论可联系以下章节找到。
在以下讨论中，首先描述可用于采用本文描述的激光模式技术的示例环境。随后描述本发明技术和过程的示例图示，该技术和过程可在该示例环境中以及在其他环境中采用。因此，该示例环境并不限于执行该示例技术和过程。同样，该示例技术和过程并不限于在该示例环境中的实现。
示例环境
图1是在一示例实现中的可用于采用激光模式技术的环境100的图示。所示的环境100包括可通过各种方式来配置的计算设备102的示例。例如，计算设备102可被配置为传统计算机（例如，台式个人计算机、膝上型计算机等）、移动站、娱乐设备、如图所示的通信耦合到显示设备104（例如，电视机）的游戏控制台，可被配置成显示设备（例如，电视机）的一部分、无线电话、平板、上网本等等，如关于图5进一步描述的。因而，计算设备102的范围可以是从具有充足存储器和处理器资源的全资源设备（如个人计算机、游戏控制台）到具有有限存储器和/或处理资源的低资源设备（如传统机顶盒、手持式游戏控制台）。计算设备102还可与使得计算设备102执行一个或多个操作的软件相关。
计算设备102被示为包括输入/输出模块106。输入/输出模块106表示与经由计算设备102的识别输入和/或供应输出相关的功能。例如，输入/输出模块106可被配置成从键盘、鼠标接收输入以标识姿势并且使得对应于姿势的操作得以执行，等等。输入可由输入/输出模块106以各种不同的方式来检测。
输入/输出模块106可被配置成经由与硬件设备（如所示出的控制器108）的触摸交互来接收一个或多个输入。触摸交互可涉及按下按钮、移动操纵杆、跨跟踪垫的移动、使用显示设备104的触摸屏（例如，检测用户的手的手指或指示笔），等等。输入/输出模块106可以利用对触摸输入的识别来与由计算设备102输出的用户界面进行交互，以与游戏、应用进行交互、浏览因特网、改变计算设备102的一个或多个设置，等等。也构想了涉及与设备的触摸交互的各种其他硬件设备。这样的硬件设备的示例包括光标控制设备（例如，鼠标）、遥控器（例如，电视遥控器）、移动通信设备（例如，被配置成控制计算设备102的一个或多个操作的无线电话）、以及涉及在用户或物体一方上的触摸的其他设备。
输入/输出模块106也可被配置成提供可识别可能不涉及触摸的交互的自然用户界面（NUI）。例如，计算设备102可包括NUI输入设备110。NUI输入设备110可按各种方式来配置以便检测输入而无需用户触摸特定设备，诸如通过使用话筒来识别音频输入。例如，输入/输出模块106可被配置成执行语音识别以识别特定话语（例如，口述命令），以及识别提供该话语的特定用户。
在另一示例中，NUI输入设备110可被配置成通过使用相机来识别姿势、所呈现的对象、图像，等等。例如，相机可被配置成包括多个镜头，使得各不同的观察点可被捕捉且由此确定深度。例如，不同的观察点可被用来确定距NUI输入设备110的相对距离并且因而可被用来确定该相对距离的改变。各不同的观察点可被计算设备102用作深度感知。这些图像还可被输入/输出模块106用来提供各种其他功能，如标识特定用户（例如通过面部识别）、对象等的技术。
输入-输出模块106可利用NUI输入设备110来执行沿着对人体的诸个特定点的特征提取（例如，48个骨架点）的骨架映射，以跟踪一个或多个用户（例如，同时跟踪4个用户）来进行运动分析。例如，NUI输入设备110可捕捉由输入/输出模块106分析的图像，来识别用户作出的一个或多个运动，包括使用了什么身体部分来作出该运动以及哪一用户作出该运动。通过识别用户的手112的一个或多个手指的定位和移动和/或识别用户的手112整体的移动来示出了一示例。运动可被输入/输出模块106标识为启动对应的操作的姿势。
各种不同类型的姿势可被识别，诸如从单个类型的输入识别的姿势（例如，运动姿势）以及包括多个类型的输入的姿势，例如运动姿势和使用诸如指示笔等物体作出的物体姿势。因而，输入/输出模块106可通过识别和利用输入之间的分界来支持各种不同的姿势技术。应当注意，通过在自然用户界面（NUI）的输入之间进行区分，通过这些姿势中的单独每一个而变得可能的姿势的数量也增加。例如，尽管移动可能是相同的，但可使用不同类型的输入来指示不同的姿势（或对于类似命令的不同参数）。因而，输入/输出模块106可提供自然用户界面，该自然用户界面支持不涉及触摸的各种用户交互。
因此，尽管以下讨论描述了输入的示例，但是在各实例中，不同类型的输入也可被使用而不背离本发明的精神和范围。此外，尽管在以下讨论中的实例中姿势被示为使用NUI来输入，但姿势可由各种不同的设备使用各种不同的技术来输入，比如采用平板计算机的触摸屏功能。
计算设备102还被示为包括表示用于操作激光二极管116的功能的激光模式模块114。例如，激光二极管116可由NUI输入设备110用来使用相干光将图案进行投影。这一图案110随后可由输入/输出模块106用来感测计算设备102所处的物理环境中的深度。深度感测例如可被用来确定姿势、房间中物体的位置，等等。
激光模式模块106还可通过在低于发射激光阈值的情况下操作激光二极管116来操作激光二极管116以用于照明目的。该照明可被用来帮助捕捉图像，该图像可被输入/输出模块106更好地用来标识姿势、物体等等，其进一步讨论将相关于图2找到。
一般而言，此处描述的任何功能可使用软件、固件、硬件（例如，固定逻辑电路）、或这些实现的组合来实现。本文使用的术语“模块”、“功能”和“逻辑”一般表示软件、固件、硬件或其组合。在软件实现的情况下，模块、功能或逻辑表示当在处理器（例如，一个或多个CPU）上执行时执行指定任务的程序代码。程序代码可被储存在一个或多个计算机可读存储器设备中。以下描述的激光模式技术的各特征是平台无关的，从而意味着这些技术可在具有各种处理器的各种商用计算平台上实现。
例如，计算设备102还可包括使得计算设备102的硬件执行操作的实体（例如软件），例如处理器、功能块，等。例如，计算设备102可包括计算机可读介质，其被配置用于维护使得计算设备尤其是计算设备102的硬件执行操作的指令。因此，指令用于配置硬件来执行操作，并以此方式致使硬件变换以执行功能。可由计算机可读介质通过各种不同配置将指令提供给计算设备102。
一种这样的计算机可读介质配置是信号承载介质，并因此被配置来将指令（例如，作为载波），例如通过网络，传送到计算设备的硬件。计算机可读介质还可被配置为计算机可读存储介质，因此不是信号承载介质。计算机可读存储介质的示例包括，随机存取存储器（RAM）、只读存储器（ROM）、光盘、闪存、硬盘存储器，和其他可使用磁、光以及用于存储指令和其他数据的其他技术的存储设备。
图2示出了一示例实现中的系统200，其中更详细地示出了图1的激光模式模块114。在该示例中，计算设备102包括结合图1描述的激光模式模块114和激光二极管116以及相机202。
激光模式模块114被示为支持相干模式204和自发模式206以用于控制激光二极管116。在相干模式204中，激光模式模块114被配置成在高于发射激光阈值的情况下操作激光二极管116。这使得激光二极管116输出相干光。这一相干光可被用于各种目的，如将图案（例如，由一系列点所形成的网格）投影到围绕计算设备102的物理环境中。这一图案可被计算设备102用来感测物理环境中包括的物体的深度，例如以确定激光二极管116与这些物体之间的距离。
在自发模式206中，激光模式模块114使得在低于发射激光阈值的情况下操作激光二极管116。这使得激光二极管116输出非相干光。因而，在这一模式中，激光二极管116担当发光二极管116以输出可被用来照亮计算设备102的物理周围环境的至少一部分的光。该光也可被用于各种目的。例如，自发模式206可使得激光二极管116将人眼不可见的光（例如，近红外光）输出到物理环境。在该示例中，相机202可被配置成捕捉与激光二极管116所输出的波长相对应的波长（例如人眼不可见的光）处的图像。以此方式，计算设备102的物理周围环境不会看起来受激光二极管116的照明输出的影响，并且因而环境可看起来保持相对黑暗而相机202仍能够捕捉适用于识别姿势、物理周围环境中的物体等等的图像。
因而，这些技术可利用使用相干（例如，激光）光将已知参考图案投影到物理周围环境中的结构化光深度相机系统来也照亮周围环境以捕捉图像。例如，激光模式模块114可以频繁地在各模式之间切换，以使得计算设备102不采用附加的激光二极管或补充照明。激光模式模块114可以用各种方式来造成激光二极管116的相干模式204和自发模式206，如通过改变提供给激光二极管116的操作电流。还构想了各种其他示例，其进一步讨论可相关于以下章节找到。
示例过程
以下讨论描述了可利用上述系统和设备来实现的激光模式技术。这些过程中每一过程的各方面可用硬件、固件、软件、或其组合来实现。过程被示为一组框，它们指定由一个或多个设备执行的操作，不一定仅限于所示出的用于由相应的框执行操作的顺序。在以下讨论的部分中将参考图1的环境100和图2的系统200。
图3示出了一示例实现中的过程300，其中各激光二极管按不同的模式操作以提供照明或相干光。使得一个或多个激光二极管按自发模式操作以使用非相干光照亮计算设备的物理周围环境的至少一部分（框302）。例如，激光模式模块114可以使得操作电流被提供给激光二极管116，该操作电流使得激光二极管116在低于发射激光阈值的情况下操作。因此，激光二极管116作为发光二极管（LED）来操作。在按此模式操作时，激光二极管116可输出各种波长的光，包括可见光、人眼不可见的光（例如，近红外光）等等。
还使得一个或多个激光二极管按相干模式操作以使用相干光将图案投影到物理周围环境中，该图案可用于确定该一个或多个激光二极管与物理周围环境中的一个或多个物体之间的距离（框304）。继续先前示例，激光模式模块114可以使得操作电流被提供给激光二极管116，该操作电流足以使得激光二极管116在高于发射激光阈值的情况下操作。这使得激光二极管116输出相干光，如上所述，这可被用于各种目的。
例如，相干光可被用来投影参考图案，该参考图案可被用来检测物理周围环境的各部分距计算设备102的深度。输入/输出模块106可以检查相机202所拍摄的参考图案的图像并根据参考图案的变形（例如，该图案的各部分的展开）来确定物理环境的各部分的深度。以此方式，激光二极管116可被用于多个目的，从而节省了计算设备102的制造和使用成本。还构想了各种其他示例，其进一步讨论可参考以下附图找到。
图4示出了一示例实现中的过程400，其中从所捕捉的被在低于发射激光阈值的情况下操作的激光二极管照亮的物理环境的图像中识别各输入。使得计算设备的一个或多个激光二极管在低于发射激光阈值的情况下操作，以照亮计算设备的物理周围环境的至少一部分（框402）。如上所述，激光模式模块114可使得激光二极管116担当发光二极管以照亮周围环境，如通过输出人眼不可见的近红外光。
由计算设备的相机捕捉被照亮物理周围环境的一个或多个图像（框404）。相机202例如可被配置成捕捉与激光二极管116按自发模式206操作时所输出的辐射波长相对应的辐射波长的图像。
从所捕捉的一个或多个图像中识别一个或多个输入，该输入用于与计算设备所显示的用户界面进行交互（框406）。输入/输出模块106可以处理该图像以从这些图像中识别各姿势。例如，各姿势可涉及用户的一个或多个身体部位的方位、一个或多个物体、物体的移动，等等。所识别的姿势随后可被用来使得计算设备102执行各操作，如涉及与由计算设备102输出以供显示设备显示的用户界面的交互的操作。
使得计算设备的一个或多个激光二极管在高于发射激光阈值的情况下操作（框408）。如上所述，这一操作可以使得激光二极管116输出可被用于各种目的的相干光。例如，可以通过相机所拍摄的至少一个图像来确定物理周围环境中的一个或多个物体的深度（框410）。如上所述也可构想各种其他的示例。
示例系统和设备
图5示出了包括参考图1描述的计算设备102的示例系统500。示例系统500实现了用于当在个人计算机（PC）、电视机设备和/或移动设备上运行应用时的无缝用户体验的普遍存在的环境。服务和应用在所有三个环境中基本相似地运行，以便当使用应用、玩视频游戏、看视频等时在从一个设备转换到下一设备时得到共同的用户体验。
在示例系统500中，多个设备通过中央计算设备互联。中央计算设备可以是多个设备本地的，或者可以位于多个设备的远程。在一个实施例中，中央计算设备可以是通过网络、因特网或其他数据通信链路连接到多个设备的一个或多个服务器计算机的云。在一个实施例中，该互联架构使得功能能够跨多个设备递送以向多个设备的用户提供共同且无缝的体验。多个设备的每一个可具有不同的物理要求和能力，且中央计算设备使用一平台来使得为设备特制且又对所有设备共同的体验能被递送到设备。在一个实施例中，创建目标设备的类，且使体验适应于设备的通用类。设备类可由设备的物理特征、用途类型、或其他共同特性来定义。
在各种实现中，计算设备102可采取各种不同的配置，诸如用于计算机502、移动设备504、和电视机506用途。这些配置中的每一个包括可具有一般不同的构造和能力的设备，并且因而计算设备102可根据不同的设备类中的一个或多个来配置。例如，计算设备102可被实现为计算机类502设备，该计算机设备类包括个人计算机、台式计算机、多屏幕计算机、膝上型计算机、上网本等。
计算设备102还可被实现为移动类502设备，该移动类设备包括诸如移动电话、便携式音乐播放器、便携式游戏设备、平板计算机、多屏幕计算机等移动设备。计算设备102还可被实现为电视机类506设备，该电视机类设备包括在休闲观看环境中具有或连接到一般更大的屏幕的设备。这些设备包括电视机、机顶盒、游戏控制台等。本文所描述的技术可由计算设备102的这些各种配置来支持，且不限于在本文描述的各具体示例。
云508包括和/或表示内容服务512的平台510。平台510抽象云508的硬件（如，服务器）和软件资源的底层功能。内容服务512可包括可在计算机处理在位于计算设备102远程的服务器上执行时使用的应用程序和/或数据。内容服务512可作为因特网上和/或通过诸如蜂窝或Wi-Fi网络之类的订户网络上的服务来提供。
平台510可抽象资源和功能以将计算设备102与其他计算设备相连接。平台510还可用于抽象资源的缩放以向经由平台510实现的内容服务512所遇到的需求提供对应的缩放级别。因此，在互联设备的实施例中，本文描述的功能的实现可分布在系统500上。例如，该功能可部分地在计算设备102上以及经由抽象云508的功能的平台510来实现。
图6示出了可被实现成参考图1、2和5所描述的用于实现本文描述的各实施例的任何类型的计算设备的示例设备600的各组件。设备600包括允许设备数据604（例如，接收到的数据、正被接收的数据、安排用于广播的数据、数据的数据包等）的有线和/或无线通信的通信设备602。设备数据604或其他设备内容可以包括设备的配置设置、存储在设备上的媒体内容、和/或与设备的用户相关联的信息。存储在设备600上的媒体内容可以包括任何类型的音频、视频和/或图像数据。设备600包括一个或多个数据输入606，经由数据输入可接收任何类型的数据、媒体内容、和/或输入，诸如用户可选输入、消息、音乐、电视媒体内容、记录的视频内容、以及从任何内容源和/或数据源接收的任何其他类型的音频、视频和/或图像数据。
设备600还包括通信接口608，该通信接口可被实现为串行和/或并行接口、无线接口、任何类型的网络接口、调制解调器、以及任何其他类型的通信接口中的任何一个或多个。通信接口608提供设备600和通信网络之间的连接和/或通信链路，其他电子、计算和通信设备通过所述连接和/或通信链路来与设备600传递数据。
设备600包括一个或多个处理器610（如，微处理器、控制器等中的任一个），该处理器处理各种计算机可执行指令来控制设备600的操作并实现此处描述的技术的各实施例。作为补充或替换，设备600可被实现为具有与在612处概括标识的处理和控制电路有关地实现的硬件、固件、或固定逻辑电路中的任何一个或组合。虽然未示出，但是设备600可包括耦合设备内的各种组件的系统总线或数据传输系统。系统总线可包括不同总线结构中的任一个或组合，诸如存储器总线或存储器控制器、外围总线、通用串行总线、和/或利用各种总线架构中的任一种的处理器或局部总线。
设备600还包括计算机可读介质614，诸如一个或多个存储器组件，存储器组件的示例包括随机存取存储器（RAM）、非易失性存储器（例如，只读存储器（ROM）、闪存、EPROM、EEPROM等中的任一个或多个）、以及盘存储设备。盘存储设备可被实现为任何类型的磁性或光学存储设备，如硬盘驱动器、可记录和/或可重写紧致盘（CD）、任何类型的数字多功能盘（DVD）等等。设备600还可包括大容量存储介质设备616。
计算机可读介质614提供数据存储机制以存储设备数据604，以及各种设备应用618和与设备600的各操作方面相关的任何其他类型的信息和/或数据。例如，操作系统620可以用计算机可读介质614作为计算机应用来维护并且在处理器610上执行。设备应用618可包括设备管理器（例如，控制应用、软件应用、信号处理和控制模块、特定设备本机的代码、特定设备的硬件抽象层等）。设备应用618还包括实现本文描述的姿势技术的实施例的任何系统组件或模块。在该示例中，设备应用618包括被示为软件模块和/或计算机应用程序的接口应用622和输入/输出模块624（其可与输入/输出模块114相同或不同）。输入/输出模块624表示用于给接口提供被配置成捕捉输入的诸如触摸屏、跟踪垫、相机、话筒等设备的软件。另选地或另外地，接口应用程序622和输入/输出模块624可被实现为硬件、软件、固件、或其任何组合。此外，输入/输出模块624可被配置成支持多个输入设备，诸如分别捕捉视觉和音频输入的单独设备。
设备600还包括向音频系统628提供音频数据和/或向显示系统630提供视频数据的音频和/或视频输入-输出系统626。音频系统628和/或显示系统630可包括处理、显示、和/或以其他方式呈现音频、视频和图像数据的任何设备。视频信号和音频信号可以通过RF（射频）链路、S-video（S-视频）链路、复合视频链路、分量视频链路、DVI（数字视频接口）、模拟音频连接，或其它类似的通信链路，从设备600传递到音频设备和/或显示设备。在一实施例中，音频系统628和/或显示系统630被实现为设备600的外部组件。或者，音频系统628和/或显示系统630被实现为示例设备600的集成组件。
结语
虽然已经用对结构特征和/或方法动作专用的语言描述了本发明，但是应该理解，在所附权利要求中定义的本发明不必限于所述的具体特征或动作。相反，这些具体特征和动作是作为实现所要求保护的本发明的示例形式而公开的。

Claims (10)

1.一种方法，包括：
使得计算设备的一个或多个激光二极管在低于发射激光阈值的情况下操作，以照亮所述计算设备的物理周围环境的至少一部分；
由所述计算设备的相机捕捉被照亮物理周围环境的一个或多个图像；以及
从所捕捉的一个或多个图像中识别一个或多个输入以用于与所述计算设备所显示的用户界面进行交互。
2.如权利要求1所述的方法，其特征在于，所述使得分别使所述一个或多个激光二极管作为一个或多个发光二极管来操作。
3.如权利要求1所述的方法，其特征在于，所述使得一个或多个激光二极管在低于发射激光阈值的情况下操作使所述一个或多个激光二极管提供人眼不可见的照明。
4.如权利要求1所述的方法，其特征在于，所述使得一个或多个激光二极管在低于发射激光阈值的情况下操作使所述一个或多个激光二极管提供近红外照明。
5.如权利要求1所述的方法，其特征在于，所述捕捉被照亮物理周围环境的一个或多个图像是针对非深度成像来执行的。
6.如权利要求1所述的方法，其特征在于，所述识别一个或多个输入包括标识对所述计算设备的物理周围环境所作的改变。
7.如权利要求1所述的方法，其特征在于，所述识别一个或多个输入包括标识使用一个或多个人体部位所作的姿势。
8.如权利要求1所述的方法，其特征在于，还包括使得所述计算设备的一个或多个激光二极管在高于所述发射激光阈值的情况下操作。
9.如权利要求8所述的方法，其特征在于，所述使得一个或多个激光二极管在高于所述发射激光阈值的情况下操作使所述一个或多个激光二极管输出用于将图案投影到所述物理周围环境中的相干光。
10.一种由计算设备实现的方法，所述方法包括：
按自发模式操作一个或多个激光二极管以使用非相干光照亮所述计算设备的物理周围环境的至少一部分；以及
按相干模式操作一个或多个激光二极管以使用相干光将图案投影到所述物理周围环境中，所述图案能用于确定所述一个或多个激光二极管与所述物理周围环境中的一个或多个物体之间的距离。
CN201280020122.6A 2011-04-25 2012-04-23 用于操作激光二极管的方法 Active CN103502910B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/093,621 US8620113B2 (en) 2011-04-25 2011-04-25 Laser diode modes
US13/093,621 2011-04-25
PCT/US2012/034641 WO2012148844A2 (en) 2011-04-25 2012-04-23 Laser diode modes

Publications (2)

Publication Number Publication Date
CN103502910A true CN103502910A (zh) 2014-01-08
CN103502910B CN103502910B (zh) 2017-03-01

Family

ID=47020912

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280020122.6A Active CN103502910B (zh) 2011-04-25 2012-04-23 用于操作激光二极管的方法

Country Status (8)

Country Link
US (1) US8620113B2 (zh)
EP (1) EP2702464B1 (zh)
JP (1) JP5976787B2 (zh)
KR (1) KR102007445B1 (zh)
CN (1) CN103502910B (zh)
AR (1) AR086175A1 (zh)
TW (1) TWI552791B (zh)
WO (1) WO2012148844A2 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8869073B2 (en) * 2011-07-28 2014-10-21 Hewlett-Packard Development Company, L.P. Hand pose interaction
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US8898687B2 (en) 2012-04-04 2014-11-25 Microsoft Corporation Controlling a media program based on a media reaction
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program
USD767590S1 (en) * 2013-12-30 2016-09-27 Nikolai Joukov Display screen or portion thereof with graphical user interface for displaying software cells

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5175641A (en) * 1991-04-05 1992-12-29 International Business Machines Corporation Dual-mode laser diode transmitter
CN1708764A (zh) * 2000-05-29 2005-12-14 Vkb有限公司 输入字母数字及其他数据的虚拟数据输入设备与方法
US20080018591A1 (en) * 2006-07-20 2008-01-24 Arkady Pittel User Interfacing
WO2009099296A2 (en) * 2008-02-05 2009-08-13 Lg Electronics Inc. Virtual optical input device for providing various types of interfaces and method of controlling the same
US20110013024A1 (en) * 1999-05-11 2011-01-20 Pryor Timothy R Camera based interaction and instruction

Family Cites Families (406)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4288078A (en) 1979-11-20 1981-09-08 Lugo Julio I Game apparatus
US7831204B1 (en) 1981-11-03 2010-11-09 Personalized Media Communications, Llc Signal processing apparatus and methods
JPS58225745A (ja) * 1982-06-24 1983-12-27 Fujitsu Ltd 半導体レ−ザ送信回路
US4695953A (en) 1983-08-25 1987-09-22 Blair Preston E TV animation interactively controlled by the viewer
US4630910A (en) 1984-02-16 1986-12-23 Robotic Vision Systems, Inc. Method of measuring in three-dimensions at high speed
US4627620A (en) 1984-12-26 1986-12-09 Yang John P Electronic athlete trainer for improving skills in reflex, speed and accuracy
US4645458A (en) 1985-04-15 1987-02-24 Harald Phillip Athletic evaluation and training apparatus
US4702475A (en) 1985-08-16 1987-10-27 Innovating Training Products, Inc. Sports technique and reaction training system
US4843568A (en) 1986-04-11 1989-06-27 Krueger Myron W Real time perception of and response to the actions of an unencumbered participant/user
US4711543A (en) 1986-04-14 1987-12-08 Blair Preston E TV animation interactively controlled by the viewer
US4796997A (en) 1986-05-27 1989-01-10 Synthetic Vision Systems, Inc. Method and system for high-speed, 3-D imaging of an object at a vision station
US5184295A (en) 1986-05-30 1993-02-02 Mann Ralph V System and method for teaching physical skills
US4751642A (en) 1986-08-29 1988-06-14 Silva John M Interactive sports simulation system with physiological sensing and psychological conditioning
US4809065A (en) 1986-12-01 1989-02-28 Kabushiki Kaisha Toshiba Interactive system and related method for displaying data to produce a three-dimensional image of an object
US4817950A (en) 1987-05-08 1989-04-04 Goo Paul E Video game control unit and attitude sensor
US5239464A (en) 1988-08-04 1993-08-24 Blair Preston E Interactive video system providing repeated switching of multiple tracks of actions sequences
US5239463A (en) 1988-08-04 1993-08-24 Blair Preston E Method and apparatus for player interaction with animated characters and objects
US4901362A (en) 1988-08-08 1990-02-13 Raytheon Company Method of recognizing patterns
US4893183A (en) 1988-08-11 1990-01-09 Carnegie-Mellon University Robotic vision system
US4931865A (en) 1988-08-24 1990-06-05 Sebastiano Scarampi Apparatus and methods for monitoring television viewers
JPH02199526A (ja) 1988-10-14 1990-08-07 David G Capper 制御インターフェース装置
US4925189A (en) 1989-01-13 1990-05-15 Braeunig Thomas F Body-mounted video game exercise device
US5229756A (en) 1989-02-07 1993-07-20 Yamaha Corporation Image control apparatus
US5469740A (en) 1989-07-14 1995-11-28 Impulse Technology, Inc. Interactive video testing and training system
JPH03103822U (zh) 1990-02-13 1991-10-29
US5101444A (en) 1990-05-18 1992-03-31 Panacea, Inc. Method and apparatus for high speed object location
US5148154A (en) 1990-12-04 1992-09-15 Sony Corporation Of America Multi-dimensional user interface
US5534917A (en) 1991-05-09 1996-07-09 Very Vivid, Inc. Video image based control system
US5417210A (en) 1992-05-27 1995-05-23 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US5295491A (en) 1991-09-26 1994-03-22 Sam Technology, Inc. Non-invasive human neurocognitive performance capability testing method and system
US6054991A (en) 1991-12-02 2000-04-25 Texas Instruments Incorporated Method of modeling player position and movement in a virtual reality system
US5875108A (en) 1991-12-23 1999-02-23 Hoffberg; Steven M. Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
JPH07325934A (ja) 1992-07-10 1995-12-12 Walt Disney Co:The 仮想世界に向上したグラフィックスを提供する方法および装置
US5999908A (en) 1992-08-06 1999-12-07 Abelow; Daniel H. Customer-based product design module
JP3244798B2 (ja) 1992-09-08 2002-01-07 株式会社東芝 動画像処理装置
US5320538A (en) 1992-09-23 1994-06-14 Hughes Training, Inc. Interactive aircraft training system and method
IT1257294B (it) 1992-11-20 1996-01-12 Dispositivo atto a rilevare la configurazione di un'unita' fisiologicadistale,da utilizzarsi in particolare come interfaccia avanzata per macchine e calcolatori.
US5495576A (en) 1993-01-11 1996-02-27 Ritchey; Kurtis J. Panoramic image based virtual reality/telepresence audio-visual system and method
US5690582A (en) 1993-02-02 1997-11-25 Tectrix Fitness Equipment, Inc. Interactive exercise apparatus
JP2799126B2 (ja) 1993-03-26 1998-09-17 株式会社ナムコ ビデオゲーム装置及びゲーム用入力装置
US5405152A (en) 1993-06-08 1995-04-11 The Walt Disney Company Method and apparatus for an interactive video game with physical feedback
US5454043A (en) 1993-07-30 1995-09-26 Mitsubishi Electric Research Laboratories, Inc. Dynamic and static hand gesture recognition through low-level image analysis
US5423554A (en) 1993-09-24 1995-06-13 Metamedia Ventures, Inc. Virtual reality game method and apparatus
US5980256A (en) 1993-10-29 1999-11-09 Carmein; David E. E. Virtual reality system with enhanced sensory apparatus
JP3419050B2 (ja) 1993-11-19 2003-06-23 株式会社日立製作所 入力装置
US5347306A (en) 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
JP2552427B2 (ja) 1993-12-28 1996-11-13 コナミ株式会社 テレビ遊戯システム
US5577981A (en) 1994-01-19 1996-11-26 Jarvik; Robert Virtual reality exercise machine and computer controlled video system
US5580249A (en) 1994-02-14 1996-12-03 Sarcos Group Apparatus for simulating mobility of a human
US5597309A (en) 1994-03-28 1997-01-28 Riess; Thomas Method and apparatus for treatment of gait problems associated with parkinson's disease
US5385519A (en) 1994-04-19 1995-01-31 Hsu; Chi-Hsueh Running machine
US5528263A (en) 1994-06-15 1996-06-18 Daniel M. Platzker Interactive projected video image display system
US5524637A (en) 1994-06-29 1996-06-11 Erickson; Jon W. Interactive system for measuring physiological exertion
US5563988A (en) 1994-08-01 1996-10-08 Massachusetts Institute Of Technology Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment
JPH0863326A (ja) 1994-08-22 1996-03-08 Hitachi Ltd 画像処理装置及び方法
US6714665B1 (en) 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
US5516105A (en) 1994-10-06 1996-05-14 Exergame, Inc. Acceleration activated joystick
JP3270264B2 (ja) 1994-10-19 2002-04-02 富士写真フイルム株式会社 放射線像変換パネルおよびその製造法
US5638300A (en) 1994-12-05 1997-06-10 Johnson; Lee E. Golf swing analysis system
JPH08161292A (ja) 1994-12-09 1996-06-21 Matsushita Electric Ind Co Ltd 混雑度検知方法およびそのシステム
US5594469A (en) 1995-02-21 1997-01-14 Mitsubishi Electric Information Technology Center America Inc. Hand gesture machine control system
US5682229A (en) 1995-04-14 1997-10-28 Schwartz Electro-Optics, Inc. Laser range camera
DE19516664C1 (de) 1995-05-05 1996-08-29 Siemens Ag Verfahren zum Aufbau einer Farbtabelle in einer Computereinheit zur Klassifikation von Bildpunkten in einem Bild
US5913727A (en) 1995-06-02 1999-06-22 Ahdoot; Ned Interactive movement and contact simulation game
JP3481631B2 (ja) 1995-06-07 2003-12-22 ザ トラスティース オブ コロンビア ユニヴァーシティー イン ザ シティー オブ ニューヨーク 能動型照明及びデフォーカスに起因する画像中の相対的なぼけを用いる物体の３次元形状を決定する装置及び方法
US5682196A (en) 1995-06-22 1997-10-28 Actv, Inc. Three-dimensional (3D) video presentation system providing interactive 3D presentation with personalized audio responses for multiple viewers
IL114278A (en) 1995-06-22 2010-06-16 Microsoft Internat Holdings B Camera and method
CN100524015C (zh) 1995-06-22 2009-08-05 3Dv系统有限公司 生成距景物距离的图象的方法和装置
US7895076B2 (en) 1995-06-30 2011-02-22 Sony Computer Entertainment Inc. Advertisement insertion, profiling, impression, and feedback
US5702323A (en) 1995-07-26 1997-12-30 Poulton; Craig K. Electronic exercise enhancer
JPH0981309A (ja) 1995-09-13 1997-03-28 Toshiba Corp 入力装置
US6308565B1 (en) 1995-11-06 2001-10-30 Impulse Technology Ltd. System and method for tracking and assessing movement skills in multidimensional space
US6098458A (en) 1995-11-06 2000-08-08 Impulse Technology, Ltd. Testing and training system for assessing movement and agility skills without a confining field
US6073489A (en) 1995-11-06 2000-06-13 French; Barry J. Testing and training system for assessing the ability of a player to complete a task
US6430997B1 (en) 1995-11-06 2002-08-13 Trazer Technologies, Inc. System and method for tracking and assessing movement skills in multidimensional space
US6176782B1 (en) 1997-12-22 2001-01-23 Philips Electronics North America Corp. Motion-based command generation technology
US5933125A (en) 1995-11-27 1999-08-03 Cae Electronics, Ltd. Method and apparatus for reducing instability in the display of a virtual environment
US5641288A (en) 1996-01-11 1997-06-24 Zaenglein, Jr.; William G. Shooting simulating process and training device using a virtual reality display screen
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
JP2000510013A (ja) 1996-05-08 2000-08-08 リアル ヴィジョン コーポレイション 位置検出を用いたリアルタイムシミュレーション
US6173066B1 (en) 1996-05-21 2001-01-09 Cybernet Systems Corporation Pose determination and tracking by matching 3D objects to a 2D sensor
US6002808A (en) 1996-07-26 1999-12-14 Mitsubishi Electric Information Technology Center America, Inc. Hand gesture control system
US5989157A (en) 1996-08-06 1999-11-23 Walton; Charles A. Exercising system with electronic inertial game playing
JP2001504605A (ja) 1996-08-14 2001-04-03 ラティポフ，ヌラフメド，ヌリスラモビチ 空間内のユーザの位置及び方向性を追跡及び表示するための方法、ユーザに対し仮想環境を提示するための方法及びこれらの方法を実現するためのシステム
JP3064928B2 (ja) 1996-09-20 2000-07-12 日本電気株式会社 被写体抽出方式
US20020120925A1 (en) 2000-03-28 2002-08-29 Logan James D. Audio and video program recording, editing and playback systems using metadata
DE69626208T2 (de) 1996-12-20 2003-11-13 Hitachi Europ Ltd Verfahren und System zur Erkennung von Handgesten
US5904484A (en) 1996-12-23 1999-05-18 Burns; Dave Interactive motion training device and method
US6009210A (en) 1997-03-05 1999-12-28 Digital Equipment Corporation Hands-free interface to a virtual reality environment using head tracking
US6100896A (en) 1997-03-24 2000-08-08 Mitsubishi Electric Information Technology Center America, Inc. System for designing graphical multi-participant environments
US5877803A (en) 1997-04-07 1999-03-02 Tritech Mircoelectronics International, Ltd. 3-D image detector
US6215898B1 (en) 1997-04-15 2001-04-10 Interval Research Corporation Data processing system and method
US6075895A (en) 1997-06-20 2000-06-13 Holoplex Methods and apparatus for gesture recognition based on templates
JP3077745B2 (ja) 1997-07-31 2000-08-14 日本電気株式会社 データ処理方法および装置、情報記憶媒体
US6188777B1 (en) 1997-08-01 2001-02-13 Interval Research Corporation Method and apparatus for personnel detection and tracking
US6289112B1 (en) 1997-08-22 2001-09-11 International Business Machines Corporation System and method for determining block direction in fingerprint images
US6720949B1 (en) 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
US6750848B1 (en) 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
AUPO894497A0 (en) 1997-09-02 1997-09-25 Xenotech Research Pty Ltd Image processing method and apparatus
EP0905644A3 (en) 1997-09-26 2004-02-25 Matsushita Electric Industrial Co., Ltd. Hand gesture recognizing device
US6141463A (en) 1997-10-10 2000-10-31 Electric Planet Interactive Method and system for estimating jointed-figure configurations
US6101289A (en) 1997-10-15 2000-08-08 Electric Planet, Inc. Method and apparatus for unencumbered capture of an object
AU9808298A (en) 1997-10-15 1999-05-03 Electric Planet, Inc. A system and method for generating an animatable character
AU1099899A (en) 1997-10-15 1999-05-03 Electric Planet, Inc. Method and apparatus for performing a clean background subtraction
US6130677A (en) 1997-10-15 2000-10-10 Electric Planet, Inc. Interactive computer vision system
US6072494A (en) 1997-10-15 2000-06-06 Electric Planet, Inc. Method and apparatus for real-time gesture recognition
US6181343B1 (en) 1997-12-23 2001-01-30 Philips Electronics North America Corp. System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs
EP1040366B1 (de) * 1997-12-23 2003-10-08 Siemens Aktiengesellschaft Verfahren und vorrichtung zur aufnahme eines dreidimensionalen abstandsbildes
US7196720B2 (en) 1998-03-06 2007-03-27 Intel Corporation Method and apparatus for powering on an electronic device with a video camera that detects motion
US6159100A (en) 1998-04-23 2000-12-12 Smith; Michael D. Virtual reality game
US6421453B1 (en) 1998-05-15 2002-07-16 International Business Machines Corporation Apparatus and methods for user recognition employing behavioral passwords
US6181472B1 (en) * 1998-06-10 2001-01-30 Robotic Vision Systems, Inc. Method and system for imaging an object with a plurality of optical beams
US6077201A (en) 1998-06-12 2000-06-20 Cheng; Chau-Yang Exercise bicycle
US6141010A (en) 1998-07-17 2000-10-31 B. E. Technology, Llc Computer interface method and apparatus with targeted advertising
US7121946B2 (en) 1998-08-10 2006-10-17 Cybernet Systems Corporation Real-time head tracking system for computer games and other applications
US6950534B2 (en) 1998-08-10 2005-09-27 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US20010008561A1 (en) 1999-08-10 2001-07-19 Paul George V. Real-time object tracking system
US6801637B2 (en) 1999-08-10 2004-10-05 Cybernet Systems Corporation Optical body tracker
US6681031B2 (en) 1998-08-10 2004-01-20 Cybernet Systems Corporation Gesture-controlled interfaces for self-service machines and other applications
US7036094B1 (en) 1998-08-10 2006-04-25 Cybernet Systems Corporation Behavior recognition system
IL126284A (en) 1998-09-17 2002-12-01 Netmor Ltd System and method for three dimensional positioning and tracking
EP0991011B1 (en) 1998-09-28 2007-07-25 Matsushita Electric Industrial Co., Ltd. Method and device for segmenting hand gestures
US6501515B1 (en) 1998-10-13 2002-12-31 Sony Corporation Remote control system
WO2000034919A1 (en) 1998-12-04 2000-06-15 Interval Research Corporation Background estimation and segmentation based on range and color
US6147678A (en) 1998-12-09 2000-11-14 Lucent Technologies Inc. Video hand image-three-dimensional computer interface with multiple degrees of freedom
US6222465B1 (en) 1998-12-09 2001-04-24 Lucent Technologies Inc. Gesture-based computer interface
US7134130B1 (en) 1998-12-15 2006-11-07 Gateway Inc. Apparatus and method for user-based control of television content
WO2000036372A1 (en) 1998-12-16 2000-06-22 3Dv Systems, Ltd. Self gating photosurface
US6466232B1 (en) 1998-12-18 2002-10-15 Tangis Corporation Method and system for controlling presentation of information to a user based on the user's condition
US6570555B1 (en) 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6226388B1 (en) 1999-01-05 2001-05-01 Sharp Labs Of America, Inc. Method and apparatus for object tracking for automatic controls in video devices
US6363160B1 (en) 1999-01-22 2002-03-26 Intel Corporation Interface using pattern recognition and tracking
US6377296B1 (en) 1999-01-28 2002-04-23 International Business Machines Corporation Virtual map system and method for tracking objects
US7120880B1 (en) 1999-02-25 2006-10-10 International Business Machines Corporation Method and system for real-time determination of a subject's interest level to media content
US7003134B1 (en) 1999-03-08 2006-02-21 Vulcan Patents Llc Three dimensional object pose estimation which employs dense depth information
US6299308B1 (en) 1999-04-02 2001-10-09 Cybernet Systems Corporation Low-cost non-imaging eye tracker system for computer control
EP1045374B1 (en) 1999-04-13 2010-08-11 Sony Deutschland GmbH Merging of speech interfaces for concurrent use of devices and applications
US6591236B2 (en) 1999-04-13 2003-07-08 International Business Machines Corporation Method and system for determining available and alternative speech commands
US20030141360A1 (en) 1999-04-22 2003-07-31 De Leo Stephen L. System and method for providing information and services to and from an automated teller machine
US6503195B1 (en) 1999-05-24 2003-01-07 University Of North Carolina At Chapel Hill Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
US7821507B2 (en) 1999-05-25 2010-10-26 Silverbrook Research Pty Ltd Method of providing information via a printed substrate and two-mode sensing device
US6476834B1 (en) 1999-05-28 2002-11-05 International Business Machines Corporation Dynamic creation of selectable items on surfaces
US6291816B1 (en) * 1999-06-08 2001-09-18 Robotic Vision Systems, Inc. System and method for measuring object features with coordinated two and three dimensional imaging
US6873723B1 (en) 1999-06-30 2005-03-29 Intel Corporation Segmenting three-dimensional video images using stereo
US6738066B1 (en) 1999-07-30 2004-05-18 Electric Plant, Inc. System, method and article of manufacture for detecting collisions between video images generated by a camera and an object depicted on a display
US7113918B1 (en) 1999-08-01 2006-09-26 Electric Planet, Inc. Method for video enabled electronic commerce
US6514081B1 (en) 1999-08-06 2003-02-04 Jeffrey L. Mengoli Method and apparatus for automating motion analysis
US7050606B2 (en) 1999-08-10 2006-05-23 Cybernet Systems Corporation Tracking and gesture recognition system particularly suited to vehicular control applications
WO2001018563A1 (en) 1999-09-08 2001-03-15 3Dv Systems, Ltd. 3d imaging system
US6512838B1 (en) 1999-09-22 2003-01-28 Canesta, Inc. Methods for enhancing performance and data acquired from three-dimensional image systems
US7050177B2 (en) 2002-05-22 2006-05-23 Canesta, Inc. Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
US7006236B2 (en) 2002-05-22 2006-02-28 Canesta, Inc. Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
DE19960180B4 (de) 1999-12-14 2006-03-09 Rheinmetall W & M Gmbh Verfahren zur Herstellung eines Sprenggeschosses
US7028001B1 (en) 1999-12-27 2006-04-11 Motorola, Inc. System and method for measuring web page advertisement impressions
EP1287490A2 (en) 2000-01-03 2003-03-05 Amova.com Automatic personalized media creation system
US7146329B2 (en) 2000-01-13 2006-12-05 Erinmedia, Llc Privacy compliant multiple dataset correlation and content delivery system and methods
US6674877B1 (en) 2000-02-03 2004-01-06 Microsoft Corporation System and method for visually tracking occluded objects in real time
US6663491B2 (en) 2000-02-18 2003-12-16 Namco Ltd. Game apparatus, storage medium and computer program that adjust tempo of sound
US6633294B1 (en) 2000-03-09 2003-10-14 Seth Rosenthal Method and apparatus for using captured high density motion for animation
EP1277104A1 (en) 2000-03-30 2003-01-22 Ideogramic APS Method for gesture based modeling
US6778171B1 (en) 2000-04-05 2004-08-17 Eagle New Media Investments, Llc Real world/virtual world correlation system using 3D graphics pipeline
EP1152261A1 (en) 2000-04-28 2001-11-07 CSEM Centre Suisse d'Electronique et de Microtechnique SA Device and method for spatially resolved photodetection and demodulation of modulated electromagnetic waves
US6856827B2 (en) 2000-04-28 2005-02-15 Ge Medical Systems Global Technology Company, Llc Fluoroscopic tracking and visualization system
US6640202B1 (en) 2000-05-25 2003-10-28 International Business Machines Corporation Elastic sensor mesh system for 3-dimensional measurement, mapping and kinematics applications
JP2003535405A (ja) 2000-05-29 2003-11-25 ブイケービー インコーポレイティド 文字・数字及び他のデータを入力する仮想データ入力装置及び方法
US6731799B1 (en) 2000-06-01 2004-05-04 University Of Washington Object segmentation with background extraction and moving boundary techniques
US7042442B1 (en) 2000-06-27 2006-05-09 International Business Machines Corporation Virtual invisible keyboard
US6788809B1 (en) 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US7227526B2 (en) 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US20090234718A1 (en) 2000-09-05 2009-09-17 Novell, Inc. Predictive service systems using emotion detection
JP4432246B2 (ja) 2000-09-29 2010-03-17 ソニー株式会社 観客状況判定装置、再生出力制御システム、観客状況判定方法、再生出力制御方法、記録媒体
US7058204B2 (en) 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
JP3725460B2 (ja) 2000-10-06 2005-12-14 株式会社ソニー・コンピュータエンタテインメント 画像処理装置、画像処理方法、記録媒体、コンピュータプログラム、半導体デバイス
US20030036944A1 (en) 2000-10-11 2003-02-20 Lesandrini Jay William Extensible business method with advertisement research as an example
US7039676B1 (en) 2000-10-31 2006-05-02 International Business Machines Corporation Using video image analysis to automatically transmit gestures over a network in a chat or instant messaging session
EP1341672B1 (en) * 2000-12-15 2007-07-25 E. I. du Pont de Nemours and Company Receiver element for adjusting the focus of an imaging laser
US20020144259A1 (en) 2001-03-29 2002-10-03 Philips Electronics North America Corp. Method and apparatus for controlling a media player based on user activity
CN100394366C (zh) * 2001-04-09 2008-06-11 华邦电子股份有限公司 应用于计算机的撷取影像和操控光标的装置及方法
US6539931B2 (en) 2001-04-16 2003-04-01 Koninklijke Philips Electronics N.V. Ball throwing assistant
US20020174445A1 (en) 2001-05-17 2002-11-21 Koninklijke Philips Electronics N.V. Video playback device with real-time on-line viewer feedback capability and method of operation
US8035612B2 (en) 2002-05-28 2011-10-11 Intellectual Ventures Holding 67 Llc Self-contained interactive video display system
US7259747B2 (en) 2001-06-05 2007-08-21 Reactrix Systems, Inc. Interactive video display system
US6594616B2 (en) 2001-06-18 2003-07-15 Microsoft Corporation System and method for providing a mobile input device
US6795972B2 (en) 2001-06-29 2004-09-21 Scientific-Atlanta, Inc. Subscriber television system user interface with a virtual reality media space
JP3420221B2 (ja) 2001-06-29 2003-06-23 株式会社コナミコンピュータエンタテインメント東京 ゲーム装置及びプログラム
US20030007018A1 (en) 2001-07-09 2003-01-09 Giovanni Seni Handwriting user interface for personal digital assistants and the like
US6868383B1 (en) 2001-07-12 2005-03-15 At&T Corp. Systems and methods for extracting meaning from multimodal inputs using finite-state devices
GB2379017A (en) 2001-07-27 2003-02-26 Hewlett Packard Co Method and apparatus for monitoring crowds
FI115419B (fi) 2001-08-20 2005-04-29 Helsingin Kauppakorkeakoulu Informaatiopalveluiden käyttäjäkohtainen personointi
US7007236B2 (en) 2001-09-14 2006-02-28 Accenture Global Services Gmbh Lab window collaboration
US6937742B2 (en) 2001-09-28 2005-08-30 Bellsouth Intellectual Property Corporation Gesture activated home appliance
US8561095B2 (en) 2001-11-13 2013-10-15 Koninklijke Philips N.V. Affective television monitoring and control in response to physiological data
US6585521B1 (en) 2001-12-21 2003-07-01 Hewlett-Packard Development Company, L.P. Video indexing based on viewers' behavior and emotion feedback
WO2003071410A2 (en) 2002-02-15 2003-08-28 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US6730913B2 (en) 2002-02-21 2004-05-04 Ford Global Technologies, Llc Active night vision system for vehicles employing short-pulse laser illumination and a gated camera for image capture
US7310431B2 (en) 2002-04-10 2007-12-18 Canesta, Inc. Optical methods for remotely measuring objects
US7607509B2 (en) 2002-04-19 2009-10-27 Iee International Electronics & Engineering S.A. Safety device for a vehicle
US7348963B2 (en) 2002-05-28 2008-03-25 Reactrix Systems, Inc. Interactive video display system
US7710391B2 (en) 2002-05-28 2010-05-04 Matthew Bell Processing an image utilizing a spatially varying pattern
US7170492B2 (en) 2002-05-28 2007-01-30 Reactrix Systems, Inc. Interactive video display system
US7489812B2 (en) 2002-06-07 2009-02-10 Dynamic Digital Depth Research Pty Ltd. Conversion and encoding techniques
US20040001616A1 (en) 2002-06-27 2004-01-01 Srinivas Gutta Measurement of content ratings through vision and speech recognition
US7883415B2 (en) 2003-09-15 2011-02-08 Sony Computer Entertainment Inc. Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion
US7623115B2 (en) 2002-07-27 2009-11-24 Sony Computer Entertainment Inc. Method and apparatus for light input device
US7646372B2 (en) 2003-09-15 2010-01-12 Sony Computer Entertainment Inc. Methods and systems for enabling direction detection when interfacing with a computer program
US8019121B2 (en) 2002-07-27 2011-09-13 Sony Computer Entertainment Inc. Method and system for processing intensity from input devices for interfacing with a computer program
US7627139B2 (en) 2002-07-27 2009-12-01 Sony Computer Entertainment Inc. Computer image and audio processing of intensity and input devices for interfacing with a computer program
EP1535305A2 (en) * 2002-08-16 2005-06-01 Brown University Research Foundation Scanning magnetic microscope having improved magnetic sensor
US7151530B2 (en) 2002-08-20 2006-12-19 Canesta, Inc. System and method for determining an input selected by a user through a virtual interface
WO2004027685A2 (en) 2002-09-19 2004-04-01 The Penn State Research Foundation Prosody based audio/visual co-analysis for co-verbal gesture recognition
US7002560B2 (en) 2002-10-04 2006-02-21 Human Interface Technologies Inc. Method of combining data entry of handwritten symbols with displayed character data
DE60215504T2 (de) 2002-10-07 2007-09-06 Sony France S.A. Verfahren und Gerät zur Analyse von Gesten eines Menschen, z.B. zur Steuerung einer Maschine durch Gestik
US20040113933A1 (en) 2002-10-08 2004-06-17 Northrop Grumman Corporation Split and merge behavior analysis and understanding using Hidden Markov Models
US7576727B2 (en) 2002-12-13 2009-08-18 Matthew Bell Interactive directed light/sound system
JP4235729B2 (ja) 2003-02-03 2009-03-11 国立大学法人静岡大学 距離画像センサ
US9177387B2 (en) 2003-02-11 2015-11-03 Sony Computer Entertainment Inc. Method and apparatus for real time motion capture
US7435941B2 (en) * 2003-03-14 2008-10-14 Inphase Technologies, Inc. Methods for measuring optical characteristics by differential diffractive scanning
US8745541B2 (en) 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7665041B2 (en) 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
DE602004006190T8 (de) 2003-03-31 2008-04-10 Honda Motor Co., Ltd. Vorrichtung, Verfahren und Programm zur Gestenerkennung
JP4355341B2 (ja) 2003-05-29 2009-10-28 本田技研工業株式会社 深度データを用いたビジュアルトラッキング
US8072470B2 (en) 2003-05-29 2011-12-06 Sony Computer Entertainment Inc. System and method for providing a real-time three-dimensional interactive environment
WO2005113099A2 (en) 2003-05-30 2005-12-01 America Online, Inc. Personalizing content
EP3190546A3 (en) 2003-06-12 2017-10-04 Honda Motor Co., Ltd. Target orientation estimation using depth sensing
US7214932B2 (en) * 2003-08-20 2007-05-08 Xyratex Technology Limited Resonator method and system for distinguishing characteristics of surface features or contaminants
US7170605B2 (en) * 2003-08-25 2007-01-30 Evan Francis Cromwell Active sensor and method for optical illumination and detection
CA2536371A1 (en) 2003-08-26 2005-03-10 Redshift Systems Corporation Infrared camera system
US7874917B2 (en) 2003-09-15 2011-01-25 Sony Computer Entertainment Inc. Methods and systems for enabling depth and direction detection when interfacing with a computer program
WO2005041579A2 (en) 2003-10-24 2005-05-06 Reactrix Systems, Inc. Method and system for processing captured image information in an interactive video display system
US7155305B2 (en) 2003-11-04 2006-12-26 Universal Electronics Inc. System and methods for home appliance identification and control in a networked environment
GB2410359A (en) 2004-01-23 2005-07-27 Sony Uk Ltd Display
JP3847753B2 (ja) 2004-01-30 2006-11-22 株式会社ソニー・コンピュータエンタテインメント 画像処理装置、画像処理方法、記録媒体、コンピュータプログラム、半導体デバイス
US7706616B2 (en) 2004-02-27 2010-04-27 International Business Machines Corporation System and method for recognizing word patterns in a very large vocabulary based on a virtual keyboard layout
US8949899B2 (en) 2005-03-04 2015-02-03 Sharp Laboratories Of America, Inc. Collaborative recommendation system
US7301529B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
US20050215319A1 (en) 2004-03-23 2005-09-29 Harmonix Music Systems, Inc. Method and apparatus for controlling a three-dimensional character in a three-dimensional gaming environment
EP1582965A1 (en) 2004-04-01 2005-10-05 Sony Deutschland Gmbh Emotion controlled system for processing multimedia data
JP4092697B2 (ja) 2004-04-07 2008-05-28 ソニー株式会社 情報処理装置および方法、プログラム並びに記録媒体
WO2005104010A2 (en) 2004-04-15 2005-11-03 Gesture Tek, Inc. Tracking bimanual movements
US7308112B2 (en) 2004-05-14 2007-12-11 Honda Motor Co., Ltd. Sign based human-machine interaction
US20050289582A1 (en) 2004-06-24 2005-12-29 Hitachi, Ltd. System and method for capturing and using biometrics to review a product, service, creative work or thing
US7178111B2 (en) 2004-08-03 2007-02-13 Microsoft Corporation Multi-planar three-dimensional user interface
US7728821B2 (en) 2004-08-06 2010-06-01 Touchtable, Inc. Touch detecting interactive display
US7704135B2 (en) 2004-08-23 2010-04-27 Harrison Jr Shelton E Integrated game system, method, and device
WO2006025137A1 (ja) 2004-09-01 2006-03-09 Sony Computer Entertainment Inc. 画像処理装置、ゲーム装置および画像処理方法
US7761814B2 (en) 2004-09-13 2010-07-20 Microsoft Corporation Flick gesture
WO2006038779A1 (en) 2004-10-01 2006-04-13 Samsung Electronics Co., Ltd. Device and method for displaying event in wireless terminal
EP1645944B1 (en) 2004-10-05 2012-08-15 Sony France S.A. A content-management interface
US7212665B2 (en) 2004-11-05 2007-05-01 Honda Motor Co. Human pose estimation with data driven belief propagation
US7870589B2 (en) 2004-11-23 2011-01-11 Palo Alto Research Center Incorporated Method for providing commentary audio and additional or replacement video content
US7814518B2 (en) 2004-11-23 2010-10-12 Palo Alto Research Center Incorporated Methods, apparatus, and program products for presenting replacement content instead of a portion of a recorded content
US7217020B2 (en) 2004-11-24 2007-05-15 General Motors Corporation Headlamp assembly with integrated infrared illuminator
US20060123360A1 (en) 2004-12-03 2006-06-08 Picsel Research Limited User interfaces for data processing devices and systems
JP4449723B2 (ja) 2004-12-08 2010-04-14 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
KR20060070280A (ko) 2004-12-20 2006-06-23 한국전자통신연구원 손 제스처 인식을 이용한 사용자 인터페이스 장치 및 그방법
EP1849123A2 (en) 2005-01-07 2007-10-31 GestureTek, Inc. Optical flow based tilt sensor
CN101198964A (zh) 2005-01-07 2008-06-11 格斯图尔泰克股份有限公司 使用红外图案照射创建对象的三维图像
EP2487624B1 (en) 2005-01-07 2020-02-19 Qualcomm Incorporated(1/3) Detecting and tracking objects in images
JP3862027B2 (ja) 2005-01-25 2006-12-27 船井電機株式会社 放送信号受信システム
US7598942B2 (en) 2005-02-08 2009-10-06 Oblong Industries, Inc. System and method for gesture based control system
US8009871B2 (en) 2005-02-08 2011-08-30 Microsoft Corporation Method and system to segment depth images and to detect shapes in three-dimensionally acquired data
US20060218573A1 (en) 2005-03-04 2006-09-28 Stexar Corp. Television program highlight tagging
GB2423808B (en) 2005-03-04 2010-02-17 Ford Global Tech Llc Motor vehicle control system for controlling one or more vehicle devices
KR100688743B1 (ko) 2005-03-11 2007-03-02 삼성전기주식회사 멀티 레이어 커패시터 내장형의 인쇄회로기판의 제조방법
US7643056B2 (en) 2005-03-14 2010-01-05 Aptina Imaging Corporation Motion detecting camera system
JP4686595B2 (ja) 2005-03-17 2011-05-25 本田技研工業株式会社 クリティカルポイント解析に基づくポーズ推定
US8147248B2 (en) 2005-03-21 2012-04-03 Microsoft Corporation Gesture training
US7468998B2 (en) 2005-03-25 2008-12-23 Pavilion Integration Corporation Radio frequency modulation of variable degree and automatic power control using external photodiode sensor for low-noise lasers of various wavelengths
US7487461B2 (en) 2005-05-04 2009-02-03 International Business Machines Corporation System and method for issuing commands based on pen motions on a graphical keyboard
BRPI0613165A2 (pt) 2005-05-17 2010-12-21 Gesturetek Inc saìda de sinal sensìvel à orientação
WO2006125133A2 (en) 2005-05-19 2006-11-23 Hillcrest Laboratories, Inc. Global navigation objects in user interfaces
EP1752748B1 (en) 2005-08-12 2008-10-29 MESA Imaging AG Highly sensitive, fast pixel for use in an image sensor
US20080026838A1 (en) 2005-08-22 2008-01-31 Dunstan James E Multi-player non-role-playing virtual world games: method for two-way interaction between participants and multi-player virtual world games
TW200713060A (en) 2005-09-30 2007-04-01 Primax Electronics Ltd Adaptive input method for touch screen
US7450736B2 (en) 2005-10-28 2008-11-11 Honda Motor Co., Ltd. Monocular tracking of 3D human motion with a coordinated mixture of factor analyzers
GB2431717A (en) 2005-10-31 2007-05-02 Sony Uk Ltd Scene analysis
US20070150281A1 (en) 2005-12-22 2007-06-28 Hoff Todd M Method and system for utilizing emotion to search content
US20070150916A1 (en) 2005-12-28 2007-06-28 James Begole Using sensors to provide feedback on the access of digital content
US20070214292A1 (en) 2006-02-24 2007-09-13 Gillian Hayes System and method for archiving of continuous capture buffers
US7433024B2 (en) 2006-02-27 2008-10-07 Prime Sense Ltd. Range mapping using speckle decorrelation
US20070219430A1 (en) 2006-03-17 2007-09-20 Moore Barrett H Electricity Providing Privately Provisioned Subscription-Based Survival Supply Unit Method And Apparatus
JP4484836B2 (ja) * 2006-03-24 2010-06-16 三洋電機株式会社 ビーム照射装置
US7568116B2 (en) 2006-04-14 2009-07-28 Clever Innovations, Inc. Automated display device
US8766983B2 (en) 2006-05-07 2014-07-01 Sony Computer Entertainment Inc. Methods and systems for processing an interchange of real time effects during video communication
US20070271580A1 (en) 2006-05-16 2007-11-22 Bellsouth Intellectual Property Corporation Methods, Apparatus and Computer Program Products for Audience-Adaptive Control of Content Presentation Based on Sensed Audience Demographics
US7721207B2 (en) 2006-05-31 2010-05-18 Sony Ericsson Mobile Communications Ab Camera based control
US7640304B1 (en) 2006-06-14 2009-12-29 Yes International Ag System and method for detecting and measuring emotional indicia
US7701439B2 (en) 2006-07-13 2010-04-20 Northrop Grumman Corporation Gesture recognition simulation system and method
TW200806029A (en) 2006-07-14 2008-01-16 Asustek Comp Inc Display system and control method thereof
US20080027984A1 (en) 2006-07-31 2008-01-31 Motorola, Inc. Method and system for multi-dimensional action capture
US8775237B2 (en) 2006-08-02 2014-07-08 Opinionlab, Inc. System and method for measuring and reporting user reactions to advertisements on a web page
US9514436B2 (en) 2006-09-05 2016-12-06 The Nielsen Company (Us), Llc Method and system for predicting audience viewing behavior
AU2007293092A1 (en) 2006-09-05 2008-03-13 Innerscope Research, Inc. Method and system for determining audience response to a sensory stimulus
US7725547B2 (en) 2006-09-06 2010-05-25 International Business Machines Corporation Informing a user of gestures made by others out of the user's line of sight
US8395658B2 (en) 2006-09-07 2013-03-12 Sony Computer Entertainment Inc. Touch screen-like user interface that does not require actual touching
US8287372B2 (en) 2006-09-28 2012-10-16 Mattel, Inc. Interactive toy and display system
US8310656B2 (en) 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
JP5395323B2 (ja) 2006-09-29 2014-01-22 ブレインビジョン株式会社 固体撮像素子
WO2008067413A2 (en) 2006-11-28 2008-06-05 Attune Interactive, Inc. Training system using an interactive prompt character
US20080134102A1 (en) 2006-12-05 2008-06-05 Sony Ericsson Mobile Communications Ab Method and system for detecting movement of an object
CN101202994B (zh) 2006-12-14 2012-10-24 北京三星通信技术研究有限公司 辅助用户健身的方法和装置
KR100720335B1 (ko) 2006-12-20 2007-05-23 최경순 접촉 위치 이동에 따라 생성되는 상대좌표값에 대응하는텍스트를 입력하는 텍스트 입력 장치 및 그 방법
US8351646B2 (en) 2006-12-21 2013-01-08 Honda Motor Co., Ltd. Human pose estimation and tracking using label assignment
KR20080058740A (ko) 2006-12-22 2008-06-26 삼성전자주식회사 디지털 방송 수신 장치 및 시간 동기화 방법
US7412077B2 (en) 2006-12-29 2008-08-12 Motorola, Inc. Apparatus and methods for head pose estimation and head gesture detection
US9311528B2 (en) 2007-01-03 2016-04-12 Apple Inc. Gesture learning
US20080163283A1 (en) 2007-01-03 2008-07-03 Angelito Perez Tan Broadband video with synchronized highlight signals
US7770136B2 (en) 2007-01-24 2010-08-03 Microsoft Corporation Gesture recognition interactive feedback
GB0703974D0 (en) 2007-03-01 2007-04-11 Sony Comp Entertainment Europe Entertainment device
US20090070798A1 (en) 2007-03-02 2009-03-12 Lee Hans C System and Method for Detecting Viewer Attention to Media Delivery Devices
US7729530B2 (en) 2007-03-03 2010-06-01 Sergey Antonov Method and apparatus for 3-D data input to a personal computer with a multimedia oriented operating system
US20080234023A1 (en) 2007-03-23 2008-09-25 Ajmal Mullahkhel Light game
CN101632053A (zh) 2007-04-03 2010-01-20 深圳Tcl新技术有限公司 根据运动探测进行系统功耗模式切换的系统和方法
US20090217315A1 (en) 2008-02-26 2009-08-27 Cognovision Solutions Inc. Method and system for audience measurement and targeting media
KR20090002809A (ko) 2007-07-04 2009-01-09 삼성전자주식회사 어플리케이션에서 생성된 데이터를 ｈｄｍｉ ｃｅｃ에 따라송수신하는 방법
US7865916B2 (en) 2007-07-20 2011-01-04 James Beser Audience determination for monetizing displayable content
US8726194B2 (en) 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US7852262B2 (en) 2007-08-16 2010-12-14 Cybernet Systems Corporation Wireless mobile indoor/outdoor tracking system
US8081302B2 (en) * 2007-08-17 2011-12-20 Princeton Satellite Systems, Inc. Multimode optical sensor
US9261979B2 (en) 2007-08-20 2016-02-16 Qualcomm Incorporated Gesture-based mobile interaction
KR101182286B1 (ko) 2007-09-19 2012-09-14 삼성전자주식회사 움직임을 감지하는 리모트 컨트롤러 및, 리모트 컨트롤러에의해 포인터를 제어하는 영상디스플레이장치 및 그들의제어방법
EP2042969A1 (en) 2007-09-28 2009-04-01 Alcatel Lucent Method for determining user reaction with specific content of a displayed page.
US7970176B2 (en) 2007-10-02 2011-06-28 Omek Interactive, Inc. Method and system for gesture classification
US8327395B2 (en) 2007-10-02 2012-12-04 The Nielsen Company (Us), Llc System providing actionable insights based on physiological responses from viewers of media
US8776102B2 (en) 2007-10-09 2014-07-08 At&T Intellectual Property I, Lp System and method for evaluating audience reaction to a data stream
US20090106645A1 (en) 2007-10-17 2009-04-23 Thinkingcraft, Inc. Adaptive response/interpretive expression, communication distribution, and intelligent determination system and method
US8001108B2 (en) 2007-10-24 2011-08-16 The Invention Science Fund I, Llc Returning a new content based on a person's reaction to at least two instances of previously displayed content
WO2009059065A1 (en) 2007-10-30 2009-05-07 Hewlett-Packard Development Company, L.P. Interactive display system with collaborative gesture detection
US8094891B2 (en) 2007-11-01 2012-01-10 Sony Ericsson Mobile Communications Ab Generating music playlist based on facial expression
US20090221368A1 (en) 2007-11-28 2009-09-03 Ailive Inc., Method and system for creating a shared game space for a networked game
GB2455316B (en) 2007-12-04 2012-08-15 Sony Corp Image processing apparatus and method
US20090157472A1 (en) 2007-12-14 2009-06-18 Kimberly-Clark Worldwide, Inc. Personalized Retail Information Delivery Systems and Methods
US9098766B2 (en) 2007-12-21 2015-08-04 Honda Motor Co., Ltd. Controlled human pose estimation from depth image streams
US9165199B2 (en) 2007-12-21 2015-10-20 Honda Motor Co., Ltd. Controlled human pose estimation from depth image streams
US8149210B2 (en) 2007-12-31 2012-04-03 Microsoft International Holdings B.V. Pointing device and method
US8090030B2 (en) 2008-01-04 2012-01-03 Silicon Image, Inc. Method, apparatus and system for generating and facilitating mobile high-definition multimedia interface
US8166421B2 (en) 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
WO2009093461A1 (ja) * 2008-01-22 2009-07-30 Ssd Company Limited 撮像装置、オンラインゲームシステム、操作物、入力方法、画像解析装置、画像解析方法、及び記録媒体
US20090189858A1 (en) * 2008-01-30 2009-07-30 Jeff Lev Gesture Identification Using A Structured Light Pattern
US7889073B2 (en) 2008-01-31 2011-02-15 Sony Computer Entertainment America Llc Laugh detector and system and method for tracking an emotional response to a media presentation
KR101365776B1 (ko) 2008-04-08 2014-02-20 엘지디스플레이 주식회사 멀티 터치 시스템 및 그 구동 방법
CN101254344B (zh) 2008-04-18 2010-06-16 李刚 场地方位与显示屏点阵按比例相对应的游戏装置和方法
GB2459707B (en) 2008-05-01 2010-08-11 Sony Computer Entertainment Inc Media recorder, audio visual entertainment system and method
US8788718B2 (en) 2008-05-27 2014-07-22 Valens Semiconductor Ltd. Multiple display network supporting HDMI-CEC
US8477139B2 (en) 2008-06-09 2013-07-02 Apple Inc. Touch screen device, method, and graphical user interface for manipulating three-dimensional virtual objects
CN201247590Y (zh) 2008-08-01 2009-05-27 鸿富锦精密工业（深圳）有限公司 可自动切换显示模式的电子相框
US8925001B2 (en) 2008-09-12 2014-12-30 At&T Intellectual Property I, L.P. Media stream generation based on a category of user expression
US20100070987A1 (en) 2008-09-12 2010-03-18 At&T Intellectual Property I, L.P. Mining viewer responses to multimedia content
US20100070913A1 (en) 2008-09-15 2010-03-18 Apple Inc. Selecting an item of content in a graphical user interface for a portable computing device
US8769427B2 (en) 2008-09-19 2014-07-01 Google Inc. Quick gesture input
US8516561B2 (en) 2008-09-29 2013-08-20 At&T Intellectual Property I, L.P. Methods and apparatus for determining user authorization from motion of a gesture-based control unit
US20100086204A1 (en) 2008-10-03 2010-04-08 Sony Ericsson Mobile Communications Ab System and method for capturing an emotional characteristic of a user
KR20100041006A (ko) 2008-10-13 2010-04-22 엘지전자 주식회사 3차원 멀티 터치를 이용한 사용자 인터페이스 제어방법
US9399167B2 (en) 2008-10-14 2016-07-26 Microsoft Technology Licensing, Llc Virtual space mapping of a variable activity region
US20100107184A1 (en) 2008-10-23 2010-04-29 Peter Rae Shintani TV with eye detection
US20100138797A1 (en) 2008-12-01 2010-06-03 Sony Ericsson Mobile Communications Ab Portable electronic device with split vision content sharing control and method
KR101531363B1 (ko) 2008-12-10 2015-07-06 삼성전자주식회사 이차원 인터랙티브 디스플레이에서 가상 객체 또는 시점을 제어하는 방법
US20100153984A1 (en) 2008-12-12 2010-06-17 Microsoft Corporation User Feedback Based Highlights of Recorded Programs
JP5156617B2 (ja) * 2008-12-26 2013-03-06 日本システムウエア株式会社 対象物検出用画像処理装置、方法、プログラム、並びに該プログラムを格納するコンピュータ可読媒体
JP4775671B2 (ja) 2008-12-26 2011-09-21 ソニー株式会社 情報処理装置および方法、並びにプログラム
US8856829B2 (en) 2008-12-29 2014-10-07 Ngc Network Us, Llc Interactive display highlight systems, methods, and computer program products
US20100248832A1 (en) 2009-03-30 2010-09-30 Microsoft Corporation Control of video game via microphone
US9172482B2 (en) 2009-03-31 2015-10-27 At&T Intellectual Property I, L.P. Content recommendations based on personal preferences
US8942428B2 (en) 2009-05-01 2015-01-27 Microsoft Corporation Isolate extraneous motions
US8660303B2 (en) 2009-05-01 2014-02-25 Microsoft Corporation Detection of body and props
KR101567603B1 (ko) 2009-05-07 2015-11-20 엘지전자 주식회사 멀티 음성 시스템의 동작 제어 장치 및 방법
US9417700B2 (en) 2009-05-21 2016-08-16 Edge3 Technologies Gesture recognition systems and related methods
US8418085B2 (en) 2009-05-29 2013-04-09 Microsoft Corporation Gesture coach
US8255955B1 (en) 2009-06-16 2012-08-28 Tivo Inc. Dynamic item highlighting system
US20100332842A1 (en) 2009-06-30 2010-12-30 Yahoo! Inc. Determining a mood of a user based on biometric characteristic(s) of the user in an online system
US8390680B2 (en) 2009-07-09 2013-03-05 Microsoft Corporation Visual representation expression based on player expression
US20110016102A1 (en) 2009-07-20 2011-01-20 Louis Hawthorne System and method for identifying and providing user-specific psychoactive content
JP5397081B2 (ja) 2009-08-12 2014-01-22 富士通モバイルコミュニケーションズ株式会社 携帯端末
US8326002B2 (en) 2009-08-13 2012-12-04 Sensory Logic, Inc. Methods of facial coding scoring for optimally identifying consumers' responses to arrive at effective, incisive, actionable conclusions
US7873849B2 (en) 2009-09-02 2011-01-18 Apple Inc. Motion sensor data processing using various power management modes
CN102687139B (zh) 2009-09-08 2015-09-09 意大利电信股份公司 探索数字信息内容的目录的方法
US8275834B2 (en) 2009-09-14 2012-09-25 Applied Research Associates, Inc. Multi-modal, geo-tempo communications systems
US8875167B2 (en) 2009-09-21 2014-10-28 Mobitv, Inc. Implicit mechanism for determining user response to media
US20110077719A1 (en) 2009-09-30 2011-03-31 Broadcom Corporation Electromagnetic power bio-medical unit
US20110145040A1 (en) 2009-12-16 2011-06-16 Microsoft Corporation Content recommendation
US10356465B2 (en) 2010-01-06 2019-07-16 Sony Corporation Video system demonstration
JP5609160B2 (ja) 2010-02-26 2014-10-22 ソニー株式会社 情報処理システム、コンテンツ合成装置および方法、並びに記録媒体
US9124651B2 (en) 2010-03-30 2015-09-01 Microsoft Technology Licensing, Llc Controlling media consumption privacy settings
US20110263946A1 (en) 2010-04-22 2011-10-27 Mit Media Lab Method and system for real-time and offline analysis, inference, tagging of and responding to person(s) experiences
US20110264531A1 (en) 2010-04-26 2011-10-27 Yahoo! Inc. Watching a user's online world
US8424037B2 (en) 2010-06-29 2013-04-16 Echostar Technologies L.L.C. Apparatus, systems and methods for accessing and synchronizing presentation of media content and supplemental media rich content in response to selection of a presented object
US9247205B2 (en) 2010-08-31 2016-01-26 Fujitsu Limited System and method for editing recorded videoconference data
US8949871B2 (en) 2010-09-08 2015-02-03 Opentv, Inc. Smart media selection based on viewer user presence
US20120084812A1 (en) 2010-10-04 2012-04-05 Mark Thompson System and Method for Integrating Interactive Advertising and Metadata Into Real Time Video Content
US20120109726A1 (en) 2010-10-30 2012-05-03 Verizon Patent And Licensing, Inc. Methods and Systems for Trigger-Based Updating of an Index File Associated with a Captured Media Content Instance
US8955001B2 (en) 2011-07-06 2015-02-10 Symphony Advanced Media Mobile remote media control platform apparatuses and methods
JP4945675B2 (ja) 2010-11-12 2012-06-06 株式会社東芝 音響信号処理装置、テレビジョン装置及びプログラム
US20120209715A1 (en) 2011-02-11 2012-08-16 Microsoft Corporation Interaction with networked screen content via motion sensing device in retail setting
US20110145041A1 (en) 2011-02-15 2011-06-16 InnovatioNet System for communication between users and global media-communication network
US20120226981A1 (en) 2011-03-02 2012-09-06 Microsoft Corporation Controlling electronic devices in a multimedia system through a natural user interface
US10671841B2 (en) 2011-05-02 2020-06-02 Microsoft Technology Licensing, Llc Attribute state classification
US20120304059A1 (en) 2011-05-24 2012-11-29 Microsoft Corporation Interactive Build Instructions
US8760395B2 (en) 2011-05-31 2014-06-24 Microsoft Corporation Gesture recognition techniques
US8509545B2 (en) 2011-11-29 2013-08-13 Microsoft Corporation Foreground subject detection
US8635637B2 (en) 2011-12-02 2014-01-21 Microsoft Corporation User interface presenting an animated avatar performing a media reaction
US20130145385A1 (en) 2011-12-02 2013-06-06 Microsoft Corporation Context-based ratings and recommendations for media
US8943526B2 (en) 2011-12-02 2015-01-27 Microsoft Corporation Estimating engagement of consumers of presented content
US9100685B2 (en) 2011-12-09 2015-08-04 Microsoft Technology Licensing, Llc Determining audience state or interest using passive sensor data
US20130159555A1 (en) 2011-12-20 2013-06-20 Microsoft Corporation Input commands
US20130198690A1 (en) 2012-02-01 2013-08-01 Microsoft Corporation Visual indication of graphical user interface relationship
CA2775700C (en) 2012-05-04 2013-07-23 Microsoft Corporation Determining a future portion of a currently presented media program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5175641A (en) * 1991-04-05 1992-12-29 International Business Machines Corporation Dual-mode laser diode transmitter
US20110013024A1 (en) * 1999-05-11 2011-01-20 Pryor Timothy R Camera based interaction and instruction
CN1708764A (zh) * 2000-05-29 2005-12-14 Vkb有限公司 输入字母数字及其他数据的虚拟数据输入设备与方法
US20080018591A1 (en) * 2006-07-20 2008-01-24 Arkady Pittel User Interfacing
WO2009099296A2 (en) * 2008-02-05 2009-08-13 Lg Electronics Inc. Virtual optical input device for providing various types of interfaces and method of controlling the same

Also Published As

Publication number Publication date
EP2702464A4 (en) 2014-09-17
US20120268362A1 (en) 2012-10-25
US8620113B2 (en) 2013-12-31
WO2012148844A3 (en) 2013-02-14
KR102007445B1 (ko) 2019-08-05
AR086175A1 (es) 2013-11-27
JP5976787B2 (ja) 2016-08-24
WO2012148844A2 (en) 2012-11-01
EP2702464A2 (en) 2014-03-05
TWI552791B (zh) 2016-10-11
CN103502910B (zh) 2017-03-01
KR20140024876A (ko) 2014-03-03
EP2702464B1 (en) 2017-09-06
JP2014513357A (ja) 2014-05-29
TW201242644A (en) 2012-11-01

Similar Documents

Publication Publication Date Title
CN102541256B (zh) 具有视觉反馈的位置知晓姿势作为输入方法
US10761612B2 (en) Gesture recognition techniques
CN103502910A (zh) 激光二极管模式
US8902158B2 (en) Multi-user interaction with handheld projectors
CN102253712B (zh) 用于共享信息的识别系统
US20130044912A1 (en) Use of association of an object detected in an image to obtain information to display to a user
US10096165B2 (en) Technologies for virtual camera scene generation using physical object sensing
CN104067204A (zh) 指示笔计算环境
CN102253802A (zh) 墨水滞后补偿技术
CN108885521A (zh) 跨环境共享
US20160012612A1 (en) Display control method and system
CN102402286A (zh) 动态姿势参数
JP2016510144A (ja) ナチュラルユーザインプットの関与の検出
CN102939574A (zh) 字符选择
CN109391848B (zh) 一种互动广告系统
KR20210033394A (ko) 전자 장치 및 그의 제어 방법
KR101964192B1 (ko) 시뮬레이션용 스마트 테이블 장치
US11169603B2 (en) Electronic apparatus and method for recognizing view angle of displayed screen thereof
CN104460962A (zh) 基于游戏引擎的4d体感交互系统
Hsu et al. A multimedia presentation system using a 3D gesture interface in museums
US20240036683A1 (en) Xr virtual trackpad
KR20230121660A (ko) 오프라인 광고영상을 통해 음성인식 반응형 3d 아바타를 이용한 가상 플랫폼 서비스 제공 방법, 장치 및 컴퓨터프로그램
JP2023114220A (ja) 情報処理装置、情報処理システム、プログラム、および情報処理方法
CN105144031A (zh) 增强的演示环境
JP2023039767A (ja) 表示装置、表示方法、表示システム

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: MICROSOFT TECHNOLOGY LICENSING LLC

Free format text: FORMER OWNER: MICROSOFT CORP.

Effective date: 20150729

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20150729

Address after: Washington State

Applicant after: Micro soft technique license Co., Ltd

Address before: Washington State

Applicant before: Microsoft Corp.

GR01 Patent grant
GR01 Patent grant