WO2006098770A3 - Apparatus and method for performing motion capture using shutter synchronization - Google Patents

Apparatus and method for performing motion capture using shutter synchronization Download PDF

Info

Publication number
WO2006098770A3
WO2006098770A3 PCT/US2005/034524 US2005034524W WO2006098770A3 WO 2006098770 A3 WO2006098770 A3 WO 2006098770A3 US 2005034524 W US2005034524 W US 2005034524W WO 2006098770 A3 WO2006098770 A3 WO 2006098770A3
Authority
WO
WIPO (PCT)
Prior art keywords
light source
motion capture
performing motion
shutter synchronization
strobing
Prior art date
Application number
PCT/US2005/034524
Other languages
French (fr)
Other versions
WO2006098770A2 (en
Inventor
Greg Lasalle
Der Laan Roger Van
Stephen G Perlman
John Speck
Timothy S Cotter
Kenneth A Pearce
Original Assignee
Rearden Llc
Greg Lasalle
Der Laan Roger Van
Stephen G Perlman
John Speck
Timothy S Cotter
Kenneth A Pearce
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=36475378&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2006098770(A3) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Rearden Llc, Greg Lasalle, Der Laan Roger Van, Stephen G Perlman, John Speck, Timothy S Cotter, Kenneth A Pearce filed Critical Rearden Llc
Priority to KR1020077008614A priority Critical patent/KR101182623B1/en
Priority to JP2008500696A priority patent/JP4705156B2/en
Priority to CN2005800308469A priority patent/CN101427564B/en
Priority to NZ553106A priority patent/NZ553106A/en
Priority to AU2005329027A priority patent/AU2005329027B2/en
Publication of WO2006098770A2 publication Critical patent/WO2006098770A2/en
Publication of WO2006098770A3 publication Critical patent/WO2006098770A3/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00—Prospecting or detecting by optical means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Abstract

A method is described comprising: applying phosphorescent paint to specified regions of a performer's face and/or body; strobing a light source on and off, the light source charging the phosphorescent paint when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is open.
PCT/US2005/034524 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization WO2006098770A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
KR1020077008614A KR101182623B1 (en) 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization
JP2008500696A JP4705156B2 (en) 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization
CN2005800308469A CN101427564B (en) 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization
NZ553106A NZ553106A (en) 2005-03-10 2005-09-26 Performing motion capture using shutter synchronization of cameras and phosphorescent paint applied to a performer
AU2005329027A AU2005329027B2 (en) 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/077,628 2005-03-10
US11/077,628 US7605861B2 (en) 2005-03-10 2005-03-10 Apparatus and method for performing motion capture using shutter synchronization

Publications (2)

Publication Number Publication Date
WO2006098770A2 WO2006098770A2 (en) 2006-09-21
WO2006098770A3 true WO2006098770A3 (en) 2007-12-27

Family

ID=36475378

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/034524 WO2006098770A2 (en) 2005-03-10 2005-09-26 Apparatus and method for performing motion capture using shutter synchronization

Country Status (18)

Country Link
US (1) US7605861B2 (en)
EP (1) EP1715454B1 (en)
JP (1) JP4705156B2 (en)
KR (1) KR101182623B1 (en)
CN (1) CN101427564B (en)
AT (1) ATE405899T1 (en)
AU (1) AU2005329027B2 (en)
CA (3) CA3176795A1 (en)
CY (1) CY1109533T1 (en)
DE (1) DE602005009141D1 (en)
DK (1) DK1715454T3 (en)
ES (1) ES2313221T3 (en)
HK (1) HK1096752A1 (en)
NZ (1) NZ553106A (en)
PL (1) PL1715454T3 (en)
PT (1) PT1715454E (en)
SI (1) SI1715454T1 (en)
WO (1) WO2006098770A2 (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10075750B2 (en) 2002-12-10 2018-09-11 Sony Interactive Entertainment America Llc Porting locally processed media data with low latency to a remote client device via various wireless links
US9819403B2 (en) 2004-04-02 2017-11-14 Rearden, Llc System and method for managing handoff of a client between different distributed-input-distributed-output (DIDO) networks based on detected velocity of the client
US10425134B2 (en) 2004-04-02 2019-09-24 Rearden, Llc System and methods for planned evolution and obsolescence of multiuser spectrum
US8654815B1 (en) 2004-04-02 2014-02-18 Rearden, Llc System and method for distributed antenna wireless communications
US9826537B2 (en) 2004-04-02 2017-11-21 Rearden, Llc System and method for managing inter-cluster handoff of clients which traverse multiple DIDO clusters
US10277290B2 (en) 2004-04-02 2019-04-30 Rearden, Llc Systems and methods to exploit areas of coherence in wireless systems
US9685997B2 (en) 2007-08-20 2017-06-20 Rearden, Llc Systems and methods to enhance spatial diversity in distributed-input distributed-output wireless systems
US20060055706A1 (en) * 2004-09-15 2006-03-16 Perlman Stephen G Apparatus and method for capturing the motion of a performer
US8194093B2 (en) * 2004-09-15 2012-06-05 Onlive, Inc. Apparatus and method for capturing the expression of a performer
AU2006225115B2 (en) 2005-03-16 2011-10-06 Lucasfilm Entertainment Company Ltd. Three- dimensional motion capture
DE102005020688B4 (en) * 2005-05-03 2008-01-03 Siemens Ag mobile phone
US8780119B2 (en) * 2005-08-26 2014-07-15 Sony Corporation Reconstruction render farm used in motion capture
US7606392B2 (en) * 2005-08-26 2009-10-20 Sony Corporation Capturing and processing facial motion data
US7701487B2 (en) * 2005-08-26 2010-04-20 Sony Corporation Multicast control of motion capture sequences
US20070076096A1 (en) * 2005-10-04 2007-04-05 Alexander Eugene J System and method for calibrating a set of imaging devices and calculating 3D coordinates of detected features in a laboratory coordinate system
US8659668B2 (en) 2005-10-07 2014-02-25 Rearden, Llc Apparatus and method for performing motion capture using a random pattern on capture surfaces
US7667767B2 (en) * 2006-06-07 2010-02-23 Onlive, Inc. System and method for three dimensional capture of stop-motion animated characters
US7548272B2 (en) * 2006-06-07 2009-06-16 Onlive, Inc. System and method for performing motion capture using phosphor application techniques
US7567293B2 (en) * 2006-06-07 2009-07-28 Onlive, Inc. System and method for performing motion capture by strobing a fluorescent lamp
US7841946B2 (en) * 2006-06-29 2010-11-30 Spawn Labs, Inc. System for remote game access
US8021160B2 (en) * 2006-07-22 2011-09-20 Industrial Technology Research Institute Learning assessment method and device using a virtual tutor
NZ574599A (en) * 2006-07-31 2012-02-24 Onlive Inc System and method for performing motion capture and image reconstruction
US20100231692A1 (en) 2006-07-31 2010-09-16 Onlive, Inc. System and method for performing motion capture and image reconstruction with transparent makeup
US8330823B2 (en) * 2006-11-01 2012-12-11 Sony Corporation Capturing surface in motion picture
US20080170750A1 (en) * 2006-11-01 2008-07-17 Demian Gordon Segment tracking in motion picture
US8199152B2 (en) * 2007-01-16 2012-06-12 Lucasfilm Entertainment Company Ltd. Combining multiple session content for animation libraries
US8542236B2 (en) * 2007-01-16 2013-09-24 Lucasfilm Entertainment Company Ltd. Generating animation libraries
US8130225B2 (en) * 2007-01-16 2012-03-06 Lucasfilm Entertainment Company Ltd. Using animation libraries for object identification
US8437514B2 (en) * 2007-10-02 2013-05-07 Microsoft Corporation Cartoon face generation
US8144153B1 (en) 2007-11-20 2012-03-27 Lucasfilm Entertainment Company Ltd. Model production for animation libraries
US8831379B2 (en) * 2008-04-04 2014-09-09 Microsoft Corporation Cartoon personalization
US9142024B2 (en) 2008-12-31 2015-09-22 Lucasfilm Entertainment Company Ltd. Visual and physical motion sensing for three-dimensional motion capture
TWI415032B (en) * 2009-10-30 2013-11-11 Univ Nat Chiao Tung Object tracking method
WO2013074926A1 (en) 2011-11-18 2013-05-23 Lucasfilm Entertainment Company Ltd. Path and speed based character control
US9224248B2 (en) * 2012-07-12 2015-12-29 Ulsee Inc. Method of virtual makeup achieved by facial tracking
US8786767B2 (en) * 2012-11-02 2014-07-22 Microsoft Corporation Rapid synchronized lighting and shuttering
US11189917B2 (en) 2014-04-16 2021-11-30 Rearden, Llc Systems and methods for distributing radioheads
US8998719B1 (en) 2012-12-14 2015-04-07 Elbo, Inc. Network-enabled game controller
US20140198185A1 (en) * 2013-01-17 2014-07-17 Cyberoptics Corporation Multi-camera sensor for three-dimensional imaging of a circuit board
US10488535B2 (en) 2013-03-12 2019-11-26 Rearden, Llc Apparatus and method for capturing still images and video using diffraction coded imaging techniques
US9973246B2 (en) 2013-03-12 2018-05-15 Rearden, Llc Systems and methods for exploiting inter-cell multiplexing gain in wireless cellular systems via distributed input distributed output technology
US9923657B2 (en) 2013-03-12 2018-03-20 Rearden, Llc Systems and methods for exploiting inter-cell multiplexing gain in wireless cellular systems via distributed input distributed output technology
US10547358B2 (en) 2013-03-15 2020-01-28 Rearden, Llc Systems and methods for radio frequency calibration exploiting channel reciprocity in distributed input distributed output wireless communications
US10126252B2 (en) 2013-04-29 2018-11-13 Cyberoptics Corporation Enhanced illumination control for three-dimensional imaging
WO2016030305A1 (en) * 2014-08-29 2016-03-03 Thomson Licensing Method and device for registering an image to a model
CN107390448A (en) * 2017-09-06 2017-11-24 成都豪宇韬鹰科技有限公司 A kind of active optical motion capture system
CN107423733A (en) * 2017-09-06 2017-12-01 成都豪宇韬鹰科技有限公司 Motion capture system based on mark point identification
KR102435406B1 (en) * 2020-07-03 2022-08-24 현대모비스 주식회사 Asynchronous control system in camera built-in lamp and method thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6592465B2 (en) * 2001-08-02 2003-07-15 Acushnet Company Method and apparatus for monitoring objects in flight
US6633294B1 (en) * 2000-03-09 2003-10-14 Seth Rosenthal Method and apparatus for using captured high density motion for animation

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3699856A (en) 1970-04-01 1972-10-24 Whittaker Corp Movement monitoring apparatus
US4389670A (en) * 1981-12-30 1983-06-21 The United States Of America As Represented By The United States Department Of Energy Electronic method for autofluorography of macromolecules on two-D matrices
US4417791A (en) 1982-08-19 1983-11-29 Jonathan Erland Process for composite photography
JP3036756B2 (en) * 1989-06-12 2000-04-24 日本電気株式会社 Oscillation circuit
US5235416A (en) * 1991-07-30 1993-08-10 The Government Of The United States Of America As Represented By The Secretary Of The Department Of Health & Human Services System and method for preforming simultaneous bilateral measurements on a subject in motion
US5903388A (en) 1992-06-11 1999-05-11 Sedlmayr Steven R High efficiency electromagnetic beam projector and systems and method for implementation thereof
US5304809A (en) * 1992-09-15 1994-04-19 Luxtron Corporation Luminescent decay time measurements by use of a CCD camera
US5519826A (en) 1994-04-29 1996-05-21 Atari Games Corporation Stop motion animation system
US5480341A (en) 1994-10-21 1996-01-02 Strottman International, Inc. Educational skeleton toy with outer shell
US5569317A (en) * 1994-12-22 1996-10-29 Pitney Bowes Inc. Fluorescent and phosphorescent tagged ink for indicia
US6020892A (en) * 1995-04-17 2000-02-01 Dillon; Kelly Process for producing and controlling animated facial representations
US5852672A (en) 1995-07-10 1998-12-22 The Regents Of The University Of California Image system for three dimensional, 360 DEGREE, time sequence surface mapping of moving objects
JP3745802B2 (en) 1995-10-13 2006-02-15 株式会社日立製作所 Image generation / display device
JPH105229A (en) * 1996-01-12 1998-01-13 Egawa:Kk Tomographic image equipment
CN1192249C (en) * 1996-06-19 2005-03-09 松下电工株式会社 Automatic-tracing lighting equipment, lighting controller and tracing apparatus
JP3873401B2 (en) 1996-11-19 2007-01-24 コニカミノルタセンシング株式会社 3D measurement system
GB9626825D0 (en) * 1996-12-24 1997-02-12 Crampton Stephen J Avatar kiosk
JP2002505134A (en) 1998-03-07 2002-02-19 クラウセン、クラウス‐フレンツ Exercise pattern evaluation method and apparatus
WO1999055220A1 (en) 1998-04-29 1999-11-04 Carnegie Mellon University Apparatus and method of monitoring a subject's eyes using two different wavelengths of light
US6149719A (en) * 1998-10-28 2000-11-21 Hewlett-Packard Company Light sensitive invisible ink compositions and methods for using the same
US7483049B2 (en) * 1998-11-20 2009-01-27 Aman James A Optimizations for live event, real-time, 3D object tracking
US6554706B2 (en) 2000-05-31 2003-04-29 Gerard Jounghyun Kim Methods and apparatus of displaying and evaluating motion data in a motion game apparatus
US6950104B1 (en) * 2000-08-30 2005-09-27 Microsoft Corporation Methods and systems for animating facial features, and methods and systems for expression transformation
US6850872B1 (en) 2000-08-30 2005-02-01 Microsoft Corporation Facial image processing methods and systems
JP2003106812A (en) * 2001-06-21 2003-04-09 Sega Corp Image information processing method, system and program utilizing the method
US7218320B2 (en) * 2003-03-13 2007-05-15 Sony Corporation System and method for capturing facial and body motion
US7333113B2 (en) * 2003-03-13 2008-02-19 Sony Corporation Mobile motion capture cameras
US7068277B2 (en) * 2003-03-13 2006-06-27 Sony Corporation System and method for animating a digital facial model
US7358972B2 (en) * 2003-05-01 2008-04-15 Sony Corporation System and method for capturing facial and body motion
US7369681B2 (en) * 2003-09-18 2008-05-06 Pitney Bowes Inc. System and method for tracking positions of objects in space, time as well as tracking their textual evolution
US7777199B2 (en) * 2004-09-17 2010-08-17 Wichita State University System and method for capturing image sequences at ultra-high framing rates
JP5149015B2 (en) 2004-12-28 2013-02-20 ハイパーメツド・イメージング・インコーポレイテツド Hyperspectral / multispectral imaging in the determination, evaluation and monitoring of systemic physiology and shock
US8330823B2 (en) * 2006-11-01 2012-12-11 Sony Corporation Capturing surface in motion picture

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6633294B1 (en) * 2000-03-09 2003-10-14 Seth Rosenthal Method and apparatus for using captured high density motion for animation
US6592465B2 (en) * 2001-08-02 2003-07-15 Acushnet Company Method and apparatus for monitoring objects in flight

Also Published As

Publication number Publication date
CN101427564A (en) 2009-05-06
JP4705156B2 (en) 2011-06-22
DE602005009141D1 (en) 2008-10-02
PT1715454E (en) 2008-11-28
US20060203096A1 (en) 2006-09-14
CA2519737A1 (en) 2006-09-10
CN101427564B (en) 2011-06-15
AU2005329027A1 (en) 2006-09-21
AU2005329027B2 (en) 2010-09-09
KR101182623B1 (en) 2012-09-14
SI1715454T1 (en) 2009-02-28
CA2519737C (en) 2017-09-05
CY1109533T1 (en) 2014-08-13
US7605861B2 (en) 2009-10-20
ES2313221T3 (en) 2009-03-01
NZ553106A (en) 2011-07-29
EP1715454A2 (en) 2006-10-25
PL1715454T3 (en) 2009-04-30
WO2006098770A2 (en) 2006-09-21
CA2973956A1 (en) 2006-09-10
CA3176795A1 (en) 2006-09-10
JP2008533810A (en) 2008-08-21
KR20070119603A (en) 2007-12-20
DK1715454T3 (en) 2008-12-15
CA2973956C (en) 2023-01-17
EP1715454B1 (en) 2008-08-20
ATE405899T1 (en) 2008-09-15
HK1096752A1 (en) 2007-06-08
EP1715454A3 (en) 2006-12-13

Similar Documents

Publication Publication Date Title
WO2006098770A3 (en) Apparatus and method for performing motion capture using shutter synchronization
AU2003295241A1 (en) Polyhydroxyalkanoate containing amide group, sulfonic group, and sulfonate ester group, method for producing the same, and charge control agent, toner, image forming method, and image forming apparatus
HK1186251A1 (en) Illumination optical apparatus, exposure apparatus, and exposure method
AU2003303449A1 (en) Transceiver with image capture device
EP1513008A4 (en) Image projector and image projecting method
EP1707996A4 (en) Optical retardation film and method for producing the same
AU2003291383A1 (en) Retractable camera apparatus
WO2009019886A1 (en) Normal information generating device and normal information generating method
AU2003208566A1 (en) An image projecting device and method
HK1106760A1 (en) Azo compound, composition for optical alignment film using same, and method for producing optical alignment film
AU2003289004A1 (en) Skin evaluation method and image simulation method
SG109576A1 (en) Optically controlled device, method of controlling the optically controlled device, spatial light modulator, and projector
AU2003276696A1 (en) Image forming apparatus
EP1905227A4 (en) An opening and closing apparatus for small image photographing devices
EP1803781A4 (en) Actinic light curable ink jet ink set, image forming method using the same, and ink jet recording apparatus
AU2003280994A1 (en) Film forming apparatus
AU2003234344A1 (en) Color image forming apparatus
AU2003275689A1 (en) Light source for image writing device, and production method for light source
AU2003294178A1 (en) Projection apparatus and image acquisition method
AU2003202498A1 (en) Exposure device and image forming device
EP1589380A4 (en) Negative charge controlling agent and static charge image developing toner using the same, and method for producing the same
WO2007146098A3 (en) System and method for performing motion capture using phosphor application techniques
DE602004008540D1 (en) Color image forming method and apparatus
AU2003292679A1 (en) Real time spectral image analysis device and analysis method
AU2003232416A1 (en) Digital camera adapted for taking images with a flashlight and corresponding method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005329027

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 553106

Country of ref document: NZ

WWE Wipo information: entry into national phase

Ref document number: 1528/DELNP/2007

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 2005329027

Country of ref document: AU

Date of ref document: 20050926

Kind code of ref document: A

WWP Wipo information: published in national office

Ref document number: 2005329027

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 200580030846.9

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2008500696

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 1020077008614

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 05801031

Country of ref document: EP

Kind code of ref document: A2