Door knocker control system for a remote controlled teleconferencing robot

mi iiiiiii ill mi mi iyijiiijiijii|jp mil linn mi mi mi

(12) United States Patent

Wang et al.

(io) Patent No.: (45) Date of Patent:

US 7,292,912 B2 Nov. 6, 2007

(54) DOOR KNOCKER CONTROL SYSTEM FOR A REMOTE CONTROLLED TELECONFERENCING ROBOT

(75) Inventors: Yulun Wang, Goleta, CA (US);

Charles S. Jordan, Santa Barbara, CA
(US); Jonathan Southard, Santa
Barbara, CA (US); Marco Pinter, Santa
Barbara, CA (US)

(73) Assignee: InTouch Technologies, Inc., Goleta, CA (US)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 804 days.

(21) Appl. No.: 10/728,453

(22) Filed: Dec. 5, 2003

(65) Prior Publication Data

US 2005/0122390 Al Jun. 9, 2005

(51) Int. CI.

G0SB 15/00 (2006.01)
G0SB 19/00 (2006.01)

(52) U.S. CI 700/259; 700/245; 700/246;

700/250; 700/254; 700/260; 700/261; 700/262;

318/568.12; 901/1; 901/2; 702/188

(58) Field of Classification Search 700/259,

700/245, 246, 250, 254, 260, 261, 262; 318/568.12;

901/1,2; 702/188 See application file for complete search history.

(56) References Cited

U.S. PATENT DOCUMENTS

A robot system that includes a robot and a remote station. The remote station may be a personal computer coupled to the robot through a broadband network. A user at the remote station may receive both video and audio from a camera and microphone of the robot, respectively. The remote station may include a graphical user interface that can be selected to generate an alert input to the robot. The user initially establishes a voice communication between the remote station and the robot. To obtain video access the user may select a graphical icon to generate and transmit the alert input to the robot. The caller recipient at the robot may grant the request for video of themselves by inputting a response into the robot. This procedure allows someone at the robot to control the initiation of a video-conference with the user of the remote station.

85 Claims, 11 Drawing Sheets

Zorn, Benjamin G., "Ubiquitous Telepresence", http://www.es.
colorado.edu/~zorn/ut/vision/vision.html, Mar. 5, 1996.
Paulos, et al. , "Ubiquitous Tele-embodiment: Applications and
Implications", International Journal of Human Computer Studies,
Jun. 1997, vol. 46, No. 6, pp. 861-877.

Paulos, et al., "Designing Personal Tele-Embodiment", Presented at the IEEE International Conference on Robotics and Animation, Leuven, Belgium, May 20, 1998.

Harmo et al., "Moving Eye—Interactive Telepresence Over Internet With a Ball Shaped Mobile Robot", 2000.

Loeb, Gerald, "Virtual Visit: Improving Communication for Those Who Need It Most", 2001.

Paulos, Eric John, "Personal Lele-Embodiment", 2001.

Hees, William P., "Communications Design for a Remote Presence

Robot", Jan. 14, 2002.

Jacobs et al., "LeleRehab: Applying Telemedicine to Outpatient Physical Therapy", 2002.

Jouppi, et al., :Mutually-Immersive Audio Telepresence, Audio Engineering Society Convention Paper, presented at 113th Convention Oct. 2002.

Jouppi, Norman P., "First Steps Towards Mutually-Immersive Mobile Telepresence", 2002.

Bauer, Jeffrey C, "Service Robots in Health Care: The Evolution of Mechanical Solutions to Human Resource Problems", Jun. 2003.

* cited by examiner