WO2008129431A2 - Matched communicating devices - Google Patents

Matched communicating devices Download PDF

Info

Publication number
WO2008129431A2
WO2008129431A2 PCT/IB2008/051083 IB2008051083W WO2008129431A2 WO 2008129431 A2 WO2008129431 A2 WO 2008129431A2 IB 2008051083 W IB2008051083 W IB 2008051083W WO 2008129431 A2 WO2008129431 A2 WO 2008129431A2
Authority
WO
WIPO (PCT)
Prior art keywords
communication
content
user
matched
devices
Prior art date
Application number
PCT/IB2008/051083
Other languages
French (fr)
Other versions
WO2008129431A3 (en
Inventor
Tim Everett
Original Assignee
Koninklijke Philips Electronics N.V.
U.S. Philips Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V., U.S. Philips Corporation filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2008129431A2 publication Critical patent/WO2008129431A2/en
Publication of WO2008129431A3 publication Critical patent/WO2008129431A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/167Systems rendering the television signal unintelligible and subsequently intelligible
    • H04N7/1675Providing digital key or authorisation information for generation or regeneration of the scrambling sequence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4405Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4408Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present system relates to communication and monitoring methods and devices that are pre-matched to each other for communication and exchange of content, such as audio, video and any other data or information, for example.
  • Advances in communication technology are leading to increased communication among various people and devices, through various media and systems.
  • Various communication choices are and becoming available, such as through wired and wireless systems, including mobile or cellular telephony, electronic email and Internet systems, for examples.
  • Devices may be paired, such as permanently, exclusively on a long term basis, or only for the duration of a single transaction or data exchange, as described in U.S. Patent No. 6,772,331 to Hind, which is hereby incorporated by reference in its entirety.
  • Another method with a reduced level of security includes pairing devices via generation of an encryption/decryption key for each new communication session using a personal identification number (PIN) chosen by the device manufacturer, so that the paired devices can communicate with each other immediately upon removal from their shipping box, without any need for configuration by the user.
  • PIN personal identification number
  • a communication system includes first and second devices which are matched to each other.
  • Each matched device includes an input device for capturing content; a memory for storing the content; a renderer configured to render the content; and a processor configured to control the first and/or second device for rendering the content and communicating between the first device and the second device.
  • the content of the first device is automatically available to be rendered on the second device.
  • FIG 1 shows communication devices according to one embodiment
  • FIG 2 shows a block diagram of a communication device according to one embodiment
  • FIG 3 shows a communication system according to one embodiment
  • FIG 4 shows a communication device according to one embodiment.
  • FIG 1 shows a system 100 according to an embodiment including a pair of devices 110, 120 that each have the ability to both capture and render content, such as images and sound, for example.
  • the devices 110, 120 may be sold as a matched pair with in-built knowledge of the other's identity.
  • Each device may have a display with integrated camera, speaker and microphone.
  • Each device further includes an RFID reader, ports and slot connection to external peripherals and insertion of cards, such as memory cards and/or broadband (e.g., cellular) communication cards, a processor configured to decode data such as pictures/video, and a communication system, e.g., configured for wired and/or wireless communication such as WiFi communication.
  • cards such as memory cards and/or broadband (e.g., cellular) communication cards
  • a processor configured to decode data such as pictures/video
  • a communication system e.g., configured for wired and/or wireless communication such as WiFi communication.
  • the matched devices may communication with each other including video messaging, photo sending and printing (e.g., via an external printer connected to a port or wirelessly connected (e.g., via BluetoothTM) to a matched device), shared gaming, etc. Further, the matched devices may be used for monitoring.
  • a master- slave relationship may also be one of the modes of operation where the master controls the slave, such as providing alarms or message, e.g., take your medicine, and continuously or periodically send such messages or alarms to the slave until an acknowledgment is received from the slaved device in response to a user input acknowledging receipt of the message or performing the function indicated in the message received from the master, such as taking the medicine, doing the homework, locking the doors, etc.
  • images and/or sound captured on one device are automatically made available to be rendered on the other device.
  • the user of the first device 110 may first request that content stored or captured by the first device be sent to the second device 120, and/or to further matched devices. Transmission of captured or stored content from one device to another may be in response to activating a key, which may be a hardware key on a frame of the device, or a software key displayed on a touch screen of the device. For example, merely touching the screen of the first device 110 may activate transmission of the displayed or selected content to the second device 120, or to further matched devices or to a, intermediary server 310, as will be described in connection with FIG 3.
  • the user of the receiving device may elect to automatically receive, without further user interaction, content sent by the first device 110 (or sent by further matched devices).
  • the user of the receiving device 120 may elect to accept rendering of content received from the transmitting device 110 or to chose which content to render, whether the content selected for rendering is newly sent by the first or transmitting device 110 (or sent by further matched devices) or previously sent and stored in the second device or in the server 310 connecting the one or more of the transmitting and receiving devices.
  • Rendering the content may be playing music, in the case the where the received content is audio, and displaying images in the case where the received content is video, which may be streamed from the server 310, or first stored in the memory of the receiving device 120 and then read out.
  • the two or more devices 110, 120 are paired or matched to each other, e.g., as part of the manufacture and/or a pre-sales process, communication between the devices 110, 120 require little or no end user setup or interaction. Any necessary information needed for matching or pairing the two devices 110, 120 are stored in a memory of each device prior to sale to the end user, such as storing in each device the identification, address and/or other information necessary for communication, including secure communication, such as authentication, encryption and decryption keys.
  • the devices 110, 120 appear to remain connected together regardless of the location of each device. Further, the devices 110, 120 are symmetrical so that images, messages or any data captured by the first device A I lO are made available to second device B 120 to be viewed at the second device B 120 at its user's or owner's convenience, and vice- versa. In one mode, content captured by one device is automatically rendered on the other matched device(s), e.g., displayed in the case where the content includes video. In addition, as the connection between the devices 110, 120 appears permanent, no addressing of messages is required. Thus in one embodiment, the act of capturing the message is all that is required in terms of user interaction.
  • FIG 2 shows a block diagram of each device 110, 120 shown in FIG 1.
  • the device 110 or 120 includes a processor 210 which is operationally coupled to a memory 220 and a communication block 230.
  • the communication block 230 may be used to communicate directly or indirectly to the other device in the pair, as well as to allow communication between the device 110 and external peripherals, such as cameras, large displays, microphones and/or speakers.
  • the communication system may be wired and/or wireless using various protocols, such as the 802.1 lb/g, GPRS, USB, and/or BluetoothTM protocols or connections, for example.
  • Further ports may also be provided for connection of external peripherals to the matched device(s) to connect cameras, microphones, speakers and other sensors or detectors. Slots may also be provided to receive various cards, such as memory cards, or communication cards such as broadband cellular communication cards for connection to a cellular telephony network, for example.
  • the processor 210 is also operationally coupled to input/output devices such as a user input system 240, which my include buttons or keys that may be on a keyboard attachable to or integrated with the device 110, 120, or soft buttons displayed on a touch sensitive screen or display 250 of the device 110, 120.
  • the display 250 may be a liquid crystal display (LCD), which may be touch sensitive, or any other type of display, used to present or display a user interface and show images (still or moving).
  • the processor 210 is also operationally coupled to other devices, such as an RFID reader 430 for reading data from RFID tags, shown in FIG 4.
  • the user input system 240 may be used to control the device 110 including selecting various modes, as well as capturing, storing, transmitting and rendering content.
  • the user input system 240 may include a touch screen covering the display, buttons surrounding the display a mouse, and/or a pointer in the case of a touch sensitive display for example.
  • other types of input devices may be provided, for instance, RFID tag readers or other devices that may also be used to influence the function of the paired devices 110, 120, e.g., by reading RFID tags for pairing or matching devices, set-up, mode selection or changing the function of the paired devices 110, 120, such as playing a game read by the RFID tag reader from an RFID positioned near the RFID tag reader.
  • An image input device 260 such as a camera or scanner, is operationally coupled to processor 210 for capturing images or any video data.
  • the image input device 260 may be used to capture still and/or moving images, and may be a camera built into the frame of the device, or connected to the device via the communications system 230.
  • the image input device 260 may also include a card reader, capable of reading memory cards from digital cameras, for example, thus allowing the first device 110 to send an image from a digital camera to its matched pair 120.
  • Any type of data such as audio, video, text and/or other type of data provided or captured by the first device 110, may be stored in the memory 220 of the first device, in addition to being available to the second device 120 which is matched with the first device 110.
  • any of the various blocks may be attachable to or integrated with the device 110, 120.
  • Each device 110, 120 also includes an audio input device 270, such as a microphone to capture audio data, such as audio messages or the audio track of a video message.
  • the audio data and/or other data may be stored in the memory 220 and/or transmitted to the matched device through the communication block 230.
  • the microphone and associated analog capture hardware may be built into the frame of the device 110, 120.
  • a video output device e.g., the display 250
  • an audio output device e.g., the display 250
  • the audio output device 270 may also be operationally coupled to the processor 210.
  • the audio output device 270 may be used to replay the audio component of messages and/or may be used as part of the user interface.
  • the audio output device 270 may be implemented using one or more speakers built into the device frame with the associated digital to analog hardware.
  • a further embodiment may include various sockets, such as audio/video
  • IN/OUT sockets for connection to a headphone, microphone, camera, display, etc.
  • Communication between the matched devices 110, 120 may be direct such as through wired or wireless/cellular telephony or through other networks such as the Internet.
  • communication between the devices 110, 120 may be indirect via a server, for example.
  • the mutual identities of matched devices 110, 120 in a pair are programmed into each device 110, 120 as part of the manufacturing (or a pre-sales) process.
  • the pair of devices 110, 120 may be sold as a matched pair.
  • a pair of matched devices is described for simplicity, it should be understood that any number of devices may be matched by programming, e.g., pre or post sale, in each device all the identities of devices that are matched.
  • the devices Once purchased or programmed with the identity or identities of the matched devices, the devices may be physically be in different locations, but they remain able to communicate with each other without the owners needing to know the locations of the matched devices.
  • the devices 110, 120 may communicate directly with each other using a peer to peer connection, such as General Packet Radio Service (GPRS), a cellular phone network, and/or even a normal phone line using a built in modem, for example.
  • a server may be used as an intermediary for communication between or among the matched devices. Using a server has the added advantages of not needing to store all pending messages on the devices themselves, and not needing the devices to be switched on all the time. Message exchanged between the two devices may be encrypted as is well known in the art using various keys known to both devices, such as stored pre-sale, e.g., by the manufacturer, or keys that may be generated by the devices 110, 120 using a known seed, for example.
  • a further advantage of having the pairing hard wired into the devices is that it becomes simpler to implement encryption of any messages between the devices 110, 120, since, for example, there is no need for a secure mechanism for exchanging encryption keys.
  • FIG 3 shows an illustrative example of implementation or system 300 of the paired devices 110, 120.
  • two matched devices 110, 120 are connected together using a server 310 as an intermediary.
  • the communication medium 370 used may be the internet, with the devices 110, 120 connecting to it using the 802.1 Ig wireless ethernet protocol via a respective commonly available routing device 350, 360.
  • the communication block 230 shown in FIG 2 is an 802.1 Ig wireless Ethernet device. Each device uses the 802.1 Ig wireless device 230 to connect to the Internet 370, to connect to the server 310, where the IP address of the server 310 is known to each of the paired or matched devices 110, 120.
  • the server may simply be a processor with memory, such as random access memory (RAM) and a hard disk memory, for example, with a connection to the Internet 370.
  • FIG 4 shows an illustrative embodiment of a device 110 that may be matched to other devices 120.
  • the device 110 includes a touch sensitive LCD display 250 surrounded by a frame 410 and has a stand 420 for standing the display on a surface, to resemble a picture frame.
  • a camera 260 and a microphone are incorporated in the frame 410.
  • the frame 410 or device 110 may include one or more speakers 280 and an RFID tag reader 430.
  • the first device 110 sends a message to its partner or the second device 120
  • the second scenario describes how a device receives a previously sent message.
  • the following operations may be carried out.
  • the user or owner of the first device 110 indicates that it is desired to send a message, e.g., by pushing a button, which may be a hardware key on the frame 510 or a software key displayed on the touch screen 250.
  • the device 110 may be configured that by simply touching the screen 250 anywhere initiates a process that may include various operations, such as recording a message or selecting a message stored in the memory for transmission to the second device 120.
  • touching the screen 250 of the first device 110 initiates recording of images and/or audio and storage in the device memory 220. Touching the screen 250 again, either anywhere or at some designated area such as a displayed soft key, indicates that the message is completed. It should be understood that in various embodiments, touching the screen may result in the display of one or more soft keys and/or menus of actions for selection by the user, such as start recording, save, read from memory, send, etc. One or more soft keys and/or dialogue boxes and menus may be displayed to prompt the reader for a next action or selection of a next action from a plurality of choice displayed on the screen, for example.
  • the processor 210 of the first device A 110 Upon completion of the recording or storage of content, whether video, audio, text or any other type of data or information, the processor 210 of the first device A 110 is configured to convert the captured or stored message or content, e.g., images and audio, into a transmission format, which may be any format understood by the partner or second device B 120.
  • the first device 110 may optionally encrypt the message using a key only known to the second device B 120.
  • the first device 110 contacts the server 310 at the known IP address.
  • the server 310 authenticates the identity of the first device 110 using any authentication means as is well known in the art.
  • the server 310 uploads the message along with the ID of the recipient or second device 120 obtained from the first device, such as included with the message transmitted by the first device 110 to the server 310.
  • the server may have in its memory a list that indicates the matching, e.g., the identities and addresses of the matched devices 110, 120, in which case, merely the identity of the first device 110 is transmitted to server 310 without transmission of information (e.g., the identities and addresses) of the second device 120 since, upon authentication, server 310 may obtain the necessary information of second device 120 from the list stored in the memory of the server 310.
  • the server 310 stores the message waiting to be contacted by the second device B 120.
  • the second device B 120 automatically checks, e.g., periodically polls the server 310 for new messages at periodic intervals without user interaction, for example, by contacting the server 310. Upon contacting the server, the second device B 120 authenticates itself. In response to being contacted by the second device 120, the server 310 may send a new message, which may be the last message or may be based on other preselected criteria (e.g., by a user, owner etc.) such as the last video, audio, text and/or any other type of message, for example. Additionally or alternately, the server 310 may send an indication of the number of waiting messages. For example, if there are any messages waiting, this fact is indicated as a displayed message on the display of the second or receiving device 120, such as indicating the number and/or type of messages.
  • the owner of the second device B 120 e.g., seeing the indication of a waiting message, signals the wish to view the message using the touch screen, e.g., by touching it the screen or a designated portion where a soft key may be displayed.
  • the second device B 120 may then carry out the following steps.
  • the second device B 120 contacts the server 310 and authenticates itself.
  • the second device 120 requests and downloads the latest message(s). If encryption had been used, then the second device 120 decrypts the message.
  • the second device 120 may now display the message, replacing any previous message on the screen, for example. Further user interaction may be performed to playback the message if it contains moving video or audio, for example.
  • a content captured by one device is automatically rendered on the second device without any user interaction.
  • Various modifications and modes may be employed and selected by the user(s), such as touching the screen of the sending device to transmit content, and touching the screen of the receiving device to receive content, e.g., that may be stored and waiting at the server 310, and/or render or select content already receive and stored at the receiving device.
  • the matched two or more devices which are uniquely coupled to each other in a similar way as a set of 'walkie-talkies' (also called two-way radio), allow content stored or captured in one device to automatically be available or be rendered at the other matched device(s), thus providing a simple communication and/or monitoring system.
  • the data or content captured by input devices of one matched device 110 such as video/audio signals from the camera 260 and microphone 270, are automatically rendered or available for rendering at the other matched device(s) 120.
  • any other input devices or sensors may be included such as temperature, smoke and motions sensors to provide for security monitoring for fires and unauthorized intrusions at the location of the one of the matched devices.
  • other uses may be envisioned such as real time videoconferencing, messaging including storing messages in one or more mailboxes associated with different users of the receiving matched device, where identification of the sending matched device is included in the stored message particularly in the case where there are more than two matched devices.
  • Communication between or among the matched devices may be through any communication link, wired, or wireless, direct or indirect such as through a server via any network such as the internet, a telephone network or a satellite network, etc.
  • One of the matched devices may have supervisory authority (master device) to control other matched and devices (slave devices) where content displayed on the slave devices may be selected by the master device.
  • the master may control sensors and actuators connectable to the slave device to detect various aspects at the location of the slave device, such as to control temperature, lighting, locking doors etc.
  • sensors connectable to the matched devices may be worn by the user to detect and monitor biological function, such as the user heart rate for example, where user vital signs or other sensed data are transmitted to the local device via BluetoothTM or any other communication protocol, for example, thus becoming available or being automatically rendered at another matched device, e.g., at the master device located at a remote location different from the location of the user and/or the slave device.
  • Communication may be seamlessly switched from one communication level or medium to another. For instance, a user may travel with a matched device that detects a communication network in a new environment, such as a hotel room, or may communicate using a cellular phone network, such as linking to the mobile phone of the user through BluetoothTM, for example. That is, the processor 210 may be configured to automatically detect and ascertain resources at the current location of the matched first device 110 to automatically effectuate communication with the second matched device 120.
  • grandma touches the screen 250 of the first device 110 to initiate sending a message, and a message is captured using internal camera 260 and microphone 270.
  • the message is then sent to the server 310 for the paired frame or second device 120 to pick up.
  • the second device 120 regularly polls the server 310.
  • the server 310 indicates a new message has been sent by the first device 110 and an alert is shown on screen of the second device 120.
  • the grandchild touches the screen of the second device 120 to access the new message which is now displayed, e.g., grandma's photo and voice.
  • the received grandma's photo may remain displayed in the second device 120, which may the form of a picture frame, until it is changed, e.g., by the user of the second device, or upon reception of another photo or video.
  • matched devices 110, 120 may including sending still pictures from in-built camera; sending still pictures from an external digital camera connected to the device; sending still pictures from in-built camera at regular intervals; remote playing of games based on two (or more) players such as Battleships, Chess; ordering prints of pictures received or printing them through an external printer connected to the device; narrating or listening to a story; lifestyle and medical monitoring of an elderly relative (remote display from additional sensors); real-time video chat with additional hardware for real-time encoding, as necessary, and the like.
  • the matched devices require minimal user interaction and setup. For example, returning to the illustrative scenario, Grandma, who got the first device 110, didn't have broadband so she bought the recommended service with a wireless modem. She plugs in the picture frame or first device 110 and a router 350 connected to the service provider, e.g., via a coaxial or fiber optic cable. The router 350 wirelessly communicates with the first device 110 e.g., using the 802.1 Ig wireless Ethernet protocol. The picture frame or first device 110 directs grandma to put an RFID installation card next to the first device 110 for reading information e.g., via the RFID tag reader 430 of the first device 110. This configures the modem and the frame or first device 110 registers with server 310.
  • the server 310 indicates that the matched frame or first device 110 is not yet registered and invites grandma to send a welcome message.
  • the grandchildren already have broadband and a wireless network and router, so they plug in the second device 120 which the wireless network and registers with the server 310.
  • the server 310 indicates a message has been sent and an alert is shown on the screen of the second device 120.
  • One of the grandchildren touches the screen to access the new message.
  • Grandpa buys an RFID card to play Battleships.
  • the function of the frame changes where, instead of displaying a photo for example, the frame 110 starts a game of Battleships on the server 310 and displays the board of the game on the screen 250. Grandpa takes his turn and plays. After a short time, the screen reverts to the previous function (or a default function, which may be preselected or predetermined), e.g., the screen reverts to the main photo, with an icon to indicate a game is in progress.
  • the frames or devices 110, 120 regularly poll the server 310.
  • the server 310 sends the second device 120 an indication that a new game has started and the opponent (using the first device 120) has moved.
  • An alert or indicator is shown on screen 250 of the second device 120.
  • the grandchild touches the screen to access the new game.
  • the server 310 displays the board of the game, and the grandchild takes his turn and moves or plays.
  • the screen 250 of the second device reverts to the main photo, for example, with an icon to indicate a game is in progress.
  • grandma touches the screen 250 to initiate sending a photo.
  • a picture is previewed using the internal camera 260.
  • Grandma touches the screen 250 again to take and/or store the picture.
  • the picture is then sent to the server 310 for pick-up by the paired frame or second device 120.
  • the devices 110, 120 regularly poll the server 310.
  • the server indicates to the second device 120 that a new photo has been sent by the first device 110.
  • An alert or indication is shown on the screen of the second device 120.
  • the grandchild touches the screen 250 of the second device 120 to access the new photo.
  • the main photo is again displayed on frame.
  • the new photo remains displayed on the screen until further action by the user or grandchild of the second device 120 that received the new photo.
  • the grandchild takes pictures with an external digital camera.
  • the grandchild takes the memory or SD card from the camera and puts the memory card into a slot of the frame 410 of the matched device 120.
  • the data e.g., the pictures
  • the data are read from the removable memory card inserted in the card reader slot, and the read pictures are displayed on the screen 250 of the second device 120.
  • the grandchild touches the frame or screen to select a picture.
  • the selected picture is then sent to the server 310 for the paired frame 110 to pick up.
  • the receiving frame 110 regularly polls the server 310 which indicates a new photo has been sent by the transmitting frame 120. An alert is shown on the screen 250 of the receiving frame 110.
  • Grandma touches the screen 250 to access the newly received photo. After the new photo is displayed, the main photo is again displayed on frame 120, for example.
  • the transmitting frame 110 may be configured to send photos at periodic intervals, for example where, at certain time intervals, the internal camera 260 captures a picture. The captured picture is then sent to the server 310 for the paired receiving frame 120 to pick up. The receiving frame 120 regularly polls the server 310 that indicates a new regular photo has been sent. The new photo is displayed on the receiving frame 120.
  • touch the screen e.g., at a particular portion such a left corner, or touching a displayed soft key
  • earlier or previous photos may be displayed on the screen 250.
  • grandma touches the screen 250 (or a dedicated portion thereof or a displayed soft key) to view previous photos.
  • grandma touches the screen 250 (or a dedicated portion thereof or a displayed soft key) to select another photo as the main photo.
  • the new main photo is then displayed on the screen 250.
  • Selected data may also be printed.
  • Grandma touches the screen (or a dedicated portion thereof or a displayed soft key) to view previous photos, and touches the screen (or a dedicated portion thereof or a displayed soft key) to select a photo for printing.
  • the server 310 sends the photo for printing and printed photo is dispatched to Grandma by a postal service for example.
  • Another illustrative example includes storybook sharing.
  • Grandpa buys an RFID card to read "The Gruffalo.” He puts the card or RFID tag close to the frame or the first device 110.
  • the first device 110 accesses the pages of the book from the server 310 and displays them on the screen 250.
  • Grandpa narrates the story.
  • the audio recording is then sent to the server 310 for the paired frame 120 to pick up.
  • the paired frame 120 regularly polls the server 310 that indicates a new book reading has been sent.
  • An alert is shown on the screen 250 of the receiving paired device 120.
  • the pages of "The Gruffalo" are displayed of the screen of the receiving paired device 120 with Grandpa's narration rendered though the speaker(s) 280.
  • the matched devices 110, 120 may also have a guardian angel mode. For example, a family buys set of sensors and control box. The sensors are placed around the house. An RFID card from the sensor kit is put next to the first device 110 to associates this set of sensors with the matched frames 110, 120. One of more matched devices 110 may monitor and report the status of the sensors. If Grandma has multiple matched frames or devices at different locations or rooms, then this can be repeated and additional sensors monitored at the various locations or rooms throughout a house, for example. The two or more matches frames or devices regularly poll the server 310 that indicates a set of sensors has been added to the other location(s), which may be another room in a house, or another house remote from grandma's house.
  • an overlay or icons may be displayed of summary information of data sensed by the various sensors the sensors. Touching a displayed icon brings up more detailed and historical data related to the icon.
  • the matched devices may have wireless, e.g., cellular or satellite, access to the internet, such as a mobile broadband communication card, which may be removable and insertable in a communication slot of the matched device(s) to provide access to the Internet or other networks.
  • a picture frame has been described as one embodiment, any device or shape may be used to provide matched communication and monitoring.
  • PDA personal digital assistants
  • the processor 210 may be any type of controller or processor, such as those described in U.S.
  • 2003/0057887 which is incorporated herein by reference in its entirety, that is capable of providing control signals in response to input signals from the input/output devices, e.g., for selecting modes of operation, capturing and storing information in the memory 220, transmitting and receiving information, executing instruction stored in the memory 220, which may be any type of memory, RAM, ROM, removable memory, CD-ROM, and the like, also as described in U.S. 2003/0057887.
  • the processor 210, memory 220, input/output devices 240, 250, 260, 270, 280 although shown as being part of the device 110, may be integrated units, or separate units alone or in combination with other units.
  • the memory 220 and other memories may be any type of device for storing information and programming application data.
  • the programming application data and other data are received by the one or more processors for configuring the one or more processors to perform operation acts in accordance with the present system.
  • the operation acts may include controlling the device 110 to display a graphical user interface (GUI) for user interaction with the present system, and configuring the one or more processors.
  • GUI graphical user interface
  • the input device 240 may further include a keyboard, mouse, trackball, or other device, such as the touch sensitive display 250 or further display, which may be stand alone or be a part of a system, such as part of a personal computer, personal digital assistant, any rendering device (e.g., MP3 player) and/or display device for communicating with the processor 210 via any type of link, such as a wired or wireless link.
  • the user input device is operable for interacting with the processor including interaction within a paradigm of a GUI for interaction with elements of the present system.
  • the one or more processors, memories, displays, and/or user input devices may all or partly be a portion of a computer system or other device.
  • the methods of the present system are particularly suited to be carried out by a computer software program, such program containing modules corresponding to one or more of the individual steps or acts described and/or envisioned by the present system.
  • a computer software program such program containing modules corresponding to one or more of the individual steps or acts described and/or envisioned by the present system.
  • Such program and elements thereof may of course be embodied in a computer-readable medium, such as an integrated chip, a peripheral device or memory, and/or other one or more memories coupled to the one or more processors.
  • One or more of the memories may be any recordable medium (e.g., RAM, ROM, removable memory, CD-ROM, hard drives, DVD, floppy disks or memory cards) or may be a transmission medium (e.g., a network comprising fiber-optics, the world-wide web, cables, a wireless channel using time-division multiple access, code-division multiple access, other radio -frequency and/or wireless communication channel). Any medium known or developed that may store and/or transmit information suitable for use with a computer system, processor, etc., may be used as one or more of the memories.
  • a recordable medium e.g., RAM, ROM, removable memory, CD-ROM, hard drives, DVD, floppy disks or memory cards
  • a transmission medium e.g., a network comprising fiber-optics, the world-wide web, cables, a wireless channel using time-division multiple access, code-division multiple access, other radio -frequency and/or wireless communication channel.
  • These memories may configure the processor to render the GUIs and implement the methods, operational acts, and functions disclosed herein.
  • the memories may be distributed or local and the processor, where additional processors may be provided, may also be distributed or may be singular.
  • the GUI may be embedded in a web- based application that is wholly or partially provided by a remote processor.
  • the memories may be implemented as electrical, magnetic or optical memory, or any combination of these or other types of storage devices.
  • the term "memory" should be construed broadly enough to encompass any information able to be read from or written to an address in the addressable space accessible by a processor. With this definition, information on a network is still within the memory, for instance, because the processor may retrieve the information from the network for operation in accordance with the present system.
  • the one or more processors may be capable of providing control signals and/or performing operations in response to input signals and executing instructions stored in the one or more memories.
  • the input signals may be from any user input device including the camera 260, microphone 270, motion, heat, smoke sensors, and medical monitoring sensors that may be attached to a monitored user of the device 110.
  • One or more of the processors may be an application- specific and/or general-use integrated circuit(s). Further, the processors may be a dedicated processor for performing in accordance with the present system and/or may be general-purpose processors wherein only one of many functions operates for performing in accordance with the present system.
  • the one or more processors may operate utilizing a program portion, multiple program segments, and/or may be a hardware device utilizing a dedicated or multi-purpose integrated circuit. Further, in a distributed system, portions of an operation may be performed on one device with data generated therefrom being transferred to one or more further devices.

Abstract

A communication system (100) includes first (110) and second (120) devices which are matched to each other. Each matched device includes an input device for capturing content; a memory for storing the content; a renderer configured to render the content; and a processor configured to control the first and/or second device for rendering the content and communicating between the first device and the second device. The content of the first device is automatically available to be rendered on the second device.

Description

MATCHED COMMUNICATING DEVICES
This application claims the benefits of U.S. Provisional Patent Application Serial No. 60/912,742 filed on April 19, 2007, the teachings of which are incorporated herein by reference.
The present system relates to communication and monitoring methods and devices that are pre-matched to each other for communication and exchange of content, such as audio, video and any other data or information, for example.
Advances in communication technology are leading to increased communication among various people and devices, through various media and systems. Various communication choices are and becoming available, such as through wired and wireless systems, including mobile or cellular telephony, electronic email and Internet systems, for examples.
Several communication systems and devices are proposed to simplify communication or monitoring, and increase efficiency. For example WO 99/17213 to White, which is hereby incorporated by reference in its entirety, describes a communication system where additional devices may be easily integrated into the system, and does not require that each communication link between devices be separately established. Conventional monitoring systems include vehicle surveillance and control systems, as described in U.S. Patent Application Publication Nos. 2006/0170770 to
MacCarthy and 2006/0047375 to Eichmann, which are hereby incorporated by reference in their entirety. Further, GB 2,384,933 to Ormson, which is hereby incorporated by reference in its entirety, described a closed circuit television system that uses a cellular network. Full service, multi-media surveillance systems with automatic assessment and response are also known, such as described in U.S. Patent No. 6,970,183 to Monroe, which is hereby incorporated by reference in its entirety.
Devices may be paired, such as permanently, exclusively on a long term basis, or only for the duration of a single transaction or data exchange, as described in U.S. Patent No. 6,772,331 to Hind, which is hereby incorporated by reference in its entirety. Another method with a reduced level of security includes pairing devices via generation of an encryption/decryption key for each new communication session using a personal identification number (PIN) chosen by the device manufacturer, so that the paired devices can communicate with each other immediately upon removal from their shipping box, without any need for configuration by the user.
There is a need for simple communication systems and paired devices that allow for exchange of content and control information in a simple manner, where content is exchanged and rendered in accordance with predetermined and/or selected settings.
One object of the present systems and methods is to overcome the disadvantages of conventional communication systems and devices. According to one illustrative embodiment, a communication system includes first and second devices which are matched to each other. Each matched device includes an input device for capturing content; a memory for storing the content; a renderer configured to render the content; and a processor configured to control the first and/or second device for rendering the content and communicating between the first device and the second device. The content of the first device is automatically available to be rendered on the second device.
Further areas of applicability of the present devices, systems and methods will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating exemplary embodiments of the systems and methods, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
These and other features, aspects, and advantages of the apparatus, systems and methods of the present invention will become better understood from the following description, appended claims, and accompanying drawing where:
FIG 1 shows communication devices according to one embodiment; and
FIG 2 shows a block diagram of a communication device according to one embodiment; FIG 3 shows a communication system according to one embodiment; and
FIG 4 shows a communication device according to one embodiment.
The following description of certain exemplary embodiments is merely exemplary in nature and is in no way intended to limit the invention, its applications, or uses. In the following detailed description of embodiments of the present systems and methods, reference is made to the accompanying drawings which form a part hereof, and in which are shown by way of illustration specific embodiments in which the described systems and methods may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the presently disclosed systems and methods, and it is to be understood that other embodiments may be utilized and that structural and logical changes may be made without departing from the spirit and scope of the present system. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present system is defined only by the appended claims. The leading digit(s) of the reference numbers in the figures herein typically correspond to the figure number, with the exception that identical components which appear in multiple figures are identified by the same reference numbers. Moreover, for the purpose of clarity, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description of the present system.
FIG 1 shows a system 100 according to an embodiment including a pair of devices 110, 120 that each have the ability to both capture and render content, such as images and sound, for example. The devices 110, 120 may be sold as a matched pair with in-built knowledge of the other's identity. Each device may have a display with integrated camera, speaker and microphone. Each device further includes an RFID reader, ports and slot connection to external peripherals and insertion of cards, such as memory cards and/or broadband (e.g., cellular) communication cards, a processor configured to decode data such as pictures/video, and a communication system, e.g., configured for wired and/or wireless communication such as WiFi communication. The matched devices, whether two or more, may communication with each other including video messaging, photo sending and printing (e.g., via an external printer connected to a port or wirelessly connected (e.g., via Bluetooth™) to a matched device), shared gaming, etc. Further, the matched devices may be used for monitoring. A master- slave relationship may also be one of the modes of operation where the master controls the slave, such as providing alarms or message, e.g., take your medicine, and continuously or periodically send such messages or alarms to the slave until an acknowledgment is received from the slaved device in response to a user input acknowledging receipt of the message or performing the function indicated in the message received from the master, such as taking the medicine, doing the homework, locking the doors, etc. In one embodiment, images and/or sound captured on one device are automatically made available to be rendered on the other device. In other embodiment, the user of the first device 110 may first request that content stored or captured by the first device be sent to the second device 120, and/or to further matched devices. Transmission of captured or stored content from one device to another may be in response to activating a key, which may be a hardware key on a frame of the device, or a software key displayed on a touch screen of the device. For example, merely touching the screen of the first device 110 may activate transmission of the displayed or selected content to the second device 120, or to further matched devices or to a, intermediary server 310, as will be described in connection with FIG 3.
In a further embodiments, the user of the receiving device (e.g., the second device 120 and/or further matched devices), may elect to automatically receive, without further user interaction, content sent by the first device 110 (or sent by further matched devices). In addition or alternately, the user of the receiving device 120 may elect to accept rendering of content received from the transmitting device 110 or to chose which content to render, whether the content selected for rendering is newly sent by the first or transmitting device 110 (or sent by further matched devices) or previously sent and stored in the second device or in the server 310 connecting the one or more of the transmitting and receiving devices. Rendering the content may be playing music, in the case the where the received content is audio, and displaying images in the case where the received content is video, which may be streamed from the server 310, or first stored in the memory of the receiving device 120 and then read out. As the two or more devices 110, 120 are paired or matched to each other, e.g., as part of the manufacture and/or a pre-sales process, communication between the devices 110, 120 require little or no end user setup or interaction. Any necessary information needed for matching or pairing the two devices 110, 120 are stored in a memory of each device prior to sale to the end user, such as storing in each device the identification, address and/or other information necessary for communication, including secure communication, such as authentication, encryption and decryption keys.
Once the devices 110, 120 are paired or matched, the devices 110, 120 appear to remain connected together regardless of the location of each device. Further, the devices 110, 120 are symmetrical so that images, messages or any data captured by the first device A I lO are made available to second device B 120 to be viewed at the second device B 120 at its user's or owner's convenience, and vice- versa. In one mode, content captured by one device is automatically rendered on the other matched device(s), e.g., displayed in the case where the content includes video. In addition, as the connection between the devices 110, 120 appears permanent, no addressing of messages is required. Thus in one embodiment, the act of capturing the message is all that is required in terms of user interaction. Sending the message/image between the first device A I lO and its matched pair 120 is automatic. FIG 2 shows a block diagram of each device 110, 120 shown in FIG 1. As shown in FIG 2, the device 110 or 120 includes a processor 210 which is operationally coupled to a memory 220 and a communication block 230. The communication block 230 may be used to communicate directly or indirectly to the other device in the pair, as well as to allow communication between the device 110 and external peripherals, such as cameras, large displays, microphones and/or speakers. The communication system may be wired and/or wireless using various protocols, such as the 802.1 lb/g, GPRS, USB, and/or Bluetooth™ protocols or connections, for example. Further ports may also be provided for connection of external peripherals to the matched device(s) to connect cameras, microphones, speakers and other sensors or detectors. Slots may also be provided to receive various cards, such as memory cards, or communication cards such as broadband cellular communication cards for connection to a cellular telephony network, for example.
The processor 210 is also operationally coupled to input/output devices such as a user input system 240, which my include buttons or keys that may be on a keyboard attachable to or integrated with the device 110, 120, or soft buttons displayed on a touch sensitive screen or display 250 of the device 110, 120. The display 250 may be a liquid crystal display (LCD), which may be touch sensitive, or any other type of display, used to present or display a user interface and show images (still or moving). The processor 210 is also operationally coupled to other devices, such as an RFID reader 430 for reading data from RFID tags, shown in FIG 4. The user input system 240 may be used to control the device 110 including selecting various modes, as well as capturing, storing, transmitting and rendering content. The user input system 240 and may include a touch screen covering the display, buttons surrounding the display a mouse, and/or a pointer in the case of a touch sensitive display for example. In addition or alternately, other types of input devices may be provided, for instance, RFID tag readers or other devices that may also be used to influence the function of the paired devices 110, 120, e.g., by reading RFID tags for pairing or matching devices, set-up, mode selection or changing the function of the paired devices 110, 120, such as playing a game read by the RFID tag reader from an RFID positioned near the RFID tag reader.
An image input device 260, such as a camera or scanner, is operationally coupled to processor 210 for capturing images or any video data. The image input device 260 may be used to capture still and/or moving images, and may be a camera built into the frame of the device, or connected to the device via the communications system 230. In addition or alternately, the image input device 260 may also include a card reader, capable of reading memory cards from digital cameras, for example, thus allowing the first device 110 to send an image from a digital camera to its matched pair 120. Any type of data, such as audio, video, text and/or other type of data provided or captured by the first device 110, may be stored in the memory 220 of the first device, in addition to being available to the second device 120 which is matched with the first device 110. Further, any of the various blocks may be attachable to or integrated with the device 110, 120. Each device 110, 120 also includes an audio input device 270, such as a microphone to capture audio data, such as audio messages or the audio track of a video message. The audio data and/or other data may be stored in the memory 220 and/or transmitted to the matched device through the communication block 230. The microphone and associated analog capture hardware may be built into the frame of the device 110, 120. In addition to a video output device, e.g., the display 250, an audio output device
270, such as speakers, may also be operationally coupled to the processor 210. The audio output device 270 may be used to replay the audio component of messages and/or may be used as part of the user interface. The audio output device 270 may be implemented using one or more speakers built into the device frame with the associated digital to analog hardware. A further embodiment may include various sockets, such as audio/video
IN/OUT sockets for connection to a headphone, microphone, camera, display, etc.
Communication between the matched devices 110, 120, e.g., via the respective communication blocks 230, may be direct such as through wired or wireless/cellular telephony or through other networks such as the Internet. In addition or alternately, communication between the devices 110, 120 may be indirect via a server, for example.
In one embodiment, the mutual identities of matched devices 110, 120 in a pair are programmed into each device 110, 120 as part of the manufacturing (or a pre-sales) process. The pair of devices 110, 120 may be sold as a matched pair. Although a pair of matched devices is described for simplicity, it should be understood that any number of devices may be matched by programming, e.g., pre or post sale, in each device all the identities of devices that are matched. Once purchased or programmed with the identity or identities of the matched devices, the devices may be physically be in different locations, but they remain able to communicate with each other without the owners needing to know the locations of the matched devices.
In one embodiment, the devices 110, 120 may communicate directly with each other using a peer to peer connection, such as General Packet Radio Service (GPRS), a cellular phone network, and/or even a normal phone line using a built in modem, for example. In addition or alternately, a server may be used as an intermediary for communication between or among the matched devices. Using a server has the added advantages of not needing to store all pending messages on the devices themselves, and not needing the devices to be switched on all the time. Message exchanged between the two devices may be encrypted as is well known in the art using various keys known to both devices, such as stored pre-sale, e.g., by the manufacturer, or keys that may be generated by the devices 110, 120 using a known seed, for example. A further advantage of having the pairing hard wired into the devices (e.g., having the identity of one device stored in the memory of the other device) is that it becomes simpler to implement encryption of any messages between the devices 110, 120, since, for example, there is no need for a secure mechanism for exchanging encryption keys.
FIG 3 shows an illustrative example of implementation or system 300 of the paired devices 110, 120. In this example, two matched devices 110, 120 are connected together using a server 310 as an intermediary. The communication medium 370 used may be the internet, with the devices 110, 120 connecting to it using the 802.1 Ig wireless ethernet protocol via a respective commonly available routing device 350, 360. In this embodiment, the communication block 230 shown in FIG 2 is an 802.1 Ig wireless Ethernet device. Each device uses the 802.1 Ig wireless device 230 to connect to the Internet 370, to connect to the server 310, where the IP address of the server 310 is known to each of the paired or matched devices 110, 120. The server may simply be a processor with memory, such as random access memory (RAM) and a hard disk memory, for example, with a connection to the Internet 370. FIG 4 shows an illustrative embodiment of a device 110 that may be matched to other devices 120. As shown in FIG 4, the device 110 includes a touch sensitive LCD display 250 surrounded by a frame 410 and has a stand 420 for standing the display on a surface, to resemble a picture frame. A camera 260 and a microphone are incorporated in the frame 410. Further, the frame 410 or device 110 may include one or more speakers 280 and an RFID tag reader 430.
Operation of the devices 110, 120 will now be described using two illustrative scenarios. In the first scenario, the first device 110 sends a message to its partner or the second device 120, and the second scenario describes how a device receives a previously sent message. In one embodiment related to transmission of messages, such as where the owner of the first device A I lO wishes to send a message, the following operations may be carried out. The user or owner of the first device 110 indicates that it is desired to send a message, e.g., by pushing a button, which may be a hardware key on the frame 510 or a software key displayed on the touch screen 250. The device 110 may be configured that by simply touching the screen 250 anywhere initiates a process that may include various operations, such as recording a message or selecting a message stored in the memory for transmission to the second device 120.
Illustratively, touching the screen 250 of the first device 110 initiates recording of images and/or audio and storage in the device memory 220. Touching the screen 250 again, either anywhere or at some designated area such as a displayed soft key, indicates that the message is completed. It should be understood that in various embodiments, touching the screen may result in the display of one or more soft keys and/or menus of actions for selection by the user, such as start recording, save, read from memory, send, etc. One or more soft keys and/or dialogue boxes and menus may be displayed to prompt the reader for a next action or selection of a next action from a plurality of choice displayed on the screen, for example.
Upon completion of the recording or storage of content, whether video, audio, text or any other type of data or information, the processor 210 of the first device A 110 is configured to convert the captured or stored message or content, e.g., images and audio, into a transmission format, which may be any format understood by the partner or second device B 120. The first device 110 may optionally encrypt the message using a key only known to the second device B 120. Next, the first device 110 contacts the server 310 at the known IP address. In turn, the server 310 authenticates the identity of the first device 110 using any authentication means as is well known in the art. After successful authentication, the server 310 uploads the message along with the ID of the recipient or second device 120 obtained from the first device, such as included with the message transmitted by the first device 110 to the server 310. Of course, the server may have in its memory a list that indicates the matching, e.g., the identities and addresses of the matched devices 110, 120, in which case, merely the identity of the first device 110 is transmitted to server 310 without transmission of information (e.g., the identities and addresses) of the second device 120 since, upon authentication, server 310 may obtain the necessary information of second device 120 from the list stored in the memory of the server 310. Next, the server 310 stores the message waiting to be contacted by the second device B 120.
In another scenario or embodiment related to reception of messages, such as when the owner of the second device B 120 wishes to receive a message, the following operations may be carried out. The second device B 120 automatically checks, e.g., periodically polls the server 310 for new messages at periodic intervals without user interaction, for example, by contacting the server 310. Upon contacting the server, the second device B 120 authenticates itself. In response to being contacted by the second device 120, the server 310 may send a new message, which may be the last message or may be based on other preselected criteria (e.g., by a user, owner etc.) such as the last video, audio, text and/or any other type of message, for example. Additionally or alternately, the server 310 may send an indication of the number of waiting messages. For example, if there are any messages waiting, this fact is indicated as a displayed message on the display of the second or receiving device 120, such as indicating the number and/or type of messages.
The owner of the second device B 120, e.g., seeing the indication of a waiting message, signals the wish to view the message using the touch screen, e.g., by touching it the screen or a designated portion where a soft key may be displayed. The second device B 120 may then carry out the following steps. The second device B 120 contacts the server 310 and authenticates itself. The second device 120 then requests and downloads the latest message(s). If encryption had been used, then the second device 120 decrypts the message. The second device 120 may now display the message, replacing any previous message on the screen, for example. Further user interaction may be performed to playback the message if it contains moving video or audio, for example.
Of course, in a fully automatic mode, a content captured by one device is automatically rendered on the second device without any user interaction. Various modifications and modes may be employed and selected by the user(s), such as touching the screen of the sending device to transmit content, and touching the screen of the receiving device to receive content, e.g., that may be stored and waiting at the server 310, and/or render or select content already receive and stored at the receiving device. The matched two or more devices, which are uniquely coupled to each other in a similar way as a set of 'walkie-talkies' (also called two-way radio), allow content stored or captured in one device to automatically be available or be rendered at the other matched device(s), thus providing a simple communication and/or monitoring system. In a monitor mode, the data or content captured by input devices of one matched device 110, such as video/audio signals from the camera 260 and microphone 270, are automatically rendered or available for rendering at the other matched device(s) 120.
Of course, any other input devices or sensors may be included such as temperature, smoke and motions sensors to provide for security monitoring for fires and unauthorized intrusions at the location of the one of the matched devices. Further, other uses may be envisioned such as real time videoconferencing, messaging including storing messages in one or more mailboxes associated with different users of the receiving matched device, where identification of the sending matched device is included in the stored message particularly in the case where there are more than two matched devices. Communication between or among the matched devices may be through any communication link, wired, or wireless, direct or indirect such as through a server via any network such as the internet, a telephone network or a satellite network, etc.
One of the matched devices may have supervisory authority (master device) to control other matched and devices (slave devices) where content displayed on the slave devices may be selected by the master device. Further, the master may control sensors and actuators connectable to the slave device to detect various aspects at the location of the slave device, such as to control temperature, lighting, locking doors etc. Further, sensors connectable to the matched devices may be worn by the user to detect and monitor biological function, such as the user heart rate for example, where user vital signs or other sensed data are transmitted to the local device via Bluetooth™ or any other communication protocol, for example, thus becoming available or being automatically rendered at another matched device, e.g., at the master device located at a remote location different from the location of the user and/or the slave device.
Communication may be seamlessly switched from one communication level or medium to another. For instance, a user may travel with a matched device that detects a communication network in a new environment, such as a hotel room, or may communicate using a cellular phone network, such as linking to the mobile phone of the user through Bluetooth™, for example. That is, the processor 210 may be configured to automatically detect and ascertain resources at the current location of the matched first device 110 to automatically effectuate communication with the second matched device 120.
As exemplary scenarios, grandma touches the screen 250 of the first device 110 to initiate sending a message, and a message is captured using internal camera 260 and microphone 270. The message is then sent to the server 310 for the paired frame or second device 120 to pick up. The second device 120 regularly polls the server 310. The server 310 indicates a new message has been sent by the first device 110 and an alert is shown on screen of the second device 120. The grandchild touches the screen of the second device 120 to access the new message which is now displayed, e.g., grandma's photo and voice. In one mode, the received grandma's photo may remain displayed in the second device 120, which may the form of a picture frame, until it is changed, e.g., by the user of the second device, or upon reception of another photo or video.
Other use of the matched devices 110, 120 may including sending still pictures from in-built camera; sending still pictures from an external digital camera connected to the device; sending still pictures from in-built camera at regular intervals; remote playing of games based on two (or more) players such as Battleships, Chess; ordering prints of pictures received or printing them through an external printer connected to the device; narrating or listening to a story; lifestyle and medical monitoring of an elderly relative (remote display from additional sensors); real-time video chat with additional hardware for real-time encoding, as necessary, and the like.
The matched devices require minimal user interaction and setup. For example, returning to the illustrative scenario, Grandma, who got the first device 110, didn't have broadband so she bought the recommended service with a wireless modem. She plugs in the picture frame or first device 110 and a router 350 connected to the service provider, e.g., via a coaxial or fiber optic cable. The router 350 wirelessly communicates with the first device 110 e.g., using the 802.1 Ig wireless Ethernet protocol. The picture frame or first device 110 directs grandma to put an RFID installation card next to the first device 110 for reading information e.g., via the RFID tag reader 430 of the first device 110. This configures the modem and the frame or first device 110 registers with server 310. The server 310 indicates that the matched frame or first device 110 is not yet registered and invites grandma to send a welcome message. The grandchildren already have broadband and a wireless network and router, so they plug in the second device 120 which the wireless network and registers with the server 310. The server 310 indicates a message has been sent and an alert is shown on the screen of the second device 120. One of the grandchildren touches the screen to access the new message. Grandpa buys an RFID card to play Battleships. He puts the card close to the frame and the RFID tag reader 430 of the frame or the first device 110 reads the RFID card, and the function of the frame changes where, instead of displaying a photo for example, the frame 110 starts a game of Battleships on the server 310 and displays the board of the game on the screen 250. Grandpa takes his turn and plays. After a short time, the screen reverts to the previous function (or a default function, which may be preselected or predetermined), e.g., the screen reverts to the main photo, with an icon to indicate a game is in progress.
The frames or devices 110, 120 regularly poll the server 310. The server 310 sends the second device 120 an indication that a new game has started and the opponent (using the first device 120) has moved. An alert or indicator is shown on screen 250 of the second device 120. The grandchild touches the screen to access the new game. The server 310 displays the board of the game, and the grandchild takes his turn and moves or plays. After a short time, the screen 250 of the second device reverts to the main photo, for example, with an icon to indicate a game is in progress. In another illustrative example, grandma touches the screen 250 to initiate sending a photo. A picture is previewed using the internal camera 260. Grandma touches the screen 250 again to take and/or store the picture. The picture is then sent to the server 310 for pick-up by the paired frame or second device 120. The devices 110, 120 regularly poll the server 310. The server indicates to the second device 120 that a new photo has been sent by the first device 110. An alert or indication is shown on the screen of the second device 120. The grandchild touches the screen 250 of the second device 120 to access the new photo. After the new photo is displayed, the main photo is again displayed on frame. Alternatively, the new photo remains displayed on the screen until further action by the user or grandchild of the second device 120 that received the new photo.
In yet another illustrative example, the grandchild takes pictures with an external digital camera. The grandchild takes the memory or SD card from the camera and puts the memory card into a slot of the frame 410 of the matched device 120. The data, e.g., the pictures, are read from the removable memory card inserted in the card reader slot, and the read pictures are displayed on the screen 250 of the second device 120. The grandchild touches the frame or screen to select a picture. The selected picture is then sent to the server 310 for the paired frame 110 to pick up. The receiving frame 110 regularly polls the server 310 which indicates a new photo has been sent by the transmitting frame 120. An alert is shown on the screen 250 of the receiving frame 110. Grandma touches the screen 250 to access the newly received photo. After the new photo is displayed, the main photo is again displayed on frame 120, for example.
In another mode, the transmitting frame 110 may be configured to send photos at periodic intervals, for example where, at certain time intervals, the internal camera 260 captures a picture. The captured picture is then sent to the server 310 for the paired receiving frame 120 to pick up. The receiving frame 120 regularly polls the server 310 that indicates a new regular photo has been sent. The new photo is displayed on the receiving frame 120. By touching the screen, e.g., at a particular portion such a left corner, or touching a displayed soft key, then earlier or previous photos may be displayed on the screen 250. Illustratively, grandma touches the screen 250 (or a dedicated portion thereof or a displayed soft key) to view previous photos. Next, grandma touches the screen 250 (or a dedicated portion thereof or a displayed soft key) to select another photo as the main photo. The new main photo is then displayed on the screen 250. Selected data may also be printed. For example, Grandma touches the screen (or a dedicated portion thereof or a displayed soft key) to view previous photos, and touches the screen (or a dedicated portion thereof or a displayed soft key) to select a photo for printing. The server 310 sends the photo for printing and printed photo is dispatched to Grandma by a postal service for example.
Another illustrative example includes storybook sharing. For example, Grandpa buys an RFID card to read "The Gruffalo." He puts the card or RFID tag close to the frame or the first device 110. The first device 110 accesses the pages of the book from the server 310 and displays them on the screen 250. Grandpa narrates the story. The audio recording is then sent to the server 310 for the paired frame 120 to pick up. The paired frame 120 regularly polls the server 310 that indicates a new book reading has been sent. An alert is shown on the screen 250 of the receiving paired device 120. The grandchildren touch the screen 250 to access the new book. The pages of "The Gruffalo" are displayed of the screen of the receiving paired device 120 with Grandpa's narration rendered though the speaker(s) 280.
The matched devices 110, 120 may also have a guardian angel mode. For example, a family buys set of sensors and control box. The sensors are placed around the house. An RFID card from the sensor kit is put next to the first device 110 to associates this set of sensors with the matched frames 110, 120. One of more matched devices 110 may monitor and report the status of the sensors. If Grandma has multiple matched frames or devices at different locations or rooms, then this can be repeated and additional sensors monitored at the various locations or rooms throughout a house, for example. The two or more matches frames or devices regularly poll the server 310 that indicates a set of sensors has been added to the other location(s), which may be another room in a house, or another house remote from grandma's house. At the matched device(s), an overlay or icons may be displayed of summary information of data sensed by the various sensors the sensors. Touching a displayed icon brings up more detailed and historical data related to the icon. Illustratively, the matched devices may have wireless, e.g., cellular or satellite, access to the internet, such as a mobile broadband communication card, which may be removable and insertable in a communication slot of the matched device(s) to provide access to the Internet or other networks. Although a picture frame has been described as one embodiment, any device or shape may be used to provide matched communication and monitoring. For example, personal digital assistants (PDA) may be pre-matched for communication and monitoring. The processor 210 may be any type of controller or processor, such as those described in U.S. 2003/0057887 which is incorporated herein by reference in its entirety, that is capable of providing control signals in response to input signals from the input/output devices, e.g., for selecting modes of operation, capturing and storing information in the memory 220, transmitting and receiving information, executing instruction stored in the memory 220, which may be any type of memory, RAM, ROM, removable memory, CD-ROM, and the like, also as described in U.S. 2003/0057887. It should be understood that the processor 210, memory 220, input/output devices 240, 250, 260, 270, 280 although shown as being part of the device 110, may be integrated units, or separate units alone or in combination with other units.
The memory 220 and other memories may be any type of device for storing information and programming application data. The programming application data and other data are received by the one or more processors for configuring the one or more processors to perform operation acts in accordance with the present system. The operation acts may include controlling the device 110 to display a graphical user interface (GUI) for user interaction with the present system, and configuring the one or more processors. The input device 240 may further include a keyboard, mouse, trackball, or other device, such as the touch sensitive display 250 or further display, which may be stand alone or be a part of a system, such as part of a personal computer, personal digital assistant, any rendering device (e.g., MP3 player) and/or display device for communicating with the processor 210 via any type of link, such as a wired or wireless link. The user input device is operable for interacting with the processor including interaction within a paradigm of a GUI for interaction with elements of the present system. Clearly the one or more processors, memories, displays, and/or user input devices may all or partly be a portion of a computer system or other device.
The methods of the present system are particularly suited to be carried out by a computer software program, such program containing modules corresponding to one or more of the individual steps or acts described and/or envisioned by the present system. Such program and elements thereof may of course be embodied in a computer-readable medium, such as an integrated chip, a peripheral device or memory, and/or other one or more memories coupled to the one or more processors. One or more of the memories may be any recordable medium (e.g., RAM, ROM, removable memory, CD-ROM, hard drives, DVD, floppy disks or memory cards) or may be a transmission medium (e.g., a network comprising fiber-optics, the world-wide web, cables, a wireless channel using time-division multiple access, code-division multiple access, other radio -frequency and/or wireless communication channel). Any medium known or developed that may store and/or transmit information suitable for use with a computer system, processor, etc., may be used as one or more of the memories.
These memories may configure the processor to render the GUIs and implement the methods, operational acts, and functions disclosed herein. The memories may be distributed or local and the processor, where additional processors may be provided, may also be distributed or may be singular. For example, the GUI may be embedded in a web- based application that is wholly or partially provided by a remote processor. The memories may be implemented as electrical, magnetic or optical memory, or any combination of these or other types of storage devices. Moreover, the term "memory" should be construed broadly enough to encompass any information able to be read from or written to an address in the addressable space accessible by a processor. With this definition, information on a network is still within the memory, for instance, because the processor may retrieve the information from the network for operation in accordance with the present system. The one or more processors may be capable of providing control signals and/or performing operations in response to input signals and executing instructions stored in the one or more memories. The input signals may be from any user input device including the camera 260, microphone 270, motion, heat, smoke sensors, and medical monitoring sensors that may be attached to a monitored user of the device 110. One or more of the processors may be an application- specific and/or general-use integrated circuit(s). Further, the processors may be a dedicated processor for performing in accordance with the present system and/or may be general-purpose processors wherein only one of many functions operates for performing in accordance with the present system. The one or more processors may operate utilizing a program portion, multiple program segments, and/or may be a hardware device utilizing a dedicated or multi-purpose integrated circuit. Further, in a distributed system, portions of an operation may be performed on one device with data generated therefrom being transferred to one or more further devices.
Of course, it is to be appreciated that any one of the above embodiments or processes may be combined with one or more other embodiments and/or processes or be separated and/or performed amongst separate devices or device portions in accordance with the present system.
Finally, the above-discussion is intended to be merely illustrative of the present system and should not be construed as limiting the appended claims to any particular embodiment or group of embodiments. Thus, while the present system has been described in particular detail with reference to exemplary embodiments, it should also be appreciated that numerous modifications and alternative embodiments may be devised by those having ordinary skill in the art without departing from the broader and intended spirit and scope of the present system as set forth in the claims that follow. Accordingly, the specification and drawings are to be regarded in an illustrative manner and are not intended to limit the scope of the appended claims.
In interpreting the appended claims, it should be understood that: a) the word "comprising" does not exclude the presence of other elements or acts than those listed in a given claim; b) the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements; c) any reference signs in the claims do not limit their scope; d) several "means" may be represented by the same item or hardware or software implemented structure or function; e) any of the disclosed elements may be comprised of hardware portions (e.g., including discrete and integrated electronic circuitry), software portions (e.g., computer programming), and any combination thereof; f) hardware portions may be comprised of one or both of analog and digital portions; g) any of the disclosed devices or portions thereof may be combined together or separated into further portions unless specifically stated otherwise; h) no specific sequence of acts or steps is intended to be required unless specifically indicated; and i) the term "plurality of an element includes two or more of the claimed element, and does not imply any particular range of number of elements; that is, a plurality of elements may be as few as two elements, and may include an immeasurable number of elements.

Claims

CLAIMS:
1. A communication system comprising: a first device; a second device, the first device and second device being matched to each other; each of the first device and the second device comprising: an input device for capturing content; a memory for storing the content; a renderer configured to render the content; and a processor configured to control the at least one of first device and the second device for rendering the content and communicating between the first device and the second device; wherein the content of the first device is automatically available to be rendered on the second device.
2. The communication system of claim 1, wherein new content captured or received by the first device is automatically rendered on the second device.
3. The communication system of claim 2, wherein the new content is at least one of automatically or periodically captured by the input device of the first device and provided by the user of the first device.
4. The communication of claim 1, wherein the first device and the second device are matched to each other by predetermined identifications known to both the first device and the second device.
5. The communication system of claim 4, wherein the content of the first device is automatically available to be rendered on the second device based on the predetermined identifications and pre-selected settings without user interaction.
6. The communication system of claim 5, wherein the pre-selected settings include at least one of automatically rendering new content newly acquired by the first device on the second device, transmitting the new content from the first device to the second device in response to a first user input of a first user of the first device, and rendering the new content in response to a second user input of a second user of the second device.
7. The communication system of claim 1, further comprising a user interface configured to allow user control, wherein the user control includes providing information to the first device, wherein at least a portion of the information is automatically rendered on the second device.
8. The communication system of claim 1, wherein the first device has supervisory authority to control the second device.
9. The communication system of claim 1, wherein the first device is configured to control the second device including rendering selected content on the second device, and controlling the input device of the second device to capture information related to at least one of a location of the second device and a user of the second device.
10. The communication system of claim 9, wherein the information is provided by sensors, the sensors being at least one of worn by the user of the second device to monitor user activity and configured to control environmental conditions at a location of the second device.
11. The communication system of claim 10, wherein the environmental conditions include at least one of lighting and temperature.
12. A communication device comprising: a second device, the first device and second device being matched to each other; each of the first device and the second device comprising: an input device for capturing content; a memory for storing the content; a renderer configured to render the content; and a processor configured to control the at least one of communication device and a further device for rendering the content and communicating between the communication device and the further device; wherein the content of the communication device is automatically available to be rendered on the further device.
13. The communication device of claim 12, wherein new content captured or received by the communication device is automatically rendered on the further device.
14. The communication device of claim 13, wherein the new content is at least one of automatically or periodically captured by the input device of the communication device and provided by the user of the communication device.
15. The communication device of claim 12, wherein the communication device and the further device are matched to each other by predetermined identifications known to both the communication device and the further device.
16. The communication device of claim 12, wherein the communication device has supervisory authority to control the further device.
17. The communication device of claim 12, wherein the communication device is configured to control the further device including rendering selected content on the further device, and controlling the input device of the further device to capture information related to at least one of a location of the further device and a user of the further device.
18. A method for communication comprising the acts of: matching a first device to a second device by predetermined identifications known to both the first device and the second device; controlling at least one of first device and the second device for rendering content and communicating between the first device and the second device; and automatically making available the content of the first device to be rendered on the second device.
19. The method of claim 18, further comprising the acts of: sensing information related to a user of the second device through sensors operationally coupled to the second device; monitoring the information at the first device.
20. The method of claim 18, further comprising the acts of: sensing information related to environmental conditions at a location of the second device through sensors operationally coupled to the second device; and controlling the environmental conditions by the first device.
PCT/IB2008/051083 2007-04-19 2008-03-21 Matched communicating devices WO2008129431A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US91274207P 2007-04-19 2007-04-19
US60/912,742 2007-04-19
US97685007P 2007-10-02 2007-10-02
US60/976,850 2007-10-02

Publications (2)

Publication Number Publication Date
WO2008129431A2 true WO2008129431A2 (en) 2008-10-30
WO2008129431A3 WO2008129431A3 (en) 2009-07-02

Family

ID=39876032

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2008/051083 WO2008129431A2 (en) 2007-04-19 2008-03-21 Matched communicating devices

Country Status (1)

Country Link
WO (1) WO2008129431A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010146399A3 (en) * 2009-06-18 2011-03-24 Simbiotec Limited Communications network
US8498392B2 (en) 2010-01-20 2013-07-30 Koninklijke Philips N.V. Method and a system for establishing a communication channel between a predetermined number of selected devices and a device and a server arranged for use in the system
US8918461B2 (en) 2007-12-21 2014-12-23 Koninklijke Philips N.V. Matched communicating devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020113861A1 (en) * 2001-02-16 2002-08-22 Samsung Electronics Co., Ltd. Remote monitoring apparatus using a mobile videophone
US6535239B1 (en) * 1999-02-05 2003-03-18 Wooju Communications Co., Ltd. Camera mounted two-way wireless personal video/audio communication system
US6772331B1 (en) * 1999-05-21 2004-08-03 International Business Machines Corporation Method and apparatus for exclusively pairing wireless devices
US7164969B2 (en) * 2002-07-25 2007-01-16 Intouch Technologies, Inc. Apparatus and method for patient rounding with a remote controlled robot

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6535239B1 (en) * 1999-02-05 2003-03-18 Wooju Communications Co., Ltd. Camera mounted two-way wireless personal video/audio communication system
US6772331B1 (en) * 1999-05-21 2004-08-03 International Business Machines Corporation Method and apparatus for exclusively pairing wireless devices
US20020113861A1 (en) * 2001-02-16 2002-08-22 Samsung Electronics Co., Ltd. Remote monitoring apparatus using a mobile videophone
US7164969B2 (en) * 2002-07-25 2007-01-16 Intouch Technologies, Inc. Apparatus and method for patient rounding with a remote controlled robot

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8918461B2 (en) 2007-12-21 2014-12-23 Koninklijke Philips N.V. Matched communicating devices
WO2010146399A3 (en) * 2009-06-18 2011-03-24 Simbiotec Limited Communications network
US8498392B2 (en) 2010-01-20 2013-07-30 Koninklijke Philips N.V. Method and a system for establishing a communication channel between a predetermined number of selected devices and a device and a server arranged for use in the system

Also Published As

Publication number Publication date
WO2008129431A3 (en) 2009-07-02

Similar Documents

Publication Publication Date Title
US8918461B2 (en) Matched communicating devices
JP2008066969A (en) Wireless communication system
JP2004104788A (en) Method for forming communication equipment, communication system and radio communications network
US10165229B2 (en) Network communication system and method thereof
JP4166466B2 (en) Wireless communication system and wireless communication method, wireless communication apparatus and control method thereof, and computer program
CN104509089A (en) Information processing device, information processing method, and program
JP4460541B2 (en) Content transmission / reception destination authentication method, content transmission / reception destination authentication system, and program
JP4449641B2 (en) Door phone device
JP2008181319A (en) Apparatus linkage operation system, linkage operation execution method, linkage-operable apparatus and pointing device
WO2008129431A2 (en) Matched communicating devices
JP4260591B2 (en) Terminal device, home control device, and visit notification system
JP2018011275A (en) Service providing system, service receiving system, service providing method, and program
JP2008211383A (en) Remote monitoring system
WO2017170237A1 (en) Service providing system, serving receiving system, service providing method and program
JPWO2017170235A1 (en) Service providing system, service delivery system, service providing method, and program
JP6704380B2 (en) External server, communication system and communication method
CN108885653B (en) Service providing system, service delivery system, service providing method, and program
JP2005130307A (en) Home network terminal and room gateway
CN105933371B (en) Unified notice and response system
JP2006115374A (en) Remote watching system
JP2009260828A (en) Operation display
JP4862200B2 (en) Content transfer system
WO2023219078A1 (en) Information management system
US8396997B2 (en) System and method for surveillance
US20220233968A1 (en) An interactive apparatus

Legal Events

Date Code Title Description
NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08719806

Country of ref document: EP

Kind code of ref document: A2