Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.


  1. Advanced Patent Search
Publication numberUS20020133405 A1
Publication typeApplication
Application numberUS 09/931,575
Publication date19 Sep 2002
Filing date16 Aug 2001
Priority date13 Mar 2001
Also published asUS7668928, US20020133827
Publication number09931575, 931575, US 2002/0133405 A1, US 2002/133405 A1, US 20020133405 A1, US 20020133405A1, US 2002133405 A1, US 2002133405A1, US-A1-20020133405, US-A1-2002133405, US2002/0133405A1, US2002/133405A1, US20020133405 A1, US20020133405A1, US2002133405 A1, US2002133405A1
InventorsScott Newnam, Izet Fraanje, Andrew Borleske, Douglas Neumann
Original AssigneeNewnam Scott G., Izet Fraanje, Borleske Andrew J., Neumann Douglas T.
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
System and method for providing interactive content to multiple platforms
US 20020133405 A1
A system and method for interactive events relating to broadcast content, whether provided over the television, internet, or other means, provides messages that can be transmitted to different types of user devices, including personal computers, set top boxes, net top boxes, and wireless clients. The system can be used with personal recorders by recording interactive content for display with the broadcast when the recorder is used to play back the broadcast.
Previous page
Next page
What is claimed is:
1. A method for enhancing a broadcast event comprising:
a server system providing content related to the broadcast event to remote users having local devices that can interpret content and process messages received from the server system to cause information to be displayed; and
during the broadcast event, the server system providing to the local devices messages that cause the local devices to display the content;
wherein each of the content and messages are provided at the same time to at least two different types of local devices, including two or more of personal computers, set top boxes, net top boxes, wireless computers, consoles, and hand held computers.
2. The method of claim 1, wherein the content and messages are sent via Internet Protocol.
3. The method of claim 1, further comprising, in response to an advertisement being broadcast, the server system selecting one additional advertisement from a plurality of different advertisements tailored to different users, the one advertisement being related to, and for display at the same time as, the broadcast advertisement.
4. The method of claim 3, further comprising maintaining user profiles, wherein the server system selects the one additional advertisement based on the user profiles.
5. The method of claim 3, wherein the server system selects the one additional advertisement based on the user's location.
6. The method of claim 1, wherein the broadcast event is broadcast over television, radio, and/or the Internet.
7. The method of claim 1, further comprising transmitting the interactive content to the local device while the event is occurring, the content being stored for later display in response to a message after the content has been transmitted.
8. The method of claim 1, further comprising transmitting the interactive content before the broadcast event begins.
9. The method of claim 1, wherein the content is provided by downloading or by flashing.
10. The method of claim 1, wherein the messages do not include Internet addresses but are sent at the same time as Internet addresses that are used for accessing web pages with similar content, the local devices displaying content in response to the messages and not using the Internet addresses on receiving a message.
11. The method of claim 1, wherein at least two of the different types of local device are programmed to display interactive content in a manner different from each other in terms of size and/or location of content on a display.
12. The method of claim 11, wherein the broadcast content is displayed and the broadcast content and the interactive content are provided on the same display in different windows.
13. The method of claim 11, wherein the broadcast content is displayed and the broadcast content and the interactive content are provided on separate displays.
14. The method of claim 1, wherein the interactive content includes content applicable to multiple broadcast events for display during the event, and content applicable to specific events for display during the respective specific event.
15. The method of claim 1, wherein at least some of the local devices include a recording device for receiving and storing the broadcast event, the content, and the messages and associating the timing of the content messages with the programming such that the playback of the broadcast event from the recording device includes the content and messages being provided at the same relative time as during the broadcast.
16. The method of claim 15, wherein the server system is responsive to a user entering data in response to content displayed during playback of a broadcast event for providing follow-on content related to the user entering data.
17. The method of claim 1, wherein the server system determines the type of local device and provides information in response to that determination.
18. The method of claim 1, wherein a first type of local device is programmed to use the content from the server system in one manner and a second type of local device is programmed to use the content from the server system in another manner.
19. An interactive system including a server system for providing to local users messages and content related to a broadcast event, the server system maintaining multiple local advertisement messages directed toward different users or groups of users, the server system, responsive to an advertisement being broadcast with the broadcast event, for selecting one of a plurality of the local advertisements and for causing that advertisement to be displayed additionally to the user at the same time as the advertisement in the broadcast event.
20. The system of claim 19, wherein the selected local advertisement is based on the user's location.
21. The system of claim 19, wherein the selected local advertisement is based on a profile of the user.
22. The system of claim 19, wherein the selected local advertisement is provided to a computer and the broadcast event is to a television.
  • [0001]
    This application claims priority from provisional patent application number 60/293,152, filed Mar. 23, 2001, which is incorporated herein by reference, and is a continuation-in-part of application Ser. Nos. 09/804,815, pending, and 09/899,827, pending, each of which is incorporated herein by reference in its entirety for all purposes.
  • [0002]
    In the interactive television market, early efforts for such interactivity have been centered simply on allowing devices such as PCs, set-tops, and net-tops to receive message types and display enhanced content. The industry lacks standard hardware and software and the products of several companies operate on separate systems Each of these systems is designed to act as a closed system: each cable headend, satellite broadcast system, etc. uses its own hardware and software within the system; digital set-top systems are designed to accept standardized triggers in the broadcast to retrieve additional information; the standardized triggering system can be an unreliable method of delivering interactivity as the triggers can be removed at any part of the line from broadcast through the MSO to the customer; the closed systems do not allow for full, real-time interactivity, but rather just send new information to the user upon request; and because all of the systems are closed, no system allows them all to be connected and provide real-time interactivity among all participants
  • [0003]
    A system of the present invention relates to connecting different client devices, such as PCs, set-top boxes, net-top devices, and wireless devices, using Internet Protocol (IP) to provide true interactivity, targeted advertising, and mechanisms for true convergence, preferably by leveraging the MPEG 4 standard set by the Motion Picture Experts Group (MPEG). A system of the present invention serves as a centralized system for connected all such external devices. Furthermore, such a system can connect closed systems, such as cable headends, and can allow different such systems to act as one cohesive system.
  • [0004]
    The system and methods of the present invention provide a comprehensive distribution and delivery system for interactive entertainment and for coordinating various types of interactive programming on various client devices (e.g., PC, set-top, net-top, consoles, or wireless) and to facilitate interaction with each other, and with on-line and/or on-air programming. This is preferably accomplished by using the advantages of IP to integrate such devices.
  • [0005]
    A system according to the present invention includes some or all of the following components: a server system that is capable of running multiple simultaneous interactive events; a software system including several independent components of an interactive program; an Interactive Program Guide (IPG) for assigning users to certain servers based on selected interactive programming; interactive content that populates the software components; an Electronic Programming Guide (EPG) that communicates the selected program to the IPG; a personal video recorder (PVR) that allows the user to time-shift television programming; a personal interactivity recorder (PIR) that records the interactive content and results associated with the recorded video signal; a controller that receives both industry standard triggers and also other message types and controls interactive content presentation in response to such triggers and message types; a content display interface that determines the layout of the interactive components based on the client hardware device and user preferences; and a client hardware device, such as a PC, set-top box, net-top box, console, or wireless device.
  • [0006]
    The system of the present invention (i) allows users to impact the programming in real-time; (ii) allows users to communicate with a producer of the programming; (iii) allows users to interact with each other across multiple platforms; (iv) is scalable to a television-sized audience; and (v) maintains synchronization among users. The system can provide all users with a similar interactive experience even though they might use one of several client hardware devices, and/or they might have different Internet connections speeds, they may or may not use an EPG, they might time-shift the programming using a PVR. The design of the system also creates opportunities for a new level of interactive and targeted advertising.
  • [0007]
    A television producer can utilize the system to provide related and synchronized interactive content for a television program. For either a live or taped broadcast, the producer can use the technical director to control content previously created and distributed to the client devices and to send dynamic content during the broadcast.
  • [0008]
    The interactive content is provided using Internet protocol (IP) and is therefore independent of the distribution of the television content. Accordingly, a producer of interactive content can also utilize the system to provided interactive content related to and synchronized with a television program without the cooperation of the television producer. If either the television producer or distributor is not participating in or cooperating with the interactive programming, message types sent over IP would determine the timing and content of the interactive programming.
  • [0009]
    If the television producer and the program distributor were cooperating in the production and distribution of the interactive content, they could utilize industry standard triggers (e.g., ATVEF triggers). ATVEF triggers are currently a standard set by the Advanced Television Enhancement Forum, in which URLs are embedded in the video signal during post-production to trigger interactivity. Cooperation between the television producer and the distributor is necessary for the use of some industry standard triggers because the distributor can remove them after post-production. The present invention can utilize these triggers, or an IP based messaging system, or a combination of both methods. The system of the present invention is flexible in terms of which types of triggers take precedent. The configuration of a specific event would determine the hierarchy of triggers. It can be configured to allow all types, take one over another or only allow for one type.
  • [0010]
    Existing set-top and net-top systems do not support the ability for the participant to affect the sequence and outcome of events in a program. With true interactivity according to the present invention, during a sports talk show, for example, the responses to polls and trivia questions can drive the commentary and direction of the show's host. Previous systems allowed users in a set-top or net-top world to merely play along with a show, without information being shared in real time with other participants or with the producer. An example might be playing along with a question-and-answer game show. In previous solutions, the television viewer would simply see a visual overlay on the screen allowing him or her to select the correct answer at the same time as the show. However, the participant's score is simply calculated on the set-top box for the participant's own knowledge. In fact, the participant has not in fact “interacted” with others. With the system of the present invention, information on every participant can be transmitted to a server system for real-time processing. Such processing allows for interactivity, such as display of aggregated results, bracketed tournaments for competition, fast display of competitor rankings, and voting for choices of a show's outcome.
  • [0011]
    The system and method of the present invention provides flexibility in interactive advertising by allowing (1) the display of advertisements that enhance the on-air advertisements without competing with them, (2) the ability to provide targeted or local advertisements, or (3) eliminating interactive advertisements to retain attention for the on-air ad. The system allows for a more targeted distribution of advertisements. For example, a broadcast might have three overlapping advertisements and the client hardware device displays one of the ads based on user preferences and experience. The system and method of the present invention allows for one of several enhanced advertisements to be delivered to the client hardware device based on similar preferences or according to the on-air ad being distributed.
  • [0012]
    Some targeted advertisement systems currently being deployed with television systems and set top boxes utilize profile and experience information stored on the set top box to select for display one of several ads being transmitted. The present invention allows users to answer questions, participate in polls, request information, obtain coupons, locate stores, etc. by interacting directly with the server system. Key information is stored or processed at the server system and can be used to more effectively target advertisement delivery. This results in lower bandwidth consumption and allows for a larger potential number of targeted ads or information to be distributed since every user does not have to receive every piece of content.
  • [0013]
    Many consumers currently use electronic program guides (EPGs) to inform them of available and scheduled programming and to bring them to the selected television program. If an EPG is resident on a client hardware device, the system of the present invention allows the EPG to interact with the Interactive Program Guide (IPG) of the present invention to communicate the selected program and assign the user to the appropriate Interactive Program Cluster of the server system.
  • [0014]
    The system of the present invention addresses problems with interactive programming in combination with time-shifting devices, such as personal video recorders (PVRs), which are individual storage devices used with the television (e.g., TiVo recorders from Tivo, Inc.). Any device that has network and video receiving/recording capabilities can be considered a time-shifting device; e.g., a PC can have video receiving capability and can store broadcast programming and other content.
  • [0015]
    In one embodiment, a PIR (personal interactivity recorder) engine collects links to interactive content associated with a particular video frame and/or interactive content itself and records that interactive content. When the broadcast is replayed, the content from each link or the content itself is displayed as the show progresses. Playback works the same as in the previously described interactive mechanism except the content does not need to be accessible from a server after the event, and the client device does not even have to be connected to the network. This eliminates the need for extra network storage costs, and lowers bandwidth requirements. Alternatively, the user could be connected to the network during playback. The playback feature with interactive content provides a potentially more enjoyable experience for the participant because, similar to live participation in the interactive program, the participant can compare his or her responses to the rest of the audience.
  • [0016]
    Another advantage of the system and method of the present invention is provided by the content display interface. The content display interface determines the size, shape, and location of the various components of interactivity based on the user's client hardware device and preferences. In one example, a user participating in interactive programming using a PC and separate television would see the entire PC monitor occupied by interactive components while a user on a net-top device might see components arranged on the left and bottom of the video screen while the television program occupies the remainder of the screen. In another example, a participant in a multi-player game not associated with a television broadcast would use the entire screen even though the participant is using a set-top, net-top or console as his client hardware device. Another participant might select only to receive programming information as a ticker along the bottom of the screen. In yet another example, two users sharing the same display might choose to each have a component for polls and contests while sharing a chat box and fun fact display. The content display interface allows users to select from available options, which may be limited based on the type of client hardware device and program.
  • [0017]
    The system of the present invention allows for a single interactive system to provide interactivity to and among users of various client hardware devices including digital head-end set-top boxes, net-tops, wireless devices, consoles, PCs and digital televisions. The present system connects to each client device using Internet Protocol. Because each client device and sub-system (e.g., Scientific Atlanta based head-end or Sprint based wireless) is slightly different, the system connects at different points in these devices, but maintains a constant communication via Internet Protocol through all systems. The system uses a software component referred to as an event management engine (EM Engine) to receive ATVEF triggers and other message types over IP and use them to control the interactive program.
  • [0018]
    Other features and advantages will become apparent from the following detailed description, drawings, and claims.
  • [0019]
    [0019]FIG. 1 is a block diagram of the server system that coordinates interactivity across multiple client devices over Internet Protocol.
  • [0020]
    [0020]FIG. 2 shows an example (poll) of the coordination and aggregation of interactivity by the server system across multiple client devices.
  • [0021]
    [0021]FIG. 3 shows the comparison of the system of the present invention for synchronization to broadcast over IP and the prior art embedded ATVEF triggers.
  • [0022]
    [0022]FIG. 4 shows an example of the convergence of on-line and on-air programming into a combined MPEG4 stream over Internet Protocol.
  • [0023]
    [0023]FIG. 5 illustrates the thin communication protocol between the server system and set-top client that provides true interactivity.
  • [0024]
    [0024]FIG. 6 is a block diagram representing the synchronization of targeted on-line advertising to the on-air broadcast over Internet Protocol across multiple client devices.
  • [0025]
    [0025]FIG. 7 is a flow diagram of the coordination of EPGs across multiple platforms and the association of interactivity to these EPGs.
  • [0026]
    [0026]FIG. 8 is a block diagram of the solution for interactive programming and timeshifting devices.
  • [0027]
    [0027]FIG. 9 shows the output of the content display interface on different user devices.
  • [0028]
    A content provider, such as a television network, can broadcast television programming to a television via cable, satellite, over-the-air, or other means. The program that is broadcast is a type of event, and the episodes are instances of that event. Events can consist of an on-air and on-line programming.
  • [0029]
    The system of the present invention provides a novel way of coordination and synchronization of interactivity across multiple client devices based on Internet Protocol (IP). The client devices can be a range of different devices, the most-used current examples of which are a computer client (further referred to as PC client but can also run on different platforms such as Macintosh), set-top client, net-top client (e.g., WebTV, a return path over dial-up), consoles, and wireless clients. The server system is responsible for interactive processing for activities, such as games, polls, and fun facts. The server system can communicate with the client devices to initiate display of content through different types of messages (over IP). The client device will leverage a message library to interpret the messages.
  • [0030]
    The on-line programming can be synchronized to the on-air broadcast by the server system's messaging system.
  • [0031]
    The server system preferably has an interactive program cluster for each concurrent interactive event. Each interactive program cluster can include an administrative server, multiple event servers, ad servers, multiple chat servers, multiple streaming servers, and a technical director. One or more of these components can be combined on a single computer or allocated among separate computers.
  • [0032]
    [0032]FIG. 1 shows the components of an embodiment of the present invention for the coordination of interactivity and ‘on-line’ programming across multiple client devices. The server system 200 sends messages across Internet Protocol to control the interactivity on the client devices: PC client 100, set-top client 110, net-top client 120 and wireless client 130. This is an illustrative selection of client devices that can interact with server system 200. Examples of other client devices are consoles and handheld devices. The messages are interpreted on the client devices using a message library. In one embodiment, the server system 200 detects the type of client device. Based on the type of client device, a device-specific configuration file can be provided to the client device that supports the interpretation of messages sent by server system 200. In another embodiment, the client device software interprets messages and tailors messages to the specific device.
  • [0033]
    The communication from these client devices back to the server system 200 is also preferably provided over IP. The system thus allows multiple client devices 50 (and different types of client devices) to simultaneously interact with server system 200. In general, the communication is initiated by the server system 200 after a user has indicated a preference to participate in interactive programming. To provide true interactivity the server system 200 can initiate this communication and keep this connection open during the full duration of an interactive program.
  • [0034]
    The technical director 300 is a software interface on a computer and is the interface between a producer of the event, such as a television broadcaster, and the system. The technical director 300 allows viewers to impact the content of the event in real-time by enabling the producer to change the content based on input received from viewers. The technical director 300 can also, for example, receive, display, and allow the producer to select questions posed to the producer or event's host or comments made by the user. The producer can respond to the questions or comments through the real-time creation of event content. The new content could be multi-media content distributed by a broadcaster or content created by the technical director 300. For example, the technical director 300 allows producers to generate real-time content (e.g., a real-time fun fact or poll) and to initiate the display of such content.
  • [0035]
    [0035]FIG. 2. shows an example of interactivity (namely, a poll) across multiple client devices by server system 200. A producer can initiate a poll using the Technical Director 300. The server system 200 receives poll 310 and sends poll 310 to the different client devices: PC client 100, set-top client 110, net-top client 120 and wireless client 130. The users of these client devices send back their responses: answer PC client 320, answer set-top client 330, answer net-top client 340, and answer wireless client 350. The server system 200 processes all these results and sends back out the aggregated results 360 to each of the different client devices.
  • [0036]
    Other types of interactivity can include fun facts (which do not require a response), and trivia questions, whereby the aggregated results can include answers, scores, and a leader board of high scores. The system can also provide chat functionality among users, and can allow textual messages to be sent to and from a producer. In response to chat or other textual messages, the producer can tailor or generate content provided during the broadcast. These functionalities can each be provided by a separate server, or multiple functionalities can be combined in one or more servers.
  • [0037]
    Content can be provided in advance of the start of the broadcast, during the broadcast for storage during the broadcast, or in real time from the server. In the first two cases, a message is sent from the server to cause the previously provided content to be displayed. The approach of providing the content before display is particularly useful for graphics and other items of content with higher bandwidth. In the third case, the content is provided in real time, preferably with a message type that causes that message to be processed. The content can thus be interpreted in real time or from storage. The types of content and the methods of transmission are also described in the incorporated pending applications.
  • [0038]
    In FIG. 3, and embodiment of the present invention is compared to a prior art system. In a prior art system, a head-end facility 400 sends an on-air broadcast signal with embedded ATVEF triggers 430 to the set-top client 110. The ATVEF trigger specifies a URL. The set-top client 110 sends a URL request 440 to the web Server 420. The web server 420 serves up a web page 450 to the set-top client 110.
  • [0039]
    The system of the present invention decouples the distribution and production of on-line enhanced TV programming from the production and distribution of the on-air broadcast. The server system 200 provides the mechanism of synched on-line program 210 over IP without embedding ATVEF triggers in the on-air broadcast signal. The on-air broadcast signal 410 is delivered by the head-end facility 400 to the set-top client 110. In the system of the present invention the ATVEF triggers do not have to be embedded in the on-air broadcast 410. This ability to avoid embedded triggers allows producers other than the on-air broadcast producers to create on-line programming. Furthermore, the system of the present invention can prevent MSOs (the operators of the head-end facility 400) from restricting the availability of interactive programming by removing ATVEF triggers from the signal 430 provided to the set-top client 110.
  • [0040]
    [0040]FIG. 4 illustrates the convergence of the on-line program over IP 210 with the on-air broadcast 410 in on-air and on-line programming 220 over IP. In one embodiment, the head end facility 400 provides the on-air broadcast 410 (e.g., based on MPEG2) to the client device 50. The server system 200 provides the on-line program over IP 210 to the client device 50 using the built-in synced-to-broadcast mechanism as described above. In another embodiment the server system 200 takes over the functionality of the head end facility 400 by combining on-air and on-line programming over IP 220 into one signal. One of the standards for this convergence over IP is MPEG4.
  • [0041]
    [0041]FIG. 5 shows the lightweight communication protocol 105 that allows for true interactivity for client devices that do not have this true interactivity today. The base software 115 on the set-top client 110 knows how to interpret the messages from server system 200 and provides light and fast communication with the server system through which the user of set-top client 110 can actually participate in interactive features such as real-time polls and trivia. The server system 200 initiates and maintains the connection with the base software 115 that is part of the set-top client 110 using the communication protocol 105 (based on IP). The base software can be part of the operating system of a user device, or it can be incorporated in other software, such as in a browser, or it can be a provided later like an application program, such as by being downloaded over the Internet or by flashing it to the memory of a client device.
  • [0042]
    As shown in FIG. 6, the server system 200 can synchronize the display of targeted advertising on the client devices to on-air advertising. The server system 200 sends message type ad 520 over IP to the PC client 100, set-top client 110, net-top client 120, and wireless client 130. These clients will interpret this message type 520 to display Ad 510. The initiation of message type ad 520 can be synchronized to the broadcast such that the on-air commercial 530 will coincide with the display of Ad 510 on all the different client devices. Ad 510 can be personalized to the user of the client device based on profiling of the server system 200.
  • [0043]
    An example of targeting Ad 510 is a localized list of car dealers. A car commercial 530 for a brand or model airs on television; in response to that ad, and at the same time, a list of local dealers for that brand or model of car is presented to the users on the different client devices based on the zip code of the users. Other factors in the profile could be used, such as age. The concept of the Ad 510 will be similar for all the user devices: PC client 100, set-top client 110, net-top client 120 and wireless client 130. The list of dealers close by, however, will depend on the profile of the user.
  • [0044]
    In FIG. 7, another embodiment includes a system for interacting with electronic programming guides (EPGs). The server system 200 coordinates the presentation of EPGs over IP 250 across multiple user devices. The EPGs on the different devices have the interactive programming associated with the broadcast programming. Each user on one of the user devices 50 can select an interactive program 260 to interact with other users on the different user devices 50. The EPG implementation of the present invention includes the association of interactive programming with the EPG and the coordination of the EPG across multiple client devices 50 over IP by server system 200. The server system 200 uses the IPG component 270 to provide a mechanism for assigning users to the appropriate servers and services depending on their client device 50, chosen interactive programming and potentially their profile. In another embodiment the user can select interactive programming by clicking on an interactive identifier, using a remote control or using a keyboard. In all cases the IPG component 270 on the server side will assign the users to the appropriate servers and services.
  • [0045]
    [0045]FIG. 8 shows a solution for interactive programming associated with time-shifted on-air broadcast. A PVR is a local client 555 that can cache programming received from the head-end 400 in a PVR storage 550 (such as a resident hard drive). A PVR allows for record and playback, but also allows one to pause programming, such that the device records while earlier content is being displayed.
  • [0046]
    According to the present invention, as this recording occurs, a PIR (personal interactivity recorder) engine 580 stores interactive content in interactive storage 560 (which can be physically the same device as PVR storage 550) originating from server system 200. The PIR engine 580 subscribes to all video control messages to the PVR client 555, as well as the video frame markers. The PIR engine associates the interactive content (or links to other interactive content) to the video frame markers received by the PVR engine 570 and stores them on the interactive storage 560. The PIR engine then can perform all time modifying operations (fast forward, rewind, pause etc) of the PVR engine on the interactive content.
  • [0047]
    The PIR can have its own processing capability through a microprocessor or a dedicated processor or programmed logic, or it can use the processing capability of the PVR. The PIR can be programmed to know how to process the messages and content in advance, and further programming or modifications can be provided by downloading or flashing.
  • [0048]
    This system allows a user to respond to a poll and then get poll results (even if not affected by that user). The PIR records that a poll was sent at a particular time during the broadcast, or that a message was sent to display a previously downloaded or flashed poll. When the PVR plays back the broadcast program, the poll is displayed at the same time during the broadcast event as it would have been during the live broadcast, and can include any timeout mechanisms included in the content or governed by operating software. The user can then enter a response to the poll, and the server system can respond with poll results based on all results previously provided including the user with the PVR, or all results from when the program was live. By waiting for the user to enter a response the user is not influenced by seeing the poll results.
  • [0049]
    It may be desirable to disconnect the user from the server during playback, in which case, the PIR would record the display of the poll, any timer showing remaining time to enter a response, and the poll results at the time of the broadcast being recorded. In this way, the user has the experience he or she would have had, with the exception that his or her response may not be used in the poll results calculation.
  • [0050]
    In another example, in the case of a question-and-answer game, the system allows the user to continue to play along with the broadcast event in what appears to the user to be real time question and answer. The user can play under the same conditions, including if the trivia question has variable points depending on the speed of the response, get his or her own personal results, and get a leader board of the scores of other players as they were during the broadcast, but the user may not be able to play with others and be a part of the leader board because of the delay involved, especially if the trivia has scoring that varies with the speed of the response. However, because the interactive program information is recorded, the user can compare his or her score to those of other users who participated in real time.
  • [0051]
    The PIR can also store for playback chat messages displayed during the broadcast, fun facts, and any other one-way or interactive content provided from the server and with the broadcast.
  • [0052]
    Those skilled in the art would appreciate that there could be other ways to subscribe to the video control messages and markers, and that video frame markers can take many forms, including, but not limited to absolute and relative time code, and frame sequence numbers. In addition or in the alternative, the PIR can also store triggers or other content or address to obtain content and associate them with times during the broadcast program for display during playback.
  • [0053]
    An example of a hard drive device is a system made by TiVo, Inc., which is also assignee of U.S. Pat. No. 6,233,389, which is expressly incorporated by reference.
  • [0054]
    [0054]FIG. 9 illustrates the content display interface that determines the layout of interactive components based on the client hardware device. PC client 100 uses the full screen for interactive programming. Fun fact 720, game 730, and chat 710 are displayed across the full screen while TV 10 displays the on-air broadcast 410. In the case of the set-top client 110, the content display interface adjusts the placement of the interactive components based on the different type of client device. The on-air broadcast 410 takes up a large part of the screen real estate of set-top client 110 while fun fact 720, game 730, and chat 710 share the remaining space.
  • [0055]
    Having described embodiments of the present invention, it should be apparent that modifications could be made without departing from the scope of the invention as defined by the appended claims. In some instances, for example, the features are described in conjunction with television broadcast, but for some features, the broadcast event could be over internet (webcast) with or without television, through radio, or other broadcast medium that allows dissemination of information to a large number of remote recipients.
Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US5517257 *28 Mar 199514 May 1996Microsoft CorporationVideo control user interface for interactive television systems and method for controlling display of a video movie
US5537141 *15 Apr 199416 Jul 1996Actv, Inc.Distance learning system providing individual television participation, audio responses and memory for every student
US5539822 *19 Apr 199423 Jul 1996Scientific-Atlanta, Inc.System and method for subscriber interactivity in a television system
US5581803 *21 Apr 19943 Dec 1996Motorola, Inc.Method of programming a radio identification code in a communication unit
US5589892 *7 Jun 199531 Dec 1996Knee; Robert A.Electronic television program guide schedule system and method with data feed access
US5638113 *7 Jun 199510 Jun 1997Thomson, Multimedia, S.A.Transaction based interactive television system
US5695400 *30 Jan 19969 Dec 1997Boxer Jam ProductionsMethod of managing multi-player game playing over a network
US5724521 *3 Nov 19943 Mar 1998Intel CorporationMethod and apparatus for providing electronic advertisements to end users in a consumer best-fit pricing manner
US5734413 *30 Nov 199331 Mar 1998Thomson Multimedia S.A.Transaction based interactive television system
US5774664 *25 Mar 199630 Jun 1998Actv, Inc.Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US5778181 *14 Mar 19967 Jul 1998Actv, Inc.Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US5848352 *26 Apr 19958 Dec 1998Wink Communications, Inc.Compact graphical interactive information system
US5903262 *30 Jul 199611 May 1999Kabushiki Kaisha ToshibaInteractive television system with script interpreter
US5930765 *21 Nov 199727 Jul 1999Martin; John R.Downloading method for songs and advertisements
US5987525 *15 Apr 199716 Nov 1999Cddb, Inc.Network delivery of interactive entertainment synchronized to playback of audio recordings
US6006256 *11 Mar 199621 Dec 1999Opentv, Inc.System and method for inserting interactive program content within a television signal originating at a remote network
US6007426 *17 Mar 199828 Dec 1999Rlt Acquisitions, Inc.Skill based prize games for wide area networks
US6018768 *6 Jul 199825 Jan 2000Actv, Inc.Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US6026366 *14 Oct 199715 Feb 2000Motorola, Inc.Method for providing software to a remote computer
US6061719 *6 Nov 19979 May 2000Lucent Technologies Inc.Synchronized presentation of television programming and web content
US6075551 *8 Jul 199713 Jun 2000United Video Properties, Inc.Video promotion system with flexible local insertion capabilities
US6161137 *31 Mar 199812 Dec 2000Mshow.Com, Inc.Method and system for providing a presentation on a network
US6173332 *28 Feb 19979 Jan 2001Paul L. HickmanMethod and apparatus for computing over a wide area network
US6193606 *30 Jun 199727 Feb 2001Walker Digital, LlcElectronic gaming device offering a game of knowledge for enhanced payouts
US6209028 *21 Mar 199727 Mar 2001Walker Digital, LlcSystem and method for supplying supplemental audio information for broadcast television programs
US6215526 *6 Nov 199810 Apr 2001Tivo, Inc.Analog video tagging and encoding system
US6233389 *30 Jul 199815 May 2001Tivo, Inc.Multimedia time warping system
US6239793 *20 May 199929 May 2001Rotor Communications CorporationMethod and apparatus for synchronizing the broadcast content of interactive internet-based programs
US6240555 *29 Mar 199629 May 2001Microsoft CorporationInteractive entertainment system for presenting supplemental interactive content together with continuous video programs
US6263505 *3 Jul 199717 Jul 2001United States Of AmericaSystem and method for supplying supplemental information for video programs
US6331144 *15 Nov 200018 Dec 2001Walker Digital, LlcElectronic gaming device offering a game of knowledge for enhanced payouts
US6414635 *23 Oct 20002 Jul 2002Wayport, Inc.Geographic-based communication service system with more precise determination of a user's known geographic location
US6421706 *25 Feb 199816 Jul 2002Worldcom, Inc.Multicast and unicast internet protocol content distribution having a feedback mechanism for real-time and store and forward information transfer
US6426778 *3 Apr 199830 Jul 2002Avid Technology, Inc.System and method for providing interactive components in motion video
US6526335 *24 Jan 200025 Feb 2003G. Victor TreyzAutomobile personal computer systems
US6573907 *4 Oct 19993 Jun 2003Obvious TechnologyNetwork distribution and management of interactive video and multi-media containers
US6577324 *7 Jun 199510 Jun 2003Compaq Information Technologies Group, L.P.Video and audio multimedia pop-up documentation by performing selected functions on selected topics
US6637032 *6 Jan 199721 Oct 2003Microsoft CorporationSystem and method for synchronizing enhancing content with a video program using closed captioning
US6675387 *6 Apr 19996 Jan 2004Liberate TechnologiesSystem and methods for preparing multimedia data using digital video data compression
US6684257 *15 Oct 199927 Jan 2004International Business Machines CorporationSystems, methods and computer program products for validating web content tailored for display within pervasive computing devices
US6699127 *27 Sep 20002 Mar 2004Nintendo Of America Inc.Real-time replay system for video game
US6718551 *21 Dec 19996 Apr 2004Bellsouth Intellectual Property CorporationMethod and system for providing targeted advertisements
US6728753 *1 Nov 199927 Apr 2004Microsoft CorporationPresentation broadcasting
US6766524 *8 May 200020 Jul 2004Webtv Networks, Inc.System and method for encouraging viewers to watch television programs
US6799327 *13 Jul 199928 Sep 2004United Video Properties, Inc.Program guide with selectable advertisements and pseudo-ads
US7024677 *8 Aug 20004 Apr 2006Thomson LicensingSystem and method for real time video production and multicasting
US7028327 *29 Mar 200011 Apr 2006Wink CommunicationUsing the electronic program guide to synchronize interactivity with broadcast programs
US7222155 *25 Apr 200122 May 2007Wink Communications, Inc.Synchronous updating of dynamic interactive applications
US20010001160 *11 Dec 200010 May 2001Microsoft CorporationInteractive entertainment system for presenting supplemental interactive content together with continuous video programs
US20020023230 *11 Apr 200121 Feb 2002Bolnick David A.System, method and computer program product for gathering and delivering personalized user information
US20020054244 *2 Apr 20019 May 2002Alex HoltzMethod, system and computer program product for full news integration and automation in a real time video production environment
US20020054750 *17 Jan 20019 May 2002Michael FiccoDVR functions status indicator
US20020100039 *19 Jan 200125 Jul 2002Nicholas IatropoulosMedia interactivity method and architecture
US20020103696 *29 Jan 20011 Aug 2002Huang Jong S.System and method for high-density interactive voting using a computer network
US20020122060 *18 Dec 20015 Sep 2002Markel Steven O.Wizard generating HTML web pages using XML and XSL
US20020124249 *2 Jan 20015 Sep 2002Shintani Peter RaeTargeted advertising during playback of stored content
US20020129381 *23 Apr 200112 Sep 2002Barone Samuel T.System and method for merging interactive television data with closed caption data
US20020133562 *13 Mar 200119 Sep 2002Newnam Scott G.System and method for operating internet-based events
US20020141734 *25 Mar 20023 Oct 2002Shigeyuki MurataMethod of making video program
US20020143901 *3 Apr 20013 Oct 2002Gtech Rhode Island CorporationInteractive media response processing system
US20020162118 *28 Jan 200231 Oct 2002Levy Kenneth L.Efficient interactive TV
US20020184623 *30 May 20015 Dec 2002Hodge Gregory A.Methods and apparatus for interactive television
US20040032132 *18 Aug 200319 Feb 2004Chin-Hun YangMotor vehicle bumper system
US20050015796 *25 Apr 200120 Jan 2005Bruckner John AnthonySystem and method for managing interactive programming and advertisements in interactive broadcast systems
US20070130581 *3 Jan 20017 Jun 2007Del Sesto Eric EInteractive content delivery methods and apparatus
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US719672218 May 200127 Mar 2007Imove, Inc.Multiple camera video system which displays selected images
US754661922 Jul 20089 Jun 2009Invidi Technologies CorporationVoting and headend insertion model for targeting content in a broadcast network
US780893216 Jan 20045 Oct 2010Sony United Kingdom LimitedVirtual connection for packetised data transfer in a video and audio network
US78604495 Dec 200528 Dec 2010Motricity, Inc.Method and system for delivering contextual content to a mobile device
US7921447 *14 Mar 20035 Apr 2011Thomson LicensingEnhanced television metadata processor for efficient broadcast operations
US7937285 *12 Apr 20023 May 2011Massachusetts Institute Of TechnologyRemote collaborative control and direction
US796663427 Oct 200321 Jun 2011Volkswagen AgMethod and apparatus for information exchange in an interactive communication system using tv broadcast information
US803750628 Feb 200711 Oct 2011Verimatrix, Inc.Movie studio-based network distribution system and method
US8102245 *14 Jul 200624 Jan 2012At&T Intellectual Property I, LpMethod and apparatus for transmitting notification messages
US848976930 Sep 200416 Jul 2013Accenture Global Services LimitedIntelligent collaborative expression in support of socialization of devices
US8510661 *9 Feb 200913 Aug 2013Goldspot MediaEnd to end response enabling collection and use of customer viewing preferences statistics
US861231031 Mar 201017 Dec 2013United Video Properties, Inc.Method and system for commerce in media program related merchandise
US8620769 *29 Mar 201131 Dec 2013United Video Properties, Inc.Method and systems for checking that purchasable items are compatible with user equipment
US862558920 Aug 20107 Jan 2014Sony United Kingdom LimitedVideo/audio network
US863891723 Dec 201128 Jan 2014Blackberry LimitedMethod and apparatus for coordinating answered call status
US867663912 May 201018 Mar 2014Visa International Service AssociationSystem and method for promotion processing and authorization
US8700454 *18 Dec 200315 Apr 2014Sony CorporationInteractive privilege supply system
US87010511 Apr 201115 Apr 2014Goldspot Media, Inc.Hot spot use in advertising
US8769564 *22 Mar 20121 Jul 2014Disney Enterprises, Inc.Cross-platform advertisement synchronization
US8813118 *3 Oct 200619 Aug 2014Verizon Patent And Licensing Inc.Interactive content for media content access systems and methods
US884339119 Oct 201123 Sep 2014Visa U.S.A. Inc.Systems and methods to match identifiers
US90318607 Oct 201012 May 2015Visa U.S.A. Inc.Systems and methods to aggregate demand
US91897941 Apr 201117 Nov 2015Goldspot Media, Inc.Method and apparatus for maximizing brand exposure in a minimal mobile display
US919119113 Aug 201317 Nov 2015Sony Europe LimitedDevice and methodology for virtual audio/video circuit switching in a packet-based network
US928212914 Nov 20138 Mar 2016Rounds Entertainment Ltd.Multi-user interactive virtual environment including broadcast content and enhanced social layer content
US931166021 Feb 201412 Apr 2016Goldspot Media, Inc.Hot spot use in advertising
US93428353 Aug 201017 May 2016Visa U.S.ASystems and methods to deliver targeted advertisements to audience
US968651226 Jan 201620 Jun 2017Kik Interactive Inc.Multi-user interactive virtual environment including broadcast content and enhanced social layer content
US969108520 Apr 201627 Jun 2017Visa International Service AssociationSystems and methods of natural language processing and statistical analysis to identify matching categories
US20020021353 *8 Jun 200121 Feb 2002Denies MarkStreaming panoramic video
US20020089587 *7 Dec 200111 Jul 2002Imove Inc.Intelligent buffering and reporting in a multiple camera data streaming video system
US20020152091 *9 Aug 200117 Oct 2002Tatsuji NagaokaBroadcast using method, receiver, mobile terminal and service providing device
US20030079218 *12 Apr 200224 Apr 2003Massachusetts Institute Of TechnologyRemote collaborative control and direction
US20030197785 *18 May 200123 Oct 2003Patrick WhiteMultiple camera video system which displays selected images
US20040143840 *18 Dec 200322 Jul 2004Kazuhiro FukudaInteractive privilege supply system
US20050125843 *23 Oct 20049 Jun 2005Okezie Charles E.Television viewer/studio interactive commentary
US20050195823 *16 Jan 20048 Sep 2005Jian-Rong ChenVideo/audio network
US20060010240 *30 Sep 200412 Jan 2006Mei ChuahIntelligent collaborative expression in support of socialization of devices
US20060015923 *3 Sep 200219 Jan 2006Mei ChuahCollaborative interactive services synchronized with real events
US20060146184 *16 Jan 20046 Jul 2006Gillard Clive HVideo network
US20060161947 *5 Sep 200120 Jul 2006Indra LaksonoMethod and apparatus for customizing messaging within a cable system
US20060293954 *12 Jan 200628 Dec 2006Anderson Bruce JVoting and headend insertion model for targeting content in a broadcast network
US20070220564 *21 Apr 200520 Sep 2007Masako YanoDigital Broadcast Playback Device and Method, Computer Program, and Storage Medium
US20070220575 *28 Feb 200720 Sep 2007Verimatrix, Inc.Movie studio-based network distribution system and method
US20070300264 *23 Oct 200627 Dec 2007Gary TurnerInteractive music and video delivery method and system
US20070300273 *11 Jan 200727 Dec 2007Gary TurnerInteractive television application and content enhancement
US20070300280 *21 Jun 200627 Dec 2007Turner Media GroupInteractive method of advertising
US20080016545 *27 Apr 200717 Jan 2008Telvue CorporationMethod and system for creating a virtual television network
US20080018452 *14 Jul 200624 Jan 2008Sbc Knowledge Ventures, L.P.Method and apparatus for transmitting notification messages
US20080092158 *3 Oct 200617 Apr 2008Verizon Data Services Inc.Interactive content for media content access systems and methods
US20080092193 *17 Apr 200717 Apr 2008The Video Load, LlcMethods and systems for creating video files for a mobile device
US20080267589 *27 Apr 200730 Oct 2008Gary TurnerTelevision bandwidth optimization system and method
US20080276271 *22 Jul 20086 Nov 2008Invidi Technologies CorporationVoting and headend insertion model for targeting content in a broadcast network
US20090055400 *3 Oct 200726 Feb 2009Tinbu, LlcInteractive presentation and distribution of web content having a search feature
US20090204901 *9 Feb 200913 Aug 2009Srinivasa DharmajiEnd to End Response Enabling Collection and Use of Customer Viewing Preferences Statistics
US20100030644 *4 Aug 20084 Feb 2010Rajasekaran DhamodharanTargeted advertising by payment processor history of cashless acquired merchant transactions on issued consumer account
US20100063866 *9 Dec 200811 Mar 2010Masaki KinoshitaService providing method, service processing device, and mobile communicating device
US20110016498 *14 Aug 200820 Jan 2011Nds LimitedAdvertisement shifting system
US20110047072 *5 Aug 201024 Feb 2011Visa U.S.A. Inc.Systems and Methods for Propensity Analysis and Validation
US20110087531 *7 Oct 201014 Apr 2011Visa U.S.A. Inc.Systems and Methods to Aggregate Demand
US20110087546 *7 Sep 201014 Apr 2011Visa U.S.A. Inc.Systems and Methods for Anticipatory Advertisement Delivery
US20110087547 *7 Sep 201014 Apr 2011Visa U.S.A.Systems and Methods for Advertising Services Based on a Local Profile
US20110087550 *3 Aug 201014 Apr 2011Visa U.S.A. Inc.Systems and Methods to Deliver Targeted Advertisements to Audience
US20110093335 *6 Oct 201021 Apr 2011Visa U.S.A. Inc.Systems and Methods for Advertising Services Based on an SKU-Level Profile
US20110106612 *30 Oct 20095 May 2011At&T Intellectual Property L.L.P.Apparatus and method for product marketing
US20110107363 *3 Nov 20095 May 2011Yahoo! Inc.Sequenced video overlay advertisements
US20110178875 *1 Apr 201121 Jul 2011Srinivasa DharmajiHot Spot Use in Advertising
US20110179454 *29 Mar 201121 Jul 2011United Video Properties Inc.Systems and methods for commerce in media program related merchandise
US20110184810 *1 Apr 201128 Jul 2011Goldspot Media, Inc.Method and Apparatus for Maximizing Brand Exposure in A Minimal Mobile Display
US20120047031 *31 Oct 201123 Feb 2012Yahoo! Inc.Sequenced video overlay advertisements, including quiz games
CN103248915A *16 May 201314 Aug 2013清新视界(北京)科技有限公司Electronic program guide (EPG) system capable of realizing personalized configuration
EP1418758A1 *1 Oct 200312 May 2004Volkswagen AGMethod and apparatus for exchanging information and computer program thereof and corresponding computer-readable storage medium
WO2014076570A3 *14 Nov 201330 Oct 2014Rounds Entertainment Ltd.Multi-user interactive virtual environment including broadcast content and enhanced social layer content
U.S. Classification705/14.58, 725/36, 725/35, 725/34, 705/14.64, 705/14.66
International ClassificationG06Q30/02
Cooperative ClassificationG06Q30/0261, G06Q30/0267, G06Q30/0269, G06Q30/02
European ClassificationG06Q30/02, G06Q30/0269, G06Q30/0261, G06Q30/0267
Legal Events
4 Jan 2002ASAssignment