WO2013059902A1 - Method and system for providing and sharing rich media information associated to media content - Google Patents

Method and system for providing and sharing rich media information associated to media content Download PDF

Info

Publication number
WO2013059902A1
WO2013059902A1 PCT/CA2011/001197 CA2011001197W WO2013059902A1 WO 2013059902 A1 WO2013059902 A1 WO 2013059902A1 CA 2011001197 W CA2011001197 W CA 2011001197W WO 2013059902 A1 WO2013059902 A1 WO 2013059902A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
rich media
media information
presenting
communication device
Prior art date
Application number
PCT/CA2011/001197
Other languages
French (fr)
Inventor
Sanjay NATHWANI
Sinnathamby PUVIKUMAR
Devendra JUGDEO
Original Assignee
Research In Motion Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research In Motion Limited filed Critical Research In Motion Limited
Priority to PCT/CA2011/001197 priority Critical patent/WO2013059902A1/en
Publication of WO2013059902A1 publication Critical patent/WO2013059902A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815Electronic shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Definitions

  • the present matter relates to methods, systems and computer program products for providing rich media information to a viewer of associated media content, such as a television programme or media stream, where the rich media information may be presented to the viewer and shared with others.
  • the media content and rich media information may be presented on separate respective devices such as a television and a smartphone, tablet or other computing device.
  • Media content such as previously recorded or live television programs, movies, advertisements, etc. may be presented via a media system, often one connected remotely to a media content source such as a cable, satellite, Internet Protocol Television (IPTV) or media streaming service provider.
  • a media content source such as a cable, satellite, Internet Protocol Television (IPTV) or media streaming service provider.
  • IPTV Internet Protocol Television
  • viewers enjoy sharing their experiences with others. It is routine that such media content may be viewed on the media system while the viewer engages with a smartphone, tablet or other computing device having communication capabilities.
  • FIG. 1 is a block diagram illustrating an communications system including components of a viewer's media system, an electronic communication device such as a smartphone and various service provider components for providing rich media information in accordance with one example embodiment; and
  • Figure 2 is an information flow among various service provider components for providing rich media information in accordance with one example embodiment
  • Figures 3 to 10 are example screen shots of a user interface of an application for presenting and interacting with rich media information according to one example embodiment
  • Figures 11A, 11 B and 11C; 12A, 12B and 12C; and 13A and 13B; are respective flowcharts for methods of presenting and interacting with rich media information according to example embodiments;
  • Figures and 14A and 14B are respective flowcharts for methods of purchasing a product and linking such a purchase to a prior presenting and interacting with rich media information according to one example embodiment
  • Figure 15 is a block diagram of an example embodiment electronic communication device.
  • Figure 16 is a block diagram of an example embodiment of a media relay.
  • a rich media information service receives identification of media content presented by a media system.
  • the service determines the rich media information for transmitting to a subscriber's electronic device associated with the media system.
  • the electronic device presents the rich media information such as in synchronization with the presenting of the media content.
  • the rich media information may include a time line for presenting different information at particular time points.
  • the rich media information may be saved for subsequent playback. Interaction with the rich media information may be tracked and linked with subsequent activities such as store location visits or purchasing.
  • the rich media information may be shared with a contact via social networking. The shared information can be localized by the service to the contact (another subscriber).
  • FIG. 1 is a block diagram illustrating a system 100 including components of a viewer's media system 140 (e.g. 120, 122, 124 and 126), a communication device such as a smartphone 130 and various service provider components 150 (e.g. 104, 108, 109, 110 and 112) operating from a cloud (network) 102 for providing rich media information 106 in accordance with one example embodiment.
  • a viewer's media system 140 e.g. 120, 122, 124 and 126
  • a communication device such as a smartphone 130
  • various service provider components 150 e.g. 104, 108, 109, 110 and 112
  • cloud network
  • Media system 140 includes a television (TV) service set top box (STB) 118 connected to TV/monitor 122 via connection 120.
  • TV service STB 118 is connected (via one or more of cable, satellite, over the air, telephone, etc.) to a TV service provider 112 for receiving and presenting media content.
  • Media content may include previously recorded or live television programming, such as from TV and cable network providers, movies, on-demand programming, among other media content including music or audio services such as radio.
  • Media system 140 further includes a BlackBerry® TV (BBTV) box (media relay) 124 which is also connected to TV/monitor 122 via connection 126.
  • TV service STB 1 18 and media relay 124 are also connected via connection 128.
  • Any one or more of connections 120, 126 or 128 may be one or more cables, links or media interfaces.
  • a media interface may be a high definition media interface (HDMITM, (HDMI is a registered trademark of HDMI LICENSING, LLC.)).
  • HDMI HDMI is a registered trademark of HDMI LICENSING, LLC.
  • media system 140 may include one or more of an audio system (amplifier and speakers), DVD player, VCR, etc. (all not shown).
  • Media relay 124 is connected to cloud 102 via connection 116 such as via an Internet Service Provider (ISP).
  • ISP Internet Service Provider
  • media relay 124 connects via a wireless local area network (LAN) such as an in-home Wi-Fi and in some examples via a cable (not shown).
  • LAN wireless local area network
  • Media relay 124 may further provide an access point to other communication devices to connect with the Internet.
  • media relay 124 may be connected to cloud 102 to receive media content, for presenting via TV/Monitor 122, such as from an Internet- based media streaming service and/or media download service (e.g. a media store) or other media source device.
  • TV/Monitor 122 such as from an Internet- based media streaming service and/or media download service (e.g. a media store) or other media source device.
  • STB 118 may be a single component, for example, connected to TV Service provider 112 and rich media information service 108 via an Internet or other connection and connected to TV/Monitor 122 via an HDMI or other interface.
  • rich media information service 08 is a server.
  • TV service STB 8 may provide media content to TV/Monitor 122 through media relay 124.
  • connection 20 from TV service STB 118 may be through media relay 24.
  • Connection 128 shown in FIG. 1 may be not necessary.
  • Media relay 124 may be configured to layer or mix other display signals with media content from TV service STB 118.
  • Smartphone 130 is connected to media relay 124 via link 1 16 providing
  • Smartphone 130 may be another type of electronic device with communication capabilities such as a tablet.
  • An example electronic device is further described and illustrated with respect to FIG. 14.
  • smartphone 130 may be coupled via a different wireless link such as BluetoothTM (Bluetooth is a registered trademark of Bluetooth SIG, Inc.) or wired link such as HDMI, Universal Serial Bus (USB), Mobile High-definition Link (MHL), among others.
  • Smartphone 130 may also be connected via cellular network 114 to cloud 102.
  • Smartphone 130 includes a Rich Media Application (App.) 132 for receiving and presenting rich media information 106 and for interacting with same.
  • Rich media application 132 is configured for social networking (e.g. by one or more client applications (not shown)) and interacting with rich media information may include sharing such information via social networking service 134 with one or more friends or contacts as described further below.
  • Social networking service 134 represents one or more social networking services (such as for example Facebook or Twitter) and any associated network components.
  • Social networking service 134 may be connected to smartphone 130 via one or more IP-based connections such as 114 or 16.
  • Social networking service 134 may also be connected to media relay 124 via connection 136 such as an IP-based connection. Though illustrated separately, connection 116 may connect media relay and social networking service 134.
  • media relay 124 may have a client application other configuration to present social networking information via TV/monitor 122.
  • Media relay 124 may mirror social network messages, etc. while presenting media content, for example, layering the social networking messages and media content.
  • Rich media information may be defined and provided via one or more cloud-based services by one or more service providers. Rich media information includes descriptions of one or more aspects of associated media content. For example, for media content including an episode of a television series program, rich media information may include program series title, episode title, episode plot description, cast and/or crew or other credit list and bios, dialogue, excerpt of the media content ("highlights"), description of wardrobe and other products, services and/or locations featured in the episode and/or series, key words (tags), etc.
  • the information may include description about the advertised product and/or service, a product and/or service provider or seller, related products and/or services, discounts (coupons), etc.
  • Rich media information may be in text, image, audio and/or video formats.
  • the information may include pointers or links (e.g. Universal Resource Locators URLs) to additional resources and/or smartphone applications.
  • the pointers may link to further information or facilitate the smartphone to interact with the rich media information, such as by sharing with a friend or contact.
  • the pointers may be configured to invoke certain smartphone capabilities such as other applications (e.g. communication applications such as Twitter®, Facebook®, Internet Message (IM), email, Short Message Service (SMS), among others).
  • service provider components 150 include rich media TV information service provider component 104, rich media information service component 08, rich media information service subscriber database 109, TV information service component 110 and TV service provider component 112.
  • One or more of such components may include a computing device configured via program instructions and/or data as a server, relay, etc.
  • Rich media information service component 108 determines the particular rich media information that is to be provided to smartphone 130 as follows. Rich media information service component 108 receives from media relay 124 a request 202 for rich media information providing program identification data of the viewer's location, TV Service Provider and channel. The request may be initiated by media relay 124 in response to a selection of a TV channel for presenting by media system 140. The parameters may include a time
  • the request may identify a rich media information service subscriber (e.g. via a PIN or other subscriber ID number) and a look up in rich media information service subscriber databasel 09 may be performed for some of the program identification data (e.g. location, and/or TV Service provider).
  • Rich media information service subscriber databasel 09 stores subscriber data for the rich media information service.
  • the data associates the media relay 124 with the smartphone 130. It may also include one or more TV Service provider, location, other media content source providers etc. for determining and providing the appropriate rich media information to the appropriate electronic device (e.g. smartphone).
  • Subscriber data may be used to facilitate sharing of rich media information among subscribers, for example, to localize the program identification data to the receiving subscriber, accounting for possible different locations and/or providers, etc.
  • a television service provider operates television service provider component
  • TV service STB 118 operates a service via component 110 to provide TV information identifying programming (media content) provided to media systems 140.
  • Rich media information service 108 performs a look up204 via component 1 10 to identify the media content with which the rich media information is associated.
  • the look up may determine particular TV Information (output 206) including program data 206A (title and/or episode) and time information (time stamp) 206B indicating progress of the show (e.g. of total minutes played or remaining).
  • the request 202 from media relay may identify other media content sources (different database(s)) against which a look up204 may be performed or may include sufficient identification of the media content and any progress therein that a look up204 is not necessary.
  • Rich media TV information service component 104 is configured to provide rich media information 106 for particular associated media content.
  • a provider of such rich media information 106 may be a TV studio, film studio and/or TV network from which the media content originates or another (e.g. third party) provider.
  • rich media information service 108 looks up the rich media information in component 104 in accordance with TV information 206, such as program title, episode, or some program ID.
  • Rich media information service 108 prepares rich media information package 210 including for example program data 206A, time stamp 206B and rich media information 106 for the entire associated media content.
  • the rich media package 210 is sent to the smartphone.
  • Rich media information service 108 may look up in rich media information service subscriber database 109 to determine the smartphone associated with the media relay.
  • media relay 124 may be associated with one or more smartphone devices for a subscriber (e.g. sub-accounts within a family or for presenting on different devices (smartphone, tablet other devices) owned by the subscriber, etc.).
  • a request for rich media information may distinguish which device is to receive the rich media information.
  • Rich media information 106 may include a time responsive presentation schedule (e.g. a time line) to facilitate the presentation of the rich media information in synchronization with a progress of the presenting of the associated media content.
  • rich media information 106 may include instructions to show certain data "from 0:00 to 0:02" then show other data "from 0:02 to 0:23".
  • Time stamp 206B may be useful to initiate the presenting of the rich media at the correct time (progress) of the associated media content on media system 40. The clock or other timing ability of smartphone 30 may then be used to continue the progress of the presenting.
  • Rich media information service component 108 may be configured to receive requests for additional rich media information from smartphone 30 e.g. via one or more controls associated with the presenting of the rich media information. Additional information may be similarly determined but may involve a look up or other requests to different information sources. A request for additional information such as "stores near me" may involve a look up in an information source providing retail store locations. A response may be location aware. A request for directions to a store may involve a request to an information source providing maps and/or directions, etc.
  • Media relay 124 may facilitate synchronization with media system 140 such as relaying a signal indicating status of the presenting (e.g. pause, stop, fast forward, rewind or other presentation activities) of media system 140 relative to the associated media content.
  • TV service STB 118 may have personal video recorder capabilities to pause, rewind, and record TV and fast forward any recorded/rewound TV.
  • This signal may be relayed to rich media application 132 via connection 116 to pause the presenting of rich media information. Another signal may indicate resumption of the presenting, etc.
  • a rewind signal may invoke a suspension of the presenting of rich media information.
  • a rewind signal may indicate how much time was rewound (e.g. rewind 2:34) or a new time stamp from which to begin (begin at 9:45) presenting rich media information.
  • rich media information 106 for a previously recorded program may be downloaded when the program is played via the PVR.
  • Behaviour of rich media application 132 can be similar for previously recorded programming, but the program data 206A sent to the cloud for "what I'm watching" may be more comprehensive, including what channel was recorded, show name, time and date of show, TV service provider to determine the appropriate rich media information to be downloaded.
  • rich media information 106 may de downloaded and saved to the smartphone when the program is recorded for later presenting (e.g. when the program is presented).
  • Rich media information service 108 may provide a trigger to rich media application 32 to present the previously downloaded rich media information 106 rather than resend it.
  • App. 132 may look up locally whether the rich media information that was previously downloaded is available present it accordingly. If not downloaded or no longer available (e.g. because it was deleted to make resources available or for another reason), rich media application 132 may request a resend. This would then allow the user to play or FFWD through the show and still have all relating rich content for the show.
  • Rich media information 106 may be selectively configured in response to the
  • rich media information for advertisements may reflect the location of the subscriber. Location may be determined in various manners such as a location defined in a subscriber's profile (stored in rich media information service subscriber database109) for the rich media information service 108, a location capability of the smartphone or by subscriber input.
  • Smartphone application and media relay 124 and/or rich media information service 108 can communicate to initiate the rich media application 132 with rich media information for media content presented by media system 140.
  • media relay 124 can detect the current channel to which the TV STP 118 is tuned and initiate a prompt or trigger to rich media application 132 to inquire whether rich media information associated with the media content should be downloaded to the application In accordance with an appropriate response, media relay 124 can initiate the method and flow of FIG. 2.
  • rich media application 132 may communicate with media relay 124 or rich media information service 108 to initiate detecting of the current channel and the download of rich media information to rich media application 132.
  • the rich media information may be "pushed" (i.e. transmitted) to rich media application 132 from the rich media information service 108, via cellular connection 114 or Wi-Fi connection 116 etc.
  • FIGS. 3 to 10 are example screen shots of a user interface of rich media application 132 for presenting and interacting with rich media information 106 according to one example embodiment.
  • FIG. 3 illustrates a representative main screen interface 300 for presenting rich media information for particular associated media content.
  • Main screen interface 300 includes one or more screen portions (e.g. 302, 304, 310 and 312 and 314) which may be active to receive user interaction or inactive.
  • Screen 300 may present one or more other controls (e.g. 306 "Save Show” described further below) or information (such as media content presentation progress information 308 and progress bar 316.
  • one or more user interface menus or other actions may be associated with screen 300 (and/or other screens) which menus may be invoked using input means of smartphone 130.
  • Portion 302 presents program data (e.g. 206A).
  • Portion 304 presents a graphic representative of the media content (e.g. from rich media information 106).
  • Portion 310 presents rich media information 106 in one or more content categories 31 OA, 310B, 310C, 310D and 310E. Specific categories may differ for particular associated media content. For example, category 310E "Cast" presenting cast members and bios may be "Players" presenting player statistics and bios in a live sports context. More or fewer categories may be used.
  • Portion 310 is active such that a particular category may be invoked to present additional rich media information for the category as described further.
  • Portion 312 presents one or more social networking interfaces 312A, 312B,
  • Invoking a social networking interface facilitates sharing of rich media information with a friend or contact via social networking service 134.
  • invoking the social networking interface may initiate an applicable communication to a contact.
  • At least some of a content for the applicable communication may be defined from a portion of rich media information and/or program data.
  • a message may be defined for the viewer to share with a contact that the viewer is watching a specific program.
  • Portion 314 may be active for example to receive input to save a show via control 306 (i.e. the rich media information associated to the show is saved to a memory of smartphone 130) for presenting later (playback mode). Presenting of saved rich media information may be performed without presenting the associated media content via media system 140.
  • Progress bar 316 may be an active control in a playback mode for saved shows (See FIGS. 9 and 10) to receive input to selectively present the rich media information from a particular time points in the time line. In one example embodiment, a viewer may drag the progress bar to fast forward or rewind to a desired time of progress (time point). Presenting may be paused.
  • Rich media information time points and/or particular information items may be saved or "bookmarked” to facilitate presenting from a specific time.
  • Bookmarks (a type of pointer) may be granular, indicating which information (e.g. category, screen, etc.) is to be presented when invoked. Bookmarks may be shared with friends and contacts such as via social networking service 134.
  • a bookmark may include program information 206A, a time stamp indicating a time point in the time line, and a pointer to particular content in the rich media information such that when invoked, the application is instructed appropriately.
  • Presenting of rich media information may be responsive to location.
  • the application may be configured to provide a current location or user specified location to rich media information service 108 to obtain location responsive rich media information.
  • a friend receiving and invoking a shared bookmark may have a different location than the friend who defined and shared the bookmark.
  • a friend receiving the bookmark may have different TV service provider.
  • rich media information service 108 may be requested to provide the appropriate rich media information that is responsive to the receiving contact's TV service provider and location if the receiving contact is a subscriber to the rich media information service. If the receiving contact is not a subscriber, the receiving contact may be invited to download the rich media application 132 and/or subscribe to the service.
  • FIG. 4 is a screen 400 showing category 310E "Cast" in accordance with an example embodiment.
  • Screen 400 presents individual cast members in respective screen portions (e.g. 402 and 404).
  • Screen controls may be provided to show other, more or fewer cast members.
  • Particular cast member information 402A from rich media information 106 may include text, image, audio and or video.
  • One or more controls may be provided to present more or less information.
  • Rich media information 106 for a particular cast member may include links or pointers 402B, 402C and 402D for interacting with the rich media information. Interaction may be to acquire additional information (e.g. 402B and 402C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 402D) via social networking service 134, for example.
  • the link or pointer may facilitate interaction within rich media application 132 or invoke other smartphone capabilities including applications.
  • FIG. 5 illustrates a category for products such as those featured in the particular episode or the series, etc.
  • the particular category presented in screen 500 is
  • Screen 500 employs a similar format to screen 400 showing particular category products in respective portions (e.g. 502).
  • Screen controls may be provided to show other, more or fewer individual products.
  • Particular electronic product information 502A from rich media information 106 may include text, image, audio and or video.
  • One or more controls may be provided to present more or less such information.
  • Rich media information 106 for a particular electronic product may include links or pointers 502B, 502C and 502D for interacting with the rich media information. Interaction may be to purchase a product online (e.g. 502B), acquire additional information (e.g. 502C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 502D) via social networking service 134, for example.
  • the link or pointer may facilitate interaction within the rich media application 132 or invoke other smartphone capabilities including applications.
  • FIGs. 6 and 7 illustrate a further category for products such as those featured in the particular episode or the series, etc.
  • the particular category presented in screen 600 and in screen 700 is "Fashion" 310C.
  • FIG. 6 represents rich media information 106 for presenting during one time period of the presentation of the associated media content and
  • FIG. 7 represents rich media information 106 for presenting during a second time period.
  • Progress information may be received from media relay 124 to coordinate the presenting of the appropriate rich media information.
  • Screens 600 and 700 employ a similar format to screen 400 and 500 showing particular category products in respective portions (e.g. 602, 604, 702, and 704).
  • Screen controls may be provided to show other, more or fewer individual products.
  • Particular fashion product information e.g. 602A and 704A from rich media information 106 may include text, image, audio and or video.
  • One or more controls may be provided to present more or less such information.
  • Rich media information 106 for a particular fashion product may include links or pointers (e.g. 602B, 602C and 602D, 704B, 704C and 704D) for interacting with the rich media information. Interaction may be to purchase a product online (e.g. 602B, 704B), acquire additional information (e.g. 602C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 602D, 704D) via social networking 34, for example.
  • the link or pointer may facilitate interaction within the rich media application 132 or invoke other smartphone capabilities including applications.
  • Screen 800 of FIG. 8 illustrates an example user interface upon the invocation of control or pointer 602C to present further information for a particular product item.
  • pointer 602C presents data including "stores near me” in portion 802.
  • Respective store information 802A, 802B, 802C, 802D may be presented such as store name, address and distance.
  • One or more controls (such as 804A or 804D for directions and details) may be provided to show other, more or less store information.
  • the controls are hyperlinks to more information, specifically details about the store and directions to the store.
  • Smartphone 130 may be configured with location awareness, for example, with Global Positioning Satellite (GPS) or other location capabilities. Invoking pointer 602C may facilitate a request (via media relay 24 and/or rich media information service 108) for store information for stores selling fashion items which information may be filtered or otherwise responsive to location of smartphone 130. While specific location information for smartphone 130 may be advantageous, alternatives for such information could be used such as the TV service provider location, user supplied location, etc. media relay and/or rich media information service 108 may be configured to look up store information, for example, using a cloud-based service (not shown). Store information may relate to stores selling the specific product item and/or similar items.
  • GPS Global Positioning Satellite
  • FIGs. 9 and 10 show screens 900 and 1000 presenting user interfaces for shows previously watched as indicated by title portion 902. Such shows in a TV context may include previously recorded or live TV programs, movies, etc.
  • the rich media information for the entire episode may be saved e.g. to the smartphone, for playback.
  • just the program data may be saved and used to retrieve the rich media information again.
  • saving may be automatically performed and saved shows kept in accordance with one or more rules to maintain resources.
  • Screen 900 provides a user interface for selectively presenting (filtering) a listing of shows previously watched (i.e. rich media information saved).
  • Portion 904 provides a plurality of filtering options 904A, 904B, 904C, 904D, 904E and 904F.
  • Screen controls may be provided to invoke the respective filtering options (e.g. control 906 for invoking "Today" option 904A).
  • Screen 1000 provides a user interface listing shows previously watched.
  • the list of all saved shows is filtered using filtering option 904A that is predefined to be responsive to current date criteria. Other predefined criteria may be a current week, month or year.
  • a search interface may permit searching by terms or categories (e.g. tags). Individual previously watched show items (e.g. 1002A) may be invoked to interact with the saved show (e.g. re-play, delete, etc. (not shown)).
  • smartphone 130 may be configured to facilitate command and control of media system 140, for example, as a remote control device. Invoking the playback (presenting) of a saved rich media information "show” may invoke playback of associated media content such as via a PVC capability of the media system 140.
  • Interaction with rich media application 132 may be tracked. For example, invocations to share rich media, buy online, determine stores near me, look at specific store directions, etc. may be logged for measuring use statistics, particularly those useful to advertisers, product and/or service providers, media content creators and providers. For example, as described further, an invocation of a "stores near me” pointer and "details and directions" control may be logged and a subsequent activity such as a store visit and/or purchase may be linked with the tracked interaction to give useful information. Store visits may be determined using location awareness of smartphone 130. Purchases may be linked using purchase capabilities of smartphone 130 (e.g. using near field communication (NFC) smart tags, e-wallet capabilities, etc.)
  • NFC near field communication
  • FIGS. 11 A, 1 B and 1 C illustrate flow charts of methods for sharing rich media information performed by the respective viewer's smartphone 130, media relay 124 and a receiving contact's smartphone (not shown in FIG. 1).
  • rich media application 132 presents rich media main interface 300 for a particular media content program with categories portion 310 and social networking portion 312.
  • rich media application 132 receives an invocation of a particular social networking control (e.g. 312A to share rich media information or program information via IM such as BlackBerry MessengerTM (BBMTM)).
  • a particular social networking control e.g. 312A to share rich media information or program information via IM such as BlackBerry MessengerTM (BBMTM)
  • a determination may be made whether the receiving contact is a subscriber to the rich media information service 108).
  • a request may be sent to the service (e.g. at 12) and an answer received.
  • Rich media information service 108 may look up subscriber information in rich media information service subscriber database109.
  • a message optionally with a bookmark to invoke the receiving contact's rich media application may be defined in response.
  • the bookmark may be defined in response to the location and TV service provider of the receiving contact, if possible.
  • a message inviting the receiving contact to download the application and/or subscribe may be defined in response, particularly if the receiving contact is not a subscriber.
  • a message may include text or other information sharing that the message sender is watching a particular program on a particular channel, which channel can be responsive to the receiving contact's data.
  • the message may invite the contact to also watch.
  • the message may invite the receiving contact to invoke the bookmark to obtain the rich media information, begin watching the program and/or other activity (e.g. look up which channel is applicable to the receiving contact).
  • a determination of subscriber status is not made and a bookmark is defined and invite sent in any event.
  • rich media information service 108 can apply the receiving contact's TV service provider and location information to determine, if possible, the appropriate program data 206A including channel for the recipient and determine the appropriate rich media information.
  • the service may define the bookmark and respond with same (at 1112) when inquired (at 1106) for inclusion in the message.
  • the message is sent via social networking (e.g. BBM).
  • social networking e.g. BBM
  • the receiving contact receives the message (at 1122).
  • the message may invite the user to watch a program.
  • a bookmark received is invoked (1124).
  • Invoking the bookmark may invoke the receiving contact's rich media application to tune the media system 140 to the program (not shown).
  • the receiving contact tunes the media system in another manner (not illustrated). Tuning the media system will in turn invoke the media relay to initiate the media service to determine and download the rich media information.
  • invoking the bookmark downloads the rich media information (e.g. prompts the user to request the download).
  • the bookmark may invoke the rich media application and one or more options may be presented by the application (e.g. download, tune, etc.).
  • invoking control 312A or a menu option will publish at least some of program data 206A (e.g. via a social networking status or other real-time indicator) to let contacts know what is being watched ("what I'm watching now").
  • Rich media application 132 may be configured to provide selective choice whether to publish the status and/or send program data 206A to a contact.
  • FIGS. 12A, 12B and 12C illustrate flow charts for sharing rich media information by methods performed by the respective viewer's smartphone 130, media relay 124 and a contact's smartphone (not shown in FIG. 1).
  • rich media application 32 presents electronic category 310D in user interface screen 500 for rich media information associated to particular media content.
  • Screen 500 is presented with portion 502 for a particular item of electronics and with portion 502 including social networking pointer or control 502D.
  • rich media application 132 receives an invocation of a particular social networking control (e.g. 502D "Tell a Friend") to share rich media information for the particular electronic item via IM.
  • a particular social networking control e.g. 502D "Tell a Friend
  • a determination may be made whether the receiving contact is a subscriber to the rich media information service 108.
  • a request may be sent to the service (e.g. at 1212) and an answer received.
  • a message optionally with a bookmark to invoke the receiving contact's rich media application may be defined in response.
  • the bookmark may be defined in response to the location and TV service provider of the receiving contact, if possible.
  • a message inviting the receiving contact to download the application and/or subscribe may be defined in response, particularly if the receiving contact is not a subscriber.
  • a message may include text or other information sharing that the message sender is telling the contact about a specific item e.g. from a particular program on a particular channel, which channel can be responsive to the receiving contact's subscriber data.
  • the message may invite the contact to also watch and/or review the information.
  • the message may invite the receiving contact to invoke the bookmark to obtain the rich media information, begin watching the program and/or other activity (e.g. look up which channel is applicable to the receiving contact).
  • the bookmark that is optionally defined may include a pointer responsive to the program data, time stamp and particular rich media information indicated to be shared (the electronic item).
  • the bookmark may be responsive to location and TV service provider of the receiving contact, if possible.
  • the rich media information may be responsive to the receiving contact's location. For example, invoking a "stores near me" control such as 602C would present stores near the location of the recipient. This location may be determined in various manners such as a location aware smartphone (GPS), rich media information subscriber data (), or user supplied data.
  • the message is sent via social networking (e.g. BBM)
  • social networking e.g. BBM
  • receiving contact's smartphone receives IM message including electronic category item information and the optional bookmark.
  • the bookmark is invoked.
  • the bookmark may invoke the receiving contact's rich media application to download the rich media information from rich information media service 108 and present the bookmarked item.
  • the rich media may tune the media system, etc.
  • FIGS. 13A and 13B illustrate flow charts of methods for interacting with product related rich media information performed by the viewer's smartphone 130 and media relay 124.
  • rich media application 132 presents fashion category 312C information in portion of a screen (e.g. 602 of screen 600).
  • rich media application 132 receives an invocation of pointer or control "Buy Near Me” 602D for an item.
  • store information in accordance with location is determined. For example, an applicable request is sent to media relay 124 (see Fig. 13B).
  • localized store Information is presented (screen 800) in portion 802.
  • rich media application 32 receives invocation of "details and directions" (e.g.
  • media relay 124 receives a request for store information in accordance with location for an item.
  • media relay tracks a click through for the item, logging the click in a data store (not shown).
  • the data store may be remote from media relay 124 such as one (not shown) associated with rich media information service component 108.
  • media relay 124 obtains and provides localized store information to rich media application 132. For example, media relay 124 requests such information from a remote service such as rich media information service component 108 or other (not shown).
  • a remote service such as rich media information service component 108 or other (not shown).
  • media relay 124 receives a request for details and directions for a store from rich media application 132.
  • media relay 124 tracks a click through for a store logging the click to a data store.
  • media relay 124 obtains and provides details and directions for the store to rich media application 132. Track clicks may be stored to facilitate linking with other smartphone activities such as store visits or purchases.
  • FIGS. 14A and 14B illustrate flow charts of methods for purchasing an item using a viewer's smartphone and linking the purchase to a preview presenting and interacting with product related rich media information.
  • smartphone 130 is payment enabled such that a financial transaction may be completed using the smartphone.
  • Smartphone may include near field communications with smart tags and/or e-wallet capabilities to make a payment to a retailer or other seller having cooperative systems for example, similar to a chip enabled credit or debit card transaction.
  • smartphone receives an invocation to conduct a purchasing transaction such as to pay for a product (or service) using payment-enabled smartphone (e.g. via NFC).
  • smartphone provides to rich media information service 108 store information and/or purchased item information for potential linking to prior tracked click through for store and/or item. Alternatively, such information is provided by the payment service associated to the smartphone.
  • rich media information service component 108 receives store information and/or purchased item information for potential linking to prior tracked click through for store and/or item.
  • rich media information service component 108 performs link search and stores link results to determine if a prior click through associated to the smartphone in the data store is a match.
  • aggregate statistics are complied and provided such as to advertisers etc.
  • smartphone 130 may store click through data and match same with purchase and store visit data, providing results to media relay 124 and/or rich media information service component 108.
  • FIG. 15 shows a block diagram illustrating an example electronic communication device 1502 that is suitable to be configured as smartphone 130 or rich information media service 108.
  • Device 1502 is illustrated with wireless communication capabilities and in particular example embodiments communicates through a communication network 1504.
  • Network 1504 is also illustrated with wireless capabilities and includes antenna, base stations, and supporting radio equipment for supporting wireless communications between device 1502 and other devices connected to network 1504.
  • Network 1504 may be connected to a network gateway and to a wide area network (not shown).
  • device 1502 is a two-way communication device having at least data and/or voice communication capabilities, including the capability to communicate with other computer systems.
  • device 1502 is a mobile device.
  • it may be a data messaging device, a two-way pager, a cellular telephone with data messaging capabilities, a wireless Internet appliance, a data communication device (with or without telephony
  • device 1502 is a desktop computer or a server. More generically, it may be a computing device.
  • Device 1502 may communicate with any one of a plurality of fixed transceiver stations within its geographic coverage area. Though a wireless device is shown, in some example embodiments device 1502 may have a wire connection to network 1504.
  • Device 1502 may incorporate one or more communication subsystems such as subsystems 1512 and/or 1580.
  • Communications subsystem 1580 may be a wireless networking communications subsystem, for example, conforming to IEEE 802.151 standards such as 802.151b, 802.151g, and/or 802.151 ⁇ and/or others.
  • subsystem 1580 is only present and communications subsystem 1512 providing cellular communications is not.
  • subsystem 1512 may be removably connected to a port of device 1502 such as via a USB stick.
  • communication subsystem 1512 includes a receiver 1514, a transmitter 1516, and associated components, such as one or more antenna elements (1518 and 1520), local oscillators (LOs) 1522, and a processing module such as a digital signal processor (DSP) 1524.
  • LOs local oscillators
  • DSP digital signal processor
  • antenna elements (1518 and 1520) may be embedded or internal to device 1502.
  • the particular design of the communication subsystem 1512 depends on the network 1504 in which device 1502 is intended to operate.
  • Device 1502 may send and receive communication signals over the network
  • Signals received (e.g. by antenna elements 1518) through network 1504 are input to receiver 1514, which may perform such common receiver functions as signal amplification, frequency down conversion, filtering, channel selection, etc., as well as analog-to-digital (A/D) conversion.
  • AID conversion of a received signal allows more complex communication functions such as demodulation and decoding to be performed in DSP 1524.
  • signals to be transmitted are processed, including modulation and encoding, for example, by DSP 1524.
  • These DSP- processed signals are input to transmitter 1516 for digital-to-analog (D/A) conversion, frequency up conversion, filtering, amplification, and transmission to the network 1504 via antenna 1520.
  • DSP 1524 processes communication signals and provides for receiver and transmitter control. For example, the gains applied to communication signals in receiver 1514 and transmitter 516 may be adaptively controlled through automatic gain control algorithms implemented in DSP 1524.
  • Network access may be associated with a subscriber or user of device 1502 via a memory module, such as a memory module 1530, which may be a
  • SIM Subscriber Identity Module
  • UMTS Universal Mobile Broadband
  • the SIM card is inserted in or connected to an interface 1532 of device 1502 in order to operate in conjunction with network 1504.
  • device 1502 may have an integrated identity module for use with systems such as Code Division Multiple Access (CDMA) systems.
  • CDMA Code Division Multiple Access
  • Device 1502 may include a Wi-Fi transceiver 1580 that may include similar
  • Wi-Fi Wireless Fidelity
  • WiMAX WiMAX is one alternative transceiver.
  • device 1502 may be capable of Wi-Fi and WiMAX communications in
  • Device 1502 may also include GPS capabilities through one or more of its antenna.
  • Device 1502 also includes a battery interface 1536 for receiving one or more battery 1538 which may be rechargeable.
  • the one or more battery 1538 provides electrical power to at least some of the electrical circuitry in device 1502, and battery interface 1536 provides a mechanical and electrical connection for the one or more battery 1538.
  • Battery interface 1536 is connected to a regulator (not shown) which provides power V+ to the circuitry of device 1502.
  • Device 1502 includes a programmable processor (e.g. microprocessor
  • Microprocessor 1540 which controls the overall operation of device 1502. Communication functions, including at least data and voice communications, are performed through the communication subsystem 512. Microprocessor 1540 also interacts with additional device subsystems such as a display 1542, a flash memory 1544, a random access memory (e.g. RAM 1546), a read-only memory (e.g. ROM 1548), input/output (I/O) subsystems, interfaces or ports 1510 (e.g.
  • an audio port for connecting to a set of headphones and/or a remote microphone, an High-Definition Multimedia Interface (HDMI), composite video, component video, S-Video, etc, a Universal Serial Bus (USB) or Ethernet port), a keyboard or keypad 1514, a speaker 1516, a microphone 1518, a clickable thumbwheel, trackball, optical or other touch or gesture based input pad, or set of scroll buttons, etc. 1560, typically for scrolling/selecting input, one or more short-range communications subsystems 1562, and any other device subsystems generally designated as 1564.
  • Some of the subsystems shown in FIG. 15 perform communication-related functions, whereas other subsystems may provide "resident" or on-device functions.
  • Some subsystems such as keypad 1514, display 1542, and input device
  • microprocessor 1560 may be used for communication-related functions, such as entering a text message for transmission over network 1504, and executing device-resident functions such as a calculator or task list, media play back, Internet browsing, etc.
  • Operating system software and other software used by the microprocessor 1540 is preferably stored in a persistent store such as flash memory 1544, which may alternatively be ROM 1548 or similar storage element.
  • the microprocessor 1540 in addition to its operating system functions, enables execution of software applications on device 1502.
  • One or more memory stores may be available on device 1502 to facilitate storage of information, such as flash memory 1544, RAM 1546, ROM 1548, memory module 1530, or other types of memory storage devices or FLASH memory cards represented by other device subsystems 1564, such as Secure Digital (SD) cards, mini SD cards, micro SD cards, etc.
  • SD Secure Digital
  • Device 1502 may be configured with a browser for interacting with Web pages.
  • Device 502 may have one or more media related applications for displaying images, playing audio and or video files/streams, etc.
  • the browser and/or media applications often have the ability to send and receive data items via either network 1504 or a link to a computer system.
  • the link to the computer system may be via serial port (e.g. 1510) or short-range communications subsystem 1562. Additional applications may also be loaded onto device 502 through network 1504, auxiliary I/O subsystems/interfaces/ports 1510, short-range
  • communications subsystem 1562 or possibly, other device subsystems 1564, and installed by a user in RAM 1546 or a non-volatile store such as ROM 1548 for execution by microprocessor 1540.
  • RAM 1546 or a non-volatile store such as ROM 1548 for execution by microprocessor 1540.
  • ROM 1548 non-volatile store
  • microprocessor 1540 microprocessor 1540.
  • Such flexibility in application installation increases the functionality of device 1502 and may provide enhanced on-device functions, communication-related functions, or both.
  • secure communication applications may enable electronic commerce functions and other such financial transactions to be performed using device 1502.
  • Device 1502 may be configured as a remote control for media system 140.
  • a data signal representing remote control codes may be received or transmitted by communication subsystem 1512, transceiver 1580 or short range
  • a short range or other communication means may be connected to device 1502 via serial or other port.
  • the microprocessor 1540 may further process a received data signal. For example, as a device 110, microprocessor 1540 may store the specific remote control codes 130 used to configure media system 102, selectively transmitting the applicable remote control code via short range communications 1562 as IR codes, under control of a user, for example.
  • a user of device 110 may selectively input commands for configuring the controls of the media system such as changing volume, playback quality controls, power, etc., for example, using keypad 1514 and/or input device 560 or a touch screen configured display 1542 and possibly auxiliary I/O subsystem 1510, Keypad 1514 may be either a complete alphanumeric keypad or telephone- type keypad.
  • a serial port (e.g. 1510) is often implemented (e.g. in a personal digital assistant (PDA) type communication device for which synchronization or other communication with a user's computer is a useful, but optional, component).
  • PDA personal digital assistant
  • a serial port enables a user to set preferences through an external device or software application and extends the capabilities of device 1502 by providing for information, media file, or software downloads to or uploads from device 1502 other than through network 1504. It may also accept other communication devices such as radio and IR dongles.
  • Short-range communications subsystem 1562 is an additional component which provides for communication between device 1502 and different systems or devices, which need not necessarily be similar devices.
  • short-range communications subsystem 1562 may include an infrared (IR) device and associated circuits and components, or a wireless bus protocol compliant communication mechanism such as a Bluetooth communication module to provide for communication with similarly-enabled systems and devices.
  • Device 1502 may be configured to pair with other Bluetooth compliant devices for establishing communications.
  • Short-range communications may include NFC for payment technologies.
  • Figure 16 is a block diagram illustrating an example embodiment of a media relay 124.
  • Rich media information may be defined using HTML (e.g. HTML 5), XML or other formatting language for presenting by rich media application 132.
  • rich media information may be associated with a time line, to coordinate the presenting of the rich media information in synchronization with the presenting of the associated media content.
  • Rich media information for the associated media content may be made available (that is, selectively visible) through rich media application 132, in response to the progress information, such as for a specific time period or other event defined period that the associated media content is presented via media system 140.
  • advertisements can be presented via media system 140.
  • rich media information associated to at least some of the advertisements may be made available for presenting via rich media application 132.
  • Rich media information for advertisements may include a category in a similar way to other categories. The advertisement category could be made visible at certain times (e.g. to coincide with typical commercial break times before, during or after a TV program). Categories associated to the TV show media content may similarly be made visible for a portion of the time.
  • FIG. 16 is a block diagram of an example embodiment of an electronic device configured as a media relay such as media relay 124. Though referenced as a media relay, such a device may have other functionality (and consequently names), such as a media client or media server.
  • Media relay 124 includes a processor 1602, memory 1604 (RAM and/or ROM) and storage 1606 (e.g.
  • Processor 1602 may be configured using instructions and/or data in memory 1604 for execution and operation.
  • Storage 1606 may store such instructions and data as well as media content, etc. Instructions and data may configure media relay, media or other application client and/or media or other application server capabilities, at least some of which are described herein.
  • Media relay may be configured to receive channel and other program information from TV service STB 118 for providing to rich media information service 108 as previously described.
  • Media relay 124 may be configured as a social networking client for receiving social networking events (e.g. messages, status updates, etc.) and displaying or otherwise presenting them on media system 140 (e.g. mirroring).
  • the client may be configured for displaying only or also for originating social networking events as well.
  • the client application may generate a status message indicating what media content is being watched for providing to social networking service 134.
  • Such a feature may be a user option and require user input before performing/completing the status update.
  • media relay 124 may be configured to receive a media content signal, either as a TV service STB or from a TV service STB, or other media source for TV/Monitor 122.
  • media relay 124 may be configured to layer or mix the social networking events with a media content signal (e.g. TV signal) received such that both the events and media content are presented simultaneously.
  • a BBM message sent to the BBTV subscriber associated with media relay (BBTV box) 124 of system 140 e.g. "John Smith is watching Monday Night Football on ESPN"
  • the message may also be presented by smartphone 130.
  • a channel change invoked as described and rich media information provided to smartphone 130.
  • Media relay 124 includes one or more interfaces such as short range communication interface 1608, wired network interface 1610, wireless network interface 1612 and input/output interface 1614.
  • a bus 1616 connects the components for communication.
  • Short range communication interface 1608 may be an Infrared (IR), radio or other communication for receiving remote control commands, for example.
  • Wired network interface 1610 may connect media relay 124 to a LAN, wide are network such as the Internet and cloud 102.
  • Wireless network interface 1612 may connect media relay 124 to a LAN, wide are network such as the Internet and cloud 102.
  • Media relay (e.g. via interfaces 1610 and/or 1612) may be configured to provide an access point and/or hub and routing capabilities for other devices such as smartphone 130, etc.
  • Input/output interfaces 1614 provide one or more input, output and input/output devices for configuring and/or operating media relay 124. Such devices may include one or more buttons, keys, display screen, lights, speakers, etc.
  • a rich media generation tool may be configured to permit a programmer to define the rich media information, for example, by viewing the media content and defining points in the time line at which particular rich media information is to be available for presenting.
  • Specific information categories can be defined for information of similar type and specific category items therein also can be defined. Description (text, image, audio/video) and pointers/controls can be added.
  • One or more templates may be useful.
  • the categories and items therein can be associated to the time line for coordinating presenting at desired times.
  • a suitable package of rich media information can be defined for the associated media content. The package and any appropriate metadata can published or loaded to a suitable store to be made available for searching and downloading.
  • Rich media information and/or packages may be defined in accordance with the end device that will ultimately present the rich media information.
  • rich media information for a particular media content and intended for presenting on a smaller display screen smartphone may be different from rich media for a tablet or personal computer, etc.

Abstract

There is disclosed one or more methods, devices, systems and components therefor for providing rich media information for media content. A rich media information service receives identification of media content presented by a media system. The service determines the rich media information for transmitting to a subscriber's electronic device associated with the media system. The electronic device presents the rich media information such as in synchronization with the presenting of the media content. The rich media information may comprise a time line for presenting different information at particular time points. The rich media information may be saved for subsequent playback. Interaction with the rich media information may be tracked and linked with subsequent activities such as store location visits or purchasing. The rich media information may be shared with a contact via social networking. The shared information can be localized by the service to the contact (another subscriber).

Description

Method and System for Providing and Sharing Rich Media Information Associated to Media
Content
FIELD
[0001] The present matter relates to methods, systems and computer program products for providing rich media information to a viewer of associated media content, such as a television programme or media stream, where the rich media information may be presented to the viewer and shared with others. The media content and rich media information may be presented on separate respective devices such as a television and a smartphone, tablet or other computing device.
BACKGROUND
[0002] Media content such as previously recorded or live television programs, movies, advertisements, etc. may be presented via a media system, often one connected remotely to a media content source such as a cable, satellite, Internet Protocol Television (IPTV) or media streaming service provider. When viewing such content, viewers enjoy sharing their experiences with others. It is routine that such media content may be viewed on the media system while the viewer engages with a smartphone, tablet or other computing device having communication capabilities.
[0003] Conventional media systems have no or poor means of providing rich media information such as information which describes one or more aspects of the associated media content, for presenting to a media content viewer while viewing the media content.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] In order that the subject matter may be readily understood, embodiments are illustrated by way of examples in the accompanying drawings, in which:
Figure 1 is a block diagram illustrating an communications system including components of a viewer's media system, an electronic communication device such as a smartphone and various service provider components for providing rich media information in accordance with one example embodiment; and
Figure 2 is an information flow among various service provider components for providing rich media information in accordance with one example embodiment; and Figures 3 to 10 are example screen shots of a user interface of an application for presenting and interacting with rich media information according to one example embodiment;
Figures 11A, 11 B and 11C; 12A, 12B and 12C; and 13A and 13B; are respective flowcharts for methods of presenting and interacting with rich media information according to example embodiments;
Figures and 14A and 14B are respective flowcharts for methods of purchasing a product and linking such a purchase to a prior presenting and interacting with rich media information according to one example embodiment;
Figure 15 is a block diagram of an example embodiment electronic communication device; and
Figure 16 is a block diagram of an example embodiment of a media relay.
[0005] For convenience, like numerals in the description refer to like structures in the drawings.
DETAILED DESCRIPTION
[0006] It would be useful to connect a personal electronic device to a media system and receive rich media information associated to media content, including advertisements, presented by the media system. It would be useful to present and interact via an application with the rich media information, which information can include descriptions of one or more aspects of the associated media content. Interacting can include sharing the rich media information with friends, determining further information and buying products or services. Rich media information shared with a friend may be modified in accordance with the location of the friend.
[0007] There is disclosed one or more methods, devices, systems and components therefor for providing rich media information for media content. A rich media information service receives identification of media content presented by a media system. The service determines the rich media information for transmitting to a subscriber's electronic device associated with the media system. The electronic device presents the rich media information such as in synchronization with the presenting of the media content. The rich media information may include a time line for presenting different information at particular time points. The rich media information may be saved for subsequent playback. Interaction with the rich media information may be tracked and linked with subsequent activities such as store location visits or purchasing. The rich media information may be shared with a contact via social networking. The shared information can be localized by the service to the contact (another subscriber).
[0008] FIG. 1 is a block diagram illustrating a system 100 including components of a viewer's media system 140 (e.g. 120, 122, 124 and 126), a communication device such as a smartphone 130 and various service provider components 150 (e.g. 104, 108, 109, 110 and 112) operating from a cloud (network) 102 for providing rich media information 106 in accordance with one example embodiment.
[0009] Media system 140 includes a television (TV) service set top box (STB) 118 connected to TV/monitor 122 via connection 120. TV service STB 118 is connected (via one or more of cable, satellite, over the air, telephone, etc.) to a TV service provider 112 for receiving and presenting media content. Media content may include previously recorded or live television programming, such as from TV and cable network providers, movies, on-demand programming, among other media content including music or audio services such as radio.
[0010] Media system 140 further includes a BlackBerry® TV (BBTV) box (media relay) 124 which is also connected to TV/monitor 122 via connection 126. TV service STB 1 18 and media relay 124 are also connected via connection 128. Any one or more of connections 120, 126 or 128 may be one or more cables, links or media interfaces. A media interface may be a high definition media interface (HDMI™, (HDMI is a registered trademark of HDMI LICENSING, LLC.)). As a home theatre system, media system 140 may include one or more of an audio system (amplifier and speakers), DVD player, VCR, etc. (all not shown).
[0011] Media relay 124 is connected to cloud 102 via connection 116 such as via an Internet Service Provider (ISP). In some examples, media relay 124 connects via a wireless local area network (LAN) such as an in-home Wi-Fi and in some examples via a cable (not shown). Media relay 124 may further provide an access point to other communication devices to connect with the Internet. Though not shown, media relay 124 may be connected to cloud 102 to receive media content, for presenting via TV/Monitor 122, such as from an Internet- based media streaming service and/or media download service (e.g. a media store) or other media source device.
[0012] In an example embodiment (not illustrated), media relay 124 and TV service
STB 118 may be a single component, for example, connected to TV Service provider 112 and rich media information service 108 via an Internet or other connection and connected to TV/Monitor 122 via an HDMI or other interface. In an example embodiment, rich media information service 08 is a server. In an example embodiment, TV service STB 8 may provide media content to TV/Monitor 122 through media relay 124. For example, connection 20 from TV service STB 118 may be through media relay 24. Connection 128 shown in FIG. 1 may be not necessary. Media relay 124 may be configured to layer or mix other display signals with media content from TV service STB 118.
[0013] Smartphone 130 is connected to media relay 124 via link 1 16 providing
Internet Protocol (IP) connection. Smartphone 130 may be another type of electronic device with communication capabilities such as a tablet. An example electronic device is further described and illustrated with respect to FIG. 14. Though connected via wireless link 1 16, smartphone 130 may be coupled via a different wireless link such as Bluetooth™ (Bluetooth is a registered trademark of Bluetooth SIG, Inc.) or wired link such as HDMI, Universal Serial Bus (USB), Mobile High-definition Link (MHL), among others. Smartphone 130 may also be connected via cellular network 114 to cloud 102.
[0014] Smartphone 130 includes a Rich Media Application (App.) 132 for receiving and presenting rich media information 106 and for interacting with same. Rich media application 132 is configured for social networking (e.g. by one or more client applications (not shown)) and interacting with rich media information may include sharing such information via social networking service 134 with one or more friends or contacts as described further below. Social networking service 134 represents one or more social networking services (such as for example Facebook or Twitter) and any associated network components. Social networking service 134 may be connected to smartphone 130 via one or more IP-based connections such as 114 or 16. Social networking service 134 may also be connected to media relay 124 via connection 136 such as an IP-based connection. Though illustrated separately, connection 116 may connect media relay and social networking service 134. As discussed below media relay 124 may have a client application other configuration to present social networking information via TV/monitor 122. Media relay 124 may mirror social network messages, etc. while presenting media content, for example, layering the social networking messages and media content.
[0015] Rich media information (e.g. 106) may be defined and provided via one or more cloud-based services by one or more service providers. Rich media information includes descriptions of one or more aspects of associated media content. For example, for media content including an episode of a television series program, rich media information may include program series title, episode title, episode plot description, cast and/or crew or other credit list and bios, dialogue, excerpt of the media content ("highlights"), description of wardrobe and other products, services and/or locations featured in the episode and/or series, key words (tags), etc.
[0016] For media content including advertisements, for example, the information may include description about the advertised product and/or service, a product and/or service provider or seller, related products and/or services, discounts (coupons), etc.
[0017] Rich media information may be in text, image, audio and/or video formats.
The information may include pointers or links (e.g. Universal Resource Locators URLs) to additional resources and/or smartphone applications. The pointers may link to further information or facilitate the smartphone to interact with the rich media information, such as by sharing with a friend or contact. The pointers may be configured to invoke certain smartphone capabilities such as other applications (e.g. communication applications such as Twitter®, Facebook®, Internet Message (IM), email, Short Message Service (SMS), among others).
[0018] In an example embodiment and with further reference to FIG. 2, service provider components 150 include rich media TV information service provider component 104, rich media information service component 08, rich media information service subscriber database 109, TV information service component 110 and TV service provider component 112. One or more of such components may include a computing device configured via program instructions and/or data as a server, relay, etc.
[0019] Rich media information service component 108 determines the particular rich media information that is to be provided to smartphone 130 as follows. Rich media information service component 108 receives from media relay 124 a request 202 for rich media information providing program identification data of the viewer's location, TV Service Provider and channel. The request may be initiated by media relay 124 in response to a selection of a TV channel for presenting by media system 140. The parameters may include a time
component indicating progress of the media content presentation. The request may identify a rich media information service subscriber (e.g. via a PIN or other subscriber ID number) and a look up in rich media information service subscriber databasel 09 may be performed for some of the program identification data (e.g. location, and/or TV Service provider). Rich media information service subscriber databasel 09 stores subscriber data for the rich media information service. The data associates the media relay 124 with the smartphone 130. It may also include one or more TV Service provider, location, other media content source providers etc. for determining and providing the appropriate rich media information to the appropriate electronic device (e.g. smartphone). Subscriber data may be used to facilitate sharing of rich media information among subscribers, for example, to localize the program identification data to the receiving subscriber, accounting for possible different locations and/or providers, etc.
[0020] A television service provider operates television service provider component
112 to provide television programming to TV service STB 118 and in the present example embodiment operates a service via component 110 to provide TV information identifying programming (media content) provided to media systems 140. Rich media information service 108 performs a look up204 via component 1 10 to identify the media content with which the rich media information is associated. The look up may determine particular TV Information (output 206) including program data 206A (title and/or episode) and time information (time stamp) 206B indicating progress of the show (e.g. of total minutes played or remaining). In other contexts, the request 202 from media relay may identify other media content sources (different database(s)) against which a look up204 may be performed or may include sufficient identification of the media content and any progress therein that a look up204 is not necessary.
[0021] Rich media TV information service component 104 is configured to provide rich media information 106 for particular associated media content. In the TV programming example, a provider of such rich media information 106 may be a TV studio, film studio and/or TV network from which the media content originates or another (e.g. third party) provider. At 208, rich media information service 108 looks up the rich media information in component 104 in accordance with TV information 206, such as program title, episode, or some program ID. Rich media information service 108 prepares rich media information package 210 including for example program data 206A, time stamp 206B and rich media information 106 for the entire associated media content. The rich media package 210 is sent to the smartphone. Rich media information service 108 may look up in rich media information service subscriber database 109 to determine the smartphone associated with the media relay. In an example embodiment, media relay 124 may be associated with one or more smartphone devices for a subscriber (e.g. sub-accounts within a family or for presenting on different devices (smartphone, tablet other devices) owned by the subscriber, etc.). A request for rich media information may distinguish which device is to receive the rich media information. [0022] Rich media information 106 may include a time responsive presentation schedule (e.g. a time line) to facilitate the presentation of the rich media information in synchronization with a progress of the presenting of the associated media content. For example, rich media information 106 may include instructions to show certain data "from 0:00 to 0:02" then show other data "from 0:02 to 0:23". Time stamp 206B may be useful to initiate the presenting of the rich media at the correct time (progress) of the associated media content on media system 40. The clock or other timing ability of smartphone 30 may then be used to continue the progress of the presenting.
[0023] Rich media information service component 108 may be configured to receive requests for additional rich media information from smartphone 30 e.g. via one or more controls associated with the presenting of the rich media information. Additional information may be similarly determined but may involve a look up or other requests to different information sources. A request for additional information such as "stores near me" may involve a look up in an information source providing retail store locations. A response may be location aware. A request for directions to a store may involve a request to an information source providing maps and/or directions, etc.
[0024] Media relay 124 may facilitate synchronization with media system 140 such as relaying a signal indicating status of the presenting (e.g. pause, stop, fast forward, rewind or other presentation activities) of media system 140 relative to the associated media content. TV service STB 118 may have personal video recorder capabilities to pause, rewind, and record TV and fast forward any recorded/rewound TV. For example, should a viewer pause the presenting of media content via TV service STB 118, a single to media relay 124 may be provided through connection 128. This signal may be relayed to rich media application 132 via connection 116 to pause the presenting of rich media information. Another signal may indicate resumption of the presenting, etc. In a rewind, a rewind signal may invoke a suspension of the presenting of rich media information. A rewind signal may indicate how much time was rewound (e.g. rewind 2:34) or a new time stamp from which to begin (begin at 9:45) presenting rich media information.
[0025] In one example, rich media information 106 for a previously recorded program may be downloaded when the program is played via the PVR. Behaviour of rich media application 132 can be similar for previously recorded programming, but the program data 206A sent to the cloud for "what I'm watching" may be more comprehensive, including what channel was recorded, show name, time and date of show, TV service provider to determine the appropriate rich media information to be downloaded.
[0026] In another example, rich media information 106 may de downloaded and saved to the smartphone when the program is recorded for later presenting (e.g. when the program is presented). Rich media information service 108 may provide a trigger to rich media application 32 to present the previously downloaded rich media information 106 rather than resend it. App. 132 may look up locally whether the rich media information that was previously downloaded is available present it accordingly. If not downloaded or no longer available (e.g. because it was deleted to make resources available or for another reason), rich media application 132 may request a resend. This would then allow the user to play or FFWD through the show and still have all relating rich content for the show.
[0027] Rich media information 106 may be selectively configured in response to the
TV service provider and/or location of the viewer (subscriber) of the rich media information service 108. For example, rich media information for advertisements may reflect the location of the subscriber. Location may be determined in various manners such as a location defined in a subscriber's profile (stored in rich media information service subscriber database109) for the rich media information service 108, a location capability of the smartphone or by subscriber input.
[0028] Smartphone application and media relay 124 and/or rich media information service 108 can communicate to initiate the rich media application 132 with rich media information for media content presented by media system 140. For example, media relay 124 can detect the current channel to which the TV STP 118 is tuned and initiate a prompt or trigger to rich media application 132 to inquire whether rich media information associated with the media content should be downloaded to the application In accordance with an appropriate response, media relay 124 can initiate the method and flow of FIG. 2. In an alternative example, rich media application 132 may communicate with media relay 124 or rich media information service 108 to initiate detecting of the current channel and the download of rich media information to rich media application 132. In one example embodiment, the rich media information may be "pushed" (i.e. transmitted) to rich media application 132 from the rich media information service 108, via cellular connection 114 or Wi-Fi connection 116 etc.
[0029] FIGS. 3 to 10 are example screen shots of a user interface of rich media application 132 for presenting and interacting with rich media information 106 according to one example embodiment.
[0030] FIG. 3 illustrates a representative main screen interface 300 for presenting rich media information for particular associated media content. Main screen interface 300 includes one or more screen portions (e.g. 302, 304, 310 and 312 and 314) which may be active to receive user interaction or inactive. Screen 300 may present one or more other controls (e.g. 306 "Save Show" described further below) or information (such as media content presentation progress information 308 and progress bar 316.
[0031] Though not shown, one or more user interface menus or other actions may be associated with screen 300 (and/or other screens) which menus may be invoked using input means of smartphone 130.
[0032] Portion 302 presents program data (e.g. 206A). Portion 304 presents a graphic representative of the media content (e.g. from rich media information 106). Portion 310 presents rich media information 106 in one or more content categories 31 OA, 310B, 310C, 310D and 310E. Specific categories may differ for particular associated media content. For example, category 310E "Cast" presenting cast members and bios may be "Players" presenting player statistics and bios in a live sports context. More or fewer categories may be used. Portion 310 is active such that a particular category may be invoked to present additional rich media information for the category as described further.
[0033] Portion 312 presents one or more social networking interfaces 312A, 312B,
312C, and 312D. Invoking a social networking interface facilitates sharing of rich media information with a friend or contact via social networking service 134. For example, as described further below, invoking the social networking interface may initiate an applicable communication to a contact. At least some of a content for the applicable communication may be defined from a portion of rich media information and/or program data. For example, a message may be defined for the viewer to share with a contact that the viewer is watching a specific program.
[0034] Portion 314 may be active for example to receive input to save a show via control 306 (i.e. the rich media information associated to the show is saved to a memory of smartphone 130) for presenting later (playback mode). Presenting of saved rich media information may be performed without presenting the associated media content via media system 140. [0035] Progress bar 316 may be an active control in a playback mode for saved shows (See FIGS. 9 and 10) to receive input to selectively present the rich media information from a particular time points in the time line. In one example embodiment, a viewer may drag the progress bar to fast forward or rewind to a desired time of progress (time point). Presenting may be paused. Rich media information time points and/or particular information items may be saved or "bookmarked" to facilitate presenting from a specific time. Bookmarks (a type of pointer) may be granular, indicating which information (e.g. category, screen, etc.) is to be presented when invoked. Bookmarks may be shared with friends and contacts such as via social networking service 134. A bookmark may include program information 206A, a time stamp indicating a time point in the time line, and a pointer to particular content in the rich media information such that when invoked, the application is instructed appropriately.
[0036] Presenting of rich media information may be responsive to location.
Location may be different when presenting in a playback mode than when playing previously such as in association with the media content or an earlier playback. The application may be configured to provide a current location or user specified location to rich media information service 108 to obtain location responsive rich media information. A friend receiving and invoking a shared bookmark may have a different location than the friend who defined and shared the bookmark. A friend receiving the bookmark may have different TV service provider. In one example embodiment, when a shared bookmark is invoked in a rich media application 132 of a receiving contact, rich media information service 108 may be requested to provide the appropriate rich media information that is responsive to the receiving contact's TV service provider and location if the receiving contact is a subscriber to the rich media information service. If the receiving contact is not a subscriber, the receiving contact may be invited to download the rich media application 132 and/or subscribe to the service.
[0037] FIG. 4 is a screen 400 showing category 310E "Cast" in accordance with an example embodiment. Screen 400 presents individual cast members in respective screen portions (e.g. 402 and 404). Screen controls may be provided to show other, more or fewer cast members. Particular cast member information 402A from rich media information 106 may include text, image, audio and or video. One or more controls may be provided to present more or less information. Rich media information 106 for a particular cast member may include links or pointers 402B, 402C and 402D for interacting with the rich media information. Interaction may be to acquire additional information (e.g. 402B and 402C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 402D) via social networking service 134, for example. The link or pointer may facilitate interaction within rich media application 132 or invoke other smartphone capabilities including applications.
[0038] FIG. 5 illustrates a category for products such as those featured in the particular episode or the series, etc. The particular category presented in screen 500 is
"Electronics" 310D. Screen 500 employs a similar format to screen 400 showing particular category products in respective portions (e.g. 502). Screen controls may be provided to show other, more or fewer individual products. Particular electronic product information 502A from rich media information 106 may include text, image, audio and or video. One or more controls may be provided to present more or less such information. Rich media information 106 for a particular electronic product may include links or pointers 502B, 502C and 502D for interacting with the rich media information. Interaction may be to purchase a product online (e.g. 502B), acquire additional information (e.g. 502C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 502D) via social networking service 134, for example. The link or pointer may facilitate interaction within the rich media application 132 or invoke other smartphone capabilities including applications.
[0039] FIGs. 6 and 7 illustrate a further category for products such as those featured in the particular episode or the series, etc. The particular category presented in screen 600 and in screen 700 is "Fashion" 310C. FIG. 6 represents rich media information 106 for presenting during one time period of the presentation of the associated media content and FIG. 7 represents rich media information 106 for presenting during a second time period. Progress information may be received from media relay 124 to coordinate the presenting of the appropriate rich media information.
[0040] Screens 600 and 700 employ a similar format to screen 400 and 500 showing particular category products in respective portions (e.g. 602, 604, 702, and 704).
Screen controls may be provided to show other, more or fewer individual products. Particular fashion product information e.g. 602A and 704A from rich media information 106 may include text, image, audio and or video. One or more controls may be provided to present more or less such information. Rich media information 106 for a particular fashion product may include links or pointers (e.g. 602B, 602C and 602D, 704B, 704C and 704D) for interacting with the rich media information. Interaction may be to purchase a product online (e.g. 602B, 704B), acquire additional information (e.g. 602C) which may be via other information sources (e.g. Internet services, etc.) or to share information (e.g. 602D, 704D) via social networking 34, for example. The link or pointer may facilitate interaction within the rich media application 132 or invoke other smartphone capabilities including applications.
[0041] Screen 800 of FIG. 8 illustrates an example user interface upon the invocation of control or pointer 602C to present further information for a particular product item. In the example, pointer 602C presents data including "stores near me" in portion 802.
Respective store information 802A, 802B, 802C, 802D may be presented such as store name, address and distance. One or more controls (such as 804A or 804D for directions and details) may be provided to show other, more or less store information. In this example, the controls are hyperlinks to more information, specifically details about the store and directions to the store.
[0042] Smartphone 130 may be configured with location awareness, for example, with Global Positioning Satellite (GPS) or other location capabilities. Invoking pointer 602C may facilitate a request (via media relay 24 and/or rich media information service 108) for store information for stores selling fashion items which information may be filtered or otherwise responsive to location of smartphone 130. While specific location information for smartphone 130 may be advantageous, alternatives for such information could be used such as the TV service provider location, user supplied location, etc. media relay and/or rich media information service 108 may be configured to look up store information, for example, using a cloud-based service (not shown). Store information may relate to stores selling the specific product item and/or similar items.
[0043] FIGs. 9 and 10 show screens 900 and 1000 presenting user interfaces for shows previously watched as indicated by title portion 902. Such shows in a TV context may include previously recorded or live TV programs, movies, etc. When saved, the rich media information for the entire episode may be saved e.g. to the smartphone, for playback. In an example embodiment, just the program data may be saved and used to retrieve the rich media information again. In some examples, saving may be automatically performed and saved shows kept in accordance with one or more rules to maintain resources.
[0044] Screen 900 provides a user interface for selectively presenting (filtering) a listing of shows previously watched (i.e. rich media information saved). Portion 904 provides a plurality of filtering options 904A, 904B, 904C, 904D, 904E and 904F. Screen controls may be provided to invoke the respective filtering options (e.g. control 906 for invoking "Today" option 904A). Screen 1000 provides a user interface listing shows previously watched. In portion 1002 the list of all saved shows is filtered using filtering option 904A that is predefined to be responsive to current date criteria. Other predefined criteria may be a current week, month or year. A search interface may permit searching by terms or categories (e.g. tags). Individual previously watched show items (e.g. 1002A) may be invoked to interact with the saved show (e.g. re-play, delete, etc. (not shown)).
[0045] In some example embodiments, smartphone 130 may be configured to facilitate command and control of media system 140, for example, as a remote control device. Invoking the playback (presenting) of a saved rich media information "show" may invoke playback of associated media content such as via a PVC capability of the media system 140.
[0046] Interaction with rich media application 132 may be tracked. For example, invocations to share rich media, buy online, determine stores near me, look at specific store directions, etc. may be logged for measuring use statistics, particularly those useful to advertisers, product and/or service providers, media content creators and providers. For example, as described further, an invocation of a "stores near me" pointer and "details and directions" control may be logged and a subsequent activity such as a store visit and/or purchase may be linked with the tracked interaction to give useful information. Store visits may be determined using location awareness of smartphone 130. Purchases may be linked using purchase capabilities of smartphone 130 (e.g. using near field communication (NFC) smart tags, e-wallet capabilities, etc.)
[0047] FIGS. 11 A, 1 B and 1 C illustrate flow charts of methods for sharing rich media information performed by the respective viewer's smartphone 130, media relay 124 and a receiving contact's smartphone (not shown in FIG. 1). At 1102 rich media application 132 presents rich media main interface 300 for a particular media content program with categories portion 310 and social networking portion 312. At 1104, rich media application 132 receives an invocation of a particular social networking control (e.g. 312A to share rich media information or program information via IM such as BlackBerry Messenger™ (BBM™)).
[0048] At 1106, a determination may be made whether the receiving contact is a subscriber to the rich media information service 108). A request may be sent to the service (e.g. at 12) and an answer received. Rich media information service 108 may look up subscriber information in rich media information service subscriber database109.
[0049] At 1108 a message optionally with a bookmark to invoke the receiving contact's rich media application may be defined in response. The bookmark may be defined in response to the location and TV service provider of the receiving contact, if possible. A message inviting the receiving contact to download the application and/or subscribe may be defined in response, particularly if the receiving contact is not a subscriber. A message may include text or other information sharing that the message sender is watching a particular program on a particular channel, which channel can be responsive to the receiving contact's data. The message may invite the contact to also watch. The message may invite the receiving contact to invoke the bookmark to obtain the rich media information, begin watching the program and/or other activity (e.g. look up which channel is applicable to the receiving contact).
[0050] In some example embodiments, a determination of subscriber status is not made and a bookmark is defined and invite sent in any event. Upon invocation of the bookmark by the receiving contact, rich media information service 108 can apply the receiving contact's TV service provider and location information to determine, if possible, the appropriate program data 206A including channel for the recipient and determine the appropriate rich media information.
[0051 ] Should the receiving contact's TV service provider not offer the equivalent channel or the receiving contact not be subscribed to the channel, the "localized" information may not be possible. In some embodiments, the service may define the bookmark and respond with same (at 1112) when inquired (at 1106) for inclusion in the message.
[0052] At 1110, the message is sent via social networking (e.g. BBM).
[0053] The receiving contact receives the message (at 1122). The message may invite the user to watch a program. In one example embodiment, a bookmark received is invoked (1124). Invoking the bookmark may invoke the receiving contact's rich media application to tune the media system 140 to the program (not shown). In one example, the receiving contact tunes the media system in another manner (not illustrated). Tuning the media system will in turn invoke the media relay to initiate the media service to determine and download the rich media information. In another example embodiment, invoking the bookmark downloads the rich media information (e.g. prompts the user to request the download). The bookmark may invoke the rich media application and one or more options may be presented by the application (e.g. download, tune, etc.).
[0054] In an example embodiment (not illustrated), invoking control 312A or a menu option, for example, will publish at least some of program data 206A (e.g. via a social networking status or other real-time indicator) to let contacts know what is being watched ("what I'm watching now"). Rich media application 132 may be configured to provide selective choice whether to publish the status and/or send program data 206A to a contact.
[0055] FIGS. 12A, 12B and 12C illustrate flow charts for sharing rich media information by methods performed by the respective viewer's smartphone 130, media relay 124 and a contact's smartphone (not shown in FIG. 1). At 1202 rich media application 32 presents electronic category 310D in user interface screen 500 for rich media information associated to particular media content. Screen 500 is presented with portion 502 for a particular item of electronics and with portion 502 including social networking pointer or control 502D.
[0056] At 1204, rich media application 132 receives an invocation of a particular social networking control (e.g. 502D "Tell a Friend") to share rich media information for the particular electronic item via IM.
[0057] At 1206, a determination may be made whether the receiving contact is a subscriber to the rich media information service 108. A request may be sent to the service (e.g. at 1212) and an answer received. At 1208 a message optionally with a bookmark to invoke the receiving contact's rich media application may be defined in response. The bookmark may be defined in response to the location and TV service provider of the receiving contact, if possible. A message inviting the receiving contact to download the application and/or subscribe may be defined in response, particularly if the receiving contact is not a subscriber. A message may include text or other information sharing that the message sender is telling the contact about a specific item e.g. from a particular program on a particular channel, which channel can be responsive to the receiving contact's subscriber data. The message may invite the contact to also watch and/or review the information. The message may invite the receiving contact to invoke the bookmark to obtain the rich media information, begin watching the program and/or other activity (e.g. look up which channel is applicable to the receiving contact).
[0058] The bookmark that is optionally defined may include a pointer responsive to the program data, time stamp and particular rich media information indicated to be shared (the electronic item). As noted the bookmark may be responsive to location and TV service provider of the receiving contact, if possible. Further the rich media information may be responsive to the receiving contact's location. For example, invoking a "stores near me" control such as 602C would present stores near the location of the recipient. This location may be determined in various manners such as a location aware smartphone (GPS), rich media information subscriber data (), or user supplied data.
[0059] At 1210 the message is sent via social networking (e.g. BBM)
[0060] At 1222, receiving contact's smartphone receives IM message including electronic category item information and the optional bookmark. At 1224, the bookmark is invoked. The bookmark may invoke the receiving contact's rich media application to download the rich media information from rich information media service 108 and present the bookmarked item. The rich media may tune the media system, etc.
[0061 ] FIGS. 13A and 13B illustrate flow charts of methods for interacting with product related rich media information performed by the viewer's smartphone 130 and media relay 124. At 302, rich media application 132 presents fashion category 312C information in portion of a screen (e.g. 602 of screen 600). At 1304, rich media application 132 receives an invocation of pointer or control "Buy Near Me" 602D for an item. At 1306, store information in accordance with location is determined. For example, an applicable request is sent to media relay 124 (see Fig. 13B). At 1308, localized store Information is presented (screen 800) in portion 802. At 310, rich media application 32 receives invocation of "details and directions" (e.g. 804A or 804D) for a store. At 1312, details and directions are determined. For example, an applicable request is sent to media relay 124 (see Fig. 13B). At 1314, rich media application 132 presents "details and directions" (not illustrated).
[0062] At 1322 media relay 124 receives a request for store information in accordance with location for an item. At 1324 media relay tracks a click through for the item, logging the click in a data store (not shown). The data store may be remote from media relay 124 such as one (not shown) associated with rich media information service component 108.
[0063] At 1326 media relay 124 obtains and provides localized store information to rich media application 132. For example, media relay 124 requests such information from a remote service such as rich media information service component 108 or other (not shown).
[0064] At 1328 media relay 124 receives a request for details and directions for a store from rich media application 132. At 1330 media relay 124 tracks a click through for a store logging the click to a data store. At 1332 media relay 124 obtains and provides details and directions for the store to rich media application 132. Track clicks may be stored to facilitate linking with other smartphone activities such as store visits or purchases.
[0065] FIGS. 14A and 14B illustrate flow charts of methods for purchasing an item using a viewer's smartphone and linking the purchase to a preview presenting and interacting with product related rich media information. As noted previously, smartphone 130 is payment enabled such that a financial transaction may be completed using the smartphone. Smartphone may include near field communications with smart tags and/or e-wallet capabilities to make a payment to a retailer or other seller having cooperative systems for example, similar to a chip enabled credit or debit card transaction.
[0066] At 1 02 smartphone receives an invocation to conduct a purchasing transaction such as to pay for a product (or service) using payment-enabled smartphone (e.g. via NFC). At 1404 smartphone provides to rich media information service 108 store information and/or purchased item information for potential linking to prior tracked click through for store and/or item. Alternatively, such information is provided by the payment service associated to the smartphone.
[0067] At 1412 rich media information service component 108 receives store information and/or purchased item information for potential linking to prior tracked click through for store and/or item. At 1414 rich media information service component 108 performs link search and stores link results to determine if a prior click through associated to the smartphone in the data store is a match. At 1416 aggregate statistics are complied and provided such as to advertisers etc. In another example embodiment, (not shown), smartphone 130 may store click through data and match same with purchase and store visit data, providing results to media relay 124 and/or rich media information service component 108.
[0068] It is understood that other interaction with rich media information may be tracked, such as instances of sharing such information with friends and/or receiving information from friends.
[0069] Persons of skill in the art will recognize that the smartphone 130 may be a tablet or other computing and/or communication devices. For example, FIG. 15 shows a block diagram illustrating an example electronic communication device 1502 that is suitable to be configured as smartphone 130 or rich information media service 108. Device 1502 is illustrated with wireless communication capabilities and in particular example embodiments communicates through a communication network 1504. Network 1504 is also illustrated with wireless capabilities and includes antenna, base stations, and supporting radio equipment for supporting wireless communications between device 1502 and other devices connected to network 1504. Network 1504 may be connected to a network gateway and to a wide area network (not shown).
[0070] In one example embodiment, device 1502 is a two-way communication device having at least data and/or voice communication capabilities, including the capability to communicate with other computer systems. In particular example embodiments, device 1502 is a mobile device. Depending on the functionality provided by device 1502, it may be a data messaging device, a two-way pager, a cellular telephone with data messaging capabilities, a wireless Internet appliance, a data communication device (with or without telephony
capabilities), a smartphone, personal digital assistant, a portable media, a music player, a tablet or a laptop. In some example embodiments device 1502 is a desktop computer or a server. More generically, it may be a computing device.
[0071 ] Device 1502 may communicate with any one of a plurality of fixed transceiver stations within its geographic coverage area. Though a wireless device is shown, in some example embodiments device 1502 may have a wire connection to network 1504.
[0072] Device 1502 may incorporate one or more communication subsystems such as subsystems 1512 and/or 1580. Communications subsystem 1580 may be a wireless networking communications subsystem, for example, conforming to IEEE 802.151 standards such as 802.151b, 802.151g, and/or 802.151η and/or others. In some example embodiments, subsystem 1580 is only present and communications subsystem 1512 providing cellular communications is not. In some example embodiments, subsystem 1512 may be removably connected to a port of device 1502 such as via a USB stick. In an example, communication subsystem 1512 includes a receiver 1514, a transmitter 1516, and associated components, such as one or more antenna elements (1518 and 1520), local oscillators (LOs) 1522, and a processing module such as a digital signal processor (DSP) 1524. In one example
embodiment, antenna elements (1518 and 1520) may be embedded or internal to device 1502. As will be apparent to those skilled in the field of communications, the particular design of the communication subsystem 1512 depends on the network 1504 in which device 1502 is intended to operate. [0073] Device 1502 may send and receive communication signals over the network
1504 after network registration or activation procedures have been completed. Signals received (e.g. by antenna elements 1518) through network 1504 are input to receiver 1514, which may perform such common receiver functions as signal amplification, frequency down conversion, filtering, channel selection, etc., as well as analog-to-digital (A/D) conversion. AID conversion of a received signal allows more complex communication functions such as demodulation and decoding to be performed in DSP 1524. In a similar manner, signals to be transmitted are processed, including modulation and encoding, for example, by DSP 1524. These DSP- processed signals are input to transmitter 1516 for digital-to-analog (D/A) conversion, frequency up conversion, filtering, amplification, and transmission to the network 1504 via antenna 1520. DSP 1524 processes communication signals and provides for receiver and transmitter control. For example, the gains applied to communication signals in receiver 1514 and transmitter 516 may be adaptively controlled through automatic gain control algorithms implemented in DSP 1524.
[0074] Network access (WAN) may be associated with a subscriber or user of device 1502 via a memory module, such as a memory module 1530, which may be a
Subscriber Identity Module (SIM) card for use in a GSM network or a USIM card for use in a UMTS. The SIM card is inserted in or connected to an interface 1532 of device 1502 in order to operate in conjunction with network 1504. Alternatively, device 1502 may have an integrated identity module for use with systems such as Code Division Multiple Access (CDMA) systems. Device 1502 may include a Wi-Fi transceiver 1580 that may include similar
components/chipsets to communication subsystem 1512 adapted for one or more Wi-Fi protocols. Though Wi-Fi is shown, WiMAX is one alternative transceiver. In some example embodiments, device 1502 may be capable of Wi-Fi and WiMAX communications in
accordance with software-defined radio ("cognizant radio") techniques. Device 1502 may also include GPS capabilities through one or more of its antenna.
[0075] Device 1502 also includes a battery interface 1536 for receiving one or more battery 1538 which may be rechargeable. The one or more battery 1538 provides electrical power to at least some of the electrical circuitry in device 1502, and battery interface 1536 provides a mechanical and electrical connection for the one or more battery 1538. Battery interface 1536 is connected to a regulator (not shown) which provides power V+ to the circuitry of device 1502. [0076] Device 1502 includes a programmable processor (e.g. microprocessor
1540) which controls the overall operation of device 1502. Communication functions, including at least data and voice communications, are performed through the communication subsystem 512. Microprocessor 1540 also interacts with additional device subsystems such as a display 1542, a flash memory 1544, a random access memory (e.g. RAM 1546), a read-only memory (e.g. ROM 1548), input/output (I/O) subsystems, interfaces or ports 1510 (e.g. an audio port for connecting to a set of headphones and/or a remote microphone, an High-Definition Multimedia Interface (HDMI), composite video, component video, S-Video, etc, a Universal Serial Bus (USB) or Ethernet port), a keyboard or keypad 1514, a speaker 1516, a microphone 1518, a clickable thumbwheel, trackball, optical or other touch or gesture based input pad, or set of scroll buttons, etc. 1560, typically for scrolling/selecting input, one or more short-range communications subsystems 1562, and any other device subsystems generally designated as 1564. Some of the subsystems shown in FIG. 15 perform communication-related functions, whereas other subsystems may provide "resident" or on-device functions.
[0077] Some subsystems, such as keypad 1514, display 1542, and input device
1560, for example, may be used for communication-related functions, such as entering a text message for transmission over network 1504, and executing device-resident functions such as a calculator or task list, media play back, Internet browsing, etc. Operating system software and other software used by the microprocessor 1540 is preferably stored in a persistent store such as flash memory 1544, which may alternatively be ROM 1548 or similar storage element.
Those skilled in the art will appreciate that the operating system, specific device applications, or parts thereof, may be temporarily loaded into a volatile store such as RAM 1546.
[0078] The microprocessor 1540, in addition to its operating system functions, enables execution of software applications on device 1502. A predetermined set of applications that control basic device operations, including data and voice communication applications, will normally be installed on device 1502 during or after manufacture. One or more memory stores may be available on device 1502 to facilitate storage of information, such as flash memory 1544, RAM 1546, ROM 1548, memory module 1530, or other types of memory storage devices or FLASH memory cards represented by other device subsystems 1564, such as Secure Digital (SD) cards, mini SD cards, micro SD cards, etc.
[0079] Device 1502 may be configured with a browser for interacting with Web pages. Device 502 may have one or more media related applications for displaying images, playing audio and or video files/streams, etc. The browser and/or media applications often have the ability to send and receive data items via either network 1504 or a link to a computer system. The link to the computer system may be via serial port (e.g. 1510) or short-range communications subsystem 1562. Additional applications may also be loaded onto device 502 through network 1504, auxiliary I/O subsystems/interfaces/ports 1510, short-range
communications subsystem 1562, or possibly, other device subsystems 1564, and installed by a user in RAM 1546 or a non-volatile store such as ROM 1548 for execution by microprocessor 1540. Such flexibility in application installation increases the functionality of device 1502 and may provide enhanced on-device functions, communication-related functions, or both. For example, secure communication applications may enable electronic commerce functions and other such financial transactions to be performed using device 1502.
[0080] In some examples, Device 1502 may be configured as a remote control for media system 140. A data signal representing remote control codes may be received or transmitted by communication subsystem 1512, transceiver 1580 or short range
communications 1562. A short range or other communication means (e.g. radio or IR transmitter (not shown)) may be connected to device 1502 via serial or other port. The microprocessor 1540 may further process a received data signal. For example, as a device 110, microprocessor 1540 may store the specific remote control codes 130 used to configure media system 102, selectively transmitting the applicable remote control code via short range communications 1562 as IR codes, under control of a user, for example. A user of device 110 may selectively input commands for configuring the controls of the media system such as changing volume, playback quality controls, power, etc., for example, using keypad 1514 and/or input device 560 or a touch screen configured display 1542 and possibly auxiliary I/O subsystem 1510, Keypad 1514 may be either a complete alphanumeric keypad or telephone- type keypad.
[0081] A serial port (e.g. 1510) is often implemented (e.g. in a personal digital assistant (PDA) type communication device for which synchronization or other communication with a user's computer is a useful, but optional, component). A serial port enables a user to set preferences through an external device or software application and extends the capabilities of device 1502 by providing for information, media file, or software downloads to or uploads from device 1502 other than through network 1504. It may also accept other communication devices such as radio and IR dongles. [0082] Short-range communications subsystem 1562 is an additional component which provides for communication between device 1502 and different systems or devices, which need not necessarily be similar devices. For example, short-range communications subsystem 1562 may include an infrared (IR) device and associated circuits and components, or a wireless bus protocol compliant communication mechanism such as a Bluetooth communication module to provide for communication with similarly-enabled systems and devices. Device 1502 may be configured to pair with other Bluetooth compliant devices for establishing communications.
[0083] Short-range communications may include NFC for payment technologies.
[0084] Figure 16 is a block diagram illustrating an example embodiment of a media relay 124.
[0085] Rich media information may be defined using HTML (e.g. HTML 5), XML or other formatting language for presenting by rich media application 132. In addition to format instructions, rich media information may be associated with a time line, to coordinate the presenting of the rich media information in synchronization with the presenting of the associated media content.
[0086] Rich media information for the associated media content may be made available (that is, selectively visible) through rich media application 132, in response to the progress information, such as for a specific time period or other event defined period that the associated media content is presented via media system 140. During a commercial break period in a TV program, advertisements can be presented via media system 140. During this break period and possibly longer, rich media information associated to at least some of the advertisements may be made available for presenting via rich media application 132. Rich media information for advertisements may include a category in a similar way to other categories. The advertisement category could be made visible at certain times (e.g. to coincide with typical commercial break times before, during or after a TV program). Categories associated to the TV show media content may similarly be made visible for a portion of the time. Alternatively or in addition, the content of the rich media information for categories may change during the presenting of the media content, for example, synchronized to time or events within the media content (when character enters the scene on media system 140, fashion category content on smart application changes to show character's items for a certain time, cast category changes to show only actor's information for a portion of the presenting, etc.). [0087] FIG. 16 is a block diagram of an example embodiment of an electronic device configured as a media relay such as media relay 124. Though referenced as a media relay, such a device may have other functionality (and consequently names), such as a media client or media server. Media relay 124 includes a processor 1602, memory 1604 (RAM and/or ROM) and storage 1606 (e.g. persistent storage device). Processor 1602 may be configured using instructions and/or data in memory 1604 for execution and operation. Storage 1606 may store such instructions and data as well as media content, etc. Instructions and data may configure media relay, media or other application client and/or media or other application server capabilities, at least some of which are described herein. Media relay may be configured to receive channel and other program information from TV service STB 118 for providing to rich media information service 108 as previously described.
[0088] Media relay 124 may be configured as a social networking client for receiving social networking events (e.g. messages, status updates, etc.) and displaying or otherwise presenting them on media system 140 (e.g. mirroring). The client may be configured for displaying only or also for originating social networking events as well. For example, the client application may generate a status message indicating what media content is being watched for providing to social networking service 134. Such a feature may be a user option and require user input before performing/completing the status update.
[0089] As described above, media relay 124 may be configured to receive a media content signal, either as a TV service STB or from a TV service STB, or other media source for TV/Monitor 122. In one example embodiment, media relay 124 may be configured to layer or mix the social networking events with a media content signal (e.g. TV signal) received such that both the events and media content are presented simultaneously. In one example, a BBM message sent to the BBTV subscriber associated with media relay (BBTV box) 124 of system 140 (e.g. "John Smith is watching Monday Night Football on ESPN") may be presented over (e.g. semi-transparent or other mode) media content on TV/Monitor 122. The message may also be presented by smartphone 130. A channel change invoked as described and rich media information provided to smartphone 130.
[0090] Media relay 124 includes one or more interfaces such as short range communication interface 1608, wired network interface 1610, wireless network interface 1612 and input/output interface 1614. A bus 1616 connects the components for communication. Short range communication interface 1608 may be an Infrared (IR), radio or other communication for receiving remote control commands, for example. Wired network interface 1610 may connect media relay 124 to a LAN, wide are network such as the Internet and cloud 102. Wireless network interface 1612 may connect media relay 124 to a LAN, wide are network such as the Internet and cloud 102. Media relay (e.g. via interfaces 1610 and/or 1612) may be configured to provide an access point and/or hub and routing capabilities for other devices such as smartphone 130, etc. Input/output interfaces 1614 provide one or more input, output and input/output devices for configuring and/or operating media relay 124. Such devices may include one or more buttons, keys, display screen, lights, speakers, etc.
[0091] A rich media generation tool (not illustrated) may be configured to permit a programmer to define the rich media information, for example, by viewing the media content and defining points in the time line at which particular rich media information is to be available for presenting. Specific information categories can be defined for information of similar type and specific category items therein also can be defined. Description (text, image, audio/video) and pointers/controls can be added. One or more templates may be useful. The categories and items therein can be associated to the time line for coordinating presenting at desired times. A suitable package of rich media information can be defined for the associated media content. The package and any appropriate metadata can published or loaded to a suitable store to be made available for searching and downloading. Rich media information and/or packages may be defined in accordance with the end device that will ultimately present the rich media information. For example, rich media information for a particular media content and intended for presenting on a smaller display screen smartphone may be different from rich media for a tablet or personal computer, etc.
[0092] The scope of the claims should not be limited by the example embodiments described herein, but should be given the broadest interpretation consistent with the description as a whole.

Claims

What is claimed is:
1. A method of providing rich media information, implemented by a processor of an electronic communication device, comprising:
receiving information identifying media content;
determining the rich media information to be provided; and
transmitting the rich media information to a first electronic device for presenting by the first electronic device in association with a presenting of the media content.
2. The method of claim 1 wherein the information indentifying media content is received from a second electronic device.
3. The method of claim 2 wherein the second electronic device is associated with the first electronic device.
4. The method of claim 3 comprising determining the first electronic device from data associating the second electronic device with one or more electronic devices for receiving the rich media information.
5. The method of claim 4 wherein the media content is presented by a media system comprising the second electronic device.
6. The method of claim 5 wherein the media content is a TV program, the second electronic device transmitting TV channel information indentifying the media content.
7. The method of claim 1 wherein the rich media information comprises one or more information items for presenting in accordance with a time line.
8. The method of claim 7 wherein the time line is defined to synchronize the presenting of the rich media information with the presenting of the media content.
9. The method of claim 8 comprising providing a time stamp with which to initiate the presenting of the rich media information in synchronization with the presenting of the media content.
10. The method of claim 1 wherein determining the rich media information is responsive to a location associated with the first electronic device.
11. The method of claim 10 comprising receiving location information and determining the rich media information in response.
12. The method of claim 1 comprising receiving a request from the first electronic device for additional rich media information and providing the additional rich media information to the first electronic device.
13. The method of claim 1 comprising receiving a request from the first electronic device to enable sharing of the rich media information with a further electronic device; and providing localized information to enable the sharing wherein the localized information is responsive to at least one of a location and a media content source provider associated to the further electronic device.
14. The method of claim 1 wherein the rich media information is presented by the first electronic device for interacting and wherein the method comprises tracking the interacting.
15. An electronic communication device, configured to provide rich media information, comprising:
a processor and memory storing instructions for configuring the processor to:
receive information identifying media content;
determine the rich media information to be provided; and
transmit the rich media information to a first electronic device for presenting by the first electronic device in association with a presenting of the media content.
16. The electronic communication device of claim 15 wherein the information indentifying media content is received from a second electronic device.
17. The electronic communication device of claim 16 wherein the second electronic device is associated with the first electronic device.
18. The electronic communication device of claim 17 comprising determining the first electronic device from data associating the second electronic device with one or more electronic devices for receiving the rich media information.
19. The electronic communication device of claim 18 wherein the media content is presented by a media system comprising the second electronic device.
20. The electronic communication device of claim 19 wherein the media content is a TV program, the second electronic device configured to transmit TV channel information indentifying the media content.
21. The electronic communication device of claim 15 wherein the rich media information comprises one or more information items for presenting in accordance with a time line.
22. The electronic communication device of claim 21 wherein the time line is defined to synchronize the presenting of the rich media information with the presenting of the media content.
23. The electronic communication device of claim 22 comprising providing a time stamp with which to initiate the presenting of the rich media information in synchronization with the presenting of the media content.
24. The electronic communication device of claim 15 wherein determining the rich media information is responsive to a location associated with the first electronic device.
25. The electronic communication device of claim 24 wherein the processor is configured to receive location information and determining the rich media information in response.
26. The electronic communication device of claim 25 the processor is configured to receive a request from the first electronic device for additional rich media information and providing the additional rich media information to the first electronic device.
27. The electronic communication device of claim 15 the processor is configured to receive a request from the first electronic device to enable sharing of the rich media information with a further electronic device; and provide localized information to enable the sharing wherein the localized information is responsive to at least one of a location and a media content source provider associated to the further electronic device.
28. The electronic communication device of claim 27 wherein the rich media information is presented by the first electronic device for interacting and wherein the processor is configured to track the interacting.
29. A method of presenting rich media information, implemented by a processor of an electronic communication device, comprising:
receiving the rich media information that is based on information identifying media content; and displaying the rich media information in association with a presenting of the media content.
30. The method of claim 29 wherein the rich media information is received from a rich media information service, the rich media information service configured to receive from a first electronic device the information identifying media content and to determine the rich media information to be provided.
31. The method of claim 29 wherein the rich media information comprises one or more information items and wherein the presenting is responsive to a time line thereby to present at least some of the information items at different time points in the time line.
32. The method of claim 31 wherein the time line is defined to synchronize the presenting of the rich media information with the presenting of the media content.
33. The method of claim 32 wherein the media content is presented by a media system including a first electronic device configured to transmit the information identifying media content to a rich media information service configured to determine the rich media information to be provided.
34. The method of claim 33 comprising receiving a time stamp with which to initiate the presenting of the rich media information in synchronization with the presenting of the media content and presenting the rich media information in response to the time stamp.
35. The method of claim 33 comprising continuing the presenting of the rich media information in synchronization with the presenting of the media content.
36. The method of claim 33 comprising receiving from the first electronic device a signal indicating a status of the presenting of the media content and presenting the rich media information in response to the signal.
37. The method of claim 29 comprising saving the rich media information to the electronic communication device for subsequent presenting.
38. The method of claim 37 comprising providing a user interface for invoking the subsequent presenting.
39. The method of claim 38 wherein the rich media information comprises one or more information items and a time line; and wherein the subsequent presenting is responsive to the time line to present at least some of the information items at different time points in the time line.
40. The method of claim 39 wherein the user interface is configured to selectively control the presenting of the information items at one or more time points in the time line.
4 . The method of claim 29 wherein the rich media information is responsive to a location associated with the electronic communication device.
42. The method of claim 29 wherein the media content is a TV program and the information identifying media content comprises TV channel information.
43. The method of claim 29 comprising requesting from the rich media information service additional rich media information and presenting the additional rich media information.
44. The method of claim 29 comprising bookmarking the rich media information, the bookmark, when invoked, invoking the presenting of the rich media information.
45. The method of claim 44 wherein the bookmark comprises a pointer to present a particular information item in the rich media information.
46. The method of claim 29 comprising sharing at least a portion of the rich media information with a further electronic communication device using social networking.
47. The method of claim 46 wherein sharing comprising sending a message indicating particular media content being presented by a media system associated to the electronic communication device.
48. The method of claim 47 wherein sharing comprises sending a message inviting a downloading of the rich media information to the further electronic communication device.
49. The method of claim 48 wherein the message inviting the downloading includes a pointer to initiate presenting of the rich media information by the further electronic device.
50. The method of claim 49 wherein the pointer initiates the presenting of a particular information item in the rich media information.
51. The method of claim 50 wherein the message is defined such that the rich media information is localized to the further electronic communication device.
52. The method of claim 29 wherein presenting includes controls for interacting with the rich media information and wherein the method comprises tracking the interacting.
53. The method of claim 52 including performing a subsequent activity and providing subsequent activity information for linking the subsequent activity with the interacting.
54. The method of claim 53 wherein the subsequent activity comprises at least one of visiting a particular location and conducting a purchasing transaction.
55. An electronic communication device configured to provide rich media information comprising: a processor and memory storing instructions for configuring the processor to: receiving the rich media information that is based on information identifying media content; and
displaying the rich media information in association with a presenting of the media content.
56. The electronic communication device of claim 55 wherein the rich media information is received from a rich media information service, the rich media information service configured to receive from a first electronic device the information identifying media content and to determine the rich media information to be provided.
57. The electronic communication device of claim 55 wherein the rich media information comprises one or more information items and wherein the displaying is responsive to a time line thereby to present at least some of the information items at different time points in the time line.
58. The electronic communication device of claim 57 wherein the time line is defined to synchronize the displaying of the rich media information with the presenting of the media content.
59. The electronic communication device of claim 58 wherein the media content is presented by a media system including a first electronic device configured to transmit the information identifying media content to a rich media information service configured to determine the rich media information to be provided.
60. The electronic communication device of claim 59 wherein the processor is configured to receive a time stamp with which to initiate the displaying of the rich media information in synchronization with the presenting of the media content; and displaying the rich media information in response to the time stamp.
61. The electronic communication device of claim 59 wherein the processor is configured to continue the displaying of the rich media information in synchronization with the presenting of the media content.
62. The electronic communication device of claim 59 wherein the processor is configured to receive from the first electronic device a signal indicating a status of the presenting of the media content and present the rich media information in response to the signal.
63. The electronic communication device of claim 55 wherein the processor is configured to save the rich media information to the electronic communication device for subsequent presenting.
64. The electronic communication device of claim 63 wherein the processor is configured to provide a user interface for invoking the subsequent presenting.
65. The electronic communication device of claim 64 wherein the rich media information comprises one or more information items and a time line; and wherein the subsequent presenting is responsive to the time line to present at least some of the information items at different time points in the time line.
66. The electronic communication device of claim 65 wherein the user interface is configured to selectively control the presenting of the information items at one or more time points in the time line.
67. The electronic communication device of claim 55 wherein the rich media information is responsive to a location associated with the electronic communication device.
68. The electronic communication device of claim 55 wherein the media content is a TV program and the information identifying media content comprises TV channel information.
69. The electronic communication device of claim 55 wherein the processor is configured to request from the rich media information service additional rich media information and present the additional rich media information.
70. The electronic communication device of claim 55 wherein the processor is configured to bookmark the rich media information, the bookmark, when invoked, invoking the presenting of the rich media information.
71. The electronic communication device of claim 70 wherein the bookmark comprises a pointer to present a particular information item in the rich media information.
72. The electronic communication device of claim 55 wherein the processor is configured to share at least a portion of the rich media information with a further electronic communication device using social networking.
73. The electronic communication device of claim 72 wherein sharing comprising sending a message indicating particular media content being presented by a media system associated to the electronic communication device.
74. The electronic communication device of claim 73 wherein sharing comprises sending a message inviting a downloading of the rich media information to the further electronic communication device.
75. The electronic communication device of claim 74 wherein the message inviting the downloading includes a pointer to initiate presenting of the rich media information by the further electronic device.
76. The electronic communication device of claim 75 wherein the pointer initiates the presenting of a particular information item in the rich media information.
77. The electronic communication device of claim 76 wherein the message is defined such that the rich media information is localized to the further electronic communication device.
78. The electronic communication device of claim 55 wherein displaying the rich media information includes controls for interacting with the rich media information and wherein the process is configured to track the interacting.
79. The electronic communication device of claim 78 wherein the processor is configured to perform a subsequent activity and provide subsequent activity information for linking the subsequent activity with the interacting.
80. The electronic communication device of claim 79 wherein the subsequent activity comprises at least one of determining a location of a visit to a particular store location and conducting a purchasing transaction.
81. A method of providing rich media information comprising:
receiving, at a media relay, identification information for media content transmitted from a media system connected to the media relay; and
providing the identification information to a rich media information service that is configured to determine rich media information.
82. The method of claim 81 wherein the rich media information service is configured to provide the rich media information to an electronic communication device associated with the media relay for presenting by the electronic communication device.
83. The method of claim 81 including providing a time stamp indicating a progress of the presenting of the media content, the time stamp for synchronizing a presenting of the rich media information by the electronic communication device.
84. The method of claim 81 comprising providing a signal indicating a status of the presenting of the media content, the signal for synchronizing the presenting of the rich media information by the electronic communication device.
85. The method of claim 81 comprising receiving a media content signal for presenting by the media system; receiving one or more social networking events; and layering the social networking events and signal for presenting simultaneously by the media system.
86. The method of claim 81 comprising providing a social networking message indentifying media content being presented by the media system.
87. The method of claim 87 wherein the media content comprises a television program.
88. The method of claim 81 wherein the identification information is received and provided in response to presenting the television program by the media system.
89. The method of claim 88 wherein the identification information is received and provided in response to a selection of a television channel for presenting by the media system.
PCT/CA2011/001197 2011-10-28 2011-10-28 Method and system for providing and sharing rich media information associated to media content WO2013059902A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CA2011/001197 WO2013059902A1 (en) 2011-10-28 2011-10-28 Method and system for providing and sharing rich media information associated to media content

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CA2011/001197 WO2013059902A1 (en) 2011-10-28 2011-10-28 Method and system for providing and sharing rich media information associated to media content

Publications (1)

Publication Number Publication Date
WO2013059902A1 true WO2013059902A1 (en) 2013-05-02

Family

ID=48166972

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2011/001197 WO2013059902A1 (en) 2011-10-28 2011-10-28 Method and system for providing and sharing rich media information associated to media content

Country Status (1)

Country Link
WO (1) WO2013059902A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3005540A1 (en) * 2013-05-07 2014-11-14 Jean-Claude Pastorelli METHOD FOR NOTIFYING CONTEXTUAL DATA
CN105264906A (en) * 2013-06-05 2016-01-20 汤姆逊许可公司 Method and apparatus for content distribution for multiscreen viewing
EP3005707A4 (en) * 2013-06-05 2016-11-02 Thomson Licensing Method and apparatus for content distribution for multiscreen viewing
US10110955B2 (en) 2017-03-17 2018-10-23 The Directv Group, Inc. Method and apparatus for recording advertised media content
US10212474B2 (en) 2013-06-05 2019-02-19 Interdigital Ce Patent Holdings Method and apparatus for content distribution for multi-screen viewing
WO2023143377A1 (en) * 2022-01-27 2023-08-03 华为技术有限公司 Content management method, and electronic device and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040068750A1 (en) * 2000-07-31 2004-04-08 Shalong Maa Methods and systems for multimedia data synchronization and multilevel network communication
US20080159715A1 (en) * 2007-01-03 2008-07-03 Microsoft Corporation Contextual linking and out-of-band delivery of related online content
US20090049092A1 (en) * 2007-08-16 2009-02-19 Sony Computer Entertainment Inc. Content ancillary to sensory work playback
US7899915B2 (en) * 2002-05-10 2011-03-01 Richard Reisman Method and apparatus for browsing using multiple coordinated device sets

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040068750A1 (en) * 2000-07-31 2004-04-08 Shalong Maa Methods and systems for multimedia data synchronization and multilevel network communication
US7899915B2 (en) * 2002-05-10 2011-03-01 Richard Reisman Method and apparatus for browsing using multiple coordinated device sets
US20080159715A1 (en) * 2007-01-03 2008-07-03 Microsoft Corporation Contextual linking and out-of-band delivery of related online content
US20090049092A1 (en) * 2007-08-16 2009-02-19 Sony Computer Entertainment Inc. Content ancillary to sensory work playback

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3005540A1 (en) * 2013-05-07 2014-11-14 Jean-Claude Pastorelli METHOD FOR NOTIFYING CONTEXTUAL DATA
CN105264906A (en) * 2013-06-05 2016-01-20 汤姆逊许可公司 Method and apparatus for content distribution for multiscreen viewing
EP3005707A4 (en) * 2013-06-05 2016-11-02 Thomson Licensing Method and apparatus for content distribution for multiscreen viewing
EP3005717A4 (en) * 2013-06-05 2017-03-08 Thomson Licensing Method and apparatus for content distribution for multiscreen viewing
US9706255B2 (en) 2013-06-05 2017-07-11 Thomson Licensing Method and apparatus for content distribution for multiscreen viewing wherein video program and information related to the video program are transmitted to a second device but not to a first device when the distance between the two devices is greater than a predetermined threshold
US9930386B2 (en) 2013-06-05 2018-03-27 Thomson Licensing Method and apparatus for content distribution multiscreen viewing
US10212474B2 (en) 2013-06-05 2019-02-19 Interdigital Ce Patent Holdings Method and apparatus for content distribution for multi-screen viewing
US10110955B2 (en) 2017-03-17 2018-10-23 The Directv Group, Inc. Method and apparatus for recording advertised media content
US10812860B2 (en) 2017-03-17 2020-10-20 The Directv Group, Inc. Method and apparatus for recording advertised media content
US11115714B2 (en) 2017-03-17 2021-09-07 Directv, Llc Method and apparatus for recording advertised media content
US11457278B2 (en) 2017-03-17 2022-09-27 Directv, Llc Method and apparatus for recording advertised media content
WO2023143377A1 (en) * 2022-01-27 2023-08-03 华为技术有限公司 Content management method, and electronic device and system

Similar Documents

Publication Publication Date Title
US10462535B2 (en) Interactive video viewing
US10939177B2 (en) System for presenting media content
US9967708B2 (en) Methods and systems for performing actions based on location-based rules
US9525902B2 (en) Discovery and analytics for episodic downloaded media
EP2525319B1 (en) Using a media content receiver to provide promotional information to a mobile device
US20150012939A1 (en) System And Method In A Television System For Providing Advertising Information Associated With A User-Selected Object In A Television Program
CA2943975C (en) Method for associating media files with additional content
US20150020096A1 (en) Method and system for synchronising social messages with a content timeline
US20120222061A1 (en) Automatic media asset update over an online social network
US20120278209A1 (en) Micro-app dynamic revenue sharing
US20120319825A1 (en) Methods, systems, and means for restricting control of a home entertainment device by a mobile device
US9743137B2 (en) Run-time SDK integration for connected video players
KR20150105342A (en) Simultaneous content data streaming and interaction system
US20190052925A1 (en) Method and System for Recognizing, Analyzing, and Reporting on Subjects in Videos without Interrupting Video Play
US8327404B2 (en) Methods and systems for providing enhanced content associated with a media content instance available for purchase
JP2012508486A (en) Content linkage method and system using portable device
WO2013059902A1 (en) Method and system for providing and sharing rich media information associated to media content
US20160165203A1 (en) Method and System for Delivery of Content Over Communication Networks
US9173001B1 (en) Media content access systems and methods
US8990104B1 (en) Multimedia product placement marketplace
WO2013045922A1 (en) System for providing interactive content to an internet - enabled television apparatus
US20210329348A1 (en) Memory management in advanced television systems committee (atsc) 3.0 system
US10721511B2 (en) Systems and methods for coordinating online activity with broadcast television
KR20150033779A (en) Apparatus and method for synchronize screen
JP2015115708A (en) Television receiver, content reproduction method and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11874495

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11874495

Country of ref document: EP

Kind code of ref document: A1