WO2013048229A1

WO2013048229A1 - A system and method for performing ad-hoc screen switching & sharing

Info

Publication number: WO2013048229A1
Application number: PCT/MY2012/000161
Authority: WO
Inventors: Khong Neng Choong; Cheng Suan Lee; Ting Hwee WONG; Abbas Mazlan
Original assignee: Mimos Berhad
Priority date: 2011-09-26
Filing date: 2012-06-28
Publication date: 2013-04-04
Also published as: MY155584A

Abstract

The present invention provides an Ad-hoc screen sharing system and method for performing ad-hoc screen sharing and switching sessions over a wired or wireless Ad- hoc networks without a dedicated centralized server. The Ad-hoc Screen Sharing system and method allows the host of the sessions to invite participants to join in the session, share materials to be used during the sessions, presenting the information through the shared screens, and allowing the participants to interact by sharing their own screen.

Description

A System And Method For Performing Ad-Hoc Screen Switching &

Sharing

Field of the Invention

[001] The present invention relates to a system and method for performing ad- hoc screen sharing and switching sessions over a wired or wireless network without a dedicated centrali ed server. Tn particular, the system and method provides a networking solution that supports multicasting and integrates both the client and server, and peer-to-peer approaches that could link multiple devices together at the same time for the purpose of switching and sharing contents over different networks. Background

[002] In a meeting session that involves many individuals, such as seminar, trainings session, conference or the likes, is typically carried out in venues such as seminar rooms, lecture halls, meeting rooms, auditoriums, etc. These places can be appropriately selected in accordance with the size, the purpose and the setup, of which, may be varying from one to another. In sotne cases, there may be provided a large projection screen allowing the presenter to present the materials thereon to the audiences. The audiences may be provided with the presentation materials in hard copies prior to the presentation. The audiences may also download the relevant presentation materials on their own personal electronic device in a modern setup. [003] There are systems or devices adapted to allow a presenter to share the presentation materials effectively. Some examples of the devices available in the market today include a Universal Serial Bus (USB) device and a Video Graphics- Array (VGA) cable. Participants and presenters may attach these devices to their own personal electronic device such as laptops, computers, etc., to copy the material from one device to the projector-connected device prior the presentation, or to pass around the VGA cable to user who wanted to present with his or her device.

[004] However, these devices may cause the electronic devices to be more vulnerable to virus infections etc. Such systems or devices also tend to provide poor performances or delayed displays of the presentation materials, in some cases, these systems or devices could introduce technical issues where no output is shown on the display screen or projector due to hardware incompatibility or varying screen resolutions.

[005] Another alternative would be an online system that uses a centralized server where various users may sign into an online conference either as a chairman (or the presenter) or normal participants to access a document. In the online system, a client/server approach is adopted where the signaling control, data or contents must be routed through a centralized point, However for such online system, a server must be allocated to serve as the centralized point, which incurs extra setup and cost of maintenance. Further, the user's electronic devices that have to be connected to the centralized server may also be subjected to poor performance or bandwidth issues, especially if the server is located beyond the client's Internet Service Provider (iSF) international gateway. Summary

[006] Tn one aspect of the present invention, there is provided a system and method for performing ad-hoc screen sharing and switching sessions over a wired or wireless network without a dedicated centralized server. The system comprises a security module, wherein the security module performs authorization on a plurality of incoQiing connection requests from a plurality of electronic devices; a connection module, wherein the connection module discovers the electronic devices, announces the session and establishes data multicast connection; a session module, wherein the session module manages the overall ad-hoc screen sharing and switching sessions; and a screen-processing module., wherein the screen-processing module captures and processes a screen output and displays the screen output on the display screens of the electronic devices.

[007] In one embodiment, the session module operably communicates with the security module: the connection module; and the screen-processing module method. [008] In another embodiment, the session module further comprises a host sub-module, a present sub-module and a view sub-module. The host sub-module, the present sub-module and the view sub-module each has a plurality of tasks to complete respectively.

[009] In one embodiment, the screen outputs comprises of any object appearing on the screen including text, picture and graphic.

[0010] In another aspect of the present invention, the method comprising executing a host node to serve incoming requests from other nodes; executing a present node for transmitting a screen output to the host node; and executing a. view node for receiving and displaying the screen outputs from the present node.

[0011] In one embodiment the host node further comprises the steps of checking a number of selected network interfaces; waiting for incommg connection request from the selected network interfaces; performing authorization on the incoming request; receiving incoming screen outputs; displaying the incoming screen outputs; multicasting the received screen outputs and session information.

[00 2] Tn yet another embodiment, the present node further comprises the steps of listening to any broadcast/multicast session information on a number of selected network interfaces; selecting a particular session to join; performing authorization with the host of the particular session; capturing screen outputs; transmitting screen outputs to the host; broadcasting/multicasting the session information to the selected network interfaces; multicasting the captured screen outputs.

[0013] In another embodiment, the view node further comprises the steps of listening to any broadcast/multicast session information on a number of selected network interfaces; presenting a list of ongoing sessions on a user interface for subsequent selection; selecting a particular session to join; performing authorization with the host of the particular session; receiving incoming screen outputs from the host; displaying the received screen outputs. Brief Description of the Drawings

[0014] This invention will be described by way of non-limiting embodiments of the present invention, with reference to the accompanying drawings, in which: [0015] FTC t illustrates an internal architecture of an Ad-hoc Screen Sharing system for performing ad-hoc screen sharing and switching sessions as one embodiment of the present invention;

[0016] FIG- 2 A is a process-flow diagram illustrating a method of the Ad-hoc Screen Sharing system as shown in FIC. L as another embodiment of the present invention;

{00171 1G. 2B illustrates a process-flow diagram of the method when the user chooses to view the session as one embodiment of the present invention; and

[0018] FIGs. 3A-3C illustrates a plurality of scenarios of the Ad-hoc Screen Sharing system when implemented.

Detailed Description

[0019] The following descriptions of a number of specific and alternative embodiments are provided to understand the inventive features of the present invention, Tl shall be apparent to one skilled in the ait, however that this invention may be practiced without such specific details. Some of the details may not be described in length so as to not obscure the invention. For ease of reference, common reference numerals will be used throughout the figures when referring to same or similar features common to the figures.

[0020] FIG. 1 illustrates a schematic block diagram of an Ad-hoc Screen Sharing system 100 tor performing ad-hoc screen sharing and switcliing sessions as one embodiment of the present invention. The ad-hoc screen sharing and switcliing sessions is carried out among a group of participants that includes a host, a presenter and audiences (or viewers) in a meeting session, such as presentations, meetings, seminars, etc. The meeting session may require various contents such as presentation slides lhal are presented by a presenter and viewed among Ihe participants through display screens. The host hosts the sessions and controls ihe contents shared among the other participants. The display screens may include one main screen for presenting the contents by the host, and individual display screen on an electronic device possessed by each participant for own viewing. The host electronic device controlling the main screen and the respective electronic devices may be in wired or wireless communications through an ad-hoc network. These meeting sessions may be held in places such as meeting rooms, seminar halls, auditoriums, etc. The meeting session is conducted in a real-time. Some examples nf the electronic devices include computers, laptops and mobile devices. Besides the display screen of the host, which may be bigger, the host electronic device and the electronic devices possessed by the participants may essentially be same electronic devices. The display screen of host electronic device may be a projector that projects the screen output to a projector screen.

[0021] In another embodiment of the present invention, the Ad-hoc Screen

Sharing system 100 may employ an instant hybrid networking solution or other available networking methods, by integrating both client/server and peer-to-peer approaches. The instant hybrid networking solution links the electronic devices together for the purpose of switching and sharing the contents over different networks. [0022] The Ad-hoc Screen Sharing system 100 comprises a security module

101_.. a connection module 102. a session module 103 and a screen-processing module 104. The security module 101 performs authorization on a plurality of incoming connection reqtiests from the plurality of electronic devices. The connection module 102 discovers the electronic devices, announces the session and establishes data multicast connection. The screen-processing module 104 captures and processes a screen output and also displays received objects on the screen output on the display screens of the electronic devices. The session module 1 3 operationally communicates with all the three other modules, the security module 101, the connection module 102 and the screen-processing module 104 in urder to manage the overall ad-hoc screen sharing and switching sessions. This ensures that the screen output can be properly synchronized; managed; and transmitted across the network.

[0023] The users, i.e. the host and the participants, of the Ad-hoc Screen.

Sliai'ing system 100 first announce and discover each other tlirough a broadcast or multicast beacon where information of the session is embedded. The session information includes session name, and also the identity or internet Protocol (IP) address of the electronic devices, and also any other related information that describes the session. Each session is uniquely identi fied by its source or host address using source-specific multicasting. Source-specific multicasting is a method for delivering multicast packets. The method of source-specific multicasting is known to those skilled in the art, and therefore no further illustration is provided herewith.

[0024] The Ad-hoc Screen Sharing system 100 could then receive and interpret the beacon message, and could later request and join the session for instant screen sharing. The switching and sharing of the contents takes place whenever the host triggers the switching command on the host clcctrooic device. The screen on the host's display screen is captured and transmitted across the network to the host electronic device. Once the electronic devices are discovered, identified and connected, the switching and sharing of the contents is done in a client/server manner.

[0025] The session module 103 further comprises a host, sub-module 105, a present sub-module 106 and a view sub-module 107. Rach sub-module has a plurality of tasks to perform. The host sub-module's t 5 plurality of tasks includes listening and receiving screen outputs over the network from the host electronic device; performing access control that allows or disallows participants' connections; projecting the received screen outputs to the connected projector; and broadcasting or multicasting the received screen outputs together with the relevant session information to all participants connected lo the Ad-hoc Screen Sharing system 100.

(0026] The present sub-module's 106 plurality of tasks includes searching tor the host electronic device; requesting permission from the host sub-module to access the meeting session; capturing and sending a plurality of screen outputs from the host electronic device > the host sub-module .105; and broadcasting or multicasting the captured screen outputs together with the relevant session information to all participants connected to the Ad-hoc Screen Sharing system 100. [0027] The view sub-module's 107 plurality of tasks includes detetmining any ongoing screen sharing session based on the session information broadcast or multicast by the host electronic device; presenting a list of available sessions on a graphical user interface (GUI) 108; allowing the participant to select a particular session to join; requesting the host for access to the selected session; receiving any broadcast or multicast screen output for the selected session; and displaying any received screen output on the display screen of the electronic device.

[0028] Firstly, the session module 103 operationally communicates with the connection module 102. The connection module 102 announces and discovers the session as well as an identity of the host electronic device. The connection module 102 then establishes a connection to the host electronic device for data transmission. To ensure that only selected participants or allowed participants are able to join a particular session, the participants have to be given access rights to the session prior to the establishment of the data connection. The security module 101 performs the access control to provide the access rights. The screen-processing module 104 captures the screen outputs from the host electronic device. The screen-processing module 104 then displays the screen outputs received over the network onto the display screen of the participants' electronic device. The screen outputs comprises of any objects appearing on the display screen, including text, picture, graphic, animation, video and pointing commands such as mouse pointe r.

[0029] With the use of multicasting, the Ad-hoc Screen Sharing system 100 allows participants to view the presentation screen during the meeting session. The participants get a real-time cop of the same screen on the respective display screen through the network. This omits the need of devices such as a Video Graphics Array (VGA) cable, a Universal Serial Bus (USB) device, etc. This also assists in reducing the number of projectors needed, or even eliminating the need of having a projector, during the meeting session. [0030] The Ad-hoc Screen Sharing system 100 also enables the user to select a role for the meeting session at different times as one embodiment of the present invention. The role selection include to host, to present and to view. Selecting to host enables the user to host the meeting session. The host of the meeting session also broatlcasts or multicasts the received screen output to the other participants' electronic device. Selecting to present presents the contents on the host electronic device over the network. Selecting to view allows the user to get the real-time copy of the presented contents on their personal electronic device. This therefore allows (he plurality of electronic devices form nelworlaag between themselves without the need of the dedicated centralized servers,

C0031] In another embodiment of chc present invention, the Ad-hoc Screen

Sharing system 100 supports multiple users to hold the same role in a same meeting session. One exemplary scenario during a particular meeting session, the meeting session can have multi le presenters located in the same room (or in different meeting rooms). The Ad-hoc Screen Sharing system 100 is therefore provided for the multiple users to hold the role of a presenter and share then own materials with the other users participating in the meeting session. The presenters are able to take his or her own turn to present their own materials from their own electronic device during the meeting session accordingly. The host of the meeting session decides which presenter's materials to broadcast or multicast through the Ad-hoc Screen Sharing system 100. The materials are then shared accordingly through the display screen of the other users' electronic device. [0032] The Ad-hoc Screen Sharing system 100 also uses broadcasting or multicasting to minimize any unnecessary setup hassles as another embodiment of the present invention. Some examples include remembering the IP address of the server or the projector and having multiple transmissions of unioasl data streams In multiple electronic devices.

[0033] Further, the Ad-hoc Screen Sharing system 100 supports multiple interfaces. The Ad-hoc Screen Sharing system 100 works across multiple networks. This allows pailicipants' electronic devices from different network to join the same session. [0034] FIGs. 2A-2B are process-flow diagrams illustrating an Ad-hoc Screen

Sharing method 200 for the Ad-hoc Screen Sharing system 100 as shown in FIG. 1 as another embodiment of the present invention. In a network with a plurality of nodes, every node has a unique network address. The nodes include clients, servers and peers. The peer may sometimes serve as the client, sometimes server. [0035] In FIG. 2A, the Ad-hoc Screen Sharing method 200 is first initiated at step 201. After initiating the method 200, a connector A in step 202 first determines the number of network interfaces selected by a user utilizing the Ad-hoc Screen Sharing system 100, to run the service across. This allows users from a network, e,g. Network A, join a session running in another network, e.g. Network B. hi step 203, the number of selected network interfaces is checked. After the number of selected network interfaces are checked, the user is asked to select a choice of a role, i.e. to host, present or view a session in step 204, step 205 and step 206 respectively. Each role executes a respective node for a respective task. When the user chooses to host, a host node is executed. When the user chooses to present a present node is executed. When the user chooses to view, the view node is executed.

[0036] In step 204, the user either chooses to host or not to host the session. Tf the user chooses not to host the session, the user is then asked to choose if lic/shc wants (o present or not to present the session in step 205. If the user chooses not to pi-cscnt the session, the user is then asked to view the session in step 206. Tn step 206, an off-page connector C is connected to another process-flow diagram in FIG. 2B.

[0037] If the user chooses to host the session in step 204, step 207 of the method 200 will therefore broadcast or multicast session information to all the selected network interfaces. In step 208, the Ad-hoc Screen Sharing method 200 waits for any client connection from any of the selected network interfaces. Whenever there is a request incoming from the client in step 209, the request is authorized in step 210 for possible access to the session, if there is no incoming request in step 209. the Ad-hoc Screen Sharing method 200 loops back to step 208 to wait for the client connection and the incoming requests again.

[0038] After the incoming request from the client is authorized in step 210, the host electronic device will start receiving screen outputs from the client in step 211 and subsequently displays (he screen outputs on a projector in step 212. In step 213, the method 200 checks if the host electronic device is configured to also multicast the session to other clients. If the host electronic device is configured to multicast the session to other clients, the received screen outputs will then be multicast together with the session information in step 214. Thereafter, the user is asked if he or she wants to end the session in step 215. The Ad-hoc Screen Sharing method 200 loops back to step 211 from step 215 until the user chooses to end the session. Once the user chooses Lo end the session in step 215, the Ad-hoc Screen Sharing method 200 ends in step 216. However if the host electronic device is not configured to multicast the session to other clients in step 213, the Ad-hoc Screen Sharing method 200 loops straight lo step 215.

[0039] Still referring to FIG. 2A, when the user chooses not to host the session in step 204 and chooses to present the session in step 205. the user is asked if he/she will like to search for the host electronic device in step 217.

[0040] If the user decides to search for the host electronic device in step 217, the Ad-hoc Screen Sharing method 200 will continue to "listen" to any broadcast or multicast session information on the selected network interfaces in step 218. Once a particular session or host electronic device has been fou d in step 219, the user will request for authorization to join the particular session from the host or the identified host electronic device in step 220. [0041] Subsequently in step 221. once access to the session has been authorized, the screen output from the user's electronic device will be captured and transmitted to host or the identified host electronic device from step 217. Similarly, the user is asked if he/she wants to end the session in step 222. The Ad-hoc Screen Sharing method 200 loops back to step 221 from step 222 until the user chooses to end the session. Once the user chooses to end the session in step 222, the Ad-hoc Screen Sharing method 200 proceeds to a connector B in step 223. Connector B connects to the end of the process-flow diagram in step 216. [0042] However, if the host electronic device was not found in step 219, an eiTor message will be displayed on the display screen of the user's electronic device Qmmgh a user interface in step 224 and the Ad-hoc Screen Sharing method 200 loops back to the contiector Λ in step 202. One example of a user interface is a Graphical User Interface (GUI). Similarly, if the user's request for authorization is denied in step 220, the Ad-hoc Screen Sharing method 200 loops to step 224.

[0043] If the user decides to not search for the host electronic device in .step

217, the screen outputs and session information will be multicast directly to the selected network interfaces in step 225 accordingly. The user is then asked if he or she wants to end the session in step 226. Thereafter, the Ad-hoc Screen Sharing method 200 loops back to step 225 from step 226 until the user chooses to end the session. Once the user chooses to end the session in step 226, the method 200 proceeds to the connector B in step 223.

[0044] If the user chooses to view the session in step 206, the process-flow of the method 200 will be further i Uustratcd in FIG. 2B.

[0045] FIG. 2R illustrates the process-flow diagram of the method 200 when the user chooses to view the session in step 206 as shown with the off-page connector C in FIG. 2A. From the off-page connector C, step 228 of the Ad-hoc Screen Sharing method 200 will "listen" to any multicast session information on the selected network interfaces. Once the session is found in step 229, the session will be listed in the GUI. In step 230, the list of sessions found will be presented to the users through the GUI. This allows the users to select a particular session to join as a viewer. In step 231, the Ad-hoc Screen Sharing method 200 checks if there is any particular session selected by lie user.

[00461 If a session is not selected, the Ad-hoc Screen Sharing method 200 will continue to check till the particular session is selected. Once the session is selected, access into the session has to he authorized in step 232.

[0047] Upon authorization to access the session, the user will receive the screen outputs in step 233 and subsequently have the screen, outputs displayed in his/her electronic device in step 234. Thereafter, the user is asked if he/she wants to end the session in step 235. The Ad-hoc Screen Sharing method 200 loops back to step 233 from step 235 until the user chooses to end the session. Once the user chooses to end the session in step 235, the Ad-hoc Screen Sharing method 200 loops back to the connector B in step 223.

[0048] However, if the user was not granted access to the session in step 232, an error message will be displayed on the display screen of the user's electronic device through the GUI in step 236 and the Ad-hoc Screen Sharing method 200 loops back step 230.

[0049] FIGs. 3A-3C illustrates the various scenarios of the Ad- hoc Screen

Sharing system 100 when implemented, as one embodiment of the present invention. Each scenario has a plurality of electronic devices that belongs to various different users (e.g. Alice 301, Bob 302 and Charlie 303) and a host electronic device 304 that may be connected to tt projector 305. The host electronic device 304 bel ngs to a host of a particular session. As shown in FIGs. 3A-3C, all three users connect to the host electronic device 304 either by a wired or a wireless manner. The projector 305 projects a screen output received over ihe network from the host electronic device 304 onto a projector screen 306.

[0050] In FIC. 3 A, all three users (Alice 301 , Bob 302 and Charl ie 303) want to conduct a meeting session in sequence through the host electronic device 304. The session commences by having the host electronic device 304 run as L e host of the session. The husl of the session then announces its presence and session to the network. Upon making the announcement of the session, the other electronic devices belonging Lo the other users (Alice 301.. Bob 302 and Charlie 303) can start listening, capturing and interpreting the information in the announcement message. The iriformation includes the contact address of the host electronic device 304 where the other electronic device of the users (Alice 301, Bob 302 and Charlie 303) establishes connection through the network for performing the switching and sharing session.

[0051] As shown in FIG. 3Λ, the electronic device belonging to Alice 301 operably communicates with the host electronic device 304 via a wired network such as F.thernet The electronic device belonging to both Bob 302 and Charlie 303 operably communicates with the host electronic device 305 via a wireless network through a wireless Access Point (AP) 307.

[0052] FIG. 3B shows that the Ad-hoc Screen Sharing system 100 is also capable of allowing lhe host electronic device 304 to multicast session information and screen outputs to a number of viewers 308, not only within a same location such as a meeting room but also to those outside the meeting room. In FIG. 3B, the viewers in the same location, refer to Alice 301, Bob 302 and Charlie 303. The other viewers located elsewhere other than the meeting room operably communicates via an IP etwork backbone.

[0053] FTG. 3C shows another scenario without Lhe use of the projector 305. Similarly, sharing the screen output is still possible with the use of the Ad-hoc Screen Sharing system 100.

[0054] FIGs. 3A-3C illustrates only three but it is not limited Lo the few possible scenarios of the Ad-hoc Screen Sharing system 100 and method 200 for pciforaiing the ad-hoc screen sharing and switching sessions over the network without the dedicated centralized server.

[0055] ^'l he above description illustrates various embodiments of the present invention along with examples of how aspects of the present invention may be implemented. While specific embodiments have been described and illustrated it is understood that many charges, modifications, variations and combinations thereof could be made to the present invention without departing from the scope of the present invention. The above examples, embodiments, instructions semantics, and drawings should not be deemed to be the only embodiments, and are presented to illustrate the flexibility arid advantages of the present invention as defined by the following claims:

Claims

1. A Ad-hoc Screen Sharing system for perforating ad-hoc screen sharing and switching sessions over a wired or wireless network without a dedicated centrali ed server, the Ad-hoc Screen Sharing system comprising: a security module, wherein the security module performs authorization, on a plurality of incoming connection requests from a plurality of electronic devices; and a connection module, wherein the connection module discovers the electronic devices, announces the session and establishes data multicast connection; characterized in that, the overall ad-hoc screen sharing and switching sessions is managed through a session module; and a screen-processing module captures and processes a screen output and displays the screen output on the display screens of the electronic devices.

2. The Ad-hoc Screen Sharing system according to claim 1, wherein the session module operably communicates with the security module; the connection module; and the screen-processing module method.

3. The Ad-hoc Screen Sharing system according to claim 1 , wherein the session module further comprises a host sub-module, a present sub-module and a view sub- module.

4. The Ad-hoc Screen Sharing system according to claim 3. wherein the host sub- module, the present sub-module and the view sub-module each has a plurality of tasks lo complete respectively.

5. The Ad-hoc Screen Sharing system according to claim 1, wherein the screen outputs comprises of any object appearing on the screen including text, picture and graphic.

<j. An Ad-hoc Screen Sharing method for performing ad-hoc screen sharing and switching sessions over a wiTed or wiTeless network without a dedicated centralized server, the method comprising: executing a host node to serve incoming requests from other nodes; executing a present node for transmitting a screen output to the host node: and executing a view node for receiving and displaying the screen outputs from the present node.

7. The Ad-hoc Screen Sharing method according to claim 6, wherein the host node further comprises the steps of checking a number of selected network interfaces; waiting for incoming connection request from the selected network interfaces; performing aulhorization on the incoming request; receiving incoming screen outputs; displaying the incoming screen outputs; multicasting the received screen outputs and session information.

8. The Ad-hoc Screen Sharing method according to claim 6, wherein the present node further comprises the steps of listening to any multicast session information on a number of selected network interfaces; selecting a particular session to join; performing aut ori-taiion with the host of the particular session; capturing screen outputs; transmitting screen outputs to the host; multicasting the session information to the selected network interfaces; multicasting the captured screen outputs.

9. The Ad-hoc Screen Sharing method according to claim 6, wherein the view node further comprises the steps of listening to any multicast session information on a number of selected network interfaces; presenting a list of ongoing sessions on a user intetface for subsequent selection; selecting a particular session lo join; performing authorization with the host of the particular session; receiving incoming screen outputs from the host; displaying the received screen outputs.