This application claims priority under 35 U.S.C. §119 or 365 to Great Britain, Application No. 0712878.8, filed Jul. 3, 2007. The entire teachings of the above application are incorporated herein by reference.
This invention relates to a communication system and method.
Voice over internet protocol (“VoIP”) communication systems allow the user of a device, such as a personal computer, to make calls across a computer network such as the Internet. These systems are beneficial to the user as they are often of significantly lower cost than fixed line or mobile networks. This may particularly be the case for long distance calls. To use VoIP, the user must install and execute client software on their device. The client software provides the VoIP connections as well as other functions such as registration and authentication. In addition to voice communication, the client may also provide video calling and instant messaging (“IM”).
One type of VoIP communication system uses a peer-to-peer (“P2P”) topology built on proprietary protocols. To access the peer-to-peer system, the user must execute P2P client software provided by a P2P software provider on their PC, and register with the P2P system. When the user registers with the P2P system the client software is provided with a digital certificate from a server. Once the client software has been provided with the certificate, communication can subsequently be set up and routed between users of the P2P system without the further use of a server. In particular, the users can establish their own communication routes through the P2P system based on the exchange of one or more digital certificates (or user identity certificates, “UIC”), which enable access to the P2P system. The exchange of the digital certificates between users provides proof of the user's identities and that they are suitably authorised and authenticated in the P2P system. Therefore, the presentation of digital certificates provides trust in the identity of the user. It is therefore a characteristic of peer-to-peer communication that the communication is not routed using a server but directly from end-user to end-user. Further details on such a P2P system are disclosed in WO 2005/009019.
One of the advantages of VoIP communication systems, compared to the public switched telephone network (“PSTN”), is that supplementary information can be provided about the users of the VoIP communication system. This supplementary information can take the form of presence information and a “mood message”.
Presence information is an indication of the current status of a user of the system. More specifically, presence information is displayed in the user interface of the client for each of the contacts that the user has stored, and allows the user to view a best guess regarding the current status of the contacts in the system. Example presence states that may be displayed include “online”, “offline”, “away”, “not available” and “do not disturb”. The use of presence states provides a user with a best guess regarding the current status of a contact before attempting to communicate with the contact. For example, if the user is not online, and therefore unable to be contacted, then this is indicated to the user before attempting to make a call. Similarly, if a contact is busy and unlikely to answer, then this may also be communicated in advance via the presence state. This is a considerable advantage over PSTN systems, which do not provide any prior information on the probable state of a user. The only option in PSTN systems is to dial a number and wait and see if it is answered.
Mood messages are short text strings that are composed by the users to distribute information about themselves to their contacts and supplement their presence status. The mood message of a contact is generally displayed next to the contact's name and presence status in the client. Mood messages are useful for a number of reasons. For example, a mood message can be used to give more information or a reason for a particular presence status, e.g. if a user is offline, the mood message may say “On holiday”, thereby explaining why the user is offline. Similarly, if a user's presence state is set to “do not disturb”, the mood message may say “Busy working. Only contact me if urgent”. Mood messages are also useful for users that travel frequently, as a VoIP system can be accessed from anywhere in the world, but this is not reflected in the presence states. Therefore, it is useful for a user to show a mood message such as “In London” next to their presence state.
One popular use for mood messages is to utilise the mood message as a means to easily share links to multimedia content on the internet. For example, users can include a hyperlink to a particular webpage that has some interesting multimedia content (such as a video, picture or audio recording) in the mood message, so that all the user's contacts can see the hyperlink and click on the hyperlink to visit the webpage.
The multimedia content at the website linked in the mood message can serve to stimulate conversation over the VoIP communication system. However, this relies on the contacts of the user with the mood message actually clicking on the hyperlink and viewing the webpage. This can be a problem, as a mere hyperlink does not generally encourage other users to view the media.
There is therefore a need for a technique to address the aforementioned problems and provide for the efficient sharing and display of multimedia content by the users.
According to one aspect of the present invention there is provided a method of accessing content at a user terminal connected to a communication network and executing a communication client, comprising: said client displaying a list of contacts associated with a user of said client; said client retrieving a message from said communication network, wherein said message is related to a further user represented by one of said contacts displayed in said list of contacts, said message comprising a reference to content stored in a storage means accessible by said communication network; said client initiating a call to said further user over the communication network responsive to a user of said client selecting said one of said contacts in said list of contacts; and responsive to initiating said call, said client establishing communication with said storage means using said reference, accessing the content and displaying the content at said user terminal.
In one embodiment, said content is a video. In another embodiment, said content is an audio recording.
Preferably, the method further comprises the step of said client muting said content responsive to said further user answering said call. Preferably, the method further comprises the step of downloading the list of contacts from a network element. Preferably, said step of retrieving the message comprises communicating with a further client executed at a user terminal of the further user. Preferably, said message is a mood message created by said further user.
Preferably, said step of displaying the content at said user terminal comprises said client executing media player means at said user terminal, wherein said content is displayed to said user using said media player means. Preferably, said media player means is embedded within said client. Preferably, said media player means comprises user-operable controls for controlling playback and setting audio properties of said content.
Preferably, the method further comprises the step of ascertaining whether said reference to said content is listed in a database prior to displaying said content. Preferably, if said reference to said content is listed in said database, said user terminal does not display said content. Preferably, said reference is a network address of said content. Preferably, said network address is a uniform resource identifier.
Preferably, said communication network is a packet based communication network. In one embodiment, said client is a voice over internet protocol communication client. Preferably, said voice over internet protocol communication client is a peer-to-peer communication client. In another embodiment, said client is an instant messaging communication client.
In one embodiment, said user terminal is a personal computer. In another embodiment, said user terminal is a mobile device.
According to another aspect of the present invention there is provided a computer program product comprising program code means which when executed by a computer implement the steps according to the above-defined method of accessing content at a user terminal.
According to another aspect of the present invention there is provided a method of accessing content at a user terminal connected to a communication network and executing a communication client, comprising: said client displaying a list of contacts associated with a user of said client; said client retrieving a message from said communication network, wherein said message is related to a further user represented by one of said contacts displayed in said list of contacts, said message comprising a reference to content stored in a storage means accessible by said communication network; said client receiving a communication request initiated by said further user over the communication network; and responsive to receiving said communication request, said client establishing communication with said storage means using said reference, accessing the content and displaying the content at said user terminal.
Preferably, said communication request is an incoming call.
According to another aspect of the present invention there is provided a computer program product comprising program code means which when executed by a computer implement the steps according to the above-defined method of accessing content at a user terminal.
According to another aspect of the present invention there is provided a user terminal comprising: communication means for communicating with a communication network; display means; and processing means arranged to execute a communication client, wherein said client is configured to: display a list of contacts associated with a user of said client on said display means; retrieve a message from said communication network, wherein said message is related to a further user represented by one of said contacts displayed in said list of contacts, said message comprising a reference to content stored in a storage means accessible by said communication network; initiate a call to said further user over the communication network responsive to a user of said client selecting said one of said contacts in said list of contacts; and, responsive to initiating said call, establish communication with said storage means using said reference, access the content and display the content on said display means.
According to another aspect of the present invention there is provided a user terminal comprising: communication means for communicating with a communication network; display means; and processing means arranged to execute a communication client, wherein said client is configured to: display a list of contacts associated with a user of said client on said display means; retrieve a message from said communication network, wherein said message is related to a further user represented by one of said contacts displayed in said list of contacts, said message comprising a reference to content stored in a storage means accessible by said communication network; receive a communication request initiated by said further user over the communication network; and, responsive to receiving said communication request, establish communication with said storage means using said reference, access the content and display the content at said user terminal.
For a better understanding of the present invention and to show how the same may be put into effect, reference will now be made, by way of example, to the following drawings in which:
Reference is first made to
The user terminal 104 is running a client 110, provided by the P2P software provider. The client 110 is a software program executed on a local processor in the user terminal 104. The user terminal 104 is also connected to a handset 112, which comprises a speaker and microphone to enable the user to listen and speak in a voice call. The microphone and speaker does not necessarily have to be in the form of a handset, but can be in the form of a headphone or earphone with an integrated microphone, or as a separate loudspeaker and microphone independently connected to the user terminal 104.
An example of a user interface 200 of the client 110 executed on the user terminal 104 of User A 102 is shown illustrated in
The client user interface 200 comprises a tab 206 labelled “contacts”, and when this tab is selected the contacts stored by the user in a contact list are displayed. In the example user interface in
The contact list for the users (e.g. the contact list 208 for User A) is stored in a contact server 113 shown in
Calls to the P2P users in the contact list may be initiated over the P2P system by selecting the contact and clicking on a “call” button 222 using a pointing device such as a mouse. Alternatively, the call may be initiated by typing in the P2P identity of a contact in the field 224. Referring again to
Following authentication through the presentation of digital certificates (to prove that the users are genuine subscribers of the P2P system—described in more detail in WO 2005/009019), the call can be made using VoIP. The client 110 performs the encoding and decoding of VoIP packets. VoIP packets from the user terminal 104 are transmitted into the Internet 106 via the network interface 108, and routed to the computer terminal 122 of User B 114, via a network interface 123. A client 124 (similar to the client 110) running on the user terminal 122 of User B 114 decodes the VoIP packets to produce an audio signal that can be heard by User B using the handset 126. Conversely, when User B 114 talks into handset 126, the client 124 executed on user terminal 122 encodes the audio signals into VoIP packets and transmits them across the Internet 106 to the user terminal 104. The client 110 executed on user terminal 104 decodes the VoIP packets from User B 114, and produces an audio signal that can be heard by the user of the handset 112.
The VoIP packets for the P2P call described above are passed across the Internet 106 only, and the PSTN network is not involved. Furthermore, due to the P2P nature of the system, the actual voice calls between users of the P2P system can be made with no servers being used. This has the advantages that the system scales easily and maintains a high voice quality, and the call can be made free to the users.
Reference is now made to
When User A uses the pointing device 308 of the user terminal 104 to select the text-entry box 406, the panel shown in
After User A has typed a mood message into text-entry box 406, then the panel 402 is of the form shown in
The mood message that was typed by User A is transmitted to the contact server 113 and stored in User A's data record. In alternative embodiments, the mood message data is not transmitted immediately to the contact server 113, but is sent with the next periodic update message from the client 110 to the contact server 113. In addition, the mood message of User A 102 is also periodically communicated to each of User A's contacts over the P2P system when this is retrieved by the contacts.
Reference is now made to
If the user uses the pointing device to click in the mood message entry area 504 (but not on the word “video”) then a cursor is shown as in
If the user uses the pointing device to click on the word “video”, then the user begins the process for selecting a video for insertion into the mood message.
In preferred embodiments, the selection of a video is made by the user through the presentation of a UI showing a selection of available videos, which is displayed to the user responsive to the user clicking on the word “video”. An example of such a video selection UI 508 is illustrated in
The information for the above-two elements in UI 508 is fetched from different sources. Firstly, the information relating to the frame of the UI is fetched from a content directory 127. The content directory 127 is shown in
Once the information regarding the frame of UI 508 has been retrieved from the content directory 127, the information for pane 526 is retrieved from a content provider.
In the example shown in
The purpose of the information shown in pane 526 is to provide the user with a selection of videos that are available to be included in the user's mood message. Pane 526 displays a plurality of thumbnail images (e.g. thumbnail 528) representing each video and a title (e.g. title 530) for each video. The thumbnail image for a video is a small image of a single frame from the video. The thumbnail for each video is generated from the video file itself (e.g. it can be the first frame of the video, or a frame a predetermined time or percentage into the video). Preferably, a list of categories 532 is displayed to allow the user to view a sub-set of the available videos. Furthermore, the user can search the videos by keywords using the search field 518.
Preferably, the content directory 127 is provided by the P2P software provider. This allows the P2P software provider to present a portal to several content providers (128, 130, 132) that are able to provide videos to the users, thereby avoiding the requirement for the P2P software provider to host and/or stream its own videos. The content directory 127 can be updated to add or remove content providers as required.
When UI 508 is displayed on the users terminal 104, the user can use the pointing device to browse the available videos from the different content providers (by using the different tabs 510-514, the categories 532 and the search field 518). When a user sees a video that he is interested in, he clicks the thumbnail to view a preview of the video. When the user has chosen a video, he can select the “save mood message” button 522 to save the video to his mood message.
In an alternative embodiment, the user can also add a video to his mood message without using the video selection UI. For example, the user can copy and paste a URL of a video on a webpage directly into his mood message (e.g. into the field illustrated in
In a further alternative embodiment, the user can additionally add a video to his mood message by selecting a control displayed on the webpage of a content provider in association with a particular video. For example, the webpage of a content provider (128, 130, 132) can display videos that can be viewed by a user using a web-browser. The webpage displays an “add to mood” button in proximity with the videos, such that if the button is activated by the user, then data regarding the video is passed to the client to allow the client to generate the required mood message data. Therefore, the client can create a multimedia mood message in the same way as described previously, but without using the video selection UI.
In yet further embodiments, the user can also add videos from a webpage, even if the webpage is not from a content provider that displays a specific “add to mood” button as part of the webpage itself. The P2P software provider can provide plug-in software for the web-browser program that detects that the webpage being viewed contains an embedded video, and overlays an “add to mood” button in proximity to the video in the webpage. If the user selects the button, then data is passed to the client that allows the client to generate the multimedia mood message data in the same way as described above. In preferred embodiments, the client can check that the webpage is from an approved partner (e.g. one of the content providers 128, 130, 132) before permitting the video to be included in a mood message.
Further details regarding the process by which the user creates a multimedia mood message is the subject of a co-pending patent application entitled “Multimedia Mood Messages” by the same applicant (Great Britain Application Number 0712877.0), and is not discussed further here.
Once the multimedia mood message has been chosen by the user, the client generates mood message data to enable the mood message to be displayed in the client and passed to the contacts of the user. The mood message data 602 that is generated by the client is illustrated in
The media object 604 comprises several data items. A media type field 608 defines the type of media (e.g. video, photo, audio etc.) A media title field 610 includes the title of the media. A content provider identity 612 is used to identify which content provider the media originated from (e.g. 128, 130 or 132 in
The multimedia mood message then appears to the user in the client UI as shown in
Therefore, at this stage, the user (in this case User A) has selected a video to be included in his mood message, and generated corresponding multimedia mood message data 602. The next stage is for the multimedia mood message to be passed to User A's contacts.
Referring again to
As User B 114 is a contact of User A, the multimedia mood message data 602 is provided to the client 124 of User B over the P2P system. The multimedia mood message data must be processed by the client 124 before the mood message is displayed to User B. The client 124 reads the mood message data 602 and analyses the media object 604. For example, the client 124 will read the media type field 608 to determine the type of media referred to in the media object 604 (e.g. a video in this example). The client will also extract the thumbnail 618 so that it may be displayed in the UI of the client 124 next to the contact entry for User A. The media URI 616 is extracted and hyperlinked to the thumbnail image in the client UI. The media title 610 is also read for display in the client UI.
The result of the multimedia mood message data 602 being displayed in User B's client is illustrated in
As mentioned previously, a problem with User A 102 sharing multimedia content in a mood message is that it relies on User B 114 actively selecting to view the video in the mood message (by activating the play button 716). To counter this, a system and method is utilised whereby the video from User A's mood message is automatically displayed to a contact of User A (e.g. User B) whenever that contact attempts to establish a call with User A. More specifically, during the time between the call being initiated by the contact and the time at which User A answers the call, the video is played to the contact. This technique can be referred to as a “video ringback”.
Reference is now made to
In addition, the client 124 of User B 114 also detects that the contact being called (User A in this example) has a video mood message. In response to detecting this, the client attempts to start a video ringback. The client 124 reads the mood message data 602, and specifically the media URI 616. The client uses the media URI 616 to contact the location at the content provider (128, 130, 132) where the video is stored, and initiate streaming of the video to the client 124 of User B 114.
The UI 700 of the client 124 of User B at the beginning of this process is shown illustrated in
Below the contact card is an embedded video player 814. In
When the video located at the media URI 616 has been loaded, the video is played back to User B 114, whilst he is waiting for User A 102 to answer the call. This is illustrated in
Preferably, the client 124 of User B 114 initially plays an audible ringing tone to User B 114 whilst the video begins to be played back, in order to indicate to the user that the call is waiting to be answered. After the ringing tone has been played for a predetermined period of time (e.g. 3 seconds), the ringing tone is faded out, and the sound that accompanies the video is faded in.
When User A 102 answers the call, the video playback is muted, so that the sound of the video is not playing over the top of User A's voice. This is shown in
If User B 114 wishes to unmute the video, so that he can continue to hear the sound of the video even after User A has answered the call, then this can be achieved by User B moving the cursor with the pointing device over the embedded video player in order to display a control bar 820, as shown in
In alternative embodiments, the client pauses the content responsive to User A answering the call, rather than the content being muted. In this case, the message 818 displayed over the video in
Therefore, the above-described process ensures that a video shared by User A 102 in his mood message is seen by his contacts, due to it being played automatically to them during a time when otherwise only a normal ringing tone would be heard.
When User B 114 first makes a call to User A 102, he may be surprised by the video that begins playing automatically. It is therefore preferable to provide a way for the video to be rapidly paused by the user, if it is inappropriate for it to be played. This is illustrated in
The result of the user clicking on the video with the pointing device is shown in
Reference is now made to
The control bar 820 comprises a play/pause button 828, a progress bar 830, a volume button 822 and a menu button 832. The play/pause button toggles between playing and pausing the video, and the symbol shown on the button changes accordingly, depending on the current state of the video (i.e. whether it is currently playing or paused). When the volume button 822 is activated, a volume slider is shown to allow the user to change the volume, or the sound can be muted. When the video is either paused, muted, or both, a message is shown overlaid on the video.
The second option is a “add to my mood” option 838. If this option is selected, then the video that is shown in the embedded video player 814 (i.e. video from User A's mood message) is added to User B's mood message.
The third option is a “more info” option 840. The “more info” option provides the user with more information regarding the video. Preferably, this is provided by the client 124 executing a web browser and navigating to a webpage of the content provider, the address of which was provided in the content provider URI 614 field of the mood message data 602.
The fourth option is an “auto-play video” option 842. Preferably, this option is enabled by default. When enabled, this option allows videos that are in a callee's mood message to be played automatically when a call is made to the callee (as described with reference to
In further embodiments, the menu button 832 can also present a fifth option (not shown in
Reference is now made to
Furthermore, during a call, User B 114 may need to use controls related to the voice call, such as adjusting sound settings, placing the call on hold or muting his microphone. The controls require space on the call tab 802. If any of these controls are activated and there is insufficient room to accommodate the controls, then the video is paused and reduced in size as shown in
If the client 124 is unable to play the video from the media URI 616 provided by User A's mood message (e.g. due to the video being removed, or a network failure), then an error message is shown to the user. This is illustrated in
In preferred embodiments, before the video is displayed to User B, the client 124 will perform a check to ensure that the media URI 616 included in the mood message does not relate to a video that has been “blacklisted”. A video may be blacklisted if, for example, it is found to infringe copyright or contains offensive material. Referring to
If the media URI matches one listed in the blacklist DB 136, then blacklist advertiser 134 sends a message to the client indicating that the video has been blacklisted. In response to this the client does not display the media, but instead displays a notification of the problem. Conversely, if the media URI 616 is not listed in the blacklist DB 136, then the blacklist advertiser 134 sends a message to indicate to the client that the media can be displayed to the user.
In preferred embodiments, in addition to the video in User A's mood message being played to User B when User B is waiting for User A to answer a call, if User B also has a video mood message, then this video can be displayed to User A as part of the incoming call alert. In other words, if both the users have video mood messages, then the video of User A is displayed to User B, and the video of User B is displayed to User A. This is illustrated with reference to
The video in the embedded video player 1514 is displayed by the client 110 using the media URI from User B's mood message to stream the video from the content provider (128, 130, 132), in the same manner as described above with reference to
User A has the same controls over the video shown when there is an incoming call as described above for User B when placing a call. In particular, the same control bar and menu options are available as described above with reference to
Therefore, the above described system and method ensures that multimedia content shared by users is shown to their contacts in two ways. Firstly, a caller is shown the multimedia content of the called user when he is waiting for the called user to answer the call. Secondly, the called user is shown the multimedia content of the caller when the incoming call is displayed in the client.
While this invention has been particularly shown and described with reference to preferred embodiments, it will be understood to those skilled in the art that various changes in form and detail may be made without departing from the scope of the invention as defined by the appendant claims.
Number | Date | Country | Kind |
---|---|---|---|
0712878.8 | Jul 2007 | GB | national |
Number | Name | Date | Kind |
---|---|---|---|
6941345 | Kapil et al. | Sep 2005 | B1 |
7200636 | Harding | Apr 2007 | B2 |
7475112 | Sinclair et al. | Jan 2009 | B2 |
7995728 | Martin et al. | Aug 2011 | B1 |
8209385 | Partaker | Jun 2012 | B2 |
8295865 | Kirchhoff et al. | Oct 2012 | B1 |
20020067812 | Fellingham et al. | Jun 2002 | A1 |
20020176404 | Girard | Nov 2002 | A1 |
20030154446 | Constant et al. | Aug 2003 | A1 |
20030222907 | Heikes et al. | Dec 2003 | A1 |
20030225848 | Heikes et al. | Dec 2003 | A1 |
20040088357 | Harding | May 2004 | A1 |
20050055627 | Lloyd et al. | Mar 2005 | A1 |
20050207379 | Shen et al. | Sep 2005 | A1 |
20050220064 | Hundscheidt et al. | Oct 2005 | A1 |
20060059236 | Sheppard et al. | Mar 2006 | A1 |
20060168015 | Fowler | Jul 2006 | A1 |
20060294195 | Hyatt | Dec 2006 | A1 |
20070143414 | Daigle | Jun 2007 | A1 |
20070287477 | Tran | Dec 2007 | A1 |
20080021957 | Medved | Jan 2008 | A1 |
20080043942 | Cardona et al. | Feb 2008 | A1 |
20080065735 | Szeto | Mar 2008 | A1 |
20080086531 | Chavda et al. | Apr 2008 | A1 |
20080162649 | Lee et al. | Jul 2008 | A1 |
20080256298 | Lu et al. | Oct 2008 | A1 |
20080313056 | Nowak et al. | Dec 2008 | A1 |
20080316999 | Qiu et al. | Dec 2008 | A1 |
20090013048 | Partaker et al. | Jan 2009 | A1 |
20090013059 | Partaker et al. | Jan 2009 | A1 |
20090161853 | Ku et al. | Jun 2009 | A1 |
20090190738 | Guedalia et al. | Jul 2009 | A1 |
20090210524 | McCormack et al. | Aug 2009 | A1 |
20100098235 | Cadiz et al. | Apr 2010 | A1 |
20130283375 | Kuo | Oct 2013 | A1 |
Number | Date | Country |
---|---|---|
10 2005 036424 | Jan 2005 | DE |
10 2005 036424 | Nov 2006 | DE |
WO 03056732 | Jul 2003 | WO |
WO 2004049182 | Jun 2004 | WO |
WO 2005009019 | Jan 2005 | WO |
WO-2009003733 | Jan 2009 | WO |
WO-2009003734 | Jan 2009 | WO |
Entry |
---|
Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration, dated Mar. 4, 2009, from counterpart International Application No. PCT/EP2008/053721. |
International Search Report and Written Opinion PCT/EP2008/053720, mailed Jul. 31, 2008. |
Office Action, U.S. Appl. No. 12/004,092, dated May 11, 2010. |
Office Action, U.S. Appl. No. 12/004,092, dated Oct. 30, 2009. |
Office Action, U.S. Appl. No. 12/004,092, dated Aug. 2, 2011. |
Final Office Action, U.S. Appl. No. 12/004,092, dated Nov. 8, 2010. |
“Notice of Allowance”, U.S. Appl. No. 12/004,092, (Feb. 28, 2012), 15 pages. |
Partaker, Eric et al., “Multimedia Mood Messages”, UK Application 0712877.0, (Jul. 3, 2007), 52 pages. |
Number | Date | Country | |
---|---|---|---|
20090013059 A1 | Jan 2009 | US |