This application claims priority under 35 U.S.C. §119 or 365 to Great Britain, Application No. 0907818.9, filed May 6, 2009, Great Britain Application No. 0816271.1, filed Sep. 5, 2008, Great Britain Application No. 0816276.0, filed Sep. 5, 2008, Great Britain Application No. 0816275.2, filed Sep. 5, 2008, Great Britain Application No. 0816278.6, filed Sep. 5, 2008, Great Britain Application No. 0816279.4, filed Sep. 5, 2008, Great Britain Application No. 0816280.2, filed Sep. 5, 2008, and Great Britain Application No. 0816281.0, filed Sep. 5, 2008. The entire teachings of the above applications are incorporated herein by reference.
This invention relates to a peripheral device for communication in a communications system.
Packet-based communication systems allow the user of a device, such as a personal computer (PC), to communicate across a computer network such as the Internet. Packet-based communication systems include voice over interne protocol (“VoIP”) communication systems. These systems are beneficial to the user as they are often of significantly lower cost than fixed line or mobile networks. This may particularly be the case for long-distance communication. Typically, to use a VoIP system, the user installs and executes client software on their device. The client software provides the VoIP connections as well as other functions such as registration and authentication. In addition to voice communication, the client may also provide further features such as video calling, instant messaging (“IM”), voicemail and file transfer.
One type of packet-based communication system uses a peer-to-peer (“P2P”) topology built on proprietary protocols. To enable access to a peer-to-peer system, the user must execute P2P client software provided by a P2P software provider on their computer, and register with the P2P system. When the user registers with the P2P system the client software is provided with a digital certificate from a server. Once the client software has been provided with the certificate, communication can subsequently be set up and routed between users of the P2P system without the further use of a server. In particular, the users can establish their own communication routes through the P2P system based on the exchange of one or more digital certificates (or user identity certificates, “UIC”), which enable access to the P2P system. The exchange of the digital certificates between users provides proof of the users' identities and that they are suitably authorised and authenticated in the P2P system. Therefore, the presentation of digital certificates provides trust in the identity of the user. It is therefore a characteristic of peer-to-peer communication that the communication is not routed using a server but directly from end-user to end-user. Further details on such a P2P system are disclosed in WO 2005/009019.
A user's device may include input means such as a microphone and/or a camera to capture data (such as audio and/or video data) from the user, and output means such as a speaker and/or a display to convey data to the user (such as audio and/or video data). The user's device typically also includes the communication client software which is executed on a processor of the device, and means for connecting to the communication system, such as a network interface. In this way the user's device typically includes all of the components necessary to communicate over the network.
However some user devices, typically corporately owned PCs, have firewall software executed on the processor of the device, or on the gateway of a Local Area Network (LAN) to block the user from downloading certain types of software onto the device. In this case the user may be prevented from installing the communication client software on his or her device and is therefore prevented from connecting to the communication system.
In some cases a user may purchase a device with the communication client preinstalled on the processor of the device and it may not be possible to download updated versions of the communication client. Since the user's device typically includes all of the components necessary to communicate over the network, if it is desired to replace one component with a new or upgraded version of the component then it is necessary to replace the whole device including all of the other components. Furthermore, the quality of each individual component in the device is often lower than the quality of corresponding components in devices that are dedicated to performing the function of the component in question. For example the display and speakers of the user's device may be of lower quality than the display and speakers of a device whose primary purpose is to display pictures and to play sounds to a user, such as a television.
Furthermore, there are currently many different methods for communicating between users, for example phone calls, emails, etc. The cost of the user's device including all of the components necessary to communicate over the P2P system may be relatively high, when compared to other devices which may be used for communicating in different ways. In some cases the increased cost of the user's device may put off some users from purchasing the device, as they may be content to use other forms of communication that are available. A reduction in new users to the P2P communication system may detract from the popularity of the P2P communication system, which in turn may reduce the desirability of the P2P communication system for existing users of the P2P system.
Updated versions of the communication client may be released from time to time. Due to the relatively high cost of the user's device and the need to replace all of the components necessary to communicate over the P2P system, the user may decide not to update his communication client every time an updated version is released. It is desirable for the users of the communication system to have the most up to date version of the communication client as this will give the users the benefit of the latest advances and should provide greater user satisfaction.
It is an aim of the present invention to address the problems with the prior art described above.
In a first aspect of the invention there is provided a method of communicating over a network using a first device and a peripheral device, the first device comprising a user interface and a network interface for connecting to the network, the peripheral device having a local connection to the first device, the local connection being independent of the network, the method comprising: receiving data packets from the network at the network interface of the first device; forwarding the received data packets from the first device to the peripheral device via the local connection; executing a client engine of a communication client on a processor of the peripheral device to process the received data packets; and sending processed data packets from the peripheral device to the first device via the local connection such that data contained in the received data packets is conveyed to a user of the first device using the user interface of the first device.
In a second aspect of the invention there is provided a system for communicating over a network comprising: a first device having a local connection to a peripheral device, the local connection being independent of the network, the first device comprising: user interface means; network interface means for connecting to the network and for receiving data packets from the network; means for forwarding the received data packets from the first device to the peripheral device via the local connection; and means for receiving processed data packets from the peripheral device via the local connection such that data contained in the received data packets is conveyed to a user of the first device using the user interface means; and the peripheral device comprising: means for receiving the received data packets from the first device via the local connection; processing means for executing a client engine of a communication client to process the received data packets; and means for sending processed data packets to the first device via the local connection.
In a third aspect of the invention there is provided a peripheral device for communicating over a network, the peripheral device comprising: means for receiving data packets from a first device via a local connection that is independent of the network, the data packets originating from the network; processing means for executing a client engine of a communication client to process the received data packets; and means for sending processed data packets to the first device via the local connection, the processed data packets being for conveying data contained in the received data packets to a user of the first device.
In a fourth aspect of the invention there is provided a method of communicating over a network using a first device and a peripheral device, the first device comprising a user interface and a network interface for connecting to the network, the peripheral device having a local connection to the first device that is independent of the network, the method comprising: receiving data at the peripheral device; encoding the received data at the peripheral device; executing a client engine of a communication client on a processor of the peripheral device to process the received data packets; sending the processed data packets from the peripheral device to the first device via the local connection; and forwarding the received data packets from the first device to the communication network via the network interface.
In a fifth aspect of the invention there is provided a method of establishing a bidirectional communication over a network using a first device and a peripheral device, the first device comprising a user interface, the peripheral device comprising a network interface for connecting to the network and a local connection to the first device that is independent of the network, the method comprising: receiving data packets from the network at the network interface of the peripheral device; executing a client engine of a communication client on a processor of the peripheral device to process the received data packets; sending processed data packets from the peripheral device to the first device via the local connection; and decoding the data at the first device such that data contained in the received data packets is conveyed to a user of the first device using the user interface of the first device; and wherein the method further comprises: receiving data at the peripheral device; encoding the received data at the peripheral device; executing a client engine of a communication client on a processor of the peripheral device to process the received data packets; sending the processed data packets from the peripheral device to the first device via the local connection; and forwarding the received data packets from the first device to the communication network via the network interface.
In a sixth aspect of the invention there if provided a system for communicating over a network comprising: a first device having a local connection to a peripheral device, the local connection being independent of the network, the peripheral device comprising: network interface means for connecting to the network and for receiving data packets from the network; processing means for executing a client engine of a communication client to process the received data packets; and means for sending processed data packets to the first device via the local connection, the first device comprising: means for receiving the processed data packets from the peripheral device; means for decoding the processed data packets; and user interface means for conveying data contained in the processed data packets to a user of the first device.
For a better understanding of the present invention and to show how the same may be put into effect, reference will now be made, by way of example, to the following drawings in which:
a shows a television of a first embodiment;
b shows a television of another embodiment;
c shows a television of a further embodiment;
Reference is first made to
Note that in alternative embodiments, the television 104 can connect to the communication network 106 via additional intermediate networks not shown in
Typically the television 104 and the peripheral device 108 are used within the vicinity of the user 102, such that data can be conveyed to the user 102 through the television 104, and data can be captured from the user 102 by the peripheral device 108 using for example a camera 122 to capture image or video data and a microphone to capture audio data. The peripheral device 108 has a communication client 110 embedded within it which is provided by the software provider. The communication client 110 is a software program executed on a processor in the peripheral device 108. The peripheral device executes a client engine of the communication client 110 in order to communicate with other users of the network (such as the user 112 called “Kevin Jackson” in
In the preferred embodiment shown in
a illustrates a detailed view of the television 104. The television 104 comprises a central processing unit (“CPU”) 202, to which is connected a display 118 such as a screen, and speakers 120. The display 118 and the speakers 120 are integrated into the television 104. In alternative devices 104 at least one of the display 118 and the speakers 120 may not be integrated into the device 104 and may be connected to the CPU 202 via respective interfaces (e.g. a USB interface). A remote controller may be connected to the CPU 202 via an interface (not shown). The CPU 202 is connected to a network interface 204 such as a modem for communication with the network 106. The CPU 202 is connected to a local connection interface, such as a USB interface or a Bluetooth interface 206 for communication with the peripheral device 108. The CPU 202 may be connected to various other input or output devices through the I/O interface 208. The network interface 204, local connection interface 206 and I/O interface 208 may be integrated into the device 104 as shown in
a also illustrates an operating system (“OS”) 210 executed on the CPU 202. Running on top of the OS 210 is a client user interface 212 for the communication client 110. The operating system 210 manages the hardware resources of the television and handles data being transmitted to and from the network via the network interface 204. Also running on top of the OS 210 is a television application 214 which is used to allow the device 104 to operate as a conventional television. Also running on top of the OS 210 is a decoder 216. The decoder 216 is used to decode broadcast television video data. The decoder 216 may also be used to decode encoded video data received from the client engine 312 as described in more detail below.
The operating system 308 manages the hardware resources of the peripheral device 108 and handles data being transmitted to and from the device 104 via the local connection interface 306. Also running on top of the OS 308 is a voice encoder 310, a voice decoder 320 and a video encoder 316. The encoders 310 and 316 may be used to encode data as described in more detail below.
With reference to
When a call accept message is received at the communication client 116 from the client engine 312, data packets are transmitted from the communication client 116 to the television 104 via the network 106. At step S402 the data packets are received at the television 104. The data packets are received via the network interface 204 of the television 104. The received data packets are routed to the local connection interface 206 of the television 104. In step S404 the received data packets are forwarded to the webcam 108 over the local connection 124. The data packets are received at the local connection interface 306 of the webcam 108. The data packets are routed to the CPU 302 of the webcam 108. At step S406 the client engine 312 is executed on the CPU 302 of the webcam 108 in order to handle the data packets in accordance with protocols of the P2P communication system. The received data packets may contain for example textual, image, video and/or audio data. The client engine 312 decrypts the data in the data packets, identifies the type of data retrieved from the data packets and provides the data to the appropriate module. For example, encoded video data is provided to the video decoder 216, encoded audio data is provided to the audio decoder 320 and textual data is provided to the IM (instant messaging module) 318.
If the data contained in the data packets is intended to be conveyed to the user 102 then at step S408 the data is sent from the webcam 108 to the television 104 using the local connection 124 via the local connection interface 306 of the webcam 108 and the local connection interface 206 of the television 104.
In a preferred embodiment of the invention encoded video data received from the client engine is decoded by the video decoder 216 located in the television, as shown in
In one embodiment of the invention, encoded audio data received from the client engine is decoded by the voice decoder 320 located in the webcam. Since audio data transmitted from the television is also encoded in the webcam, acoustic echo cancellation may be applied to the transmitted audio data based on the decoded received audio data.
The method described above allows data received from the network 106 to be conveyed to the user 102.
During a communication event, such as a video call, data may be sent from the user 102 (“Tom Smith”) to the user 112 (“Kevin Jackson”). With reference to
In step S504 the captured voice data and video data are encoded by the voice encoder 310 and the video encoder 316 respectively. Encoded data packets are output from the voice and video encoders. In step S506 the client engine 312 running on the operating system 302 of the webcam 108 handles the encoded data packets according to the requirements and protocols of the P2P communication system on which the data will be transmitted.
As described above, in preferred embodiments, the webcam 108 is not directly connected to the network 106. In step S508 the captured data packets are sent to the television 104 using the local connection 124 which is distinct from the network 106, and then the data packets are forwarded from the television 104 to the network using the network interface 204 of the television 104. In this way, the webcam 108 is configured to use the network interface 204 of the television to send data captured from the user 102 to the network 106.
As described above, in a preferred embodiment of the invention, the webcam 108 includes the video encoder 316 and the television 104 includes the video decoder 216. Therefore video data sent between the webcam 108 and the television 104 on the local connection 124 is always encoded. User interface instructions are sent from the television CPU 202 to the webcam 108 via the local connection 124. User interface notifications are sent from the client engine 312 of the webcam 108 to the user interface 212 of the television via the local connection 124.
In one embodiment of the invention, driver software is stored on the peripheral device. When the peripheral device is first connected to the television, the operating system 202 of the television 104 retrieves a driver suitable for the operating system from the peripheral device 108 and sets up the network configuration.
In one embodiment of the invention the client user interface 212 may be stored on the peripheral device together with the driver software. The operating system of the device 104 may be arranged to retrieve the client user interface 212 together with the driver when the peripheral device is attached.
In a further embodiment of the invention a client user interface API (Application Programming Interface) 213 may be stored on the peripheral device. The operating system of the device 104 may be arranged to retrieve the client user interface API 213 together with the driver when the peripheral device is attached. The client user interface API 213 provides an interface between the client engine 312 and a user interface 212′. In one exemplary embodiment the client user interface 212 may be preinstalled on the device and form part of the user interface of the television application 214.
As shown in
In a further exemplary embodiment of the invention the client user interface 212′ may be provided by a webpage. This embodiment will now be described with reference to
When the peripheral device 108 is connected to the device 104, the operating system of the user device 104 is arranged to retrieve driver software for the peripheral device 108 from the memory of the peripheral device 108. The client user interface API 213 is provided together with the driver software to the device 104. As shown in
Executing the client engine 312 on a peripheral device (such as the webcam 108) attached to a device (such as the television 104) has several advantages over a system in which the client engine is executed on the device 104 itself. Executing the client engine 312 on the peripheral device 108 means that it is not necessary to install a client engine in the processor of the device 104. Indeed, in preferred embodiments there is not a communication client installed on the television 104. The user 102 can use the communication client simply by connecting the peripheral device 108 to the device 104.
Therefore if the user is prevented from downloading communication client software on the device due to firewall restrictions, the user may nevertheless use the device to communicate via the communication system by connecting the device to the peripheral device. Furthermore instead of having to purchase a new television 104 with the desired communication client preinstalled the user may connect the peripheral device to communicate via the communication system using the user interface of the device. Additionally, updated versions of the communication client engine may be used without having to purchase a new television 104. Users are likely to already have televisions, with the primary use being for watching (and listening to) television programs. The quality of the display and the speakers of existing televisions is high (when compared to the display and speakers of a device which is to be used primarily as a communication device). The user may therefore prefer to use the display and speakers of the television to convey data that is received from the network 106.
Furthermore, existing televisions are often capable of connecting to the network 106 through a network interface (e.g. network interface 204). Therefore a user who owns a television (such as television 104) already has in his possession some of the components necessary to communicate over the P2P system (e.g. a display, speakers, a network interface). The peripheral device 108 of the present invention provides the remaining components necessary to communicate over the P2P system (e.g. the webcam 108 provides the client engine 312 to handle received data packets from the P2P system, and means for capturing data from the user such as a camera 122 and a microphone 304). Since the user is likely to already own a television 104, it is advantageous to provide only the remaining components necessary for using the P2P communication system in a peripheral device that can connect to the television. The present invention exploits that fact users often own devices (such televisions) which can connect to the network through a network interface. The peripheral device 108 includes the client engine 312 of a client for communicating over a P2P system. The peripheral device does not need its own network interface for connecting to the network 106 because it can use the existing network interface 204 of the device 104. The peripheral device 108 therefore requires only a local connection interface 306 for connecting with the device 104.
The cost of the webcam 108 is likely to be lower than a dedicated device that includes all of the components necessary to communicate over the P2P system. A lower cost gives users more incentive to purchase the webcam 108 and they are also more likely to purchase the latest updates of the communication client engine, as they are not required to purchase a whole new television. It is beneficial to user satisfaction for the users to be using the most up to date versions of the client software. Another aspect of the webcam that can reduce its cost is that it does not require a separate network interface for connecting to the network 106. The webcam 108 can connect to the television using the local connection 124 (e.g. a USB connection) such that it can use the network interface 204 of the television 104 to connect to the network 106.
The webcam 108 may be built into the casing of the television 104 to make the system compact. It may still be simple to replace the webcam with an updated version by removing the webcam from the casing of the television 104. Alternatively, the webcam 108 may be physically separate from the television.
User data, such as chat history, may be stored on the webcam 108. When the webcam 108 is detachable from the television 104 the privacy of the user data may be improved as the user is able to remove the webcam, storing the user data.
The client user interface 600 comprises a button 606 labelled “contacts”, and when this button is selected the contacts stored by the user in a contact list are displayed in a pane below the button 606. In the example user interface in
Presence information in packet-based communication systems can additionally be supplemented by “mood messages”. Mood messages are traditionally short text strings that are composed by the users to distribute information about themselves to their contacts to supplement their presence status. The mood message of a contact is generally displayed next to the contact's name in the list of contacts 608. The presence status of the contact is displayed with the mood message next to the name of the contact in the list of contacts 608. In
The user 102 may also select a picture 628 to represent the user (known as an avatar). The client 110 periodically requests the presence state information for each of the contacts in the contact list 608 directly over the communication system. Similarly, the current mood message (e.g. “in London” 622 for “Kevin Jackson”) for each of the contacts, as well as a picture (avatar—e.g. picture 630 for “Kevin Jackson”) that has been chosen to represent the contact, are also retrieved by the client 110 directly from the respective clients of each of the contacts over the communication system. The presence states and mood messages of the contacts are therefore determined using a “pull” technique, as the data is requested from the clients of each of the contacts. In alternative embodiments, the presence state, mood message and avatar of a user can be “pushed” to each of the user's contacts over the communication network, either periodically or whenever the presence state is changed.
A further advantage of the present invention is that the CPU resources of the processor 202 of the television 104 are not required to maintain presence states, avatar or mood message changes of contacts in the contact list 608. Changes to the presence states, avatar or mood messages of the contacts in the contact list 608 are maintained by the client engine 312 of the webcam 108 and it is only necessary to provide these changes to the user interface 212 of the television 104 when the user 102 chooses to view the contact list 608 on the television 104. This reduces the processing resources of the television 104 that are used, as compared to executing the entire communication client on the television 104.
In a second embodiment shown in
When the network interface is in the peripheral device 708 then the peripheral device 708 is used to connect to the network 106 and data is communicated between the device 704 and the network 106 via the local connection 124 and the network interface 702.
With reference to
The methods and systems described above advantageously limit the amount of data that is sent via the local connection. In embodiments of the invention where the peripheral device is a data capture device it is desirable to compress the data captured by the peripheral device for transmission over both the local connection and the network. By providing the communication client in the data capture device, data may be encoded in dependence on conditions on the P2P network—for example the client engine may communicate network conditions e.g. channel bandwidth, to the voice and video encoders of the peripheral device—in this case the encoders may encode the data at a lower bit rate if the channel bandwidth is low. Furthermore the client engine may make further decisions that affect the data rate, for example the client may chose not to send data packets in dependence on network conditions. As such, when the network interface is in the TV (as shown in
Other technical advantages provided by executing the communication client in the data capture device include: (i) improved real-time scheduling of communication applications on a dedicated processor and operating system in the peripheral device (e.g. webcam) than on a general purpose PC; and (ii) improved synchronization between audio and video data streams in the communications system.
While this invention has been particularly shown and described with reference to preferred embodiments, it will be understood to those skilled in the art that various changes in form and detail may be made without departing from the scope of the invention as defined by the appendant claims. For example, it will be appreciated that embodiments of the invention described herein can be employed in an IM system, a VoIP system, a video call system or any combination thereof.
Number | Date | Country | Kind |
---|---|---|---|
0816271.1 | Sep 2008 | GB | national |
0816275.2 | Sep 2008 | GB | national |
0816276.0 | Sep 2008 | GB | national |
0816278.6 | Sep 2008 | GB | national |
0816279.4 | Sep 2008 | GB | national |
0816280.2 | Sep 2008 | GB | national |
0816281.0 | Sep 2008 | GB | national |
0907818.9 | May 2009 | GB | national |