This application claims priority under 35 USC §119 or §365 to Great Britain Patent Application No. 1413581.8, filed Jul. 31, 2014, the disclosure of which is incorporate in its entirety.
Packet-based communication systems allow the user of a device, such as a personal computer, to communicate across the computer network using a packet protocol such as Internet Protocol (IP). Packet-based communication systems can be used for various types of communication events. Communication events which can be established include voice calls, video calls, instant messaging, voice mail, file transfer and others. These systems are beneficial to the user as they are often of significantly lower cost than fixed line or mobile networks. This may particularly be the case for long-distance communication. To use a packet-based system, the user installs and executes client software on their device. The client software provides the packet-based connections as well as other functions such as registration and authentication.
Communications systems allow users of devices to communicate across a computer network such as the internet. Communication events which can be established include voice calls, video calls, instant messaging, voice mail, file transfer and others.
An instant messaging communication session allows a chat to be conducted between users of computer devices via a computer network. Each user can enter text into a field, actuate a send button and thereby create an instant message which is communicated to another user.
According to one aspect of the present disclosure there is provided a method implemented by a client application when executed on a user device during an instant messaging communication between said user device and at least one further device, the method comprising: transmitting a first message comprising media data over a communication network from said user device to said at least one further device; receiving a second message comprising further media data transmitted over said communication network from said at least one further device; determining that the media data and the further media data are of the same data type; and generating a composite media object based on the media data and the further media data in response to said determination and displaying the composite media object on a display of said user device.
According to a further aspect of the present disclosure there is provided a user device comprising: a display; a network interface configured to transmit and receive messages between the user device and at least one further user device over a communication network during an instant messaging communication; one or more processors configured to run a client application, wherein the client application is configured to: transmit a first message comprising media data over a communication network from said user device to said at least one further device; receive a second message comprising further media data transmitted over said communication network from said at least one further device; determine that the media data and the further media data are of the same data type; generate a composite media object based on the media data and the further media data in response to said determination; and display the composite media object on said display of the user device.
According to another aspect of the present disclosure there is provided a computer program product, the computer program product being embodied on a computer-readable medium and configured so as when executed on a processor of a user device to: transmit a first message comprising media data over a communication network from said user device to said at least one further device; receive a second message comprising further media data transmitted over said communication network from said at least one further device; determine that the media data and the further media data are of the same data type; generate a composite media object based on the media data and the further media data in response to said determination; and display the composite media object on a display of the user device.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
For a better understanding of the present disclosure and to show how the same may be put into effect, reference will now be made, by way of example, to the following drawings in which:
a illustrates a user terminal displaying a transmitted message; and
b illustrates a user terminal displaying a composite media object.
Embodiments of the present disclosure are described by way of example only.
Note that in alternative embodiments, user terminals can connect to the communication network 106 via an additional intermediate network not shown in
The user terminal 102 may be, for example, a mobile phone, a personal digital assistant (“PDA”), a personal computer (“PC”) (including, for example, Windows™, Mac OS™ and Linux™ PCs), a tablet computer, a gaming device or other embedded device able to connect to the communication network 106. The user terminal 102 is arranged to receive information from and output information to User A 104.
The user terminal 102 executes a communication client application 112, provided by a software provider associated with the communication system 100. The communication client application 112 is a software program executed on a local processor in the user terminal 102. The communication client application 112 performs the processing required at the user terminal 102 in order for the user terminal 102 to transmit and receive data over the communication system 100. The communication client application 112 executed at the user terminal 102 may be authenticated to communicate over the communication system through the presentation of digital certificates (e.g. to prove that user 104 is a genuine subscriber of the communication system—described in more detail in WO 2005/009019).
The user terminal 108 may correspond to the user terminal 102. The user terminal 108 executes, on a local processor, a communication client application 114 which corresponds to the communication client application 112 executed at the user terminal 102. The communication client application 114 at the user terminal 108 performs the processing required to allow User 110 to communicate over the network 106 in the same way that the communication client application 112 at the user terminal 102 performs the processing required to allow the User A 104 to communicate over the network 106. The user terminals 102 and 108 are end points in the communication system.
The messages exchanged during an instant messaging communication session are transmitted over the network 106. They may be transmitted via a network entity (e.g. a server) connected to the network 106 between the user terminals. Alternatively or additionally, the messages of the communication session may be transmitted on point-to-point routes between the user terminals (i.e. a route that does not go via any server in the communication system 100), as is known in the art
As shown in
The user terminal 102 is installed with the communication client application 112, in that the communication client application 112 is stored in the memory 226 and arranged for execution on the CPU 202.
Also running on top of the OS 214, is a location determination module 230. The location determination module 230 determines the location of the user terminal 102. The location determination module 230 uses geographic location technology for determining the location of the user terminal 102, in terms of geographic position relative to the surface of the earth; for example, a satellite based positioning system such as GPS (Global Positioning System, including potential variants such as assisted GPS or differential GPS), GLONASS (Global Navigation Satellite System) or Galileo; and/or trilateration (or more generally muiltilateration) relative to a plurality of different wireless base stations or access points having known locations; and/or a technique based on detecting signal strength relative to a known base station or access point. Other well-known methods may be used for the user terminal 102 to determine its location.
A method implemented during an instant messaging communication session between User A 104 associated with user terminal 102 and User B 110 associated with user terminal 108 over the communications network 106 will now be described with reference to
Reference will also be made to
The client user interface provided by the communication client application 112 executed on user terminal 102 is operable to display text input by User A 104 to be transmitted in a message of the instant messaging communication session but which has not yet been transmitted. Specifically, the communication client application 112 displays via the client user interface a message field 402 (shown in
At step S302, the communication client application 112 detects a selection by User A 104 to send the location of user terminal 102 to user terminal 108 based on detecting an interaction with the client user interface provided by the communication client application 112. The communication client application 112 may display via the client user interface a menu button (404 in
In response to the detection at step S302, the process 300 proceeds to step S304.
At step S304 the communication client application 112 requests location information from the location determination module 230. Upon receiving this request, the location determination module 230 determines the location of the user terminal 102 and supplies this location information to the communication client application 112. The communication client application 112 transmits a message comprising this location information (e.g. a first location message) over the communications network 106 to user terminal 108. The location information may comprise a longitude and latitude of the user terminal 102. The location information may additionally comprise an altitude of the user terminal 102.
At step S306, the communication client application 112 transmits the location information, with a request for map data via the network interface 224 to the mapping server 116. The mapping server 116 stores a large set of pre-generated map tile images covering the entire globe, each map tile has a z coordinate describing its zoom level and x and y co-ordinates describing its position. For each zoom level there is a predetermined number of map tile images to cover the entire globe, whereby the greater the zoom level, the greater the number of predetermined number of map tile images are required to cover the entire globe. A single map tile at a lower zoom level illustrates a larger geographic area than a single map tile at a higher zoom level.
The mapping server 116 determines, based on the received location information, a subset of map tile images of the large set of pre-generated map tile images stored by the mapping server 116. The mapping server 116 transmits the subset of map tile images to the communication client application 112 with an indication of the location of the user terminal 102 with reference to the subset of map tile images.
The communication client application 112 then displays a map 408 formed of the subset of map tile images on the display 204. The generated map provides a diagrammatic representation of an area of land or sea in the vicinity of the user terminal 102 at an appropriate scale. For example, the generated map may show roads, parks, railway lines, rivers, hospitals, landmarks etc. The communication client application 112 displays a visual indicator 410 (e.g. pointer, marker or icon) of the location of the user terminal 102 on the display 204 with reference to the displayed map 408. The communication client application 112 may also display the username 412 of User A 104, which is used to uniquely identify User A 104 to other users of the communication system 100, in close proximity to the visual indicator 410 to convey that the visual indicator 410 is indicating User A's location.
As shown in
In response to receiving the message comprising the location information of user terminal 102, the communication client application 114 executed on user terminal 108 transmits the received location information, with a request for map data to the mapping server 116 in order to retrieve a subset of map tile images with an indication of the location of the user terminal 102 with reference to subset of map tile images.
The communication client application 114 then displays map 408 formed of the subset of map tile images on the display 204 in the chat window 403 of the user interface provided by the communication client application 114.
In response to receiving the location message from User A 104, User B 110 may reply by sending the location of user terminal 108 to user terminal 102. That is, the communication client application 114 transmits a message comprising location information of user terminal 108 (e.g. a second location message) over the communications network 106 to user terminal 102.
At step S308, the communication client application 112 receives, via network interface 224 of user terminal 102, the message transmitted from user terminal 108 comprising location information of user terminal 108. Based on the communication client application 112 determining that message transmitted at step S304 and the message received from the user terminal 108 both comprise data of the same type (location information), the process then proceeds to step S310.
At step S310, the communication client application 112 determines whether the first location message transmitted at step S304 was transmitted during a current portion of the instant messaging communication session.
The communication client application 112 may perform step S310 in a number of ways.
For example, the communication client application 112 may perform step S310 by determining whether the number of non-location messages (messages not comprising location information) exchanged between the user terminal 102 and user terminal 108 during the instant messaging communication session between the first location message being transmitted at step S304 and the second location message being received at step 308 is greater than a predetermined number.
If the number of non-location messages exchanged between the first location message being transmitted at step S304 and the second location message being received at step 308 is not greater than a predetermined number, then the communication client application 112 determines that the first location message transmitted at step S304 was transmitted during a current portion of the instant messaging communication session. If the number of non-location messages (messages not comprising location information) exchanged between the first location message being transmitted at step S304 and the second location message being received at step 308 is greater than a predetermined number, then the communication client application 112 determines that the first location message transmitted at step S304 was not transmitted during a current portion of the instant messaging communication session.
The predetermined number is selected by the provider of the communication client application 112.
In another example, the communication client application 112 may perform step S310 by determining whether a predetermined amount of time has elapsed between the first location message being transmitted at step S304 and the second location message being received at step 308.
If the predetermined amount of time between the first location message being transmitted at step S304 and the second location message being received at step 308 has not elapsed, then the communication client application 112 determines that the first location message transmitted at step S304 was transmitted during a current portion of the instant messaging communication session. If the predetermined amount of time between the first location message being transmitted at step S304 and the second location message being received at step 308 has elapsed, then the communication client application 112 determines that the first location message transmitted at step S304 was not transmitted during a current portion of the instant messaging communication session.
If the communication client application 112 determines at step S310 that the first location message transmitted at step S304 was transmitted during a current portion of the instant messaging communication session, then the process 300 proceeds to step S312, otherwise the process 300 proceeds to step S314.
At step S312, the communication client application 112 is configured to display an indicator of the location of the user terminal 102 and an indicator of the location of the user terminal 108 in map 408 that was displayed at step S306.
In particular, the communication client application 112 transmits the location information of user terminal 102 and the location of user terminal 108 (received at step S308), with a request for map data via the network interface 224 to the mapping server 116.
The mapping server 116 determines, based on the location information of user terminal 102 and the location of user terminal 108, a new subset of map tile images of the large set of pre-generated map tile images stored by the mapping server 116. The mapping server 116 transmits the new subset of map tile images to the communication client application 112 with an indication of the location of the user terminal 102 and the location of the user terminal 108 with reference to the new subset of map tile images.
The communication client application 112 then displays the map 408 using the new subset of map tile images. The communication client application 112 displays a visual indicator 410 (e.g. pointer, marker or icon) of the location of the user terminal 102 and a visual indicator 414 (e.g. pointer, marker or icon) of the location of the user terminal 108, with reference to the map 408 as shown in
b illustrates the communication client application 112 displaying the username 412 of User A 104 in close proximity to the visual indicator 410 to convey that the visual indicator 410 is indicating User A's location, and username 416 of User B 110 in close proximity to the visual indicator 414 to convey that the visual indicator 414 is indicating User B's location,
It will be appreciated that if the user terminal 102 and user terminal 108 are located close together, the new subset of map tile images may be the same as the map tiles used to display the map at step S306. However if the user terminal 102 and user terminal 108 are not located close together, the new subset of map tile images will be at a different scale to the map tiles used to display the map at step S306.
At step S314, the communication client application 112 is configured to display an indicator of the location of the user terminal 108 in a second map (not map 408 that was displayed at step S306).
In particular, the communication client application 112 transmits the location of user terminal 108 (received at step S308), with a request for map data via the network interface 224 to the mapping server 116.
The mapping server 116 determines, based on the location information of user terminal 108, a subset of map tile images of the large set of pre-generated map tile images stored by the mapping server 116. The mapping server 116 transmits the subset of map tile images to the communication client application 112 with an indication of the location of the user terminal 108 with reference to the new subset of map tile images.
The communication client application 112 then displays a second map using the new subset of map tile images. The communication client application 112 displays a visual indicator (e.g. pointer, marker or icon) of the location of the user terminal 108 with reference to the second map 408.
In the embodiments described above, in order to supply accurate location information, the location determination module 230 on user terminal 102 may determine and supply location information of the user terminal 102 to the communication client application 112 periodically. This enables, any change in location (i.e. movement) of the user terminal 102 to be displayed on the map 408. Alternatively, after supplying location information to the communication client application 112, the location determination module 230 may only supply additional location information to the communication client application 112 if the location determination module 230 determines that the user terminal 102 has moved (i.e. changed location).
Similarly, the location determination module 230 on user terminal 108 may determine and supply location information of the user terminal 108 to the communication client application 114 periodically, which can be sent by the communication client application 114 to the communication client application 112. This enables, any change in location (i.e. movement) of the user terminal 108 to be displayed on the map 408 (shown in
It will be appreciated that step S310 advantageously prevents plotting the location of the second user terminal 108 in a map that is unrelated to a current portion of the instant messaging communication session. It will be apparent that plotting the location of the second user terminal 108 in a map that is only viewable in the chat window 403 by User A 104 scrolling back through past conversation activity is undesirable.
However, step S310 is not essential in embodiments of the present disclosure. That is, in response to the communication client application 112 determining that message transmitted at step S304 and the message received from the user terminal 108 both comprise data of the same type (location information), the process may proceed directly to step S312.
By displaying the map 408 in the chat window 403 of the user interface provided by the communication client application 112, continuity of the IM conversation can be maintained and user engagement is increased. Furthermore by plotting both locations of two users on a single map in a chat window, the location of the two users is presented for viewing in a simpler manner than prior art methods.
Whilst embodiments of the present disclosure are described above with reference to the first message transmitted at step S304 and the second message received at step S308 comprising location information, embodiments of the present disclosure extend to other types of media data other than location information.
During the instant messaging communication session, User A 104 can select an option presented by the user interface provided by the communication client application 112 to transfer a media file to User B 110 at the user terminal 108. In response to detecting this selection the communication client application 112 transmits a message comprising the media file over the communications network to user terminal 102
The communication client application 112 then displays the transmitted message in the chat window 403 of the user interface provided by the communication client application 112. The displayed transmitted message may comprise an icon which User A 104 may select to open (i.e. to view or to listen to) the media file.
In response to receiving the message comprising the media file from User A 104, User B 110 may reply by sending a message comprising a further media file from user terminal 108 over the communications network 106 to user terminal 102.
In response to determining that the message transmitted by user terminal 102 and the message received from the user terminal 108 both comprise data of the same type (e.g. audio, image, video), in accordance with the teachings above, the communication client application 112 is configured to generate a composite media file based on the media file in the message transmitted from user terminal 102 to user terminal 108, and the further media file in the message transmitted from user terminal 108 to user terminal 102.
The communication client application 112 displays the generated composite media file in the chat window 403 of the user interface provided by the communication client application 112. For example, the communication client application 112 may display an icon which User A 104 may select to open (i.e. to view or to listen to) the composite media file.
The media files may be audio files in which case, the communication client application 112 is configured to generate a composite audio file based on the audio file in the message transmitted from user terminal 102 to user terminal 108, and the further audio file in the message transmitted from user terminal 108 to user terminal 102.
The media files may be image files (comprising one or more images) in which case, the communication client application 112 is configured to generate a composite image file based on the image file in the message transmitted from user terminal 102 to user terminal 108, and the further image file in the message transmitted from user terminal 108 to user terminal 102.
The media files may be video files in which case, the communication client application 112 is configured to generate a composite video file based on the video file in the message transmitted from user terminal 102 to user terminal 108, and the further video file in the message transmitted from user terminal 108 to user terminal 102.
The generation of the composite media files may comprise joining the media file in the message transmitted from user terminal 102 to user terminal 108 with the further media file in the message transmitted from user terminal 108 to user terminal 102.
Alternatively, the generation of the composite media file may comprise merging media of the media file in the message transmitted from user terminal 102 to user terminal 108 with media of the further media file in the message transmitted from user terminal 108 to user terminal 102. The media processing techniques implemented by the communication client application 112 to generate the composite media file are configured by the provider of the communication client application 112.
In the example wherein the media files are audio files, the communication client application 112 may use known audio processing techniques to stitch together (interlace) portions of both audio files to generate the composite audio file. For example if the audio files both capture a song performed at a concert, the audio processing may enable the portions of the audio files with optimal audio characteristics (e.g. noise, volume, interference) to be stitched together to provide an enhanced composite audio file of the song.
In the example wherein the media files are image files, the communication client application 112 may use known image processing techniques to stitch together (interlace) images of both image files to generate the composite image file (e.g. an image slideshow). For example the image processing may detect images of the same scene in the image files and group these detected images together in the composite image file.
Similarly, in the example wherein the media files are video files, the communication client application 112 may use known video processing techniques to stitch together (interlace) portions of both video files to generate the composite video file. For example the video processing may detect portions of the video files comprising the same scene in the video files and group these portions together in the composite video file.
Embodiments of the present disclosure are described above with reference to the client user interface displaying content in an available area 400 of the display 204. As depicted in
The steps shown separately in
Generally, any of the functions described herein can be implemented using software, firmware, hardware (e.g., fixed logic circuitry), or a combination of these implementations. The terms “controller”, “functionality”, “component”, and “application” as used herein generally represent software, firmware, hardware, or a combination thereof. In the case of a software implementation, the controller, functionality, component or application represents program code that performs specified tasks when executed on a processor (e.g. CPU or CPUs). The program code can be stored in one or more computer readable memory devices. The features of the techniques described below are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
For example, the user terminals may also include an entity (e.g. software) that causes hardware of the user terminals to perform operations, e.g., processors functional blocks, and so on. For example, the user terminals may include a computer-readable medium that may be configured to maintain instructions that cause the user terminals, and more particularly the operating system and associated hardware of the user terminals to perform operations. Thus, the instructions function to configure the operating system and associated hardware to perform the operations and in this way result in transformation of the operating system and associated hardware to perform functions. The instructions may be provided by the computer-readable medium to the user terminals through a variety of different configurations.
One such configuration of a computer-readable medium is signal bearing medium and thus is configured to transmit the instructions (e.g. as a carrier wave) to the computing device, such as via a network. The computer-readable medium may also be configured as a computer-readable storage medium and thus is not a signal bearing medium. Examples of a computer-readable storage medium include a random-access memory (RAM), read-only memory (ROM), an optical disc, flash memory, hard disk memory, and other memory devices that may use magnetic, optical, and other techniques to store instructions and other data.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Number | Date | Country | Kind |
---|---|---|---|
1413581.8 | Jul 2014 | GB | national |