Patent Grant
8521830
1. Statement of the Technical Field
The present invention relates to the field of image distribution and more particularly to the distribution of application imagery during an application sharing session between a multiplicity of application viewers.
2. Description of the Related Art
The rapid development of the Internet has led to advanced modes of communication and collaboration. Using the Internet as a backbone, individuals worldwide can converge in cyberspace to share ideas, documents and images in a manner not previously possible through conventional telephony and video conferencing. To facilitate collaboration over the Internet, a substantial collection of technologies and protocols have been assembled to effectively deliver audio, video and data over the single data communications medium of the Internet. These technologies include instant messaging, Internet telephony and application sharing.
In conventional application sharing, an application host can distribute imagery of an application operating in the host to one or more application viewers distributed about the computer communications network. The imagery can include not only the screens rendered in association with the operation of the shared application, but also the visual presentation of mouse pointer movements and the like. Generally, speaking, however, the imagery can include only discrete “snap-shots” of the actual display of the operating application in the host system. In this way, the application viewers can be given the appearance of sharing an application, though each viewer merely views a shadow rendering of only a portion of the operation of the shared application.
As it will be apparent to the skilled artisan, the transmission of imagery across the computer communications network to a multiplicity of viewers can produce substantial problems which relate not only to the timing of delivery of the distributed image frames to the viewing population, but also in delivering the imagery to multiple disparate viewing clients. In this regard, while some viewing clients may enjoy substantial communications bandwidth and access to vast processing resources, other viewing clients may suffer from limited bandwidth and inferior processing resources. Accordingly, accommodating “slower” viewing clients without affecting the viewing experience of “faster” viewing clients can be challenging if not impossible.
The problem of accommodating multiple, disparate viewing clients can be exacerbated when considering that not all viewing clients begin a viewing session simultaneously. More particularly, in the prototypical circumstance, the delivery of viewing frames of a shared application can be synchronized so that all viewing clients view the application in the same state at the same time. Synchronization can be particularly important when supporting a collaborative effort such as an e-meeting where all participants presume that the shared application appears identically for all e-meeting participants.
Just as in the case of a human-to-human meeting, however, in the world of the e-community, some meeting participants fail to “arrive” at an e-meeting in a timely manner. Where multiple participants engage in the e-meeting, however, it may not be feasible to await the arrival of a “late joiner”. In this case, the e-meeting must commence in the absence of the late joiner. When the late joiner does finally “arrive” for the e-meeting, the distribution of further imagery relating to a shared application must halt pending the synchronization of the view of the application with the display of the late joiner. Accordingly, accommodating the late joiner can produce an unwanted delay in the distribution of additional updated frames to the existing meeting participants.
The present invention addresses the deficiencies of the art in respect to distributing application imagery in an application sharing session and provides a novel and non-obvious method, system and apparatus for flexible application sharing. In a system for flexibly distributing imagery in an application sharing session, an image cache can be disposed between an application sharing host and a plurality of application sharing viewers. Additionally, a multipoint communications server can be disposed between the image cache and the application sharing viewers and can be communicatively linked to the application sharing host. Importantly, a pull-based subscription model can be implemented in an image cache server hosting the image cache. In particular, the model can have a configuration for registering respective ones of the application sharing viewers to receive notifications of available updated imagery for a shared application.
In a method for flexibly distributing imagery for a shared application in an application sharing session, an image frame update can be cached for a shared application. Registered ones of a plurality of application sharing viewers can be notified of the image frame update. Consequently, the cached image frame update can be served to requesting ones of the application sharing viewers. In a preferred aspect of the invention, the cached image frame update can be partitioned into multiple sub-sections and the multiple sub-sections can be cached. As a result, the serving step also can include comparing an already served image frame in the requesting ones of the application sharing viewers to the cached image frame update. As a result, only changed ones of the multiple sub-sections can be served to the requesting ones of the application sharing viewers.
In another preferred aspect of the invention, the serving step can include detecting a slow one of the application sharing viewers, and serving a newer image frame to the slow one of the application sharing viewers responsive to a request by the slow one of the application sharing viewers for an older image frame. Similarly, in yet another preferred aspect of the invention, the serving step can include detecting a late joining one of the application sharing viewers, and serving a pre-defined layout of the shared application to the late joining one of the application sharing viewers in order to facilitate a sequential retrieval by the late joining one of the application sharing viewers of already distributed image frames for the shared application.
Additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The aspects of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
The accompanying drawings, which are incorporated in and constitute part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. The embodiments illustrated herein are presently preferred, it being understood, however, that the invention is not limited to the precise arrangements and instrumentalities shown, wherein:
The present invention is system, method and apparatus for the flexible distribution of imagery in an application sharing session. In accordance with the present invention, an image cache can be disposed between an application sharing host and a multiplicity of application sharing viewers. Images from a shared application can be pushed to the cache at a rate preferred by the application sharing host. By comparison, the cached images can be pulled from the cache by individual ones of the application sharing viewers at a rate preferred by the individual application sharing viewers. In this way, the characteristics of operation of each individual application sharing viewer cannot affect the application sharing process experienced by others of the individual application sharing viewers.
In further illustration of the specific preferred aspects of the present invention,
More particularly, the image cache 140 can push imagery 120 and image metadata 130 regarding the pushed imagery 120 to the image cache 140 at a rate pre-specified by one of the image cache 140 and the application sharing host 110. Either the application sharing host 110 or the image cache 140, upon receipt of pushed imagery 120, can provide an update notification 170 to the application sharing viewers 180 to indicate that new imagery 120 has been uploaded to the cache. In response, the individual application sharing viewers 180, when permitted by the operation of the individual application sharing viewers 180, individually can post image requests 160 to the image cache 140 to retrieve the new imagery 120. Responsive to receiving the posted image requests 160 from individual ones of the application sharing viewers 180, the image cache 140 can serve cached imagery 150 to the individual ones of the application sharing viewers 180.
Importantly, the image cache 140 need not necessarily serve cached imagery 150 which corresponds to the image requests 160 provided by the individual ones of the application sharing viewers 180. Rather, the image cache can compare the state of the shared application in the application sharing host 110 by way of inspecting the available imagery 120 in the image cache 140 to the imagery 150 which already had been distributed to the individual ones of the application sharing viewers. When appropriate, particular frames representative of a past state of the shared application in the application sharing host 110 can be skipped in favor of subsequent frames. In this way, slower ones of the individual application sharing viewers 180 and late joiners among the application sharing viewers 180 can be accommodated without impacting the performance of application sharing among others of the application sharing viewers 180.
To further enhance the flexibility of the distribution of shared application imagery to varying types of application sharing viewers, the present invention can include a configuration for partitioning each image into a multiplicity of subsections. The partitioned image 190 can be stored within the image cache 140 and can be distributed to requesting ones of the application sharing viewers 180 on demand. In this regard, image metadata 130 can be associated with each separate sub-section of the partitioned image 190 so that each separate sub-section can be individually identified. When one of the application sharing viewers 180 requests an updated image 150, the cache 140 can serve only that portion of the requested image 150, stored as a partitioned image 190, which has changed since the last time the image had been distributed to the application sharing viewer 180.
It will be apparent to the skilled artisan that the novel and nonobvious arrangement illustrated in
To further illustrate the inventive arrangements within the context of several different distribution scenarios during an application sharing session,
Once the cache server 220 has received an updated image frame for distribution to the application sharing viewers 240, an image update signal can be forwarded to the application sharing viewers 240 by way of the multipoint communications server 230. Notably, the image update signal can be initiated by either the application sharing host 210 or the cache server 220. In any event, once an application sharing viewer 240 receives an image update signal, the application sharing viewer 240, at its discretion can request an image update. Specifically, as shown in the second scenario B, the application sharing viewer 240 can forward a request to receive an image update from the cache server 220 which can respond with the requested image which the application sharing viewer 240 can render accordingly.
In the third illustrated scenario C, a slow or late joining application sharing viewer 250 can attempt to request an image which has become outdated in respect to other updated frames available in the cache server 220. In this regard, it can be presumed that the application sharing host 210 has produced shared application imagery at a faster rate than the imagery can be consumed by the slow application sharing viewer 250. In this case, the slow application sharing viewer 250 can receive an update signal for an Nth image of the shared application. In response, the slow application sharing viewer 250 can request the distribution of the Nth image.
Significantly, the cache server 220, recognizing the “slowness” of the slow application sharing viewer 250 can forward to the slow application sharing viewer 250 not the Nth image of the shared application, but the Nth+1 image which can be rendered in the application sharing viewer 250. When the slow application sharing viewer 250 subsequently receives an update signal indicating the availability of the Nth+1 image, the slow application sharing viewer 250 can request the Nth+1 image. The cache server 220, however, can respond only by indicating that the requested image already is available for viewing within the slow application sharing viewer 250. Accordingly, it is to be understood that the slow application sharing viewer 250 need not receive every image update, but only as many updates as possible.
Finally, in scenario D, a late joining application sharing viewer 250 can join an application sharing session in progress. To facilitate the late joining of the application sharing viewer 250, the late joining application sharing viewer 250 can obtain a pre-defined layout of the shared application so as to become familiarized with the images to be distributed in the course of application sharing. Using the pre-defined layout, the late joining application sharing viewer 250 can sequentially request the previously distributed images from the cache server 220, rendering each image before requesting the next. Alternatively, the late joining application sharing viewer 250 can acquire from the application sharing host 210 enough image metadata to identify those images which are to be fetched from the cache server 220.
From a review of the foregoing description of the preferred embodiments, the skilled artisan will recognize several departures from convention methods and systems for application sharing. First, late joiners to an application sharing session now can be accommodated gracefully without impinging upon the flow of application sharing with other application sharing viewers in the session. Second, images can be cached for retrieval by application sharing viewers. To the extent that a slow viewer cannot keep pace with other viewers, the slow viewer can skip some updated images. Finally, as the system of the invention can be characterized as a pull-system, the system can scale to accommodate a substantial number of viewers without impacting the performance of any one viewer.
The present invention can be realized in hardware, software, or a combination of hardware and software. An implementation of the method and system of the present invention can be realized in a centralized fashion in one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system, or other apparatus adapted for carrying out the methods described herein, is suited to perform the functions described herein.
A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which, when loaded in a computer system is able to carry out these methods.
Computer program or application in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following a) conversion to another language, code or notation; b) reproduction in a different material form. Significantly, this invention can be embodied in other specific forms without departing from the spirit or essential attributes thereof, and accordingly, reference should be had to the following claims, rather than to the foregoing specification, as indicating the scope of the invention.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5581702 | McArdle et al. | Dec 1996 | A |
| 5586264 | Belknap et al. | Dec 1996 | A |
| 5758079 | Ludwig et al. | May 1998 | A |
| 6167438 | Yates et al. | Dec 2000 | A |
| 6269080 | Kumar | Jul 2001 | B1 |
| 6570590 | Dubrow et al. | May 2003 | B1 |
| 6584493 | Butler | Jun 2003 | B1 |
| 6973455 | Vahalia et al. | Dec 2005 | B1 |
| 6986018 | O'Rourke et al. | Jan 2006 | B2 |
| 7369515 | Salesky et al. | May 2008 | B2 |
| 20010051985 | Haverstock et al. | Dec 2001 | A1 |
| 20010052015 | Lin et al. | Dec 2001 | A1 |
| 20020016718 | Rothschild et al. | Feb 2002 | A1 |
| 20020055891 | Yang | May 2002 | A1 |
| 20020069282 | Reisman | Jun 2002 | A1 |
| 20020099853 | Tsujii et al. | Jul 2002 | A1 |
| 20040064574 | Kurauchi | Apr 2004 | A1 |
| 20040080504 | Salesky et al. | Apr 2004 | A1 |
| 20050033817 | Wei | Feb 2005 | A1 |
| 20050128511 | Hornback et al. | Jun 2005 | A1 |
| 20060161624 | Montgomery et al. | Jul 2006 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20050138228 A1 | Jun 2005 | US |
