Patent Application
20110314133
The invention relates generally to a computer software routine which facilitates and expands the functionality of secure program routines running on a local client computing system by permitting such routines to interact with resources located at a remote server. The invention has particular use in increasing the utility of routines embodied in Java® applets, which, while running locally on a user's system, can nonetheless be configured to access resources from a remote server so as to circumvent security mechanisms otherwise prohibiting such applets from generating or reading local data structures.
A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the xerographic reproduction by anyone of the patent document or the patent disclosure in exactly the form it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
The use of the world wide web (WWW) is increasing rapidly, and so of course is the demand for intelligent systems and software which can permit users to better and more easily explore its offerings. To access information on the WWW, a user typically utilizes a browser program having a graphical interface (such as those offered by such companies as Sun, Microsoft, and Netscape) to establish an electronic connection between his/her local client computing system, and a remote server system located at an ISP (Internet Service Provider). After such connection is made, the user can then perform a number of operations through the browser, including such tasks as uploading/downloading files (including text, graphics, audio, video, etc.) and even executing programs located on such remote server. The ability to locally execute programs retrieved from a remote ISP is in fact one of the greater attractions and promises of the WWW. By having a repository which is accessible to millions of users simultaneously, program authors have an opportunity to expand the distribution and use of their products to a level far beyond that previously attainable. To avoid cluttering the user's local computing system with extraneous program and associated support files, and more importantly so as to provide a measure of protection and security to such user, many of such programs are now being implemented using a language known in the art as Java®, and, in particular, using programming tools known as “applets.” Java® applets are akin to Java® applications, but the former are specifically designed to interoperate with graphical user interfaces such as the conventional browsers mentioned above. Applets are extremely popular programs today also due to the fact that they provide program authors with the tools to create multi-media capable programs quickly and easily.
The ease of access to remote programs, however, also increases the possibility of potential security/privacy breaches at the user's local computing system. There is simply no practical method for a user to monitor the behavior of a remotely retrieved program to ensure that it is not improperly loading data to the user's system, or worse yet, capturing or altering private data from the user's local file system in his/her computing system. To address this concern, the authors of Java® intentionally constrained applets to operate in what is conventionally known as “sand box.” In other words, applets were imbued with substantial functionality, but they are not permitted, for example, to do such things as read or write from file systems outside their own domain (usually the file system of the remote server). So, in the case of a remotely downloaded applet embodying some code which the user desires to execute, such applet cannot read or write to the users local file system. For a discussion of this limitation of applets, please see “An Introduction to Computer Science—Using Java” by Kamin et. al., McGraw-Hill, p. 345 (1998). Another limitation, of course, is the fact that an applet cannot make use of data structures (such as graphics file formats for example) that are incompatible or unreadable with the browser within which such applet is executing.
Heretofore this limitation on applets has not posed a substantial barrier to the use of applet based programs on the WWW, although some attempts have been made to ameliorate the effects of this restriction. For example, some program designers have tried to exploit loopholes in the sandbox to trick the user's operating system into permitting the applet to gain local access and print a file on a local printer. These programming patches, however, are undesirable because they are system specific, and are susceptible to being closed down by Java® developers/standards enforcers. Others have suggested relaxing the constraints on applets which are known by the user to come from a verified “clean” source. By requiring an applet to pass through a certification process, some measure of security can be maintained. Again, nonetheless, such “exemption” process is also vulnerable to attack from would-be security invaders, and is therefore unattractive to users seeking the maximum security intended to be offered by the applet environment. It is also inconvenient to users, because they must still perform the task of evaluating whether a particular program is worthy of certification. This, too, reduces the incentives for users to use the WWW, since it requires too much effort for the ordinary user to know what is safe and what is unsafe.
Despite the fact that such efforts have been limited in the past, applicant has realized that the need for a satisfactory solution to the applet limitation is more crucial now. The inability of an applet to print to a local printer, for example, means that a local user is unable to capture his/her local input and/or contributions to an applet program displaying a remotely retrieved file. This limits the users enjoyment of the program, since any contributions are lost once the browser program is closed. For example, a user who has used an applet in his/her browser and accessed a stock price chart located on a remote server, can make annotations, mark-ups, etc., and see such contributions on a display screen. They cannot, however, print a hard copy of such image, and again this reduces significantly the user's enjoyment and the utility of such program.
An object of the present invention, therefore, is to provide a system and method for permitting a local resource constrained software routine running on a local client system to circumvent such restrictions by exploiting resources at a remote server location;
Another object of the present invention is to provide a system and method for permitting a user of a locally executing client internet browser to manipulate and perform operations on files containing a mixture of local and remote server data;
A related object of the present invention is to provide a system and method for permitting a Java® applet to be able to emulate local file type functionality to a user while still complying with applicable security restrictions on such types of routines when running on a client machine;
Yet another object of the present invention is to provide a system and method for transferring data between a local computing system and a remote server so that file access privileges on the latter can be exploited by a program running on the former;
A further object of the present invention is to provide a system and method for permitting a user to engage in an interactive session during which they may modify content of data files from different remote sources, and still be able to capture and preserve such efforts in a local file system of the user's computing system;
Another object of the present invention is to provide a system and method for a remote server to engage a user to perform the above mentioned objectives.
A data capture program of the present invention is characterized generally by the fact that it is restricted from accessing a first local file system, but does have access rights to a second file system at a separate computing system. When program data is generated during an interactive on-line session that cannot be transferred to such local file system, the program instead transmits such program data from the local computing system to the second file system. The data capture program is further configured to interact with a browser on the local computing system, which browser has access rights to the local file system. In this manner, the browser program can then access the program data from the second file system, and transfer the program data to an output and/or storage device in the local computing system.
In a preferred embodiment, the program data is generally associated with modified file data resulting from modifications made by a user to initial data from an initial data file. These modifications could include additions, deletions, edits, etc., of any initial data file type preferably retrieved from the remote system, such as a file containing chart data, an audio file, a video file, a text file, etc. During the interactive session involving modifications to chart data, for example, any updates by the user are displayed dynamically in a first window on a display device for ease of use. Such modifications, because of restrictions on the environment in which such are created, cannot normally be saved to the users local file system. Therefore, when the user wishes to save the results of such modifications, the modified file data is transferred as noted above to the remote server, where it is treated as described. Thereafter, the modified file data as retrieved from the remote server can be displayed in a second window to such user where it can be manipulated as desired by the browser program operating on the users machine. In this manner, a user can preserve and capture the results of their efforts during such interactive session on a local computing system for future reference.
To transfer the modified file data from the local computing system to the remote server, an encoder is preferably used to compress the file data into a standard file format readable by the browser program. In the case of a visual image data, for example, the preferred approach is to convert such file into a GIF or JPEG formatted file.
The data capture program of the present invention is preferably implemented with one or more Java applets which are in the form of a remote program stored at a remote server. These applets are initially downloaded during the interactive session from the remote server but then execute on the user's local computing system within a restricted environment within the user's browser program. The remote program is preferably configured such that it interacts with the browser program and performs at least the following operations:
(1) retrieving an initial data file from the remote server for use during the interactive session; and
(2) displaying information relating to the initial data file in a display window visible to the user; and
(3) accepting modifications to such initial data file during the interactive session; and
(4) saving such modifications to such initial data file in an modified data file;
(5) routing the modified data file to the remote server; and
In this fashion, the modified data file can be retrieved by the user at a later time and saved to the local file system by the browser program as noted above.
To further assist the user, the remote program also provides user command functions in the display window, which command functions can be used to generate the modifications more easily. As the modifications are made, the user is preferably given feedback to confirm the same (such as with a line drawn on a chart for example). The invention is also flexible in that more than one initial data file can be loaded from one or more remote servers and modified, thus permitting essentially unlimited editing capability.
A remote server of the present invention is configured to permit a user remote from such server to engage in an interactive on-line session with such server using the aforementioned remote program. In this way, the server can interact with the local machine as described above.
In a preferred embodiment of the remote program permitting a user to annotate chart data with visual labels and descriptions, an interactive portion of such program has a first executable routine for processing initial data from the initial data file obtained from the remote server and for storing first image data associated with the initial data in a window image data buffer. The browser program then causes the local computing system to display the first image data in a window on a display to the user. A second executable routine generates modified data based on the users modifying of the initial data with the visual labels and descriptions. A third routine then generates an modified data file based on the modified data, and then further transmits the modified data file to the remote server. Thereafter, the first routine, in cooperation with the browser, can also process the modified data file from the remote server, and thus the browser program can communicate the modified data file to a file system in the local computing system.
An interactive session between a local computing system and a remote server is therefore conducted in accordance with the present invention using the following preferred steps:
(a) accessing a remote program located on the remote server using a browser program located on the local computing system;
(b) executing the remote program on the local computing system;
(c) accessing an initial data file from the remote server with the remote program for use during the interactive session; and
(d) displaying an initial display image based on initial data from the initial data file; and
(e) modifying the initial data;
(f) saving the modified initial data as modified data; and
(g) transmitting an modified data file corresponding to the modified data from the local computing system to the server; and
(h) accessing the modified data file from the remote server with the remote program;
(i) communicating the modified data file to a file system in the local computing system using the browser program.
In the above described method, the modified data is derived from an initial data file (which may include more than one initial data file) and supplemental data input under control of a user of the remote program.
In a further variation, the updated data file is image data compressed using an encoder which translates a pixel stream into a file format usable by the browser program or another program having access to the local file system.
Data transfers of the present invention are accomplished through an on-line connection between a local computing system and a remote server preferably using the following steps:
(a) executing an interactive program on the local computing system, which interactive program coordinates with an on-line connection management program on such local computing system, and which interactive program further is restricted from accessing a local file system on such local computing system;
(b) accessing initial data information for use on the local computing system; and
(c) generating modified data information, which modified data information includes the initial data information and any additional data supplemental information added under control of a user of the interactive program; and
(d) saving the modified data information;
(e) transmitting the modified data information from the local computing system to the server; and
(f) accessing the modified data information from the remote server;
(g) communicating the modified data information to an output and/or storage device in the local computing system using the on-line connection management program.
Again, in a preferred embodiment, the modified data is compressed image data derived from dynamically modifying an initial data file. This image data is compressed using an encoder which translates a pixel stream into a file format usable by the second program. Nonetheless, the initial data file can be in a graphics file format, an audio file format, a text format, a video format, or some combination thereof.
An interactive, on-line session of the present invention permitting a user to engage in an interactive on-line session with a server using a remote program downloaded from the server but executing on the users local computing system, and wherein the remote program is restricted from accessing a file system on such local computing system, is accomplished as follows:
(a) coordinating communications between the server and a browser program also executing on the user's local computing system during the interactive on-line session, the browser program further including software routines for interacting with the file system on the users local computing system; and
(b) receiving data at the server consisting of modified information transmitted from the remote program;
(c) creating an modified file for the modified information at the server, which modified file is accessible by the remote program;
(d) transferring the modified file to the local computing system so that the browser program can utilize the modified file;
In this manner, the browser program can thereafter transfer such modified file to an output and/or storage device in the local computing system, such as a printer, a local file system, etc.
Although the inventions are described below in a preferred embodiment, it will be apparent to those skilled in the art the present invention would be beneficially used in many environments where it is necessary to provide security constrained software routines with additional functionality.
A preferred embodiment of a system 100 constructed in accordance with the present disclosure is shown in block diagram form in
Operating within code/data memory 110 under control of processor 105 is a browser program 150, and an applet 160 executing within such browser. This applet runs in a standard Java virtual machine (JVM) within the browser. This operational relationship is denoted by browser program 150 enclosing applet 160; it will be apparent to those skilled in the art that this visual representation is merely intended for illustrative purposes, and does not purport to describe the entirety of the relationship between the browser and the applet. Moreover, since this relationship is well-known in the art, see e.g., the Kamins reference discussed above, it is not necessary to replicate such details here. Browser program 150 (preferably one of the more robust versions known in the art, such as Netscape Navigator or Microsoft Explorer) is configured to operate within system memory 110, and is capable of interacting/communicating of course with the other components within system 102 in conventional fashion, as well as through internet link 142 with a remote server 180 located at an ISP site. Remote server 180 also includes many of the same components of system 102 (albeit in larger scale to accommodate the needs of several potential data requesters) such as an I/O interface 181, a processor 182, a server code/data memory 183, and a storage system 185. This system is used to store both an initial data file 186, and an modified data file 187, which items are discussed in more detail below.
Returning back to applet routine 160, it can be seen in
With the exception of the above details pertaining to applet 160, the other circuitry, structures and routines embodied in the block diagram of
As
To overcome this limitation, applet code 162 of the present invention includes instructions which permit the local client computing system 102 of
In any event, initial data from file 186 is stored within Applet Data Buffer 164 at location 165 (as shown in
Up until this point, the above description has merely described the typical operation of any prior art Java® applet program loaded from a remote site onto a local client computing system. In the present embodiment, nonetheless, a number of additional unique operative steps are implemented to provide such program user with functionality not previously available.
Referring again to
Returning to
In any event, after such conversion, at step 260 modified window data 166 is then uploaded by applet 160 to remote server 180, where it can be written to remote data storage device 185 in a location 187 as a modified data file. This happens by opening a connection to a programming script running on web server 180 at the site the user is connected to. In the preferred embodiment, this is a script is implemented in “perl” which is a conventional, well-known scripting language commonly used by those skilled in the art. Basically, the perl script running on server 180 merely fetches the next available image number and writes the data from modified window data file 166 (containing the compressed array) to it, with a designation such as chartxxx.gif, where xxx is the next available number available on server 180. Because this file is in compressed format, the transfer time between local computing system 102 and remote server 180 should be relatively reasonable. Furthermore, it is expected that improvements in high speed internet access will likely obviate any concerns about such types of relatively small scale data transfers.
At this point the captured user modified image data is now located on a server which can be accessed by browser program 150. The perl script on server 180, therefore, replies to applet 160 at step 265 with a URL indicating the location of the new file, such as “www.prophetcharts.com/graphs/chartXXX.gif” and applet 160 then opens a new browser window, which can be displayed to the user on display 125, which points to that image file. Because such file is also retrieved in a format usable by browser 150, it can be manipulated and treated like any other file so that, for example, at step 270 it can now be saved in electronic form on local storage device 130, or printed on a local output device 135. The user can then proceed to retrieve additional data files at step 230, or as noted above, simply go on to another operation.
As a housekeeping matter, and to save storage space, any such additional files stored on server 180 can be deleted after the user's session is over. It can be seen from the above description, therefore, that a server 180 is configured to permit a user remote from such server to engage in an interactive on-line session with such server using the aforementioned applet 160. In this way, server 180 can interact and exchange data with local computing system 102 as described above, and preserve any contributions made during such session for the users benefit.
While the above process appears somewhat circuitous, applicants have confirmed that it in fact proceeds very rapidly, and from the perspective of the user, does not involve an inordinate delay. Furthermore this process retains the integrity of the intended framework for Java® applets by ensuring that they do not access local resources. In this manner, users are guaranteed that the applets are kept in the Java® “sandbox,” and not permitted to perform operations that might compromise the users privacy or security. The present invention is extremely useful, therefore, for preserving and capturing the users edits, modification, supplementations of an applet window's image data during an interactive session with a remote server, which, absent the present teachings, would be otherwise lost resulting in reduced productivity, utility, user satisfaction, etc. It is expected that the present teachings can be used in any number of Java® applet based programs, therefore, where it is desirable to permit the user to interact with applet data and yet still permit the user to exploit the use of local resources without the restrictions normally imposed on applet code. The present invention opens up a new realm of possibilities for WWW programmers, web-site operators, on-line vendors and users of the WWW since it now allows data to be freely transferred and then modified under the users control in a manner that preserves the users contributions.
Assuming the user desires to capture the image data including the added trend line 330, the conversion steps described above beginning with step 255 (
As alluded to briefly above, in another variation of the present invention, applet 160 can also permit such user to import an additional data file 166′ from server 180, for example, representing data for a different stock so that a combined data image utilizing data from two different files 166 and 166′ can be observed simultaneously in an overlay fashion and manipulated by the user. Such data from the different files can be represented in different colors in applet data image window 320 to help the user differentiate the behavior of the two superimposed data sets for the selected two stocks. Such combined data from the two files (or more if desired) can then be converted into a suitable file format as explained above for the single image case, and then handled subsequently in the same manner.
In yet another embodiment, the modified data file can include information other than graphics data. For example, the user can download a standard audio file from the remote server, edit such audio file using any conventional audio file editor, and then save any modifications in the same manner as performed above for the image data. Then, instead of receiving back a GIF file, a WAV file, MIDI file, etc., could be returned by the server. Standard encoders for compressing audio information can be used for generating the modified file at the local computing system before sending on this file to the server for later retrieval. Similar editing sessions with other types of files retrieved during an on-line session and manipulated by the user could be captured as well. In this manner, a user's contributions associated with an audio file, a text file, a video file, or any kind of multimedia file can be preserved and stored on the local computing system, even when using restricted code such as Java applets.
Although the present invention has been described in terms of a preferred embodiment, it will be apparent to those skilled in the art that many alterations and modifications may be made to such embodiments without departing from the teachings of the present invention. Accordingly, it is intended that the all such alterations and modifications be included within the scope and spirit of the invention as defined by the following claims.
The present application is a divisional application of U.S. patent application Ser. No. 11/359,720 filed Feb. 22, 2006, the contents of which are hereby incorporated by reference into this application, which is a continuation of application of U.S. patent application Ser. No. 09/845,595 filed Apr. 30, 2001, the contents of which are also hereby incorporated by reference into this application, which is a divisional application of U.S. patent application Ser. No. 09/172,191 filed on Oct. 13, 1998, now U.S. Pat. No. 6,489,954, the contents of which are also hereby incorporated by reference into this application.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11359720 | Feb 2006 | US |
| Child | 13217663 | US | |
| Parent | 09172191 | Oct 1998 | US |
| Child | 09845595 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 09845595 | Apr 2001 | US |
| Child | 11359720 | US |
