Patent Grant
7051019
This application relates generally to obtaining images from a database, and, more specifically, to returning chosen images from the database that are relevant to indicated text in a document.
In the past, when a user of an application program wished to add an image to a file created by that application, the user manually searched a database of images or surveyed a relatively large group of images organized into predetermined categories. Alternatively, the user might be required to pre-purchase access to a database of images prior to searching for an image relevant to the content of the document. In either case, the user would be required to indicate the relevant image by manually comparing a set of preselected images to the content of a document.
Therefore, it is desirable to provide a simple and intuitive facility for enabling a user to choose an image relevant to the content of a document. The facility could be a stand alone application program or integrated with an existing application program, e.g., a word processor, slide show presentation or email program. It is also desirable to provide a facility that enables the user to purchase a chosen image and indicate the quality and options associated with the purchased image. Also, the facility should enable the purchased image to be viewed and printed with any widely available application program.
In accordance with the present invention, a method for searching a database to obtain an object that is related to an indicated object, comprising: (1) automatically creating a query related to the indicated object, the query having a data structure that is recognizable by a search engine for the database; (2) providing the query to the search engine, the search engine searching the database for at least one object that is related to the indicated text; (3) returning the result from the query of the database, the result indicating when at least one object is related to the indicated text; and (4) producing a display of a related object, so that the related object may be associated with the indicated object. The indicated object and the related object may include data such as video, picture, sound, and text. Also, a qualification engine may be used to determine a context of the indicated object. The query for the database can be automatically created based on the context of the indicated object. Additionally, the related object may be purchased over a network. When complete financial information provided over a network to an electronic commerce service, the service can enable the purchase of the related object.
In accordance with another embodiment of the present invention, a method provides for obtaining an image from a database for insertion into a document, the image being related to indicated text, comprising: (1) enabling an automatic creation of a query related to the indicated text, the query having a data structure that is recognizable by a search engine for the database; (2) providing the query to the search engine, the search engine searching the database for an image that is related to the indicated text; (3) returning the result from the query of the database, the result indicating when at least one image is related to the indicated text; (4) enabling the display of at least one image indicated by the result from the query, a displayed image being selectable for insertion into the document; and (5) displaying a related image that is inserted into the document, so that the related image is associated with the indicated text in the document.
In accordance with other aspects of the other embodiment of the present invention, the method provides for employing a user interface component to automatically create the query for the database, the creation of the query being related to the indicated text. The user interface component enables the indicated text to be edited and chosen in the document. The indicated text may be chosen from within an application program that provides the document. A command can be chosen to create the query for the indicated text, the command may include a selection in a context menu, drop-down menu, pop-up window, dialogue box, toolbar and hot key. The indicated text may be chosen in another application program, e.g., a clipboard program, that is separate from the application program that provides the document.
In accordance with yet other aspects of the other embodiment of the present invention, the method provides for enabling a qualification engine to determine a context of the indicated text within the document. The context of the indicated text may be employed by the user interface component to automatically create the query for the database. The determined context of the indicated text may include text, template, sound, video, picture, use and user preference.
In accordance with still other aspects of the other embodiment of the present invention, the search engine may be a local search engine that employs the query to search for related images on a local drive that includes the database. The local drive may include a hard disk, floppy disk, tape drive, DVD and CD-ROM. The query of the database may include an XML data structure. Also, a network component may be employed to communicate with the search engine over a network that can include an intranet and the Internet. Additionally, a result component may be employed to manage the result of the query returned by the search engine, the result component enabling the parsing, storing and display of the result of the query. The result may be provided in a metadata format.
In accordance with other aspects of the other embodiment of the present invention, the method provides for requesting at least one related image from the database that is indicated by the result of the query, the related image being provided as binary image data. An image component may be provided to manage the storage and display of binary image data.
In accordance with yet other aspects of the other embodiment of the present invention, a navigation component may be employed to provide a control for displaying at least one related image. The navigation component enables a slide show display of a group of related images that are indicated in the result from the query. The navigation component enables the slide show to display other groups of related images that are indicated in the result from the query. The navigation component may include a control for determining a period of time that each related image is displayed in the slide show. Also, the navigation component can include a control for indicating the number of the related image in the group that is currently displayed in the slide show. Additionally, the navigation component may include a control for indicating each group of related images that are currently displayed in the slide show.
In accordance with yet other aspects of the other embodiment of the present invention, a help facility may be launched in response to an input and provide an explanation of a chosen topic. Also, a thumbnail of the related image may be displayed. Additionally, a digital watermark may be included with the related image which provides information related to the content of the related image. Furthermore, the query can include a cookie that may provide information related to a user.
In accordance with other aspects of the other embodiment of the present invention, the method provides for: (1) indicating a higher quality image of the related image is to be purchased over a network; (2) providing financial information to an electronic commerce service over the network, the electronic commerce service enabling the purchase of the higher quality image when the financial information is complete; and (3) inserting the purchased higher quality image into the document so that the higher quality image is displayed with the indicated text. An electronic shopping cart may be employed to store a potential purchase of the higher quality image. A parameter and use of the higher quality image may be indicated.
In accordance with yet other aspects of the other embodiment of the present invention, each time indicated text is employed to create the query, the method may automatically save the indicated text as an entry in a history file and enable at least one of the entries in the history file to be chosen for the currently indicated text. Also, a URL may be embedded in the related image pasted into the document. The URL can provide a link to information associated with the related image. Additionally, the method can automatically connect to the search engine for the database when the search engine is remotely located from the indicated text. Also, when no indicated text is provided, a word that is closest to a cursor may be determined and employed as the indicated text.
In accordance with another embodiment of the present invention, a method for electronically purchasing an image over a network, comprising: (1) automatically creating a query related to an indicated object, the query having a data structure that is recognizable by a search engine for the database; (2) providing the query to the search engine, the search engine searching the database for at least one image that is related to the indicated object; (3) returning the result from the query of the database, the result indicating when at least one image is related to the indicated object; (4) indicating a related image is to be purchased over the network, financial information being provided to an electronic commerce service that enables the purchase of the related image when the financial information is complete; and (5) when the related image is purchased, enabling a display of the related image, so that the related image may be associated with the indicated object.
In accordance with other additional aspects of the present invention, a system which implements substantially the same functionality in substantially the same manner as the methods described above is provided.
In accordance with yet other additional aspects of this invention, a computer-readable medium that includes computer-executable instructions may be used to perform substantially the same methods as those described above is provided.
The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:
The present invention enables a user to choose an image from a group of images that are determined to be the most relevant for indicated text. The present invention uses indicated text to find relevant images by automatically generating a query based on the indicated text for a database of images and displaying the query results as thumbnail images in a slide show. The user may insert any of the thumbnail images into a document or purchase a higher quality version of an indicated thumbnail image for use in the document. An electronic shopping cart may be provided for temporarily storing several higher quality images that may be purchased individually or as a group at a later date.
It is envisioned that the functionality of the present invention may be provided in different ways, including a stand-alone application program and an add on (extension) facility incorporated into an application program. For example, the present invention may be implemented as an executable file (EXE), as a Visual Basic control (VBX) or as a dynamic linked library (DLL). Also, the application programs that work with the present invention may include email, spreadsheet, word processor, slide show presentation, browser and editor.
Graphical User Interface
In a document window 102, the sentence (string) “Do you want to learn how to sail” is positioned in the upper left hand corner. The word “sail” 106 is highlighted (indicated) in the sentence and a context menu 104 is disposed adjacent to the indicated word. Alternatively, the context menu 104 may be disposed adjacent to a cursor. However, in this example, the context menu 104 for the word “sail” 106 is displayed when a button on a user interface pointing device, e.g., a mouse, is selected. The context menu 104 lists several commands including cut, paste, font and imagizer. When an imagizer command 108 is selected, a pop-up window 112 entitled “imagizer” is displayed by the Imagizer facility, as shown in
In
Another button 116, entitled “Paste Image Into Document,” is displayed adjacent to the thumbnail image 110A in the upper right hand portion of the pop-up window 112 and directly below the button 114. As described in greater detail below, the selection of the button 116 causes an indicated image, e.g., a currently displayed thumbnail image or a purchased higher quality version, to be pasted into the document adjacent to the indicated word “sail” 106.
A button 115, entitled “Send Picture Mail,” is displayed adjacent to the thumbnail image 110A in the uppermost right hand portion of the pop-up window 112, directly above button 114. The selection of the button 115 causes an email facility to create and send an email message that includes the indicated image from within the Imagizer facility. Although not shown, the email facility enables the user to enter an email destination and text to accompany the indicated image.
Another button 120, entitled “<<Back,” is displayed in the lower left quarter of the pop-up window 112 and below the slider control 118. Directly to the right of the button 120, another button 122, entitled “Play,” is disposed and a button 124, entitled “Next>>,” is positioned to the right of the button 122. The three button 120, 122 and 124 enable a user to navigate the slide show by selectively controlling the play, advance and replay of the thumbnail images. A button 126, entitled “More,” is displayed to the right of the button 124 (“Next>”) and the selection of the button 126 causes another pop-up window 128, entitled “More,” to be displayed, as shown in
Although not shown, it is envisioned that the functionality of the “<<Back” button 120 and the “Next>>” button 124 may be incorporated into a horizontal scrollbar that includes a pointer. The horizontal scrollbar could include separate buttons disposed at opposing ends of the scrollbar and the selection of a button would enable a forward or backward navigation of the group of thumbnail images. Also, the pointer might move along the scrollbar as each thumbnail image in the group is sequentially displayed. By selecting the position of the pointer on the scrollbar, the user could navigate through the group of thumbnail images.
A button 134, entitled “<Back 50,” is positioned directly below the text box 130 in the bottom left hand of the pop-up window 128 and another button 136, entitled “Next 50>,” is positioned directly below the search button 132 in the bottom right hand of the pop-up window. Also, a view box 135, entitled “Now Viewing”, is positioned horizontally between the buttons 134 and 136, which displays reference numbers for the group of relevant thumbnail images that are currently displayed in the slide show.
The slide show displayed in pop-up window 112 uses a predetermined number (group) of thumbnail images that are relevant to the indicated/entered text. However, the present invention enables more than one group of relevant images to be viewed in the slide show by using the buttons 134 and 136 to navigate the display of different groups of images. When the “<Back 50” button 134 is selected, this action will cause a previously displayed group of fifty relevant thumbnail images to be used in the slide show. Similarly, when the “Next 50>” button 136 is selected, the next group of fifty relevant thumbnail images will be displayed in the slide show.
Alternatively, a seamless slide show display (no 50 image pagination) of the entire group of thumbnail images may be provided. In this case, the buttons 134 and 136 would not be provided in the “More” pop-up window 128.
A slide control 138 is disposed in the bottom portion of the pop-up window 128. The manipulation of the slider control 138 will cause an increase or decrease in the amount of time each thumbnail image is displayed in the slide show. Also, a button 140, entitled “help,” is disposed below the slide control 138 in the lower left hand of the pop-up window 128. The selection of the help button 140 causes a help facility to display information regarding a chosen topic in an index. Another button 142, entitled “About Imagizer,” is positioned below the slide control 138 in the lower right hand of the pop-up window 128. The selection of the button 142 causes the display of information regarding the version of the Imagizer facility and other related matters. Also, a button 131, entitled “About Indicated Image”, is positioned in the upper left most portion of the pop-up window 128. The selection of the button 131 causes the display of related information that is included in metadata associated with an indicated image. For example, the Imagizer facility may display related information that includes an image identification number, author, original date that image of subject matter was captured, location and descriptive title. It is also envisioned that this information may be automatically displayed by the Imagizer facility along with a display of each related image.
Additionally, an embedded link (URL) may be automatically added to a pasted image. When the pasted image is selected, the embedded URL could provide a link to an information page associated with the pasted image on a remotely located server.
Generally, a thumbnail image may have a resolution of 100×100 pixels. However, the higher quality versions of the relatively low resolution thumbnail image can be provided at increasingly greater resolutions for a correspondingly larger cost, e.g., a 256×256 pixel image might be free, a 640×640 pixel image could cost $5.00 and a 1024×1024 pixel image might cost $20.00. It is envisioned that the actual cost of the images could be controlled/changed by a server that enables the Imagizer facility to access a database of images.
Flowing to a decision block 148, a determination is made whether text is indicated. If false, the logic moves to a block 156 where the “options” pop-up window 128 for the Imagizer facility is displayed as shown in
At the decision block 150, a determination is made whether the Imagizer facility can connect directly to the Internet. If false, the logic moves to a decision block 160 where a determination is made whether the Imagizer facility can connect to the Internet through an intranet connection. If the determination at the decision block 160 is false the logic will move to a decision block 162 where a determination is made whether a local server for searching a database of images is available. The Imagizer facility can determine if a local drive contains a database of images that might be relevant to the indicated text. Also, the Imagizer facility may prompt the user to indicate the path to a local image database.
If the determination at the decision block 162 is negative, the logic moves to a decision block 175, as shown in
Alternatively, when the determination at the decision block 150 is true, the logic moves to the block 152 where the Imagizer facility connects through the Internet to another search engine server that returns metadata results from a remotely located image database. Also, if the determination at the decision block 160 is true, the logic steps to a block 161 where an autoconnect facility is invoked to connect the Imagizer facility to the remotely located image database. The autoconnect facility can determine if a proxy server is available for connecting across the Internet to the remotely located image database. Alternatively, the autoconnect facility may initiate a dial-up telephone connection to an indicated Internet Service Provider (ISP) to create a connection to the remotely located image database. The autoconnect facility may prompt the user to provide a new telephone number for the ISP when a previously provided telephone number is not available.
The logic moves from the block 161 to the block 152 where the Imagizer facility connects with the other search engine server. An important aspect of the present invention is sending a query and receiving results over a network without having to launch a separate application program such as a browser. Additionally, the query may employ an extensible markup language (XML) data structure to communicate over a network with a search engine for searching an image database such as the CORBIS CORPORATION's CORBIS PICTURE EXPERIENCE at http://www.corbis.com.
The logic flows to a decision block 154 and determines if the metadata results from the query were returned. If false, the logic jumps back to the block 156 where substantially the same logic discussed above is repeated. However, if the determination is true, then the logic moves to a block 164 as shown in
The logic steps to a block 166 where the first group of thumbnail images are displayed in the slide show such as illustrated in pop-up window 128 of
Alternatively, when the determination at the decision block 168 is negative, the logic steps to a decision block 170 where a determination is made as to whether the purchase of a higher quality version of the thumbnail image is indicated. If false, the logic moves to a decision block 176 where a determination is made as to whether a request for the next group of thumbnail images is provided. If negative, the logic moves to the decision block 175 where substantially the same logic discussed above is repeated. However, when the determination at the decision block 176 is positive, the logic returns to the block 166 where the next group of 50 thumbnail images are displayed in a slide show and substantially the same logic discussed above is repeated.
Also, when the determination at the decision block 170 is positive, i.e., the purchase of a higher quality image is indicated, the logic moves to a block 172 where a browser program is launched to connect to an Internet based web site for performing an electronic financial transaction service that enables the purchase of a higher quality version of the indicated thumbnail image. The logic flows to a block 178 where the purchased higher quality image is inserted into the open document. Next, the logic advances to the block 166 where the same group of images are displayed in the slide show and substantially the same logic discussed above is repeated.
Although not shown, different parameters of the higher quality image may be chosen such as resolution and color. Also, the use of the higher quality image may be identified, e.g., personal, work and publication. The chosen parameters and use may be employed to determine the cost of purchasing the higher quality version of the indicated thumbnail image.
In one embodiment, the network component 184 may launch a separate browser program to manage the transfer of data over a network. In another embodiment, the network component 184 will manage the data transfer from within the Imagizer facility without having to launch the browser program. The network component 184 could send the query to a remotely located search engine, obtain the result of the query and download thumbnail images indicated by the query result. In yet another embodiment, a browser program could be launched by the network component 184 for managing the transfer of financial data to purchase of a higher quality version of an indicated thumbnail image from an electronic commerce server. In still another embodiment, the network component may manage the transfer of financial data to purchase a higher quality image without having to launch the browser program.
A “Get thumbnail images” request 218 is communicated by the client 204 to the server 206 indicating a particular group of thumbnail images. The server 206 provides a “Send thumbnail images” response 220 to the client 204 which includes the binary image data for the requested group of thumbnail images. Optionally, when the client 204 has requested a purchase of a higher quality image, a “Get Purchased HQ Image” request 222 will be provided by the client to the server. In reply, the server 206 will provide a “Send Purchased HQ Image” response 224 to the client 204 that includes the binary image data for the purchased higher quality image.
The electronic commerce server 200 provides a service that enables the conduct of commerce in goods and services, with the assistance of telecommunications and telecommunications-based tools. The client 204 may provide a credit card number to the electronic commerce server 200 to purchase a higher quality (resolution) version of an indicated thumbnail image which is retrieved from the database 198 by the server 206 and downloaded to the client. The electronic commerce server 200 may employ a digital signature and public/private key based encryption to complete the financial transaction.
As noted above, the present invention can be distributed for use on the computer system 10 as machine instructions stored on a memory media such as a floppy disk 24 that is read by the floppy disk drive. The program would then typically be stored on the hard drive so that when the user elects to execute the application program to carry out the present invention, the machine instructions can readily be loaded into memory 14. Control of the computer and selection of options and input of data are implemented using input devices 20, which typically comprise a keyboard and a pointing device such as a mouse (neither separately shown). Further details of the system 10 and of the computer comprising it are not illustrated, since they are generally well known to those of ordinary skill in the art. Additionally, although not shown, a computer system for the server 206 could be configured in substantially the same way as the computer system 10 illustrated here, albeit different in other ways.
In one embodiment, an electronic shopping cart may be used for the temporary storage of a potential purchase of a higher quality version of at least one indicated thumbnail image. An electronic shopping cart is an application program that enables on-line image selection and ordering processes. Typically, an electronic shopping cart is part of the interface between an Internet web site and its deeper infrastructure, e.g., an image database, allowing users to select merchandise; review what they have selected; make necessary modifications or additions; and purchase the selected merchandise. It is envisioned that the electronic shopping cart would temporarily hold a higher quality image until the purchase could be completed at a later date when final purchasing decisions are made and/or sufficient funds become available.
In another embodiment, the present invention may employ a separate qualification engine to assist in the creation of the query for the search engine to locate relevant images in an image database. It is envisioned that the qualification engine may determine the context of the indicated text, e.g., the qualification engine may examine the context of the indicated text within a sentence, paragraph, or entire document. Also, the qualification engine may employ the content of other images in the document and user preferences to help create the query.
In one embodiment, a digital watermark may be included with each image. A digital watermark is a represented by a pattern of bits inserted into a file for an image. The digital watermark may be designed to be completely invisible or visible and the actual bits representing the watermark tend to be scattered throughout the file in such a way that they cannot be identified and manipulated. The digital watermark can withstand normal changes to the file, such as reductions from lossy compression algorithms. It is envisioned that a digital watermark may be employed to identify copyright information and provide information related to the content of the image.
In yet another embodiment, a cookie identifying user preferences may be included with the query that is sent to the search engine. The search engine could use the cookie information to help provide metadata results that are related to the user preferences. Also, the cookie information may provide a user-specific set of results, such as a list of images that were previously pasted into documents, a history of previously ordered/purchased images, and a user-organized collection of images, e.g., a portfolio.
In yet another embodiment, the present invention may be employed to automatically generate a query for an indicated object and return results from a search engine that identifies any object that is related to the indicated object. The indicated object and the related object may include different types of data comprising text, pictures, video, and sound. For example, an indicated text object could be used by the present invention to cause a search engine to return different related objects that include text, video and sound (audio).
While the preferred embodiment of the invention has been illustrated and described, it will be appreciated that various changes can be made therein without departing from the spirit and scope of the invention.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5317508 | Okamoto et al. | May 1994 | A |
| 5404435 | Rosenbaum | Apr 1995 | A |
| 5493677 | Balogh et al. | Feb 1996 | A |
| 5761655 | Hoffman | Jun 1998 | A |
| 5893101 | Balogh et al. | Apr 1999 | A |
| 6021412 | Ho et al. | Feb 2000 | A |
| 6094649 | Bowen et al. | Jul 2000 | A |
| 6108674 | Murakami et al. | Aug 2000 | A |
| Number | Date | Country |
|---|---|---|
| 0 657 828 | Jun 1995 | EP |
