Patent Grant
8341136
This invention relates generally to Internet search engines, and more particularly to a search engine for retrieval of video and graphics over the Internet.
Over the past few years, the amount of content available over the Internet has grown tremendously. Much of the Internet's content is distributed widely across many locations. Therefore, a search engine and/or navigator is required for meaningful retrieval of information. There are numerous search engines and navigators available to search for specific content on the Internet.
Current search engines and navigators are designed to search for text within the text contained in web pages or other files on the Internet or a written description of the web page to be located. A search engine stores the location of a given piece of information and various descriptions of the information in a database that is searchable by a user. Often, the information to be located is itself descriptive.
A search engine may rely upon the content providers to establish both the location of the content and descriptive search terms to enable users of the search engine to find the content. Alternatively, the process of search engine registration is automated. A content provider places a “meta-tag” into their web page or other content. The “meta-tag” contains keywords that a search engine can index the page location upon to enable searching. The “meta-tag” is not displayed by a page reader's web browser software.
A search engine may use a web crawler to search for content on the Internet. The web crawler automatically “spiders” through web pages by following every link from one web page to other web pages until all of the links are exhausted. As the web crawler spiders through pages, the web crawler correlates the descriptive tags on each page viewed with the location of the page to construct a searchable database.
Recently, advances in Internet access have enabled more users to create video and graphic content and to distribute that content over the Internet. Furthermore, video streams are becoming more and more common as a form of content on the Internet. As with text and file content, the increasingly large amount of video and graphic content is distributed widely across many locations, thus creating the need for a search engine and/or navigator for meaningful retrieval of information.
The need to be able to search for video or graphics will only continue to grow as streaming video becomes more available and popular over the Internet or similar information transferal systems, such as on-line services, Intranets, etc. Furthermore, as personal computers and other office or home equipment develop larger and larger memory and storage capacity, the storage of video streams will become even more common and the need for a video search engine (“VSE”) will increase.
Video and graphic content does not lend itself to easy searching because video and graphics often do not contain any text description that can be searched with a currently available navigator or search engine. Furthermore, there is no uniform format for identifying and describing a video or a graphic. Therefore, currently available search engines and browsers are inefficient and unusable for meaningful retrieval of video and graphic information over the Internet. There is currently no easy or direct way to search for a video or to search, display, select, or take action on, video streams. As the usage of video streams becomes even more common, there is a need for a centralized navigator and search engine for video streams.
One object of the present invention is to provide a search engine for graphics and video.
The present invention provides a method of searching for graphic or video files having corresponding locators used to locate such graphic or video files using a computer. The method comprises creating an identifier of searchable file information from identifier information related to a graphic or video file and storing the identifier and the locator for the graphic or video file in a database. The method further comprises receiving search criteria, and searching the identifiers in the database in order to select content matching the request of the user. The results of the search are sent or displayed for the user. In another embodiment of the present invention, video and graphic content is provided to a user based on user submitted criteria.
In a preferred embodiment of the present invention, identifiers are created by searching an area within a web page near a graphic or video file and by searching an area within web pages near links to a graphic or video file for searchable identification terms.
The present invention provides a system for searching for graphic or video files having corresponding locators used to locate such graphic or video files. The system comprises a means for creating an identifier containing searchable file information from identifier information related to a graphic or video file. The system further comprises a database for storing an identifier, as well as an input for receiving search criterion from a user. The system uses a search engine to search the identifiers in the database. The system sends or displays the results of the search for the user.
These and other aspects of the present invention are more readily understood when considered in conjunction with the accompanying drawings and the following detailed description.
An overview of a video search engine (“VSE”) in accordance with the present invention is illustrated in
An overview of a process in accordance with one embodiment of the present invention is shown in
Graphic or video content is created using specialized software and hardware, as well as other equipment such as a camera. For example, a graphic may be created by scanning a picture with a scanner, or by creating a freehand drawing in a drawing program. A video may be created for example by using a digital video camera, or by digitizing analog video using a video capture board in a computer. As used herein the term video includes animation.
In an embodiment of the present invention, the process for searching and manipulating video and graphic content over the Internet comprises a system of identifiers. An identifier is created for each graphic or video file from pieces of information herein called identifier information. As shown in the examples below, an identifier for a video file comprises one or more of the following: a text string or other searchable attribute of a whole, segment, frame, or sub element of a video. The identifiers are used to consistently identify a whole, segment, frame, or sub element of a video respectively. An identifier for a graphic file comprises a text string or other searchable attribute of the graphic file.
Examples of identifiers are shown below. Example 1 is a whole video identifier. Example 2 is a video segment identifier. Example 3 is a video frame identifier.
A whole video identifier comprises one or more of the following:
A video segment identifier comprises one or more of the following:
A video frame identifier comprises one or more of the following:
In a preferred embodiment, the textual elements of the identifier are standardized to facilitate creation, searching and archiving. In additional embodiments, one or more of the textual elements of the identifier is in coded, compressed, or encrypted form. Additionally, the textual elements in coded form utilize static and/or dynamic dictionaries.
In an embodiment of the present invention, the process for integrating identifier information into a video or graphic file is a part of the creation of the graphic or video file. The process is resident in the software or hardware used to create the content, and integrates identifier information into the graphic or video automatically as the video or graphic is saved to a storage device, such as a hard disk, optical disk, floppy disk or similar device.
In an alternative embodiment of the present invention, a process for integrating identifier information into a video or graphic file is performed after the creation of the graphic or video. Already created graphic or video files are submitted to a process server along with desired identifier information and the files are modified with identifier information. The modified file is saved to a storage device, such as a hard disk, optical disk, floppy disk or similar device.
The process provides a means of attaching identifier information to a video in a manner that does not interfere with the viewing clarity of the video. In an embodiment of the present invention, the process integrates textual identifier information into the filename of the video stream or graphic file. In an alternative embodiment of the present invention, the identifier information is located in a part of the file that is not displayed by viewer software, such as at the beginning or the end of the file.
In a preferred embodiment of the present invention, as shown in
In another embodiment of the present invention, the video content comprises a stream of packets containing the elements of the video. Each packet contains informational headers indicating the content contained in the packet. Identifier information is placed into informational packets that are located within a video stream. These informational packets contain headers identifying them as non-video packets. The information packets are not displayed by the video viewer, but are used by the identifier creation process to acquire identifier information for each whole, segment, or frame of the video.
In an embodiment of the present invention, the content comprises graphic or video files wherein the identifier information is not located inside of the file itself. To acquire identifier information, the process searches the content surrounding the graphic or video on the content provider's computer. The process also searches the content of a web page surrounding links to the graphic or video, or receives identifier information directly from the content provider. Alternatively, the identifier information is placed in a file accompanying the graphic or video file.
In an embodiment of the present invention, the process generates identifiers to be searched by automatically locating video streams or graphics on the web, reading any associated text surrounding any links to the video stream or graphic, and using the text to create an identifier or identifiers for a video or graphic file. The process also searches through web sites that contain video streams or graphics, and using pointers in such web sites that open or click to the video stream or graphic or web page containing the video stream or graphic, and “reverse locates” any text description of the video stream. Additionally, a database of links contained in a large number of other web sites from throughout the world wide web, such as a typical database created by a web spider or web crawler, is searched for other web pages with links to the video or graphics file. After generating an identifier, the process stores the identifier in a database. In a preferred embodiment of the present invention, the database is stored in a storage device, such as a hard disk, optical disk, floppy disk or similar device.
For example, when a link is used to open a video stream, the process automatically searches to find all of the web pages where the link is contained, whether from the same web site as the video or graphic file or other web site. Once a link to the graphic or video is found, the process searches in the “neighborhood” around the link to acquire relevant text information. The text in the “neighborhood” or area around the link is likely to contain descriptive and informational terms of interest. The closer to the link, the more likely the text is to contain relevant information. Text within the same paragraph, column, or general page area as the link, is likely to contain some information that can be placed into a searchable identifier. When more than one web page is found that contains links to the video or graphic, a comparison is performed on the “neighborhood” text from the various web pages and terms or phrases that appear on more than one web page. Such terms in common are given more weight in the identifier for the video stream. Further, the more of these web pages that include the same terms, the more weight is given to these terms in the identifier.
In a preferred embodiment of the present invention, text parsing techniques are used to identify relevant lines of text to incorporate into the textual description and other textual fields such as a date of creation, size, or category of the video in the identifier. Alternatively, keywords are used to locate and incorporate relevant information into the textual description and other textual fields in the identifier.
In an additional embodiment of the present invention, the process solicits a user to submit information regarding a graphic or video file and then generates one or more tags to be inserted into the area surrounding the link to the graphic or video file. Currently, meta-tags exist for describing a page of content, but additional specialized tags may be created to contain identifier information for other specific types of content. Once the tags are inserted into the area surrounding the link, the automatic identifier creation process creates a searchable link to the video or graphic.
In an additional embodiment of the present invention, the process solicits a user to submit information regarding a graphic or video file. Using the user provided information along with the location of the file, the process generates an identifier, and saves the identifier in a database. Alternatively, the process solicits a user to submit information regarding a graphic or video file and then generates a file that contains identifier information about the graphic or video file to accompany the graphic or video file.
An embodiment of the present invention allows a user to search through identifiers to locate one or more graphics or videos. The process locates and retrieves video and graphic files by searching through the identifiers in a database for desired attributes and uses the location information in the identifier to acquire the file.
In a preferred embodiment of the present invention, as shown in
In another embodiment of the present invention, the results page provides a link to a detailed information page 44. The process caches a portion of a video, or an attribute of the video, such-as an audio segment, or at least one video frame or sub-frame, to enable a user to further identify content. Additionally, the process aggregates the identifiers for display to users on the detailed information page.
In a preferred embodiment of the present invention, the process assembles a “video guide” that comprises: a text description of a video, a URL or other location indicator for locating a whole, segment, or frame of a video, an audio sample from the video, and “teaser” frames or segments of a video to assist in the identification or promotion of a video. In an embodiment of the present invention, the “video guide” is resident on a central server, in a local unit, or a combination of both.
In a more preferred embodiment of the present invention, the “video guide” enables a user to locate, display, download, and record a selected whole, segment, frame, or sub-component of a video. Moreover, the “video guide” allows a user to conduct all of the above operations, as well as finding, selecting, grouping, erasing, concatenating, segmenting, and integrating a class of videos. In a preferred embodiment of the present invention, the “video guide” is a software, firmware, or hardware feature resident in a personal computer or similar device capable of storing video streams.
In an additional embodiment of the present invention, the process integrates video or graphic information with a conditional access system or a payment system. The identifier for the video or graphic contains a field indicating whether there is a conditional access or payment system. If there is a conditional access or payment system, then the identifier contains information about the access site or payment system and/or a link to the access site or payment system. In a preferred embodiment of the present invention, the process solicits the user for the authorization information or payment, and only upon proper authorization allows the user to access the video or graphic.
In an additional embodiment of the present invention, the process integrates video stream information with television programs that are receivable on the same device enabling the video or graphic search. If there is a link to a television show, the identifier contains a link to that televisions show and conveys that information to a user. Additionally, the process enables the user to search for video streams and graphics using television links as a searchable attribute.
In an additional embodiment of the present invention, the process integrates video stream information with other information, such as guides or lists of other items associated with the video stream. Items associated with the video or graphic include products, services, and web sites. Additionally, the process provides links to other information, whether or not that information is related to the video.
In an additional embodiment of the present invention, the process allows the user to customize, program, or set parameters for the usage of the process, such as smart agent filtering, a programmed search of certain types of video streams already in existence, and programmed “alert” searching for types of video streams coming into existence in the future. Additionally, the process provides a means of filtering, selecting or blocking whole video files, video segments, and video frames in accordance with user controls, such as the blocking of violence or nudity from a video.
The preceding description has been presented with reference to the presently preferred embodiments of the invention shown in the drawings. Workers skilled in the art and technology to which this invention pertains will appreciate that alteration and changes in the described processes and structures can be practiced without departing from the spirit, principles and scope of this invention.
Accordingly, the present invention provides for a video search engine. Although this invention has been described in certain specific embodiments, many additional modifications and variations would be apparent to those skilled in the art. It is therefore to be understood that this invention may be practiced otherwise than as specifically described. Thus, the present embodiments of the invention should be considered in all respects as illustrative and not restrictive, the scope of the invention to be determined by the claims supported by this application and their equivalents rather than the foregoing description.
This application is a continuation of U.S. patent application Ser. No. 11/894,684, filed Aug. 20, 2007, now U.S. Pat. No. 7,822,760, which is a continuation of U.S. patent application Ser. No. 11/021,478 filed Dec. 22, 2004, which is a continuation of U.S. patent application Ser. No. 09/452,287 filed Nov. 30, 1999, now U.S. Pat. No. 6,859,799, which claims priority to U.S. Provisional Application No. 60/110,299, filed Nov. 30, 1998,all of which are hereby incorporated by reference in their entireties.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4985887 | Mizuhara et al. | Jan 1991 | A |
| 5247575 | Sprague et al. | Sep 1993 | A |
| 5329379 | Rodriguez et al. | Jul 1994 | A |
| 5474000 | Mizuno et al. | Dec 1995 | A |
| 5475835 | Hickey | Dec 1995 | A |
| 5491820 | Belove et al. | Feb 1996 | A |
| 5517605 | Wolf | May 1996 | A |
| 5565922 | Krause | Oct 1996 | A |
| 5583566 | Kanno et al. | Dec 1996 | A |
| 5614940 | Cobbley et al. | Mar 1997 | A |
| 5659742 | Beattie et al. | Aug 1997 | A |
| 5696869 | Abecassis | Dec 1997 | A |
| 5734431 | Dachiku et al. | Mar 1998 | A |
| 5734886 | Grosse et al. | Mar 1998 | A |
| 5742816 | Barr et al. | Apr 1998 | A |
| 5751286 | Barber et al. | May 1998 | A |
| 5752246 | Rogers et al. | May 1998 | A |
| 5790176 | Craig | Aug 1998 | A |
| 5796829 | Newby et al. | Aug 1998 | A |
| 5812134 | Pooser et al. | Sep 1998 | A |
| 5813009 | Johnson et al. | Sep 1998 | A |
| 5886742 | Hibi et al. | Mar 1999 | A |
| 5911139 | Jain et al. | Jun 1999 | A |
| 5936673 | Agarwal | Aug 1999 | A |
| 5956716 | Kenner et al. | Sep 1999 | A |
| 5987454 | Hobbs | Nov 1999 | A |
| 6014184 | Knee et al. | Jan 2000 | A |
| 6028603 | Wang et al. | Feb 2000 | A |
| 6075530 | Lucas et al. | Jun 2000 | A |
| 6141693 | Perlman et al. | Oct 2000 | A |
| 6166735 | Dom et al. | Dec 2000 | A |
| 6172674 | Etheredge | Jan 2001 | B1 |
| 6177931 | Alexander et al. | Jan 2001 | B1 |
| 6185573 | Angelucci et al. | Feb 2001 | B1 |
| 6209103 | Schreiber et al. | Mar 2001 | B1 |
| 6243419 | Satou et al. | Jun 2001 | B1 |
| 6246719 | Agarwal | Jun 2001 | B1 |
| 6266657 | deVries et al. | Jul 2001 | B1 |
| 6269394 | Kenner et al. | Jul 2001 | B1 |
| 6271840 | Finseth et al. | Aug 2001 | B1 |
| 6275268 | Ellis et al. | Aug 2001 | B1 |
| 6275532 | Hibi et al. | Aug 2001 | B1 |
| 6275829 | Angiulo et al. | Aug 2001 | B1 |
| 6305019 | Dyer et al. | Oct 2001 | B1 |
| 6324538 | Wesinger, Jr. et al. | Nov 2001 | B1 |
| 6351765 | Pietropaolo et al. | Feb 2002 | B1 |
| 6357042 | Srinivasan et al. | Mar 2002 | B2 |
| 6370543 | Hoffert et al. | Apr 2002 | B2 |
| 6397387 | Rosin et al. | May 2002 | B1 |
| 6449608 | Morita et al. | Sep 2002 | B1 |
| 6473463 | Agarwal | Oct 2002 | B2 |
| 6496856 | Kenner et al. | Dec 2002 | B1 |
| 6573907 | Madrane | Jun 2003 | B1 |
| 6701060 | Yuen et al. | Mar 2004 | B2 |
| 6799174 | Chipman et al. | Sep 2004 | B2 |
| 6859799 | Yuen | Feb 2005 | B1 |
| 6869799 | Guan et al. | Mar 2005 | B1 |
| 7155451 | Torres | Dec 2006 | B1 |
| 7328450 | Macrae et al. | Feb 2008 | B2 |
| 7372976 | Rhoads et al. | May 2008 | B2 |
| 7505913 | Tobin | Mar 2009 | B2 |
| 7769775 | Yuen | Aug 2010 | B2 |
| 20010022815 | Agarwal | Sep 2001 | A1 |
| 20010042098 | Gupta et al. | Nov 2001 | A1 |
| 20020116509 | DeLaHuerga | Aug 2002 | A1 |
| 20030088554 | Ryan et al. | May 2003 | A1 |
| 20030088613 | Goldschmidt lki et al. | May 2003 | A1 |
| 20040128514 | Rhoads | Jul 2004 | A1 |
| 20050013462 | Rhoads | Jan 2005 | A1 |
| 20070055689 | Rhoads et al. | Mar 2007 | A1 |
| 20080133378 | Tobin | Jun 2008 | A1 |
| 20090271286 | Tobin | Oct 2009 | A1 |
| Number | Date | Country |
|---|---|---|
| 0525427 | Feb 1993 | EP |
| 0751648 | Jan 1997 | EP |
| 0472521 | Jun 1998 | EP |
| 09-138804 | May 1997 | JP |
| 1019970078662 | Dec 1997 | KR |
| WO 9641285 | Dec 1996 | WO |
| WO 9746950 | Dec 1997 | WO |
| WO 9847084 | Oct 1998 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20100313130 A1 | Dec 2010 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60110299 | Nov 1998 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11894684 | Aug 2007 | US |
| Child | 12819347 | US | |
| Parent | 11021478 | Dec 2004 | US |
| Child | 11894684 | US | |
| Parent | 09452287 | Nov 1999 | US |
| Child | 11021478 | US |
