This application claims priority under 35 U.S.C. §119 to Korean Patent Application No. 10-2009-0127370, filed on Dec. 18, 2009, and Korean Patent Application No. 10-2010-0055676, filed on Jun. 11, 2010 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety.
1. Field of the Invention
The present invention relates to a system for certifying an image identify technology, and more particularly, to a system for certifying an image identify technology for evaluating and certifying an ROI-based still image identify technology.
2. Description of the Related Art
With the increase in the demand for digital contents, a vast amount of multimedia contents (video, music, image, etc.) have been ceaselessly created, produced, distributed, and served around us. Among others, the number of digital still images (hereinafter, referred to as still images) have explosively increased due to the spread of high-performance portable digital camera or the drop in price of a large-capacity storage apparatus or a portable storage medium. On the other hand, the demand for a product that efficiently searches the still images if necessary and accurately identifies and searches the desired targets from other targets has increased gradually.
The technology for identifying and searching the still image may be largely divided into three stages according to difficulty and application purpose.
The first stage includes a technology for identifying the exactly same image among large-capacity still images. This application field is a) contents search and confirmation of contents having no metadata and related information, b) trace of illegal use of contents with copyright, or the like.
The second stage includes a technology for identifying still images of which original characteristics (size, type, or quality, etc., of image) are modified by the Internet, a reproducing apparatus, or intentional editing. The application field is a) confirming use of illegal contents by a copyright holder, royalty collection, brand management, b) copyright management such as determination as to whether pressed contents are related to copyright, etc., c) personal image media management, etc., of various versions (time, place, device).
The third stage includes a technology for identifying contents including several still images based on a common region and an object when several images include a common region or the same object (character, building, background, place, etc.). The application field is a) searching and grouping of contents including the same region and object, b) content linking that links related contents based on presence and absence of the common region or the object at the time of Internet search.
The above three-stage technology is called an ROI-based image identifier.
In order to evaluate and certify the ROI-based image identifier, the identifier robust to the type, size, modified type, strength, etc., of the ROI, the evaluation information for evaluating their performance, and the certify technology for systematically evaluating and certifying a product are needed.
It is an object of the present invention to evaluate and certify a ROI-based image identify technology through a system for certifying a still image identify technology and to provide a system for certifying an image identify technology.
The present invention is not limited to the above-mentioned object and other objects, which are not described above, can be obviously understood to those skilled in the art from the following description.
In order to achieve the above objects, according to an aspect of the present invention, there is provided a system for certifying an image identify technology according to an embodiment of the present invention, including: a test image DB that stores still images and moving images; a modified image generator that generates modified images from the still images and the moving images; a modified image DB that stores the modified images; a statistical information unit that calculates statistical information by using results identifying the still images, the moving images, and the modified images by the image identify technology; an evaluator that evaluates the accuracy of the image identify technology according to the statistical information; and a certificate generator that generates certificate by using the statistical information and the accuracy.
According to another aspect of the present invention, there is provided a system for certifying an image identify technology, including: a receiver that receives an image identify technology and certificate application from a user; an environment setting unit that sets an evaluation environment of the image identify technology according to the certificate application; a test image DB that stores still images and moving images; a modified image generator that sets regions of interest in the still images and the moving images, respectively, and modifies the set regions of interest to generate the modified images for each region of interest for the still images and the moving images; a statistical information unit that calculates statistical information by using results identifying the still images, the moving images, and the modified images for each region of interest by the image identify technology; an evaluator that evaluates the accuracy of the image identify technology according to the statistical information and the evaluation environment; and a certificate generator that generates certificate using the statistical information and the accuracy.
The details of other exemplary embodiments are included in the detailed description and the drawings.
According to embodiments of the present invention, it can evaluate and certify the ROI-based still image identify technology.
Advantages and features of the present invention and methods to achieve them will be elucidated from exemplary embodiments described below in detail with reference to the accompanying drawings. However, the present invention is not limited to the exemplary embodiment disclosed herein but will be implemented in various forms. The exemplary embodiments is provided by way of example only so that a person of ordinary skill in the art to fully understand the disclosures of the present invention and the scope of the present invention. Therefore, the present invention will be defined only by the scope of the appended claims. Meanwhile, terms used in the present invention are to explain exemplary embodiments rather than limiting the present invention. In the specification, a singular type may also be used as a plural type unless stated specifically. “comprises” and/or “comprising” used herein does not exclude the existence or addition of one or more other components.
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.
A system for certifying an image identify technology according to an exemplary embodiment of the present invention will be described with reference to
Referring to
The test image DB 300 stores still images and moving images.
The modified image generator 400 generates modified images from the still images and the moving images.
The modified image DB 450 stores modified images.
The statistical information unit 500 calculates statistical information from the results of identifying still images, moving images, and modified image using an image identify technology.
The evaluator 600 evaluates the accuracy of the still image identify technology according to the statistical information.
The certification generator 700 generates a certificate by using the statistical information and the accuracy.
Meanwhile, the test image DB may be a set of still images and the moving images classified into various categories for evaluating the image identify technology.
In addition, the test image DB may be a query image for evaluating the accuracy of the image identify technology.
In addition, the test image DB may be a query target image for evaluating the accuracy of the image identify technology.
The test image DB according to the embodiment of the present invention may be classified into each category as the following Table. Further, each quantity for each category should be enough to evaluate the image identify technology as exemplified in the following Table. Each quantity may be varied according to the image identify technology. Therefore, the scope of the present invention is not limited thereto.
(a) Still Image (10,000 Sheet)
(b) Moving Images (1,600 Shot)
Meanwhile, the moving image may include at least one of still or moving objects.
Further, the moving image may include a moving background or a still background.
Meanwhile, the modified image generator 400 sets the region of interest to calculate the accuracy of the image identify technology to generate the modified image for each region of interest from the still images and the moving images. The statistical information unit 500 may calculate the statistical information by further using the results of identifying the modified images for each region of interest by the image identify technology.
Meanwhile, the type of region of interest may be a rectangle.
Further, the size of region of interest may be close shot, middle shot, and full shot.
The close shot may be ½ or more of the entire image.
The middle shot may be between ¼ or more and under ½ of the entire image.
The full shot may be 1/9 or less of the entire image.
Further, the modified image generator 400 selects the modified function to generate the modified image for each region of interest from the still images and the moving images.
The modified function applies at least one of black-and-white conversion, rotation, pan, tilt, occlusion, and complex modification to the still images and the moving images. The complex modification may be a case when at least two of a black-and-white conversion, rotation, pan, tilt, occlusion, and complex modification are applied in combination.
Further, the modified image generator 400 selects the still image photographing environment to generate the modified image for each region of interest corresponding to the still image photographing environment from the still images.
In addition, the modified image generator 400 selects the resolution of the moving images and frames per second to generate the modified image for each region of interest corresponding to the resolution of moving image and the frames per second from the moving image.
Meanwhile, the modified image generator 400 may generate the modified image by a camera photographing scheme using a modified software.
In the test image class using the modified software, the test image class according to the modified level may have 6 types of 16 levels.
The detailed contents of the modified software as one embodiment are as follows.
The test image class according to the photographing environment may be 1 type of 4 cases.
The test image class selected using moving images may be 2 types of 6 cases.
In addition, the statistical information unit 500 uses the still image and the moving image as the query image and uses the modified image as the query target image to allow the image identify technology to identify the image corresponding to the query image among the query target images, thereby making it possible to calculate the statistical information using the identified results.
In addition, the statistical information unit 500 uses the modified image as the query image and uses the still image and the moving image as the query target image to allow the image identify technology to identify the image corresponding to the query image among the query target images, thereby making it possible to calculate the statistical information using the identified results.
Further, the statistical information unit 500 may calculate the statistical information for the modified function.
Meanwhile, the evaluator 600 may calculate the identification ratio of the number of identified images to the number of query images at a percent rate by dividing the identification ratio by each region of interest and evaluate the accuracy of the still image identify technology at a percent rate.
Further, the evaluator 600 may calculate the identification ratio of the number of identified images to the number of query images at a percent rate by dividing the identification ratio by each modified function and evaluate the accuracy of the still image identify technology at a percent rate. Herein, this is called the robust evaluation.
Meanwhile, the evaluator 600 may evaluate the calculation complexity and evaluate the accuracy of the still image identify technology according to the result.
The evaluation of the calculating complexity depends on the average value calculated by the number of query images per second according to the size of the region of interest.
The detailed contents of the evaluation of the calculation complexity are as follows.
In addition, the system for certifying an image identify technology according to one embodiment of the present invention may further include an environment setting unit 200.
The environment setting unit 200 sets the evaluation environment of the image identify technology according to the certification application.
Meanwhile, the certificate application may include certificate authority information, certificate applicant information, and general information of image identify technology.
The detailed contents of a certificate application are as follows.
The certificate authority information may include at least one of certificate authority name information, certificate authority address information, and certificate authority serial number.
In addition, the certificate authority name information may include the name information on the certification authority.
Further, the certificate authority address information may include zip code and country, city/province, and address information to which the certificate authority belongs.
Further, the certificate authority serial number may be the serial number information by differentiating the certificate authority from other certificate authorities.
Meanwhile, the certificate applicant information may be at least one of the certificate applicant name information, the certificate applicant address information, and the certificate applicant identification information.
Further, the certificate applicant name information may be a name or a corporate name information of the image identify technology owner.
Further, the certificate applicant address information may include address information such as country, city/province, address, zip code, etc.
In addition, the certificate applicant identification number information may include a resident registration number and a business license number.
Meanwhile, the image identify technology information may include at least one of technology number information, patent information, algorithm description information, and target application information.
The technology number information is number information that can identify the image identify technology from other technologies.
The patent information is the patent information related to the image identification technology.
The algorithm description information is information describing an algorithm related to the image identification technology.
The target application information is application information related to the image identify technology such as search, copyright information, contents linking, metadata and fingerprinting, etc.
Meanwhile, the evaluator 600 may evaluate the accuracy of the image identify technology according to the statistical information and the evaluation environment.
In addition, the certificate generator 700 may generate certification using the statistical information and the accuracy.
The detailed contents of the certification are as follows.
A. Evaluation Result Certification (A): Calculation Complexity and Identifier Size
Meanwhile, the size of the identifier represents the size of feature representing the region of interest as a byte.
B. Evaluation Certificate (B); Identification Rate 1
C. Evaluation Result Certification (C): Identification Rate 2
While certain embodiments have been described above, it will be understood to those skilled in the art that the embodiments described can be modified into various forms without changing technical spirits or essential features. For example, the method for certifying an image identify technology proposed in the present invention may be implemented in various forms. Accordingly, the embodiments described herein are provided by way of example only and should not be construed as being limited. While this invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2009-0127370 | Dec 2009 | KR | national |
10-2010-0055676 | Jun 2010 | KR | national |