The present invention relates to a checking system for checking browsing image data that can be in a browsing state on a site on a network.
In recent years, copyright infringement on the Internet has been acknowledged as a problem, along with the digitalization of information such as novels, music, films and pictures, and the popularization of the Internet. This is due to the fact that the digitalization of information allows the information to be copied without degrading the quality, also to the ease of secondary use or tertiary use of information such as editing or adaptation of information, and further to the environment in which other people's copyrighted works can be easily exploited because of the capability of public transmission via the Internet. In particular, not only groups such as companies but also respective individuals are placed under these environments, thereby making prevention and management of copyright infringement more difficult.
Recently, while video sharing service for sharing moving images on the Internet has been provided, copyright infringement has becomes a big problem in this video sharing service. The video sharing service refers to a service in which sharing of moving image data uploaded by a user allows other users to download the moving image data, thereby allowing the moving images to be made public and browsed. Tens of thousands of pieces of moving image data are posted per day on this video sharing service, and those pieces of moving image data actually include a number of illegal pieces of data which infringe copyrights. For example, films, TV programs, live images, promotion videos, etc, are uploaded without the permission from the owners of the copyrights.
Conventionally, the management of copyrights in the video sharing service only states in terms of service or the like that it is forbidden to post moving image data which infringes a copyright, and is left to each user's moral without providing any special censorship system. Even if illegal moving image data is uploaded, data pointed out by a third party as illegal moving image data is only deleted. While owners of copyrights and the like reproduce and view moving image data to retrieve illegal moving image data, and then report the infringement, it is not realistic to check every piece of moving image data increasing by tens of thousands of pieces from day to day. Furthermore, even if illegal moving image data is reported and deleted, the user often posts the illegal moving image data again, and therefore, the conventional countermeasure is not effective.
Meanwhile, conventional image retrieval techniques utilizing optical correlation include a technique using, for retrieving images input from a great deal of recorded image data, optical correlation with a thin-screen liquid crystal element, a thin hologram, or the like as a display element. However, the liquid crystal element carries out optical correlation processing while switching the great deal of recorded image data, and thus requires electrical control for switching images, and the time for each correlation is limited. Furthermore, since images accumulated from a recording medium are transferred to the liquid crystal display element before carrying out optical correlation processing, the speed of the optical correlation processing is limited also by the transfer rate. Moreover, in the case of the thin hologram, it is difficult to increase the storage capacity or the recording density.
On the other hand, holographic memories on which two-dimensional image data can be recorded have been developed as one of next-generation memories, and above all, random-accessible collinear-type holographic memories allow reference light to coaxially interfere with information light, thereby allowing large volumes of data to be recorded and reproduced (Patent Document 1). Thus, as an image retrieval technique, the technique has been proposed in which optical correlation calculation is carried out by using a volume-type (thick) hologram that is a collinear type holographic memory (Non-Patent Document 1).
[Patent Document 1] Japanese Patent No. 3403068
[Non-Patent Document 1] Eriko Watanabe, et al., “Image Search Engine with All-Optical Ultrahigh-Speed Optical Correlation”, Extended Abstracts of Optics Japan 2005, pp. 260-261, 2005
In view of the background art described above, an object of the present invention is to provide a checking system which makes it possible to carry out effective censorship with respect to browsing image data that can be in a browsing state on a site on a network. Furthermore, another object of the present invention is to provide management of copyrights and a new business model with the use of the aforementioned checking system.
A checking system according to the present invention consists in a checking system for checking browsing image data that can be in a browsing state on a site on a network, characterized in that it comprises: an image database in which multiple pieces of registration image data are registered; a retrieving light generating means for generating retrieving light on the basis of the browsing image data; and a checking means for checking the browsing image data against the registration image data registered in the image database, the image database includes a holographic recording medium comprising a hologram recording layer on which image data is recorded by an interference fringe resulting from information light generated on the basis of registration image data and reference mark light generated on the basis of a reference mark, and the checking means irradiates the hologram recording layer of the holographic recording medium with retrieving light generated by the retrieving light generating means, and detect reproduced reference mark light to check the browsing image data against the registration image data.
Further, in the checking system, it is preferable to add identification data to the browsing image data when the browsing image data is registered in the image database, and it is further preferable to change a condition for browsing the browsing image data on the basis of the identification data.
Further, in the checking system, it is preferable to provide the holographic recording medium with an address layer for specifying a location, and when reference mark light is reproduced by the retrieving light, to specify the location of a reference fringe reproducing the reference mark light by using the address layer and to specify the browsing image data from the location of the interference fringe.
Further, in the checking system, when the browsing image data is registered in the image database, information regarding the image data may be provided to a registrant who registers the image data in the image database.
Further, in the checking system, it is preferable to carry out irradiation with the retrieving light while rotating the holographic recording medium which has the shape of a disc.
Further, in the checking system, it is preferable that the information light be spatially modulated by an image for registration generated from an reproduced image of the registration image data displayed on a partial region of a spatial light modulator, and that the reference mark light be modulated by the reference mark displayed on another partial region of the spatial light modulator.
Further, in the checking system, it is preferable that a partial region of the spatial light modulator be divided into a plurality of spaced-apart regions, that the registration image data be divided and displayed on the plurality of spaced-apart regions, and that at least a portion of the reference mark be displayed between the plurality of spaced-apart regions.
Further, in the checking system, it is preferable that the retrieving light be spatially modulated by an image for retrieval generated from a reproduced image of the browsing image data, and that the image for retrieval be displayed on a partial region of the spatial light modulator on which the image for registration is displayed.
Further, in the checking system, it is preferable to provide the registration image data with at least one keyword, to add at least one keyword data to the browsing image data, and for the checking means to first irradiate, with retrieving light, the holographic recording medium on which the registration image data provided with the keyword acquired from the keyword data is recorded, when the checking means checks the browsing image data.
Further, in the checking system, it is preferable that at least moving image data be contained in the registration image data, that the information light be generated on the basis of a still image of frame of moving image data extracted from reproduced moving images obtained by reproducing the moving image data, and that the number of frames per unit time extracted from the reproduced moving images be variable.
The use of the checking system according to the present invention allows browsing image data that can be in a browsing state on a site on a network to be checked against registration image data registered in an image database. Therefore, the management of the registration image data and the protection or licensing of copyrights can be collectively put into execution. Furthermore, the browsing image data can be censored within the range of registration in the image database, and infringement due to illegal image data uploaded and further, exercise of right by the registrant can be avoided. Other advantageous effects will be described in the following embodiments.
While embodiments of the present invention will be described below with reference to the drawings, the present invention is not to be considered limited to the following examples.
The checking sever 1 is provided with an image database 2 in which multiple pieces of registration image data are registered, a retrieving light generating means 3 for generating retrieving light on the basis of the browsing image data 13, and a checking means 4 for checking the browsing image data against the registration image data registered in the image database 2. The registration image data is provided by registrants 5, 6, and registered in the image database 2. It is to be noted that image data includes moving image data and still image data, and it is preferable that at least moving image data (registration moving image data) be contained as the registration image data, because of currently increased requests of checking systems for moving image data.
The registrants 5, 6 refer to, for example, the operator of the site 12, or the owner of copyright or producer for the registration image data. As shown in
In
The group of clients 10 is composed of multiple clients using the site 12 and connected to the network 11, and can request the server for the site 12 to allow image data to be browsed. For example, as the group of clients 10, users of an image sharing site and members of paid content can be cited, and as a specific terminal device, personal computers, personal digital assistants, cellular phones, etc. can be cited.
The network 11 refers to a telecommunication network connecting between the terminal devices of the clients, and the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), etc. can be sited as the network 11.
The site 12 has content prepared for providing browsing image data to the group of clients 10, and in
The browsing image data 13 is checked by the checking server 1, and can be then in a browsing state on the site 12. In
Furthermore, it is preferable to add, to the browsing image data 13, at least one piece of keyword data for making the checking and the retrieval easier (see
It is preferable to add identification data to the checked browsing image data 14 which has been checked by the checking server 1. The identification data can be the data that is history of checking finished in the checking server 1 or the data that identifies whether or not the browsing image data 13 is registered in the image database 2, and the data that may further contain a portion of the browsing condition or registration data when the browsing image data 13 is registered in the image database 2.
For example, when the browsing image data 14 to which identification data of checking finished has been added in the checking server 1 is downloaded to the other client and posted again from the other client, the checking server 1 can recognize the identification data of checking finished to determine whether or not checking is necessary for the browsing image data 14 to which the identification data has been added. Furthermore, if information on whether or not registered in the image database 2 is contained as identification data, it is possible to change the browsing condition depending on whether or not to be registered, or to manage image data on the network. Moreover, if information such as a title for an image and a browsing condition is also contained in the identification data, setting or management of more detailed browsing condition is made possible.
As the browsing condition, for example, deleting image data without allowing the image data to be browsed, treating image data as charged content, charging for image data depending on the number of browsing records, bringing only a portion of image data into content allowed to be viewed, bringing image data into invalid content, etc. can be cited.
In
It is to be noted that a configuration may be employed in which the identification data is added only to data registered in the image database 2, of the browsing image data. Alternatively, when processing of the browsing image data is carried out depending on the checking result in the checking server 1, the identification data may or may not be added to the browsing image data. For example, if image data registered in the image database 2 is not allowed to be browsed or uploaded at all, the browsing image data may be deleted in the checking server 1, and any identification data may or may not be added to the browsing image data to be uploaded onto the site 12. In addition, only if the aim is to merely survey data or manage how many times image data is posted, the information may be provided to the registrant in the checking server 1, and identification data may or may not be added to the browsing image data 13.
Furthermore, when the browsing image data is registered in the image database 2, the checking server 1 or the site 12 may provide information regarding the image data to the registrant who has registered the image data in the image database 2 (see
Furthermore, the checking server 1 transmits, to the client who has posted the image data registered in the image database 2, a warning message which warns that posting the image data infringes the copyright (see
The use of the checking system described above allows each of the registrants 5, 6 to collectively put the management of the registration image data and the protection or licensing of copyrights into execution on the network 11 by registering image data desired to be managed, as the registration image data, in the image database 2. Furthermore, the site 12 can censor the browsing image data within the range of registration in the image database 2, and can avoid infringement due to illegal image data uploaded, and further avoid exercise of right by the registrant.
More specifically, the checking server 1 can provide, to the registrants 5, 6, service of registering in the image database 2 image data desired to be managed, and also provide service of acting for a part of management of the registration image data. Furthermore, the checking server 1 can provide, to the site 12, service of censoring the browsing image data within the range of registration in the image database 2, and also provide service of acting for a part of management of the browsing image data. It is to be noted that the registrants 5, 6 or the site 12 itself can also provide the checking server 1.
Now, specific configuration and operation in the checking server 1 will be described with reference to
In
The information processing device 30 is connected to the network, and performs various types of information processing executed in the checking system. The types of information processing include, for example, reproduction of browsing image data and creation of images for retrieval, recording and reproduction of registration data, recording and reproduction of the correspondence relationship between the recording location of an interference fringe and registration image data, addition of identification data to browsing image data, determination of the order of checking on the basis of keyword data, transmission of information regarding image data, transmission of a warning message, etc.
The optical system 40 can record an interference fringe on the holographic recording medium 20, and check browsing image data against registration image data recorded on the holographic recording medium 20. The optical system 40 includes a laser 41 for hologram, a mirror 42, a spatial light modulator 43, a polarization beam splitter 44, a first relay lens 45, a mirror 46, a second relay lens 47, a beam splitter 48, a quarter wavelength plate 49, an object lens 50, an aperture 51, and a reference mark light detector 52, and further includes a laser 60 for addressing, a beam splitter 61, a mirror 62, and an address light detector 63.
The laser 41 for hologram serves as a light source for information light and reference mark light when an interference fringe is to be recorded, or serves as a light source for retrieving light when checking is to be carried out, for which, for example, short-wavelength high-power lasers such as blue lasers and green lasers are preferable. The spatial light modulator 43 has a plurality of pixels, and can spatially modulate light by changing the attribute of light for each pixel, for which, for example, a liquid crystal display device or a DMD (Digital Micromirror Device) can be used. In
Light emitted from the laser 41 for hologram is reflected by the mirror 42, is spatially modulated by the spatial light modulator 43, transmits through the polarization beam splitter 44, is relayed by the first and second relay lenses 45, 47 between which the light is reflected by the mirror 46, transmits through beam splitter 48 and the quarter wavelength plate 49, and is subjected to Fourier transform by the object lens 50 to irradiate the hologram recording layer 21 of the recording medium 20. When reference mark light is reproduced in the hologram recording layer 21, the reference mark light reflected by the reflective layer 24 is emitted from the recording medium 20, transmits through the object lens 50, the quarter wavelength plate 49, the beam splitter 48, the first and second relay lenses 45, 47, and the mirror 46 in a direction opposite to the direction during the irradiation, is reflected by the polarization beam splitter 44, transmits through the aperture 51 and enters the reference mark light detector 52.
Furthermore, the laser 60 for addressing, the beam splitter 61, the mirror 62, and the address light detector 63 are provided to specify the irradiation position from an address layer when the recording medium 20 is provided with the address layer. Light emitted from the laser 60 for addressing transmits through the beam splitter 61, is reflected by the mirror 61 and further reflected by the beam splitter 48, and transmits through the quarter wavelength plate 49 to irradiate the address layer of the recording medium 20 by the object lens 50. Reflected light from the recording medium 20 transmits through the optical system in the reverse direction, is reflected by the beam splitter 61 and is detected by the address light detector 63. It is preferable to use, as the laser 60 for addressing, a relatively long-wavelength laser such as red light.
The operation of the checking server 1 will be described below. First, the operation will be described for recording, as the registration image data, moving image data (registration moving image data) on holographic recording medium 20 in order to create the image database 2.
The information processing device 30 reproduces registration moving image data provided by the registrant, and extracts a still image of frame of the moving image data to be recorded from the reproduced moving images (S41 to S43). Then, required preprocessing is applied to the extracted still image to generate an image for registration (S44), and the image for registration is output to the spatial light modulator 43 (S45). When the number of frames recorded is increased, the accuracy in checking can be increased. However, correspondingly, the number of interference fringes recorded is increased, thereby increasing the required storage capacity, and also making the time required for recording and checking longer. Therefore, in the case of extracting a frame to be recorded from the moving image data, it is preferable that the number of recorded frames per unit time (fps: frames per second) be made variable in such a way that the number of recorded frames is increased in situations with dramatic changes, whereas the number of recorded frames is decreased in situations with slight changes. For example, general digitized moving image data is compressed with the use of VBR (Variable Bit Rate), which is higher in situations with dramatic changes and lower in situations with slight changes. Therefore, the fps may be changed on the basis of the bit rate.
At least a portion of the image 31 for registration is displayed on the region 43a of the spatial light modulator 43. Of course, the region 43a may be a region large enough to display the entire image 31 for registration. Furthermore, the region 43a does not necessarily have the same shape as that of the image 31 for registration, as long as an image can be displayed which is enough for computing optical correlation with an image for retrieval. In
As for the region 43b of the spatial light modulator 43, at least one is located around the region 43a, on which a reference mark is displayed. The information light 32 and the reference mark light 33 are diffracted by the spatial light modulator, thereby resulting in collection of divergent rays from each pixel, and the divergent rays from each pixel in terms of the information light and the reference mark light are brought into parallel rays by the object lens 50 to irradiate the recording medium 20, thereby as a whole allowing the converging information light and reference mark light to be crossed, and allowing an interference fringe to be formed (see
In
As shown in
More preferably, as shown in
The effect on the checking result due to the difference in the display mode for the region 43a on which the image for registration is displayed and the region 43b on which a reference mark is displayed in these spatial light modulators 43 will be described with reference to
The value at which the registered image rejection rate FRR and the other image acceptance rate FAR intersect with each other refers to a threshold value at which both of the registered image rejection rate FRR and the other image acceptance rate FAR are minimized, where the error rate at the value is referred to an EER (Equal Error Rate), and when the EER has a certain range, the range is referred to as a threshold value region. In
Furthermore, it is preferable to specify the recording location of the interference fringe 24 from the address layer with the use of the laser 60 for addressing and the address light detector 63, and to record on a recording means or the like of the information processing device, the correspondence relationship between the recording location of the interference fringe 24 and the recorded image 31 for registration or the registration moving image data, when the interference fringe 24 is to be recorded. If this correspondence relationship is recorded, the location of the interference fringe obtained by reproducing the reference mark light is specified from the address layer, thereby allowing the image 31 for registration or registration moving image data with its interference fringe 24 recorded to be specified, when checking is to be carried out. In addition, when the registrant sets registration data as the registration image data, the correspondence relationship between the registration data and the recording location of the registration image data or its interference fringe 24 is recorded on a recording means or the like of the information processing device.
Next, operation for checking will be described.
In processing for creating the image for retrieval (S82), the same processing as the image processing in
It is preferable that the region 43c on which the image 35 for retrieval is displayed have the same extent as the region 43a on which the image 31 for registration is displayed. Also in
The reference mark light detector 52 detects at least the optical power of the reference mark light, the detected optical power of the reference mark light is compared with a predetermined threshold value in the information processing device, and if the optical power is less than the threshold value, with the result as mismatching, another interference fringe or another image for retrieval is used to continue the processing for checking. If the optical power is the threshold value or more, the laser 60 for addressing and the address light detector 63 are used to specify the recording location of the interference fringe 24 from the address layer. Furthermore, from the correspondence relationship between the recording location of the interference fringe 24 recorded on a recording means or the like of the information processing device and the image for registration or the registration moving image data, the image for registration or the registration moving image data is specified for the interference fringe 24, and registration data on the registration moving image data recorded on a recording means or the like of the information processing device is also read out to retrieve information which is to be added as identification data to the browsing moving image data. It is to be noted that these types of processing are not necessary when a portion of the registration data is not to be contained as identification data.
In the description above, since a collinear type apparatus is employed in which information light is allowed to coaxially interfere with reference light, it is possible to carry out checking at high speed. It is to be noted that while the reflective holographic recording medium has been described in the description above, it is also possible to achieve the present invention with a transmission holographic recording medium which transmits and then displays reference mark light reproduced by computing optical correlation. In addition, it is also possible to achieve the present invention with a two-beam interference type apparatus in which the optical path of information light and the optical path of the reference mark light are separated from each other and crossed at a given degree in a recording medium, rather than the collinear type apparatus. For example, the configuration may be employed in which light from the light source 41 is divided into two light rays by a beam splitter, one of the light rays is modulated by the spatial light modulator to generate information light whereas the other light ray is shaped to generate reference mark light, and the two types of light are used for irradiation so as to be crossed on the recording medium.
In
Furthermore, when at least one piece of keyword data is added to the browsing image data, the order of the interference fringe, recording medium, or image database to be subjected to checking is determined on the basis of the keyword data, thereby allowing processing for checking to be carried out efficiently. In the case of employing keyword data, it is first necessary to set a keyword for the registration image data by registration data or other recognition means. The keyword may be recorded to correspond to each interference fringe, each piece of registration image data, each recording medium, or each image database. For example, a keyword is recorded in addition to the correspondence relationship between the recording location of each interference fringe and the registration image data, a keyword is set for each recording medium, followed by recording registration image data with the keyword, or an image database is provided for each keyword, followed by recording registration image data with the keyword. Then, in checking, a holographic recording medium on which registration image data is recorded with a set keyword acquired from keyword data added to the browsing image data is irradiated first with retrieving light, thereby increasing the rate of being able to carry out early checking. Therefore, checking can be carried out efficiently.
The keyword can be set, for example, from rough classifications such as films, TV programs, original videos, and music, to further fine classifications such as Japanese films, foreign films, dramas, variety shows, news programs, animated cartoons, and CM.
As described above, the output signal from the reference mark light detector 52 is monitored while irradiating each interference fringe on the recording medium with retrieving light, thereby allowing an interference fringe on which an image for registration highly correlated with an image for retrieval is recorded to be retrieved so that the browsing image data can be checked against the registration image data. It is to be noted that it is also possible in checking to employ a configuration in which a checking result eventually considered appropriate is determined after acquiring correlation signals for all of interference fringes.
Meanwhile, in conventional holographic record reproduction, reference light is allowed to interfere with information light to form an interference fringe in recording, while irradiation with the reference light is carried out to reproduce the information light in reproduction. Such holographic record reproduction is significantly characterized in that information light with a staggering amount of information, such as two-dimensional images, can be recorded and reproduced, but it is necessary in reproduction to detect the staggering amount of information of the information light, such as two-dimensional images. Therefore, a high-performance detection means in which light receiving elements are two-dimensionally arranged is used to reproduce two-dimensional images, etc. However, in order to detect the two-dimensional distribution of the optical power, irradiation with reference light needs to be carried out to some extent to increase the quantity of the reproduced information light, and the reproduction speed and the transfer rate are limited since the throughput of the detection means is also limited. In contrast, the checking means 4 described above only detects the power of the reference mark light, and need not reproduce an image for registration from an interference fringe on the holographic recording medium, thereby allowing processing to be carried out at an extremely high speed. In particular, the configuration in which reproduced light is collected and detected on one point, as typified by the lens 53 in
Furthermore, in the conventional holographic record reproduction, which is recognized as an alternative to general-purpose recording media, the recording rate is also an important factor, and as a result, it is necessary to use a spatial light modulator that can be switched at high speed. However, it is enough for the holographic recording medium 2 according to the present invention to only achieve speeding up in checking, and the recording rate in recording or the transfer rate is not particularly important. Therefore, ferroelectric liquid crystal display devices, etc. which are slow in switching of the display can also be used as the spatial light modulator. It is to be noted that in checking the switching rate is loosely limited since the same image for retrieval is displayed on the spatial light modulator for a certain period of time.
[Example] 10 fps (frames/second) of images for registration, that is, 10 frame images for a moving image for one second were extracted to record moving image data. When interference fringes about 200 μm in diameter are recorded on a holographic recording medium in the shape of a 12 cm disc to be spaced 20 μm apart in the track direction and spaced 20 μm apart in the radial direction, about 170 pieces (=15,300 minutes=9,180,000 images for registration) of moving image data for 90 minutes can be recorded on one holographic recording medium. 50 pieces (=4,500 minutes=2,700,000 images for registration) of moving image data for 90 minutes were recorded on this holographic recording medium at 10 fps to create a database. Then, when irradiation with retrieving light generated on the basis of an image for checking was carried out to carry out processing for checking, while rotating the holographic recording medium at the number of revolutions of 2400 rpm, 753,600 images could be subjected to checking for one second, and all of the images in the database could be subjected to checking for 3.6 seconds. The transfer rate in this case was about 250 Gbps. Further, when the number of revolutions of the holographic recording medium is set at 5000 rpm, retrieval can be completed for 1.7 seconds. If the utmost of the storage capacity of the holographic recording medium is used to record 170 pieces of moving image data of 90 minutes, checking can be completed for 12.2 seconds. Furthermore, the use of multiple holographic recording mediums eliminates the limitation to the storage capacity of the image database, and the checking time can also be kept if the processing for checking is carried out in parallel by multiple devices. Therefore, a checking system can be provided which can always handle a huge number of posted images.
[Comparative Example] In conventional hard disks, while it was also possible to create a database of 1 TB (=1000 GB), the transfer rate was generally from 300 Mbps to at most 3 Gbps or less. Even if currently available high-performance computers, for example, a computer including a CPU with a frequency of 3.00 GHz and a RAM of 1.99 GB is used to optimize the calculation, checking for one second was limited to 100 to 1000 images (a moving image for 10 to 100 seconds) of a database recorded on a hard disk In a system using such a hard disk, for example, a time period of at least 45 minutes was required to check one image, with respect to a database created in the hard disk, in which 50 pieces (=4,500 minutes=2,700,000 images for registration) of moving image data for 90 minutes have been recorded at 10 fps. In other words, checking is completed for 3.6 seconds in the checking system in Example, while it takes 750 times as long time as in the case of using the hard disk From another point of view, in the case of using the hard disk, 750 computers are operated in parallel to manage to achieve the checking speed comparable to that in Example. Accordingly, Example not only allows the speed of processing to be increased, but also leads to reduction in power consumption and capital investment cost.
Number | Date | Country | Kind |
---|---|---|---|
2007-153340 | May 2007 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2008/058859 | 5/14/2008 | WO | 00 | 8/4/2010 |