This patent application claims priority from a Japanese patent application No. 2000-201548, filed on Jul. 3, 2000, the contents of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates to an image distributing system. More particularly, the present invention relates to an image distributing system which distributes images in which a certain individual or target character is present to the character themselves.
2. Description of the Related Art
People who visit an amusement park take pictures at various places and times in the amusement park for souvenirs. The pictures are usually taken with a camera that is owned by a person visiting the park. The character who wants to be pictured stops and positions themselves, and ask someone else to take a picture. When a group of people go to an amusement facility, people in the group take pictures of one another.
Pictures are preferably taken at a place that has interesting characteristics such as an object which catches the eye in a facility. When people move along a route in a certain facility of the amusement park, pictures are taken along the route.
Conventionally, if a person wants to take a picture, the person needs to bring their own camera. The camera often is a burden to carry around while people enjoy themselves, although if no one in a group has a camera they cannot take photographs. When a person visits an amusement park, it is not easy for the person to take their own photograph. People stop, prepare themselves and then take pictures. For taking a picture, people need to interrupt their activities in the facility. Further, a target character typically poses to be photographed so that their natural facial expression and behavior is not caught in the picture. Further, the person who has the camera takes the pictures so that he or she has fewer pictures of themselves with the rest of the group. Because the person who takes the pictures has to think about timing the photographs, he or she can not fully enjoy the activities in the amusement facility.
Therefore, it is an object of the present invention to provide an image distributing system, which is capable of overcoming the above drawbacks accompanying the conventional art. The above and other objects can be achieved by combinations described in the independent claims. The dependent claims define further advantageous and exemplary combinations of the present invention.
According to a first aspect of the present invention, an image distributing system for distributing an image in which a certain objected character is caught, comprises: a camera system capturing images in which a person who is the objected character is caught; a signal transmitter connecting to the camera system; an image database connecting with the signal transmitter and storing a plurality of the image data transmitted by the signal transmitter; a character information database for storing character information for identifying the person caught in the image as the objected character; and an image collecting unit, identifying a person caught in the image, data of which is stored in the image database, as the objected character, and collecting image data in which the objected character is caught.
The image distributing system may include an image selecting terminal which shows the images thus collected to a user and prompt the user to select images from the images in which the objected character is caught. The selecting unit may distribute the image data thus selected. The image distributing system may include an outputting unit for outputting the image data collected by the image collecting unit.
The outputting unit may distribute the image data thus outputted. The system may include an image selecting terminal which shows the images thus collected to a user and prompt the user to select images from the images in which the objected character is caught, wherein the image selecting terminal transmits to the outputting unit image selection information notifying which images are thus selected. The image selecting unit may have means for capturing an image of a user who selects the images.
The image selecting terminal may further have means for verifying the person who selects the images based on the character information. The character information may be data about at least one of facial characteristic, body characteristic, and characteristic of outfits of the objected character.
The camera system may include a plurality of cameras provided within a predetermined area. The image distributing system may include a character information obtaining unit, which imports an image of the objected character to the character information database for the character information of the objected character.
The image collecting unit may identify a plurality of characters in an image data based on the character information corresponding to each of the plurality of characters.
The character information obtaining unit may have a plurality of cameras for capturing character information, the character information obtaining unit imports a plurality of images of the objected character captured from a plurality angles different from one another using the plurality of cameras for capturing character information, and the image collecting unit may identify and collect, based on the plurality of images captured from the plurality of angles, the image in which the objected character is caught from the image data thus stored in the image database.
The character information obtaining unit may update the character information when the character information is newly obtained about the objected character whose character information is already obtained.
When a person refuses to be objected, the person who refuses to be objected may register refusal to the character information database, and the image collecting unit may not collect an image when at least one of the characters caught in the image is the person who refuses to be objected.
At least one of the cameras may be movable and the mobile camera may further have a wireless transmitter. The mobile camera may be installed in a mobile facility which is an object to absorb attention of the objected character.
When the same person is caught in a plurality of images and the person is identified as an objected character in one of the plurality of images, the character identifying unit may also identify the same person in the rest of the plurality of images as the objected character. The camera system includes a plurality of cameras provided within a predetermined area.
The camera system may further have a camera group, the camera group including a plurality of cameras, each of the plurality of cameras may capture an image in which a certain person is caught from a plurality of different angles, the character identifying unit may identify, when the person in an image captured by one of the camera group is identified as a certain objected character, the same person in the rest of the images captured by the rest of the cameras included in the camera group as the same objected character.
The camera system further having a camera group, the camera group further including a plurality of cameras, each of the cameras may capture an image in which a certain person is caught at a plurality of different moments, the character identifying unit may identify, when the person in an image captured by one of the camera group is identified as a certain objected character, the same person in the rest of the images captured by the rest of the cameras included in the camera group as the same objected character.
The image collecting unit may identify a person captured in the image as the objected character substantially every time when the image is captured by the camera system. The image collecting unit may save only image data in which the objected character is caught into the image database. When the image collecting unit identifies a person caught in the image as the person who refuses to be objected substantially every time when the image is captured by the camera system, and when at least one of the persons caught in the image is identified as the person who refuses to be objected, the image collecting unit does not collect the image data in which the person who refuses to be objected is caught.
The image distributing system may include a timing detecting unit which detects a timing to capture an image in which the objected character is caught, wherein the camera system may capture an image in which the objected character is caught when the timing for capturing an image is thus detected by the timing detecting unit. The timing unit may detect, based on position information about a plurality of characters, the timing for capturing an image when a plurality of characters are at a predetermined position.
The system may prompt a person in the predetermined area to carry a transmitter for transmitting radio waves and the timing detecting unit has a receiver for receiving the radio waves, and the timing detecting unit may determine a distance between the transmitter and the receiver based on the radio waves transmitted from the transmitter, and may detect the timing to capture an image when the distance is thus determined to be a predetermined distance.
The transmitter may include one of an ID card and a cellular phone. At least one of the radio waves transmitted and received between the transmitter and the receiver may include the character information. The image collecting unit may identify a person captured in the image as the objected character substantially every time when the image is captured by the camera system. The system may prompt the person who refuses to be objected to have a transmitter.
When the image collecting unit identifies a person caught in the image as the person who refuses to be objected substantially every time when the image is captured by the camera system and when at least one of the persons caught in the image is identified as the character who refuses to be objected, the image collecting unit may not collect the image data in which the person who refuses to be objected is caught.
At least one of the radio waves transmitted and received between the transmitter and the receiver is directive. The timing detecting unit detects positions of both the objected character and an object to absorb attention of the character. The timing detecting unit may detect both the objected character and an object to absorb attention of the character in a predetermined range to be captured in an image.
The transmitting unit may transmit the image data to the image database in substantially every time an image is captured. The transmitting unit may transmit the image data to the image database in substantially every predetermined time interval.
The transmitting unit may transmit the image data to the image database when a predetermined number of images are stored in the camera system. The signal transmitter may transmit the image data to the image database when at least one of following conditions are satisfied that a predetermined number of images are stored and that a predetermined time interval has past.
The outputting unit may include at least one of a printer, a means for recording a CD-R, a means for recording an MD, a web server which offers the images thus collected, a means for sending E-mail to which the image thus collected is attached.
The system may be applied in an amusement park.
According to a second aspect of the present invention, a method for distributing an image in which an objected character is caught, comprises the following steps: registering character information of the objected character; capturing images in which a person who is the objected character is caught; storing image data of the captured images; identifying the person caught in each of the images thus stored as the objected character based on the character information; and collecting the image data in which the character is caught from the stored image data.
The method for distributing an image may include outputting the data of collected image in which the objected character is caught. The method for distributing an image may include distributing the data of image thus collected. The method for distributing an image may include a choosing step, including showing a plurality of collected images in which the character is caught to a user the system objects to distribute the image, and selecting that the system directs the user to select an image the user want to be distributed from the shown images and that the system directs the user to input information which images are to be distributed.
The method for distributing an image may include distributing the data of images thus chosen. The choosing may include limiting the user who chooses the images to the objected character himself or herself based on the character information. The choosing may include verifying the user who chooses the image as the objected character based on the character information.
The method for distributing an image may include outputting the collected image in which the character is caught, and the choosing further includes notifying that the information about selected image is notified to the outputting. The registering may import an image of the character for the character information. The registering may register data about at least one of facial characteristic, body characteristic, and characteristic of outfits of the character.
The registering may have obtaining image of the character, the obtaining captures image about at least one of face, body, and outfit of the character and reads in the image data about at least one of facial characteristic, body characteristic, and outfit characteristic of the character for the character information.
The registering may import a plurality of images about an objected character from a plurality of angles different from one another, and the identifying identifies a person caught in the image thus stored as the objected character based on the plurality of images imported as character information of the objected character.
The registering may update the character information about the objected character whose character information is already registered when new character information is obtained. When a person refuses to be objected, the person who refuses to be objected may register a refusal to be objected in the registering, and the identifying may identify the character who refuses to be objected based on the refusal thus registered, and the collecting may not collect images that at least one of the persons caught in the image is the person who refuses to be objected.
The capturing may capture images using a camera system, the camera system may include a plurality of cameras provided within a predetermined area. The capturing may capture images using a mobile camera and the mobile camera may transmit the images wirelessly. The mobile camera may be installed in an object to absorb attention of the objected character, and the capturing may capture images from the object to absorb the attention.
When a person is caught in a plurality of images and the identifying identifies the person as an objected character in one of the plurality of images, the identifying may identify the same person in the rest of the plurality of images as the objected character. The capturing may capture a plurality of images from a plurality of cameras provided within a predetermined area.
The identifying may set an image group for a plurality of images, the images included in the image group may capture the same object from different angles to one another, and the identifying, when a person caught in one of the plurality of images is identified as an objected character, may also identify the same person in the rest of the images thus captured by the camera included in the camera group as the same objected character.
The identifying may set an image group for a plurality of images, the images included in the image group may capture the same object at different moments from one another, and the identifying may also identify, when a person caught in one of the plurality of images is identified as an objected character, the same person in the rest of the images thus captured by the camera included in the image group as the same objected character.
The identifying may identify a person caught in an image as the objected character substantially every time when the image is captured. The collecting may save only image data in which the objected character is caught. When a person refuses to be objected, the registering may register refusal of the person who refuses to be objected, the identifying may identify a person caught in an image as the person who refuses to be objected substantially every time when the image is captured, and when the identifying may identify at least one of the persons caught in the image as the person who refuses to be objected, the collecting may not collect the image data if at least one of the persons caught in the image is the person who refuses to be objected. The identifying may identify a plurality of people in an image based on the character information corresponding to each of the plurality of characters.
The method for distributing an image may include timing detecting which detects timing for the capturing, and the capturing may capture the image when the timing is thus detected. The method for distributing an image may include locating a position which locates a position of the objected character based on position information of the objected character, when the locating position locates that the objected character is located at a predetermined position, the timing detecting detects the timing for capturing an image.
The method for distributing may includes transmitting which includes controlling the radio wave transmission installed on the objected character, and the timing detecting may have means for receiving radio wave which receives radio waves thus transmitted, the locating position may calculate distance between the camera system for capturing an image and the objected character based on the radio wave thus transmitted and received, and the capturing may capture an image when the distance between the camera system and the character thus calculated becomes a predetermined distance.
The timing detecting may locate positions of both the objected character and a predetermined object to be captured in an image, and the capturing may capture an image when both the objected character and the predetermined object may be located within a predetermined area where both the objected character and the predetermined object are caught in the same image.
The transmitting may transmit image data captured by the capturing to the storing substantially every time an image is captured. The transmitting may transmit image data thus captured to the storing in a predetermined time interval. The transmitting may transmit image data thus captured to the storing when the capturing captures a predetermined number of images.
The transmitting may transmit image data thus captured to the storing when at least one of the following conditions is satisfied that a predetermined number of images are stored and that a predetermined time interval has elapsed.
The outputting may include at least one of printing the image out on paper, recording the image on a CD-R, recording the image on an MD, offering the images on a predetermined URL, sending E-mail to which the image thus collected is attached.
The method for distributing an image may be applied in an amusement park.
According to a third aspect of the present invention, a business method for distributing an image in which an objected character is caught, comprises the following steps: registering character information of the objected character; capturing images in which a person who is the objected character is caught; storing image data of the captured images; collecting data of images in which the character is caught from the stored image data based on the character information thus registered; selecting, the system prompts the person to select an image the character wants to be distributed from the images thus collected; and distributing the selected image in which the character is caught based on the information about the selected image notified from the selecting.
The summary of the invention does not necessarily describe all necessary features of the present invention. The present invention may also be a sub-combination of the features described above. The above and other features and advantages of the present invention will become more apparent from the following description of the embodiments taken in conjunction with the accompanying drawings.
The invention will now be described based on the preferred embodiments, which do not intend to limit the scope of the present invention, but exemplify the invention. All of the features and the combinations thereof described in the embodiment are not necessarily essential to the invention.
The image distributing system 10 has an image management server 20, a character information obtaining unit 30, a character information updating unit 32, a character positioning unit 210, a camera system 40, a timing detecting unit 140, an image selecting terminal 50, and an outputting unit 60. First, a system constructed by the image management server 20, the character information obtaining unit 30, the character information updating unit 32, the camera system 40, the image selecting terminal 50, and the outputting unit 60 is described. A usage of a character positioning unit 210 will be described later.
The character information obtaining unit 30 obtains a character information of a characteristic such as face, body, and outfits of a character who wants to have images distributed by the image distributing system 10. The character information obtaining unit 30 is, for example, a plurality of cameras for capturing character information. The cameras for capturing character information capture images from various angles such as a head-on and a profile of the person. Another example of the character information obtaining unit 30 is a scanner for reading an image. In this case, the scanner reads a photograph attached to a driver's license, for example. In another case such that the character information is already obtained and the obtained character information is recorded in an ID card, an ID card reader for reading information recorded in the ID card is used as a character information obtaining unit 30. The ID card may be issued when the character information is registered.
The character information obtaining unit 30 has a transmitter for transmitting the obtained character information. The transmitter for the character information is, for example, a LAN included in the image distributing system 10. The LAN may include a wireless signal transmitter. The character information obtained by the character information obtaining unit 30 is transmitted to a character information database 110 in the image management server 20 using the LAN. Another example of the transmitter is a portable wireless transmitter and a cellular phone, or the wireless transmitter may be installed in an ID card issued at entrance which is described later.
Some people playing in the amusement park do not want for unspecified other people to obtain their picture image. To satisfy such people, an option is set at the registration of the character information such that only the character by themselves is allowed to obtain the image of the specific person. When entering the amusement park, every person may be prompted to choose whether he or she wants their images to be distributed or refuses to be objected. When the person wants images to be distributed in which he or she is caught, the person may set an optional restriction such that others may not obtains the images in which the registering person is caught. Using such optional settings, when another person collects the images, the images of the specific person are omitted from the collected objects. Such information about limiting the image collection is also included in the character information. The image collecting unit does not collect the images in which at least one person who refuses to be objected is caught.
If each of the persons in the amusement park has a transmitter as described later, the transmitter transmits not only character information of the each of the characters, but also transmits information that the person refused to be objected. In this case, the camera system does not capture the image in which the person who refuses to be objected is caught.
The character information updating unit 32 registers the character information again about the character whose character information is already registered. The character information updating unit 32 has a camera system for re-registration of the character information, and capturing the character information again by capturing an image of the character. The character information updating unit 32 is mainly applied in such a case that a person changes his or her appearance while playing in the amusement park, for example, he or she purchases a hat or a T-shirt and puts on the hat or the shirt. In such case, the character information registered first may not be enough to collect the image properly. Thus, using the character information updating unit 32, the character information is updated. The character information obtained by the character information updating unit 32 is transmitted to the image management server 20, and the character information in the character information database 110 is updated.
The camera system 40 include a plurality of cameras. The cameras are installed in an amusement facility. The installed cameras are preferably painted similar to the surrounding colors and patterns, so that the cameras are not easy to recognize. Thus, the character, not conscious of the camera taking a picture, has his or her image captured with ordinary action and natural facial expression. A transmitter transmits the image data captured by the camera system 40 to the image database 120. The image database 120 is provided in the image management server 20. The transmitter transmits the images captured by the camera system to the image database 120 when a predetermined number of the images are accumulated in the camera, when a predetermined time interval is past, or substantially every time the image is captured.
The camera system 40 located in the amusement facility may include a camera installed in a mobile costume that an actor wears, which is one of the attractions in the amusement park. In this case, the camera is installed in the costume such that it can not be found or seen from the outside, while the image view around (especially in front of) the costume is captured such as a natural facial expression of the person approaching the costume with interest in the costume. In this case, the camera system 40 may transmit to the image management server 20 the captured image using the wireless transmitter.
Furthermore, the camera system 40 include a camera following the predetermined specific material, for example, the above described costume, and capturing images. Using this camera, people playing with the costume and the costume are captured in an image. The camera may be set such that the camera captures images including the character, the costume, and an eye-catching object such as a water fountain, a merry-go-round, and a Ferris wheel.
Here, images captured by the camera system 40 may include a still picture and a moving image. Moving images record a series of actions of a person playing in the amusement facility, so that the images of how the person played in the amusement park may be distributed with more effect than a still picture.
Further, the camera system 40 may include a camera for character identification which is only used for identifying each person playing in the amusement park. For example, a camera for character identification is provided on a gate 390 for which an ID card for identifying the person is used. The ID card may also work as a ticket for the amusement park or a pass for entering a facility in the amusement park. The ID card may include a transmitter described in the following. The transmitter in the ID card transmits the character information about the objected character. The character information may be the information about who refuses to be objected and who registers the restriction that others not obtain his or her images. The ID card records the character information in a form of bar code, which is used at an image selecting terminal described later. When a person passes this gate 390 using the ID card, the camera system for character identification captures an image of the person who passes the gate 390 which is set on an entrance for each of the facilities in the amusement park. Thus, without being recognized by the character, the character information updating unit 32 may capture the updated character information of each character. Positions at a certain time of each character may be checked at the same time.
A region of the image captured by a camera 40 may be calculated by the direction and angle of the camera 40 when the camera 40 is fixed at a predetermined position. When the camera 40 is a mobile camera, the camera 40 may include a GPS device so that a position of the camera 40 is specified. In other case, both when the camera 40 is located in a predetermined position and when the camera 40 is mobile, the region of the captured image may be specified from the image captured by the camera 40 using image recognition of where the image is captured.
The image management server 20 stores the character information transmitted from the character information obtaining unit 30. On the other hand, the image management server 20 stores the image transmitted from the camera system 40. The image management server 20 also stores information attached to the transmitted image, for example, the position information such as when and where the image was captured, with the image.
The image selecting terminal 50 obtains conditions to collect proper images from the images stored in the image management server 20. The user may appoint or specify these conditions. Furthermore, after the collecting is executed, an image to be outputted is appointed or designated from the collected images and the outputting medium is also appointed or designated.
The outputting unit 60 outputs the image appointed or selected to output by the image selecting terminal 50 to the appointed outputting medium.
Here, the position information database 230, character information database 110, image database 120, and image set database 130 are provided in the image management server, but these servers may be provided in a database server separated from the image management server, or each of the databases may stand alone.
Next, the image distributing system 10 will be described from a viewpoint of the user of the present system.
First, a character who wants his or her image to be distributed registers character information for themselves at the character information obtaining unit 30. The registered character information is transmitted to the character information database 110 in the image management server 20. After the registration of the character information, the user plays in the amusement park without recognizing the camera system. While playing, the user has his or her image captured using the camera system 40. The user goes to an image distributing station which has the image selecting terminal 50 whenever he or she wants, selects images the user wants to purchase from the images already captured up till the moment to which the user is imaged. The collection of the images is executed based on the registered character information. The user is prompted to select favorite images from the collected images and a medium on which the image is to be outputted. Thus, the user may obtain the images caught while he or she is playing in the amusement park.
Here, the character information may be registered while playing at the amusement facility or after playing at the amusement facility. In this case, the character may collect the images themselves using the image selecting terminal 50 from images captured by the camera 40 installed in the image selecting terminal 50, and may output the collected images at once.
Further, the image management server 20 has a position information writing unit 220, a position information database 230, an object speed detecting unit 240, an object position forecasting unit 250, and an image screening unit 300 which will be described later.
The character information writing unit 70 executes a processing of receiving the character information obtained by the character information obtaining unit 30, and writing into the character information database 110.
The image writing unit 80 executes a processing of receiving the image captured by the camera system 40 and writing into the image database 120. While this process is executed, the position information of each captured image is also written into the image database 120.
The image collecting unit 90 receives a selecting condition, which includes a character ID of the character who wants to purchase images, from the image selecting terminal 50. The image collecting unit 90 executes collecting the images to be selected corresponding to the character ID included in the collect condition from the images accumulated in the image database. The character information stored in the character information database 110 is used for the collecting of the images. After the images are collected, the image collecting unit 90 transmits to the image selecting terminal 50 a result of the collecting of the images.
An output processing unit 100 outputs the selected images appointed by the image selecting terminal 50 to an appointed output medium. For example, if paper is appointed to the output medium, the output processing unit 100 executes a process of printing the appointed image on paper. In this case, the outputting unit 60 is a printer.
Furthermore, the character information about each of the characters obtained by the character information obtaining unit 30 is recorded in the character information database 110. The character information is information for identifying each of the characters using image recognition. For example, the character information may be described by a facial parameter into which an outline and a size of a face, or shape and size of eyes, a nose, a mouth and so on are digitized. Other than that, the character information includes information about height, physical constitution, clothing, eye glasses, and accessory for each of the characters. There are two kinds of character information, the character information as an initial data inputted for the first time and the character information as an updated data which is updated later.
Furthermore, entry time to a facility (or starting time to apply the image distributing system) is recorded for each of the characters.
On the other hand, a position of a character at a certain time is recorded as position information when the character is caught in an image captured by a camera system so that the position of the person is identified.
Each of the characters may set such limitations that an image with the character caught in sight is not collected or outputted so that no other person may obtain his or her image. Whether this limitation is set or not is also recorded in the character information database 110.
The image database 120 enables identification of each of the images and reference of a character caught in each of the images and information such as a position information where each of the images are captured.
The image set database 130 enables to manage a plurality of images when characters in common are caught in sight. The image set database 130 is used for collecting images and identifying people caught in the image.
The selecting condition setting unit 150 sets a selecting condition for selecting a desired image from the images stored in the image management server 20. The selecting condition is, for example, that the character is smiling or has a predetermined specific facial expression.
Further, when a group of people go to the amusement park, pictures taken with other members in the group are preferred for a souvenir. To meet this need, a selecting condition such that a plurality of people are caught in the same sight maybe set for selecting using the selecting condition setting unit 150. For example, when “images of Ms. A and I are caught in sight in common” is set for a selecting condition, the images of Ms. A and the character I which are caught in sight in common are searched based on the character information of Ms. A and the character I.
The selecting condition set in the selecting condition setting unit 150 may be transmitted to the image management server 20.
The collected image offering unit 160 receives from the image management server 20 a list of the images searched corresponding to the above described selecting condition and displays the transmitted result on a monitor to distribute for the user. When the character information is recorded on the ID card in the form of bar code and the user wears the ID card, the collected image offering unit 160 may have a bar code reader and read the character information. In other case, the collected image offering unit 160 may have a camera system and verify the user, so that the image is distributed only to the objected character themselves.
The outputting image setting unit 170 sets images appointed by the user to images to be outputted selected from the images distributed by the collected image offering unit 160.
The outputting format setting unit 180 sets a medium appointed by the user to medium on which the image is outputted. Paper, CD-R, and MD may be selected for a medium on which the image is outputted. In other case, the outputting is offering image data on the web or sending an attached file with e-mail.
The image to be outputted set at the outputting image setting unit 170 and the type of the output medium for outputting images set at the outputting format setting unit 180 are transmitted to the image management server 20.
Character identification in a set image is one of distinguishing facility included in the image management server 20. A character identification unit 190 processes character identification in a set image. This facility enables to identify a plurality of characters as a whole in case that there are a plurality of images where a character caught in images in common, when the character is identified in one of the images, the character caught in sight in common included in the rest of images in a lump. A set image includes the character in common in a plurality of images captured at the same time from a plurality of cameras having different angles (an angle set), or includes the character in common is caught in sight in a plurality of images captured in a predetermined period from a certain time (a chronological set). For each of the cases, how to identify a character will be described using
When a plurality of people is caught in each of the images, how the person is to be identified is now described. The person in the left end of four, for example, is identified in one of images captured by camera A in an angle set S1. One of the rest of camera B included in the angle set S1 captures a group of four people. When the angle between an optical axis of the camera A and an optical axis of the camera B is less than 180 degree, the person in the left end of four is verified as the identified character. When the angle between an optical axis of the camera A and an optical axis of the camera B is 180 degree or more, the person in the right end of four is verified as the identified character. The position of person to be verified is any one of the groups, but when the number of people included in the group is odd, the center does not move, therefore it is convenient for verifying.
Thus, without identifying characters caught in the images for each of the images, the identification of characters may be executed effectively.
Thus, without identifying characters caught in the images for each of the images, the identification of characters may be executed effectively.
A camera included in the camera system 40, for example, captures images automatically in a predetermined time interval. In this case, an image without any character or an image with a character who does not register character information maybe captured. Thus, the image screening unit 300 executes a processing for selecting and deleting the images captured by the camera 40.
The above described example is preferable when the character information objects to the previously registered characters. On the other hand, when the character information is obtained afterward to the image capturing, the image screening unit 300 checks if any character is caught in the image transmitted from the camera system 40. When there is at least a character is caught in the image, the image is saved. Applying this processing, without registering the character information previously, when the character information is registered afterward to the image capturing, images with character matching to the registered character information may be collected from the images with unidentified people stored in the image database 120 and set to the image selecting terminal 50 by the image collecting unit 90 or by the image identifying unit 95 when a plurality of characters are caught in a plurality of images in common. In this case, the images in which the objected character is caught is set to the image selecting terminal 50 (S 50′) and rest of the images are left in the image database 120 (S 60′).
If the camera system 40 captures images, for example, in predetermined time intervals without concerning a facial expression of the character, the captured image may include many images with an unwanted facial expression captured at improper timing. Improper timing not only increases the images to be searched so that the collecting needs more time, but also distributes images captured in a undesired timing for the user. Thus, it is more preferable for the camera system 40 to include a mechanism for automatically capturing images in a proper predetermined image capturing timing.
At least one of the radio wave transmitted from the transmitter 192 and a region where the receiver 194 receives the radio wave preferably have directivity. The directivity enables detection of the position of the character with higher accuracy so that the timing for capturing an image is detected more properly.
The radio wave transmitted from the transmitter 192 preferably includes character information to identify the character who has the transmitter 192, so that enables an identification of a character caught in an image based on the character information included in the radio wave at the moment when the camera 40 captures the image by the detection of the radio wave. Thus, the character is identified, and the character information or the character ID of the character caught in each of the images is recorded into the image database 120. When a character is searched by the image collecting unit 90 or a character identify unit 95 described later, the image database 120 is applied. Based on the character information or the character ID of the character to be searched, the image data in which the character is caught is searched infallibly and rapidly in the image database 120.
On the other hand, the character information obtaining unit 30, when new character information is obtained about the character whose character information is already obtained (S 170), the character information is transmitted to the image management server 20 (S 180). The character information database is updated based on the transmitted character information (S 190). Thus, when the character information about a certain character is changed, for example, a character puts off his or her contact lens and puts on glasses so that face image is changed, or he or she buys a hat and wears it so that the character information about his or her body is changed while he or she is playing may be processed.
In other case not shown in figures, the user may set a lower limit for the verification degree between the registered character information and the character included in the images to be collected. For example, the lower limit of the verification degree is set at 50%, the images of which the verification degree is more than 50% are selected. When the collected result is distributed to the user, the images are preferably offered in an order of the verification degree, so that the user may choose the images he or she wants from the distributed images conveniently.
On the other hand, the user also selects a medium on which the image is outputted. The medium to be used for image distributing may be chosen from paper (printing out an image on paper), CD-R (writing an image into a CD-R), MD (writing an image into an MD), the Web (the image data is distributed at a predetermined URL on the Web, the user downloads the distributed image data by accessing the predetermined URL), and attaching to mail (an image is sent to an E-mail address appointed by the user attached to a mail). Furthermore, the user may select outputting forms of images such as size, picture quality, color tone, and brightness.
Charge amount for outputting images, corresponding to numbers of the images selected by the user and a choice of the output medium, is also indicated as apart the information. The user selects number of outputting images depending on his or her budget, so that the system becomes more user-friendly.
The user, after confirming the settings about image outputting, selects “output” or “purchase”, and prompts the system to output the appointed images.
The outputted medium (except distributing on the Web and attaching to e-mail) may be handed to the user at the place, or be delivered to where the user appointed. If the user expects to look at the image at once, the image is handed to the user at once. If the user does not want to carry more or expects to look at the image later, the image is properly delivered. The user may choose the preferred delivery.
Next, an image searching system, which is advantageous for the image searching executed in the present embodiment, will be described. The image searching system uses the character positioning unit 210 shown in
The character positioning unit 210 identifies a character and obtains position information about a position of the character at a certain time. The character positioning unit 210 is connected to communicate with the image management server 20. The obtained position information of the character is transmitted to the image management server 20. When a plurality of the characters is objects, the character positioning unit 210 obtains not only positions of each of the characters, but also relative position of each of the characters. An example of the character positioning unit 210 will be described later.
The position information writing unit 220 executes processing of receiving the position information about each of the characters obtained by the character positioning unit 210 and writing into the position information database 230.
The position information database 230 stores position in formations, that is, the position and the time where each of the characters is at a certain time, which is obtained by the character positioning unit 210. An example of the position information database 230 will be described later.
The object speed detecting unit 240 refers times when each of the characters passes two points on a predetermined route which are stored in the position information database 230. Speed of each of the characters is calculated from the distance between these two points and the period to pass these two points. In other case, the character positioning unit 210 may have a speed sensor, in this case, the object speed detecting unit 240 detects a speed of each of the characters directly by the position information sent from the character positioning unit 210.
The object position forecasting unit 250 forecasts where a certain character is when a predetermined period is past since the character passes a predetermined spot, based on the speed of each of the characters calculated by the object speed detecting unit 240.
First, examples for each of the character positioning unit 210 and the position information database 230 will now be described. After this description, an example of image search of the character by the character identifying unit 95 using the position information database 230 will be described.
The position information recorded in position information database 230 is used when the image collecting unit 90 collects images in which a certain character is caught from the image database 120, the character identifying unit 95 searches images in which a certain character is caught from the image database 120, the image screening unit 300 screens the image transmitted from the camera system 40, and the timing detecting unit 140 detects the image capturing timing. Here, for example, the image collecting unit 90 collects images from the image database 120 will be described. The image collecting unit 90 refers the position information database 230 and obtains position information about a certain character. Using this position information enables to narrow the images for a certain character maybe caught in. That is, if a position information that the character whose character ID is 1 is positioned on point P at a certain time is reported, an image captured by the camera system which captures images including point P and captured at the moment are selected as candidates for the image the character ID1 maybe caught in. Images captured by cameras provided on places except the point P at that moment are omitted from the search objects for the character ID1 may be caught in. Thus, a collecting time that an image a certain character is caught in is collected from images a plurality of unidentified characters is caught in is shortened.
Furthermore, the image collecting unit 90 has a means for collecting images the character is caught in when the character goes through a predetermined route.
The character positioning unit 210 is provided on a predetermined point P so that position information of a certain character may be obtained. Using this position information, it is detected that the certain character exists on some point on the predetermined route around point P in a predetermined period after and before when the character passes the point P. Therefore, candidate images for the images the certain character may caught in are selected such that captured in the period around the passing time of point P and capturing points around the point P on the predetermined route from the image database 120.
Furthermore, another character positioning unit 210 is provided on point Q which is located on ahead of the point P on the predetermined route. As these character positioning units 210, the period while the certain character stayed from point P to point Q on the route is detected, so that the candidate images that the certain character is caught in may be further narrowed.
On the other hand, using the object speed detecting unit 240, it is detected that the speed of the certain character when the certain character passes the point P or the speed of the character goes through a predetermined route, so that more accuracy on the narrowing the selection of images may be realized. That is, an outline position of the certain character exists after he or she passed the point P may be forecasted based on when the certain character passes the point P and the speed of the character. More narrowing of images to be collected for images the certain character may be caught in is further executed based on this forecasted point at a certain time.
In some case, a sequence of characters changes only a little while a plurality of characters goes along a route. In such case, characters may be effectively identified by detecting the sequence of the characters.
Applying the above described image collecting system, when images the character possibly caught in is collected from the images captured at various points in various time, the system collects images which have higher possibility the character caught in for search objects based on the position information of the character. Therefore, the collecting images is executed effectively. Here, the description of the image searching system will be finished.
At last, other configurations of the image screening unit 300 which is included in the image management server 20 will be described. The other configurations of the image screening unit 300 limits numbers of images captured by the camera system 40.
The identical image selecting unit 308 executes processing of selecting images the same character caught in from a plurality of images captured by the camera system 40 within a predetermined area.
The image screening processing unit 310 executes processing of limiting the images, which is selected by the identical image selecting unit 308 and each of the characters caught in, to a predetermined number based on a predetermined condition.
The character image recognizing unit 320 recognizes a facial expression of each of the characters caught in the images captured by the camera system 40.
When the identical image selecting unit 308 recognizes that a same character is caught in a plurality of images captured in a certain area, the image screening processing unit 310 decreases a number of images in which the same character is caught based on a predetermined condition. This processing is, for example, saving the first captured image of the character and deleting rest of images the same character caught in. Thus, the number of images maybe reduced when there is plurality of images the same character caught in at similar background and these plurality of images are not so different from each other.
On the contrary, a condition for saving may be appointed for choosing images from a plurality of images a same character caught in the condition. The condition for saving is, for example, “the character caught in the image is smiling”.
The description about the image screening unit 300 which reduces number of the captured images based on a predetermined condition will be finished. This limitation is also applied to collecting performed by the image collecting unit 90 and identifying performed by the character identifying unit 95.
Next, limitation on number of the camera system 40 captures images executed by the image screening unit 300 will be described here.
Therefore, using the image screening unit 300, number of the image to be searched may be reduced, and only the images captured in a proper timing are saved.
The obtaining position information of characters and the timing detection for screening image described above is also applied to the timing detecting performed by the timing detecting unit 140 for capturing preferable images.
Applying the above described image distributing system 10, an image of a character playing in an amusement park with natural facial expression may be captured, the images a certain character caught in is searched from the captured images and distributed to the character himself or herself.
This system is also applied for security use, for detecting a registered person, for example, a habitual shoplifter. Applying this system, watching for the shoplifting using a camera system is effectively executed. In such case, an announcement that a shoplifter is registered to the security system works as a warning to prevent crime.
It is obvious from the description above, according to the present invention, the user is not required to capturing images of himself or herself anymore. The user may search the images of himself or herself with natural facial expression is caught in from images unspecified number of characters are caught in, and purchases the personalized images.
Furthermore, accuracy of image search maybe improved applying the position information to search images.
Limiting number of images captured in a certain region for each of the characters may reduce load for selecting images.
Although the present invention has been described by way of exemplary embodiments, it should be understood that those skilled in the art might make many changes and substitutions without departing from the spirit and the scope of the present invention which is defined only by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2000-201548 | Jul 2000 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5553609 | Chen et al. | Sep 1996 | A |
5563722 | Norris | Oct 1996 | A |
5568406 | Gerber | Oct 1996 | A |
5675358 | Bullock et al. | Oct 1997 | A |
5694514 | Evans et al. | Dec 1997 | A |
5740267 | Echerer et al. | Apr 1998 | A |
5745126 | Jain et al. | Apr 1998 | A |
5806072 | Kuba et al. | Sep 1998 | A |
5850352 | Moezzi et al. | Dec 1998 | A |
5917958 | Nunally et al. | Jun 1999 | A |
5946444 | Evans et al. | Aug 1999 | A |
6018774 | Mayle et al. | Jan 2000 | A |
6031935 | Kimmel | Feb 2000 | A |
6035323 | Narayen et al. | Mar 2000 | A |
6064398 | Ellenby et al. | May 2000 | A |
6080063 | Khosla | Jun 2000 | A |
6081206 | Kielland | Jun 2000 | A |
6084510 | Lemelson et al. | Jul 2000 | A |
6095650 | Gao et al. | Aug 2000 | A |
6111571 | Summers | Aug 2000 | A |
6122409 | Boggs et al. | Sep 2000 | A |
6166729 | Acosta et al. | Dec 2000 | A |
6238337 | Kambhatla et al. | May 2001 | B1 |
6249316 | Anderson | Jun 2001 | B1 |
6260021 | Wong et al. | Jul 2001 | B1 |
6313875 | Suga et al. | Nov 2001 | B1 |
6351556 | Loui et al. | Feb 2002 | B1 |
6359643 | Visvanathan et al. | Mar 2002 | B1 |
6538689 | Chang | Mar 2003 | B1 |
6549913 | Murakawa | Apr 2003 | B1 |
6567121 | Kuno | May 2003 | B1 |
6587596 | Haeberli | Jul 2003 | B1 |
6591068 | Dietz | Jul 2003 | B1 |
6606411 | Loui et al. | Aug 2003 | B1 |
6608650 | Torres et al. | Aug 2003 | B1 |
6609135 | Omori et al. | Aug 2003 | B1 |
6636259 | Anderson et al. | Oct 2003 | B1 |
6639998 | Lee et al. | Oct 2003 | B1 |
6804684 | Stubler et al. | Oct 2004 | B2 |
6807294 | Yamazaki | Oct 2004 | B2 |
7085402 | Lee et al. | Aug 2006 | B2 |
20020188602 | Stubler et al. | Dec 2002 | A1 |
20030018974 | Suga | Jan 2003 | A1 |
20030084065 | Lin et al. | May 2003 | A1 |
Number | Date | Country |
---|---|---|
2563478 | Oct 2005 | CA |
0593183 | Apr 1994 | EP |
1045586 | Oct 2000 | EP |
1077414 | Feb 2001 | EP |
04-071068 | Mar 1992 | JP |
05-161064 | Jun 1993 | JP |
07-193646 | Jul 1995 | JP |
08-077479 | Mar 1996 | JP |
09-294222 | Nov 1997 | JP |
10-215434 | Aug 1998 | JP |
10-224773 | Aug 1998 | JP |
10-243269 | Sep 1998 | JP |
11-258688 | Sep 1999 | JP |
2000-23015 | Jan 2000 | JP |
2000-137722 | May 2000 | JP |
WO 9828053 | Jul 1998 | WO |
WO 03038680 | May 2003 | WO |
Number | Date | Country | |
---|---|---|---|
20020049728 A1 | Apr 2002 | US |