Patent Application
20200234464
This nonprovisional application is based on Japanese Patent Application No. 2017-045443 filed with the Japan Patent Office on Feb. 21, 2017, the entire contents of which are hereby incorporated by reference.
The present invention relates to a system for recognizing a large quantity of chips used in a game house type-by-type via images, and counting the quantity of chips type-by-type.
Conventionally, in game houses such as casinos, game tokens (referred to hereinafter as “chips”) are used for game betting and payout. In order to accurately recognize chips stacked on a table, a method is employed of using cameras and recognizing chips as images. WO 2015/107902 discloses one example of a system for recognizing the in-game movement of chips by using cameras.
When recognizing chips via images by using cameras, it is requested that not only the outlines of the chips be recognized but also the differences in colors of the chips be recognized, and further, that the quantity of chips stacked up be grasped for each type of chip. However, chips recognized by cameras, even if the chips have the same color, are imaged or recognized as having different colors due to the difference in lighting environments in which the chips are placed, and are not recognized as having the same color. Conventionally, it has been thus difficult for example to count the quantity of chips type-by-type from images.
The present invention has been made in view of such a problem, and provides a chip recognition system having a mechanism enabling the recognition of chip color via images and the counting of the quantity of chips even under different lighting environments.
A chip recognition system according to one aspect of the present invention is a recognition system for recognizing a chip used on a game table of a game house, the chip configured to at least partially have a specific color indicative of a value of the chip, the recognition system including: a recording device that uses a camera and records a state of the chip as an image; an image analysis device that subjects the image so recorded to image analysis and recognizes at least two colors being the specific color and a reference color that is present in the image and differs from the specific color; and a recognition device at least including an artificial intelligence device that uses a result of the image analysis by the image analysis device and specifies the specific color of the chip, wherein the artificial intelligence device of the recognition device has been subjected to teaching using, as training data, a plurality of images of the chip and the reference color irradiated with different illumination intensities.
Furthermore, the chip at least has the specific color, which is indicative of the value of the chip, at a predetermined position or with a predetermined shape.
Furthermore, the recognition device specifies the specific color of the chip to specify a quantity in which the chip is provided. Furthermore, the recognition device may specify specific colors of a plurality of the chips chip-by-chip to specify a quantity of chips of each of the specific colors.
Further, the artificial intelligence device of the recognition device has been subjected to teaching using, as training data, a plurality of images of the reference color and the chip irradiated under different lighting environments. Further, the artificial intelligence device may determine the specific color of the chip by using a relative relation with the reference color.
The recognition device determines specific colors of a plurality of the chips stacked one on top of another, and may be configured to be capable of determining the specific colors or a quantity of the chips even when some of the chips are in hidden state due to a dead angle of the camera.
A recognition system for recognizing an article according to one aspect of the present invention, the article at least partially having, on the article itself or a wrapping of the article, a specific color enabling the article or the wrapping to be specified, includes: a recording device that uses a camera and records a state of the article as an image; an image analysis device that subjects the image so recorded to image analysis and recognizes at least two colors being the specific color and a reference color that is present in the image and differs from the specific color; and a recognition device at least including an artificial intelligence device that uses a result of the image analysis by the image analysis device and specifies the specific color of the article itself or the wrapping, wherein the artificial intelligence device of the recognition device has been subjected to teaching using, as training data, a plurality of images of the reference color and the specific color of the article itself or the wrapping irradiated with different illumination intensities.
Furthermore, the article itself or the wrapping at least partially has the specific color, which enables the article or the wrapping to be specified, at a predetermined position or with a predetermined shape.
Furthermore, the recognition device specifies the specific color of the article itself or the wrapping to specify a quantity in which the article is provided. The recognition device may specify specific colors of a plurality of the articles themselves or the wrappings of the articles article-by-article to specify a quantity of articles of each of the specific colors.
Further, the artificial intelligence device of the recognition device has been subjected to teaching using, as training data, a plurality of images of the reference color and the specific color of the article itself or the wrapping irradiated under different lighting environments. Further, the artificial intelligence device may determine the specific color of the article itself or the wrapping by using a relative relation with the reference color.
Further, the recognition device determines specific colors of a plurality of the articles stacked one on top of another or the wrappings of the articles, and is configured to be capable of determining the specific colors even when some of the articles are in hidden state due to a dead angle of the camera. Further, the recognition device determines specific colors of a plurality of the articles stacked one on top of another or the wrappings of the articles, and is configured to be capable of determining a total quantity of the articles or a quantity of the articles of each of the specific colors even when some of the articles are in hidden state due to a dead angle of the camera.
A chip recognition system pertaining to one aspect of the present invention is: a chip recognition system for recognizing a chip used on a game table of a game house, the chip configured to at least partially have a specific color indicative of the value of the chip, the chip recognition system including: a recording device that uses a camera and records a state of the chip as an image; an image analysis device that subjects the image so recorded to image analysis and recognizes at least two colors being the specific color and a reference color that is present in the image and differs from the specific color; and a recognition device at least including an artificial intelligence device that uses a result of the image analysis by the image analysis device and specifies the specific color of the chip, wherein the artificial intelligence device of the recognition device is configured to extract a center line from the image of the chip and subject, to image analysis, a surrounding image covering a predetermined range centered on the center line to recognize, in the surrounding image, at least two colors being the specific color and the reference color, which differs from the specific color, and has been subjected to teaching using, as training data, a plurality of the surrounding images of the chip and the reference color irradiated with different illumination intensities.
A recognition system for recognizing an article, pertaining to one aspect of the present invention is: a recognition system for recognizing an article, the article at least partially having, on the article itself or a wrapping of the article, a specific color enabling the article or the wrapping to be specified, the recognition system including: a recording device that uses a camera and records a state of the article as an image; an image analysis device that subjects the image so recorded to image analysis and recognizes at least the specific color and a reference color that is present in the image and differs from the specific color; and a recognition device at least including an artificial intelligence device that uses a result of the image analysis by the image analysis device and specifies the specific color of the article itself or the wrapping, wherein the artificial intelligence device of the recognition device is configured to recognize the specific color from the image of the article itself or the wrapping, extract an image portion having the specific color, and subject a surrounding image of the specific color to image analysis to recognize, in the surrounding image, at least two colors being the specific color and the reference color, and has been subjected to teaching using, as training data, a plurality of the surrounding images of the specific color of the article itself or the wrapping and the reference color irradiated with different illumination intensities.
The present invention enables the recognition of chips used on a game table type-by-type and the counting of the quantity of the chips from images.
The following describes embodiments of the present invention in detail, with reference to the attached drawings. Note that the same symbols are provided to constituent elements having equivalent functions in the drawings, and detailed description regarding constituent elements provided with the same symbol is not repeated.
In the chip recognition system 10 according to the present embodiment, a chip W is configured to at least partially have a specific color 121 indicative of the value thereof, as illustrated in
Note that the chip recognition system 10 according to the present embodiment is connected in communicable state with respect to the camera 212.
As illustrated in
The recording device 11 includes a stationary data storage such as a hard disk, for example. The recording device 11 records a state of a chip W stacked on the game table 4 as an image captured by the camera 212. Note that the image may be a moving image or may be successive still images.
The recording device 11 may append an index or time with respect to the image acquired from the camera 212, so that imaging history can be later analyzed by the later-described recognition device.
The image analysis device 14 subjects the image recorded by the recording device 11 to image analysis and recognizes at least two colors being the specific color 121, which is at least partially provided to the chip W, and the reference color R that is present in the image and differs from the specific color 121. Note that the specific color 121 is provided at least partially to the chip W at a predetermined position or with a predetermined shape. For example, the specific color 121 may be provided on a lateral surface of the chip W in the circumferential direction, or may be provided as a predetermined mark on a surface of the chip W. Meanwhile, the reference color R may for example be a color of a specific area of the game table 4 or a color provided to a position of the chip W differing from the position of the specific color 121.
The recognition device 12 includes the artificial intelligence device 12a, which uses the result of the image analysis by the image analysis device 14 and specifies the specific color 121 by using deep learning technology, for example. The recognition device 12 determines the quantity and types of the chips W placed on the game table 4. The recognition device 12 may further determine the positions of the chips W on the game table 4.
As illustrated in
In the present embodiment, the learning machine 13 acquires, via the image analysis device 14, a plurality of images, recorded by the recording device 11, of the chip W and the reference color R irradiated with different illumination intensities. Further, the learning machine 13 undergoes learning by being subjected to teaching by a person using the acquired images and the correct colors of the specific color 121 of the chip W and the reference color R in the respective images as training data, and creates a learning model 13a (recognition program). Note that the relative relation between the specific color 121 and the reference color R can be acquired from images of the chip W and the reference color R irradiated with illumination intensities of the same condition, due to the specific color 121 and the reference color R being irradiated with the same illumination intensity. This relative relation, for example, may be utilized in the recognition of the specific color 121. Images each of which was acquired by irradiating from different irradiation angles or images each of which was created by arbitrarily changing the distribution of RGB values of the acquired images may be used as training data.
By a teaching operation being repeated in which a person inputs the above-described training data to the learning machine 13 and causes the learning machine 13 to undergo learning, the accuracy of specification of the specific color 121 of the chip W by the learning model 13a possessed by the learning machine 13 can be improved. The learning machine 13 is capable of creating a learning model 13a with which it is possible to determine specific colors 121 of a plurality of chips W placed on the game table 4 even when some of the chips Won the game table 4 are in hidden state due to a dead angle of the camera 212, by repeating learning of such images in advance.
The learning model 13a so created can be input to the artificial intelligence device 12a via an external medium such as a USB memory, a HDD, etc., or a communication network, etc.
Further, as illustrated in
Note that various modifications can be made based on the above-described embodiment. The following describes one example of a modification, with reference to the drawings. Note that in the following description and the drawings used in the following description, the same symbols as used for the corresponding portions in the above-described embodiment are used for portions that could be configured similarly to the above-described embodiment, and redundant description is also omitted.
Further, in the article recognition system 20 according to the present embodiment, an article B is configured to at least partially have a specific color 121 on the article itself or a wrapping of the article. The specific color 121 enables the article or the wrapping to be specified. Further, the article recognition system 20 according to the present embodiment includes: a recording device 11 that uses the camera 212 and records a state of the article B as an image; an image analysis device 14 that subjects the image so recorded to image analysis and recognizes at least two colors being the specific color 121 and a reference color R that is present in the image and differs from the specific color 121; and a recognition device 12 at least including an artificial intelligence device 12a that uses a result of the image analysis by the image analysis device 14 and specifies the specific color 121 of the article B, wherein the artificial intelligence device 12a of the recognition device 12 has been subjected to teaching using, as training data, a plurality of images of the reference color R and the specific color 121 of the article B itself or the wrapping irradiated with different illumination intensities.
Note that the article recognition system 20 according to the present embodiment is connected in communicable state with respect to the camera 212.
The article recognition system 20 includes: the recording device 11; the recognition device 12; a learning machine 13; and the image analysis device 14. Note that at least part of the article recognition system 20 is realized by using a computer.
The recording device 11 includes a stationary data storage such as a hard disk, for example. The recording device 11 records a state of an article B placed on the article display shelf 5 as an image captured by the camera 212. Note that the image may be a moving image or may be successive still images.
The recording device 11 may append an index or time with respect to the images acquired from the camera 212, so that imaging history can be later analyzed by the later-described recognition device.
The image analysis device 14 subjects the image recorded by the recording device 11 to image analysis and recognizes at least two colors being the specific color 121, which is at least partially provided to the article B, and the reference color R, which is present in the image and differs from the specific color 121. The specific color 121, which is provided to the article B itself or a wrapping thereof, is at least partially provided to the article B itself or the wrapping thereof at a predetermined position or with a predetermined shape, and may be provided at any position of the article B itself or the wrapping thereof and may have various shapes. Meanwhile, the reference color R may for example be a color of a part of a frame of the article display shelf 5 or a color of a wall in the background.
The recognition device 12 includes the artificial intelligence device 12a, which uses the result of the image analysis by the image analysis device 14 and specifies the specific color 121 by using deep learning technology, for example. The recognition device 12 determines the quantity and types of articles B placed on the article display shelf 5. The recognition device 12 may further determine the positions of the articles B placed on the article display shelf 5.
In the present embodiment, the learning machine 13 acquires, via the image analysis device 14, a plurality of images, recorded by the recording device 11, of the article B itself or the wrapping thereof and the reference color R irradiated with different illumination intensities. Further, the learning machine 13 undergoes learning by being subjected to teaching by a person using the acquired images and the correct colors of the specific color 121 provided to the article B itself or the wrapping thereof and the reference color R in the respective images as training data, and creates a learning model 13a (recognition program). Note that the relative relation between the specific color 121 and the reference color R can be acquired from images of article B and the reference color R irradiated with illumination intensities of the same condition, due to the specific color 121 and the reference color R being irradiated with the same illumination intensity. This relative relation, for example, may be utilized in the recognition of the specific color 121. Images each of which was acquired by irradiating from different irradiation angles or images each of which was created by arbitrarily changing the distribution of RGB values of the acquired images may be used as training data.
By a teaching operation being repeated in which a person inputs the above-described training data to the learning machine 13 and causes the learning machine 13 to undergo learning, the accuracy of specification of the specific color 121 provided to the article B itself or the wrapping thereof by the learning model 13a possessed by the learning machine 13 can be improved. The learning machine 13 is capable of creating a learning model 13a with which it is possible to determine specific colors 121 of a plurality of articles B placed on the article display shelf 5 even when some of the articles B on the article display shelf 5 are in hidden state due to a dead angle of the camera 212, by repeating learning of such images in advance.
The learning model 13a so created can be input to the artificial intelligence device 12a via an external medium such as a USB memory, a HDD, etc., or a communication network, etc.
Further, as illustrated in
Specifically, as illustrated in
By a teaching operation being repeated in which a person inputs the above-described training data to the learning machine 13 and causes the learning machine 13 to undergo learning, the accuracy of specification of the center line C of the chip W by the learning model 13a possessed by the learning machine 13 can be improved. The learning machine 13 is capable of creating a learning model 13a with which it is possible to determine center lines C of a plurality of chips W placed on the game table 4 even when some of the chips Won the game table 4 are in hidden state due to a dead angle of the camera 212, by repeating learning of such images in advance.
The learning model 13a so created is input to the artificial intelligence device 12a via an external medium such as a USB memory, a HDD, etc., or a communication network, etc., whereby the artificial intelligence device 12a becomes capable of extracting the center line C of the chip W from the image of the chip W by using artificial intelligence.
Note that image analysis of the center line C from the image may be performed by analyzing the image in its original state or after subjecting the image to image processing such as color emphasis, noise removal, etc., in order to facilitate the recognition of the center line C.
Further, the recognition device 12, without using artificial intelligence, may extract the center line C of the chip W through a method of using the result of the imaging by the camera 212, the recording as the image, and further the image analysis, and measuring image features such as shapes, brightness, chroma, and hue.
As illustrated in
The artificial intelligence device 12a has been subjected to teaching using, as training data, a plurality of images of the chip W and the reference color R irradiated with different illumination intensities. Note that the relative relation between the specific color 121 and the reference color R can be acquired from surrounding images of the center line C of the chip W irradiated with illumination intensities of the same condition, due to the specific color 121 and the reference color R being irradiated with the same illumination intensity. This relative relation, for example, may be utilized in the recognition of the specific color 121.
Further, the recognition device 12, without using artificial intelligence, may recognize the specific color 121 through a method of using the result of the imaging by the camera 212, the recording as the image, and further the image analysis, and measuring image features such as shapes, brightness, chroma, and hue.
In summary, the artificial intelligence device 12a of the recognition device 12 is configured to extract a center line C from an image of a chip W and subject, to image analysis, a surrounding image covering a predetermined range centered on the center line C to recognize, in the surrounding image, at least two colors being a specific color 121 and a reference color R, which differs from the specific color 121, and has been subjected to teaching using, as training data, a plurality of the surrounding images of the chip W and the reference color R irradiated with different illumination intensities.
In another embodiment for determining an article, the artificial intelligence device 12a of the article recognition device 12 extracts a specific color 121 of an article B itself or a wrapping of the article B from an image of the article B itself or the wrapping thereof by using artificial intelligence.
Specifically, as illustrated in
By a teaching operation being repeated in which a person inputs the above-described training data to the learning machine 13 and causes the learning machine 13 to undergo learning, the accuracy of specification of the specific color 121 provided to the article B itself or the wrapping thereof by the learning model 13a possessed by the learning machine 13 can be improved. The learning machine 13 is capable of creating a learning model 13a with which it is possible to determine specific colors 121 of a plurality of articles B placed on the article display shelf 5 even when some of the articles B on the article display shelf 5 are in hidden state due to a dead angle of the camera 212, by repeating learning of such images in advance.
The learning model 13a so created is input to the artificial intelligence device 12a via an external medium such as a USB memory, a HDD, etc., or a communication network, etc., whereby the artificial intelligence device 12a becomes capable of extracting a portion having the specific color 121 provided to the article B itself or the wrapping thereof from the image of the article B by using artificial intelligence.
Note that image analysis of the portion having the specific color 121 from the image may be performed by analyzing the image in its original state or after subjecting the image to image processing such as color emphasis, noise removal, etc., in order to facilitate the recognition of the portion having the specific color 121.
Further, the recognition device 12, without using artificial intelligence, may recognize the portion having the specific color 121 of the article B itself or the wrapping thereof through a method of measuring image features such as shapes, brightness, chroma, and hue.
The artificial intelligence device 12a is further configured to subject, to image analysis, a surrounding image covering a predetermined range around the portion having the specific color 121 (for example, a range corresponding to eight pixels around the portion having the specific color 121) to recognize, in the surrounding image, at least two colors being the specific color 121 and the reference color R, which differs from the specific color 121. Note that image analysis of the surrounding image of the predetermined range around the portion having the specific color 121 may be performed by analyzing the image in its original state or after subjecting the image to image processing such as color emphasis, noise removal, etc., in order to facilitate the recognition of the portion having the specific color 121.
The artificial intelligence device 12a has been subjected to teaching using, as training data, a plurality of images of the portion having the specific color 121 of the article B itself or the wrapping thereof and the reference color R irradiated with different illumination intensities. Note that the relative relation between the specific color 121 and the reference color R can be acquired from surrounding images of the portion having the specific color 121 of the article B itself or the wrapping thereof irradiated under illumination intensities of the same condition, due to the specific color 121 and the reference color R being irradiated with the same illumination intensity. This relative relation, for example, may be utilized in the recognition of the specific color 121. Images each of which was acquired by irradiating from different irradiation angles or images each of which was created by arbitrarily changing the distribution of RGB values of the acquired images may be used as training data.
Further, the recognition device 12, without using artificial intelligence, may recognize the specific color 121 through a method of using the result of the imaging by the camera 212, the recording as the image, and further the image analysis, and measuring image features such as shapes, brightness, chroma, and hue.
In summary, the artificial intelligence device 12a of the recognition device 12 is configured to recognize a specific color 121 from an image of an article B itself or a wrapping thereof, extract an image portion having the specific color 121, and subject a surrounding image of the specific color 121 to image analysis to recognize, in the surrounding image, at least two colors being the specific color 121 and the reference color R, and has been subjected to teaching using, as training data, a plurality of the surrounding images of the specific color 121 of the article B itself or the wrapping thereof and the reference color R irradiated with different illumination intensities.
The above-described embodiments are disclosed for the purpose of allowing those having ordinary knowledge in the technical field to which the present invention belongs to implement the present invention. Those skilled in the art could naturally make various modifications of the above-described embodiments, and the technical concept of the present invention is also applicable to other embodiments. Accordingly, the present invention is not limited to the embodiments disclosed herein, and shall be construed as having the broadest scope in accordance with the technical concept defined by the patent claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-045443 | Feb 2017 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/006247 | 2/21/2018 | WO | 00 |
