Patent Grant
12020538
The present invention relates to a system for detecting fraud in a game in a casino or an error or fraud at the time of wagering chips or doing settlement.
Casinos are attempting to prevent various types of fraud. The casino is equipped with a surveillance camera for surveilling fraud to prevent fraud by determining fraud of a game, fraud of a win or lose result, or fraud of collection or redemption of chips from images from the surveillance cameras.
On the other hand, in order to the number or total amount of wagered chips, proposed is a technique of attaching an wireless IC (RFID) tag to each chip to recognize the amount of the chip.
In a card game monitoring system disclosed in WO 2015/107902 A, fraud monitoring is performed by determining through image analysis of movement of chips whether or not the chips placed on a gaming table are collected or redeemed in accordance with a win or lose result.
The invention is to provide a new system for detecting fraud in a game in a casino or an error or fraud at the time of wagering chips or doing settlement.
According to an aspect of the invention, there is provided a fraud detection system in a casino having a plurality of gaming tables, including: a game recording apparatus which records a progress of a game played in the gaming table as an image; an image analyzing apparatus which performs image analysis on the image of the recorded progress of the game; a win/lose result determining apparatus which determines a win or lose result of each game in the gaming table; and a control device which detects fraud practiced in the gaming table by using a result of the image analysis by the image analyzing apparatus and the win or lose result determined by the win/lose result determining apparatus, wherein the control device recognizes a position, type, and number of the chips wagered by each player through the image analyzing apparatus and recognizes a total amount of chips in a chip tray of a dealer of the gaming table, performs addition/subtraction calculation of an increased/decreased amount of the chips in the game calculated from the position, type, and number of the chips wagered by all the players in the game and the win or lose result of the game obtained from the win/lose result determining apparatus from the total amount of the chips in the chip tray before the settlement of each game and compares a correct total amount of the chips in the chip tray after end of the game and settlement and an actual total amount of the chips in the chip tray at the time of the end of the game obtained through the image analyzing apparatus to determine whether or not there is difference between the correct total amount and the actual total amount.
In the above fraud detection system, the control device may recognize the position, type, and number of the chips wagered by each player through the image analyzing apparatus, recognize the actual total amount of the chips in the chip tray at the time when the collection of all the amount of the lost chips wagered by each player is ended, and compare the correct total amount of the chips in the chip tray added with the increased amount of the chips in the chip tray in the game from the position, type, and number of the chips wagered by the lost player from the total amount of the chips in the chip tray before the settlement of each game and the actual total amount of the chips in the chip tray to determine whether or not there is difference between the correct total amount and the actual total amount.
In the above fraud detection system, in the case where the control device compares the correct total amount of the chips in the chip tray added with the increased amount of the chips in the chip tray in the game from the position, type, and number of the chips wagered by the lost player from the total amount of the chips in the chip tray before the settlement of each game and the actual total amount of the chips in the chip tray and determines that there is no difference between the correct total amount and the actual total amount and the control device compares the correct total amount of the chips in the chip tray after the end of the game and the settlement and the actual total amount of the chips in the chip tray obtained through the image analyzing apparatus at the time of the end of the game and determines that there is difference between the correct total amount and the actual total amount, the control device may determine a mistake in payment and generate a payment mistake signal indicating the mistake in payment.
In the above fraud detection system, the chip tray may be provided with a collection chip tray where the chips wagered by the lost player are collected and temporarily stored, and the image analyzing apparatus and the control device may compare the correct amount of chips in the collection chip tray calculated from the position, type, and number of the chips wagered by the lost player and the actual total amount of the chips in the collection chip tray to determine whether or not there is difference between the correct total amount in the collection chip tray and the actual total amount.
In the above fraud detection system, acquisition of the actual total amount in the chip tray after the end of the game and the settlement through the image analyzing apparatus may be performed any one of: 1) the time when redemption for the winning chips is ended; 2) the time when the cards used in the game are collected to be discarded into a discard area of the table; 3) the time when a predetermined button attached to the win/lose result determining apparatus is pushed; and 4) the time when a marker representing win or lose is returned to an initial state.
In the above fraud detection system, when the control device determines that there is difference that the recognized actual total amount of the chips in the chip tray of the dealer of the gaming table does not match with the increased/decreased amount of the chips calculated from the amount of the chips wagered by all the players and the win or lose result of the game, the game recording apparatus may be configured to be capable of allocating indexes or time points to the acquired images or reproducing the images specified with a collection scene or a redemption scene of the chips so that the record of the game where the difference occurs can be analyzed in the game recording apparatus.
In the above fraud detection system, the image analyzing apparatus or the control device may have a structure where, although a portion of or the entire chips among a plurality of the chips placed on the gaming table is concealed due to a blind spot of the camera, information on the type, number, and position of the wagered chips can be obtained.
In the above fraud detection system, the control device may have a structure capable of: 1) recognizing the position, type and number of the chips wagered in each play position of the game table and comparing the history of win and lose of each player obtained from the win or lose result of each game and the amount of the acquired chips and the statistical data of previous games to extract a strange situation; and 2) comparing a state that, at a play position of a certain gaming table, the amount of betting chips at the lost time is smaller than the amount of betting chips at the win time and the statistical data of previous games to extract a strange situation.
In the above fraud detection system, the control device may perform comparison determination as to whether or not the recognized amount of chips in the chip tray of the dealer of the gaming table is increased or decreased according to the paid amount of the chips corresponding to the exchanged cash or the paid amount of the cash corresponding to the exchanged chips after the exchange of cash and chips.
In the above fraud detection system, the control device may be further provided with database storing history of exchange of cash and the chips, and by referring to the database in unit of a predetermined time or a day, and the control device may be capable of performing comparison determination as to whether or not the recognized amount of the chips in the chip tray of the dealer of the gaming table is increased or decreased according to the paid amount of the chips corresponding to the exchanged cash or the total amount of the paid amount of the cash corresponding to the exchanged chips.
In the above fraud detection system, the control device may be capable of specifying a player of the play position extracted as the difference or the strange situation through the image analyzing apparatus.
In the above fraud detection system, the control device may have a caution function of informing about the existence of the specified player in another gaming table when the specified player departs and arrives at the other gaming table.
In the above fraud detection system, the control device may have at least one of functions of determining as to: 1) whether or not there is movement of chips during the time interval from the start of extraction of cards or from the game start operation of the dealer before the win or lose result of the game is displayed by the card distribution device in each game; 2) whether or not there is movement of chips by a person other than the dealer during the time interval when the dealer collects chips wagered by the losers among the game participants after the end of each game; 3) whether or not a chip is added during the time interval when the dealer collects chips wagered by the losers among the game participants after the end of each game; 4) whether or not the dealer performs payment for a position of chips wagered by the winner among the game participants after the end of each game; and 5) whether or not the winner among the game participants receives wagered chips and paid chips after the end of each game.
In the above fraud detection system, the win/lose result determining apparatus may be a card distribution device which distributes the cards in the gaming table or a control device which determines the win or lose result of each game from information of the image analyzing apparatus reading the cards distributed in the gaming table by using a camera.
According to the fraud detection system of the invention, it is possible to detect fraud in collection and redemption of chips in accordance with a win or lose result of a game.
In addition, according to the system of the invention, although the cards are slanted by “card squeegee” frequently performed by players in a baccarat game or the like, the rank and suit of the cards can be determined by image analysis, so that the total amount of chips being overlapped or being in a blind spot together with the positions can be recognized. In addition, fraud at the time of exchanging cash and chips can be detected.
In a casino such as a casino, highly stacked chips are placed on a gaming table, and thus, there is a problem in that a total amount of the chips cannot be accurately read by an IC tag reading device provided under the gaming table. If the sensitivity of the reading device is heightened, chips placed at other positions (win or lose depends on the position) may be added, and thus, there is a problem in that the total amount of chips at each position cannot be recognized. In addition, in image capturing of a camera, there is a problem in that the total amount of chips cannot be recognized because a blind spot is formed according to a viewing angle of the camera, or entering into a shadow caused by overlap.
In addition, if cards are slanted by “card squeegee” (behavior of bending a face-down card to enjoying a rank of the card little by little) or the like which is frequently performed by players in a baccarat game, there is a problem in that ranks and suits of cards cannot be determined through image analysis using cameras.
In addition, fraud in the gaming table is further more sophisticated, and thus, there is a new problem in that fraud by an advanced betting method which cannot be found through simple detection of largeness or the like in the winning amount in the gaming table cannot be detected by the camera or by tracking the winning amount. In addition, fraud according to conspiracy of a dealer and a player is not sufficiently prevented in the related art.
In order to solve the above-described problems, in a first embodiment, a fraud detection system in a casino having a plurality of gaming tables is configured to include a game recording apparatus which records a progress of a game played in the gaming table including a dealer and a player as an image through a camera, an image analyzing apparatus which performs image analysis on the image of the recorded progress of the game, a card distribution device which determines a win or lose result of each game in the gaming table, and a control device which detects fraud practiced in the gaming table by using a result of the image analysis by the image analyzing apparatus and a win or lose result determined by the card distribution device.
In addition, in the fraud detection system, the card distribution device has a structure capable of reading ranks of the cards distributed. The control device has a structure capable of determining match or mismatch by checking information on the rank obtained from the image of each card distributed in the gaming table by the image analyzing apparatus and information on the rank of the card read by the card distribution device.
In addition, in the fraud detection system, the image analyzing apparatus or the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of obtaining information on rank of a card from the card which is distributed in the gaming table and is folded or stained by a player.
In addition, in the fraud detection system, the control device recognizes positions, types, and numbers of chips wagered by players through the image analyzing apparatus and determines by image analysis of a progress of the game through the image analyzing apparatus whether or not the collection of the lost chips wagered by each player and the redemption for the winning chips are correctly performed in accordance with a win or lose result of the game.
In addition, in the fraud detection system, the image analyzing apparatus or the control device has an artificial intelligence utilizing type structure or a deep learning structure where, although a portion of or the entire chips among a plurality of the chips placed on the gaming table is concealed due to a blind spot of the camera, the information on the type, number, and position of the wagered chips can be obtained.
In addition, in the fraud detection system, the control device has an artificial intelligence utilizing type structure or a deep learning structure where comparison calculation according to the win or lose result of the game can be performed on whether or not the recognized amount of the chips in the chip tray of the dealer of the gaming table is increased/decreased according to the collected amount of the lost chips wagered by each player and the paid amount of the winning chips after the end of the game and the settlement.
In addition, in the fraud detection system, the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of recognizing the position and amount of the chips wagered in each play position of the game table and comparing the history of win and lose of each player obtained from the win or lose result of each game and the amount of the acquired chips and the statistical data of previous games to extract a strange situation.
In addition, in the fraud detection system, the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of comparing a state that, at a play position of a certain gaming table, the amount of betting chips at the lost time is smaller than the amount of betting chips at the win time and the statistical data of previous games to extract a strange situation.
In addition, in the fraud detection system, the control device has a structure capable of extracting the strange situation through the image analyzing apparatus or specifying individual players at the player positions where winning of a predetermined amount or more occurs.
In addition, in the fraud detection system, the control device has a caution function of informing about the existence of the specified player in another gaming table when the specified player departs and arrives at the other gaming table.
In order to solve the above-described problems, according the invention, there is provided a fraud detection system in a casino having a plurality of gaming tables is configured to include a game recording apparatus which records a progress of a game played in the gaming table including a dealer and a player as an image through a camera, a card distribution device which determines a win or lose result of each game in the gaming table, an image analyzing apparatus which performs image analysis on the image of the recorded progress of the game, and a control device which can detect cash and chips in the game table by using a result of the image analysis by the image analyzing apparatus.
The image analyzing apparatus or the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of detecting the exchange of cash and chips in the gaming table in a situation other than the state that the dealer is dealing based on information from the card distribution device or the dealer, capable of recognizing the total amount of the cash which is genuine cash verified by black light and recognizing the total amount of the chips even in the state that a portion of or entire one chip among a plurality of the chips placed on the gaming table as an exchange object is concealed due to a blind spot of the camera, and capable of comparing the total amount of cash placed on the gaming table by the player and the total amount of chips placed by the dealer to determine whether or not the two amounts match with each other.
In addition, in the fraud detection system, the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of performing comparison calculation as to whether or not the recognized amount of chips in a chip tray of a dealer of the gaming table is increased or decreased according to a paid amount of the chips corresponding to the exchanged cash after exchange of cash and chips for settlement.
In addition, in the fraud detection system, the control device has an artificial intelligence utilizing type structure or a deep learning structure where, after the exchange of the cash and the chips for settlement, comparison calculation of match or mismatch between the input amount of the cash according to the input by the dealer and the total amount of the cash according to the result of the image analysis by the image analyzing apparatus can be performed. In addition, the control device has an artificial intelligence utilizing type structure or a deep learning structure capable of performing comparison calculation of match or mismatch between the total input amount of the cash according to the input by the dealer in the gaming table for which the dealer is responsible and the total amount of the cash according to the result of the image analysis by the image analyzing apparatus.
According to the fraud detection system of the embodiment, although the cards are slanted by “card squeegee” frequently performed by players in a baccarat game or the like, the rank and suit of the cards can be determined by image analysis, so that the total amount of chips being overlapped or being in a blind spot together with the positions can be recognized. In addition, fraud at the time of exchanging cash and chips can be detected.
Hereinafter, an overview of the fraud detection system in the casino having a plurality of the gaming tables in the first embodiment will be described more in detail.
The fraud detection system is configured to further include a control device 14 which compares the actual rank of the cards according to the result of the image analysis by the image analyzing apparatus 12 and the win or lose result determined by the card distribution device 3 to detect fraud (for example, mismatch between a sum of ranks of distributed cards and a win or lose result) performed in the gaming table 4. The card distribution device 3 has a structure capable of reading rank (A, 2 to 10, J, Q, K) and suit (heart, spade, or the like) of the card C manually distributed by the dealer 5. The control device 14 has a structure capable of determining match or mismatch by checking information on rank and suit obtained from the image (captured by using the camera 2) of each card distributed in the gaming table 4 by the image analyzing apparatus 12 (using artificial intelligence) and information on rank and suit read by the card distribution device 3. In this fraud detection system, each of the image analyzing apparatus 12 and the control device 14 has a structure including a computer configured with an integrated or plural components, a program, and a memory in a complex manner.
Each of the image analyzing apparatus 12 and the control device 14 has an artificial intelligence utilizing type structure or a deep learning structure where, with respect to even a card C which is distributed in the gaming table 4 and is folded or stained by the player 6, information on rank of the card can be obtained. As illustrated in
The control device 14 having an artificial intelligence utilizing type structure or a deep learning structure can recognize, through the camera 2 and the image analyzing apparatus 12, the position (player, banker, or pair) of the betting area 8 on which the player 6 wagers the chip 9 and the types (different amount values are designated to different colors of the chips 9) and the number of the wagered chips 9. In many case, the chips 9 are not aligned and stacked in the vertical direction, but as illustrated in
The control device 14 is capable of performing analysis and recognition of the total amount of the chips 9 in the chip tray 17 of the dealer 5 of the gaming table 4 by using the image analyzing apparatus 12 and is capable of performing comparison calculation according to the win or lose result of the game as to whether or not the total amount of the chips 9 in the chip tray 17 is increased or decreased according to the amount of the collection of the lost chips 9 wagered by the players 6 and the redemption (9W) of the winning chips of the winning player 6W after the end of the game and the settlement. Although the total amount of the chips 9 in the chip tray 17 are always checked by means of RFID or the like, whether or not the increased or decreased amount is correct is performed by the control device 14 allowing the image analyzing apparatus 12 to perform image analysis of the progress of the game. An artificial intelligence utilizing type structure or a deep learning structure is used for these configurations.
In this example, since fraud or error is detected based on the information of the win or lose result of the game, information as to what position (player, banker, or pair) of the betting area 8 how many and what type of the chips 9 are wagered on, and the increased/decreased amount of the chips 9 in the chip tray 17 after the collection of the lost chips and the redemption for the winning chips 9, fraud or error can be detected although the recognition of the movement of the chips 9 after the end of the game, that is, the movement of the wagered chips 9 toward the player side or the movement toward the dealer side is not performed.
Herein, for example, in the baccarat, the win or lose result of the game can be determined in accordance with the rule of the baccarat by reading the rank of a card C fed out in the game in the card distribution device 3. In addition, the win or lose result of the game can be determined by capturing an image of the gaming table 4 by using the camera 2, analyzing the image by using the image analyzing apparatus 12, and matching the analysis result with the game rule by using the control device 14. In this case, the camera 2, the image analyzing apparatus 12, and the control device 14 constitute a win/lose result determining apparatus. Information on the players at each play position 7 and information as to what position (player, banker, or pair) of the betting area 8 how many and what type of the chips 9 are wagered on can be obtained by capturing an image of the chips 9 placed on the betting area 8 by using the camera 2 and analyzing the image at each play position 7 by using the image analyzing apparatus 12.
In addition, the increased/decreased amount of the chips 9 in the chip tray 17 before and after the collection of the lost chips 9 and the redemption for the winning chips 9 can be calculated by comparing total amount of the chips 9 in the chip tray 17 before the collection of the lost chips 9 and the redemption for the winning chips 9 and the total amount of the chips 9 in the chip tray 17 after the collection of the lost chips 9 and the redemption for the winning chips 9. The total amount of the chips 9 in the chip tray 17 before the collection of the lost chips 9 and the redemption for the winning chips 9 and the total amount of the chips 9 in the chip tray 17 after the collection of the lost chips 9 and the redemption for the winning chips 9 can be detected by capturing an image of the chip tray 17 containing the chips 9 by using the camera 2 and analyzing the image by using the image analyzing apparatus 12. In addition, the total amount of the chips 9 contained in the chip tray 17 may be detected by burying RFIDs representing the amount is in the chips 9 and providing an RFID reader to the chip tray 17.
For example, the total amount of the chips 9 in the chip tray 17 before the start of the game is denoted by Bb, and the total amount of the chips 9 in the chip tray 17 after the end of the game and the end of the collection of the lost chips and the redemption of the winning chip is denoted by Ba. In addition, in the game, the total amount of the entire play positions 7 in the player area where the chips 9 are wagered is denoted by bp, the total amount of the entire play positions 7 in the banker area where the chips 9 are wagered is denoted by bb, and the total amount of the entire play positions 7 in the tie area where the chips 9 are wagered is denoted by bt. For example, in the case where the win or lose result of the game is banker win, Ba−Bb=bp−bb+bt needs to be satisfied. Alternatively, the total amount Ba of the chips 9 in the chip tray 17 after the end of the game needs to be (Bb+bp−bb+bt). In the case where the above condition is not satisfied, it may be determined that fraud or mistake occurs in the collection of the chips or the redemption for the chips.
In addition, the redemption for the chip 9W to the wining player 6W is performed by using the chips 9 in the redemption chip tray 172, and the image analyzing apparatus 12 and the control device 14 can secure an enough time to recognize the actual total amount of the chips 9 in the collection chip tray 171 after the collection.
The gaming table 4 is provided with a discard area 41 and/or a discard slot 42 for discarding the cards C used in the game. When the game is ended, the cards C used in the game are collected and discarded in the discard area 41 or the discard slot 42 on the gaming table 4.
The gaming table 4 is further provided with a marker 43 indicating win or lose of the game.
In this manner, in the embodiment, the control device 14 calculates balance in chips from the amount of the betting chips on the gaming table 4 for each game and the win or lose result of the game and verifies the increased amount of the balance of the chips in the chip tray 17 after the game. If the difference is detected in the verification, the control device 14 issues caution or adds the record indicating this message to the record of the video captured by the camera 2. A casino manager can investigate the cause of the difference by checking the video.
In the embodiment, the fraud detection system performs addition/subtraction calculation of the increased/decreased amount of the chips in the game calculated from the position, type, and number of the chips 9 wagered by all the players 6 in the game and the win or lose result of the game obtained from the win/lose result determining apparatus from the total amount of the chips 9 in the chip tray 17 before the settlement of each game and compares the correct total amount of the chips 9 in the chip tray 17 after the end of the game and the settlement and the actual total amount of the chips 9 in the chip tray 17 at the time of the end of the game obtained through the image analyzing apparatus 12 to determine whether or not there is difference between the correct total amount and the actual total amount.
The control device 14 recognizes the position, type, and number of the chips wagered by each player through the image analyzing apparatus 12, recognizes the actual total amount of the chips in the chip tray at the time when the collection of all the amount of the lost chips wagered by each player is ended, compares the correct total amount of the chips 9 in the chip tray 17 added with the increased amount of the chips in the chip tray 17 in the game from the position, type, and number of the chips wagered by the lost player from the total amount of the chips in the chip tray before the settlement of each game and the actual total amount of the chips 9 in the chip tray 17 to determine whether or not there is difference between the correct total amount and the actual total amount.
In the case where the control device 14 compares the correct total amount of the chips 9 in the chip tray 17 added with the increased amount of the chips in the chip tray 17 in the game from the position, type, and number of the chips 9 wagered by the lost player from the total amount of the chips 9 in the chip tray 17 before the settlement of each game and the actual total amount of the chips 9 in the chip tray 17 and determines that there is no difference between the correct total amount and the actual total amount and the control device compares the correct total amount of the chips in the chip tray 17 after the end of the game and the settlement and the actual total amount of the chips 9 in the chip tray 17 obtained through the image analyzing apparatus 12 at the time of the end of the game and determines that there is difference between the correct total amount and the actual total amount, the control device determines a mistake in payment and generates a payment mistake signal indicating the mistake in payment.
The chip tray 17 is provided with a collection chip tray 171 where the chips 9 wagered by the lost player are collected and temporarily stored. The image analyzing apparatus 12 compares the correct total amount of the chips 9 in the collection chip tray 171 added with the increased amount of the chips 9 in the game calculated from the position, type, and number of the chips 9L wagered by the lost player and the actual total amount of the chips 9 in the collection chip tray 171 to determine whether or not there is difference between the correct total amount and the actual total amount.
When the control device 14 determines that there is difference that the recognized actual total amount of the chips 9 in the chip tray 17 of the dealer 5 of the gaming table 4 does not match with the increased/decreased amount of the chips calculated from the amount of the chips wagered by all the players and the win or lose result of the game, the game recording apparatus 11 may allocate indexes or time points to the acquired images or may reproduce the images specified with a collection scene or a redemption scene of the chips 9 so that the record of the game where the difference occurs can be analyzed in the game recording apparatus 11.
In this manner, the control device 14 acquires the total amount of the chips in the chip tray 17 after the end of the game and the settlement through the image analyzing apparatus 12, and in this case, the determination after the settlement is performed at any one of the times 1) to 4) as follows: 1) The time when redemption for the winning chips 9 is ended. 2) The time when the cards C used in the game are collected to be discarded into a discard area 41 or a discard slot 42 of the table; 3) The time when a predetermined button attached to the win/lose result determining apparatus is pushed; and 4) The time when a marker 43 representing win or lose is returned to an initial state.
In addition, the control device 14 has an artificial intelligence utilizing type structure or a deep learning structure capable of extracting a strange situation (set by the casino side) by recognizing the position (position of player, banker, or pair wagered) and amount (type and number) of the chips wagered on each play position 7 of the gaming table 4, comparing the history of win and lose of each player 6 obtained from win or lose result of each game and the amount of the acquired chips (winning amount) and the statistical data of a large number of previous games (big data). Typically, the control device 14 has an artificial intelligence utilizing type structure or a deep learning structure, where, in the case where an winning amount of a certain amount (one million dollars) or more occurs and the state that the amount of betting chips at the lose time is small and the amount of betting chips at the win time is large at a play position 7 of a certain gaming table 4 continues several games, the state can be extracted as a strange situation by comparing the state and the statistical data (big data or the like) of previous games.
In addition, the control device 14 (integrated with the image analyzing apparatus 12) of the fraud detection system has a structure capable of extracting a strange situation or specifying individual player 6 at the play position 7 which the player wins a predetermined amount or more. With respect to the specifying of the player 6, in the image analyzing apparatus 12, an image of a face is obtained by extraction of feature points, and identification number (ID) is provided to specify the player. In addition, the control device 14 has a caution function of informing about the existence of the specified player in another gaming table when the specified player 6 departs and arrives at the other gaming table. More specifically, a pit manger managing each gaming table 4 or each table manager (or a dealer) is informed, so that the strange situation can be further prevented.
In addition, control device 14 is provided with database storing history of exchange of cash K and the chips 9. By referring to the database in unit of a predetermined time or a day, the control device performs comparison determination as to whether or not the recognized amount of the chips 9 in the chip tray 17 of the dealer 5 of the gaming table 4 is increased or decreased according to the paid amount of the chips 9 corresponding to the exchanged cash K or the total amount of the paid amount of the cash K corresponding to the exchanged chips 9.
In addition, in the above-described example, the history of win and lose and the amount of the acquired chips (winning amount) for each play position 7 may be surveilled without specifying individual player 6. In this case, if each player 6 leaves the seat, the player 6 cannot be tracked. However, the strange situation where the amount of betting chips at the lose time at the specified play position 7 of one game table 4 is small and the state that the amount of betting chips at the win time is large continues for several games can be detected. Next, in the case where such a play position 7 is detected, it is suspected that there is fraud or error at the play position 7. Next, by verifying the video obtained by capturing an image of the play position 7, the fraud or error can be found.
More specifically, the camera 2 is installed to capture at least an image of the chips 9 placed on the betting area 8 of the gaming table 4. The image analyzing apparatus 12 analyzes the image captured by the camera 2 to detect which of the positions “player”, “banker”, and “tie” of the betting area 8 the chips are placed on for each user position 7 and the amount of the placed chips. In addition, the card distribution device 3 also functions as a win/lose result determining apparatus to determine the win or lose result of the game. The control device 14 records (surveils) the history of win and lose and the amount of the acquired chips (acquired amount of chips) for each play position 7 based on the position (player, banker, or tie) of the betting area 8 on which the chips 9 are placed and the win or lose result of the game. In addition, any one of the history of win and lose and the acquired amount of chips may be recorded. In the case of a strange situation (set by the casino side) that the history of win and lose and/or the history of the acquired amount of chips are strange in comparison with the statistical data of a large number of previous games (big data), the control device 14 specifies the player position 7 as a play position where fraud is suspected to occur.
In the case where fraud is suspected to occur at a certain player position 7, the fraud detection system may generate alarm (light, sound, or vibration) so that at least dealer can perceive at this time. Therefore, at least at this moment, by stopping the subsequent game or the like, it is possible to prevent the fraud from continuously occurring. In addition, information indicating that fraud is suspected to occur may be added to the image captured and recorded by the camera 2. Therefore, by checking video, it is possible to find a cause of the suspicion of the fraud.
The fraud detection system in the casino having the gaming table according to the embodiment further has a function of performing inspection at the time of exchange of cash and chips which is frequently performed in the gaming table 4. In the casino such as a casino, before a game, the player 6 exchanges money (cash or the like) and gaming chips at a predetermined cashier cage. When the player 6 spends all chips, the player may exchange cash and chips 9 on the gaming table (baccarat table or the like) to continuously do the game without leaving the seat from the gaming table 4. However, at the point, there is a chance of fraud between the dealer 5 and the player. On the gaming table (baccarat table or the like), the exchange of the cash and the chip 9 needs to be performed when the game is not in progress. In order to determine the win or lose of the game, the card distribution device 3 can detect card dealing start and dealing end (time of determining the win or lose). Therefore, the card distribution device 3 detects a situation other than card distributing (dealing), and the control device 14 detects the exchange of the cash and the chips 9 in the gaming table 4 in the situation other than the card dealing (illustrated in
The control device 14 can recognize the number and amount of cash K by performing the image analysis on the surface of the cash. In addition, in the gaming table 4, whether or not the cash K in exchange for the chips 9 is genuine is performed by irradiating the cash with black light to detect a genuine mark G of the cash. As illustrated in
The control device 14 has an artificial intelligence utilizing type structure or a deep learning structure capable of performing comparison calculation as to whether or not the total amount of the chips 9 in the chip tray 17 of the dealer 5 of the gaming table 4 is increased or decreased according to the paid amount of the chips corresponding to the exchanged cash after the exchange of cash and chips and the settlement. The case where the total amount of the chips 9 in the chip tray 17 of the dealer 5 is always checked by the RFID or the like of the chips 9 in advance may be considered. In addition, the total amount of the chips 9 contained in the chip tray 17 can be detected by capturing an image of the chip tray 17 containing the chips 9 by using the camera 2 and analyzing the image by using the image analyzing apparatus 12.
In addition, the control device 14 verifies match between the increase or decrease of the amount of the chips 9 in the chip tray 17 and the exchanged amount of the chips according to the result of the image analysis of the gaming table 4 before and after the exchange of cash and chips. The paid amount of the cash may be input to the control device 14 by the dealer 5 through key input or the like. The paid amount of the cash may be specified by the camera 2 capturing an image of the gaming table 4 where the cash is being paid and by the image analyzing apparatus 12 analyzing the image.
As described above, the control device 14 determines whether or not the decreased amount of the chips 9 in the chip tray 17 due to the exchange of cash and chips matches with the amount of the cash paid to the dealer 5 by the player 6. In addition, the control device 14 is an intelligence control device and has an artificial intelligence utilizing type structure or a deep learning structure capable of performing comparison calculation of match or mismatch between the input amount (typically, obtained by key input or the like) of the cash by the dealer 5 and the calculated amount of the cash obtained from the result of the image analysis by the image analyzing apparatus 12 after the exchange of cash and chips and the settlement.
In addition, the control device 14 has an artificial intelligence utilizing type structure or a deep learning structure capable of performing comparison calculation of match or mismatch between the total input amount of the cash according to the input by the dealer in the gaming table 4 for which the dealer is responsible and the total amount of the cash according to the result of the image analysis by the image analyzing apparatus 12.
The control device 14 performs comparison determination as to whether or not the recognized amount of the chips 9 in the chip tray 17 of the dealer 5 of the gaming table 4 is increased or decreased according to the paid amount of the chips 9 corresponding to the exchanged cash or the paid amount of the cash corresponding to the exchanged chips 9 after the exchange of the cash and the chips 9.
Among many table games played in a casino such as a casino, there are baccarat and blackjack. In such a game, a standard deck of 52 playing cards is used, the playing cards are distributed on the game table from a card distribution device including a plurality of decks (six to nine decks or ten decks) which are shuffled in advance, and win or lose is determined according to the number of distributed cards and a game rule.
The distribution of the cards from the card distribution device and the settlement of betting money to a player (game participant) are performed by a dealer or the like who is responsible for the gaming table. In a casino such as a casino, prevention of error or fraud in the settlement of the betting money for the player (game participant) is attempted.
WO 2015/107902 A discloses a card game monitoring system of reading movement of chips by using a surveillance camera and checking whether or not betting money is paid to a winner.
In a baccarat or a blackjack, there are problems in that, in the betting by a player or in the settlement for betting money to the player (game participant) by the dealer, timing of performing the betting and the settlement, who places the chips, or who takes the chips cannot be detected, and thus, whether or not these are correct cannot be recognized.
In order to solve the above-described problems, according to the second embodiment, a fraud detection system in a casino including a gaming table includes a game monitoring device which monitors a progress of a game played on the gaming table by using a camera, an image analyzing apparatus which performs image analysis on an image obtained from the camera, a card distribution device which determines a win or lose result of each game in the game table, and a control device which specifies positions of chips placed on the gaming table by game participants by using a result of the analysis of the image analyzing apparatus in each game and determines a winner and losers among the participants of each game by using the win or lose result, and the control device further includes a function of determining at least one of: 1) whether or not there is movement of chips during the time interval from the start of extraction of cards or from the game start operation of the dealer before the win or lose result of the game is displayed by the card distribution device in each game; 2) whether or not there is movement of chips by a person other than the dealer during the time interval when the dealer collects chips wagered by the losers among the game participants after the end of each game; 3) whether or not a chip is added during the time interval when the dealer collects chips wagered by the losers among the game participants after the end of each game; 4) whether or not the dealer performs payment for a position of chips wagered by the winner among the game participants after the end of each game; and 5) whether or not the winner among the game participants receives wagered chips and paid chips after the end of each game.
In addition, the control device may be configured so as to determine at least one of the aforementioned 1) to 5) by detecting movement of hands of the dealer and the game participants, movement of the chips, or the movement of hands and the movement of chips by using the result of the analysis of the image analyzing apparatus.
In addition, the control device may be configured so as to determine whether or not the amount of chips paid to the winner by the dealer is correct in accordance with the amount wagered by the winner among the game participants.
In addition, the fraud detection system of the game may be further provided with a monitor or lamp which receives the determination result and performs caution or display.
According to the fraud detection system of the embodiment, in a baccarat or a blackjack, in the betting by the player or in the settlement for betting money to the player (game participant) by the dealer, timing of performing the betting and the settlement, who places the chips, or who takes the chips can be detected, so that such an error or fraud is detected, a caution of the error or fraud is issued or the error or fraud is displayed, and the recurrence there can be prevented.
Before the embodiment is described in detail, a flow of a baccarat game played in a casino such as a casino will be described. In addition, in the second embodiment, the same components as those of the first embodiment are denoted by the same reference numerals.
As described in
After that, the playing cards 1 are extracted one by one from the card distribution device 3 on the gaming table 4 in the state that the back side is faced up. First, four cards are extracted, as illustrated in (1) to (4) of
Hereinafter, an overview of the fraud detection system for the game in the embodiment of the invention will be described.
The control device 14 of the fraud detection system has a chip detecting function of specifying which of the betting areas 8 of the player side and the banker side on the gaming table 4 the players 6 (game participants) wager the chips 9 on by using the result of the analysis of the image analyzing apparatus 12 in each game. It is assumed that, when the chips 9 are overlapped in a deviated manner or are in a blind spot from the position of the camera 2, the position and total amount of the chips 9 (which of the betting areas 8 of the player side and the banker side the chips 9 are wagered on) cannot be read normally. The control device 14 is configured to be capable of recognizing concealing or the like (including concealing of a portion of one chip and concealing of the entire chip) of the chip 9 caused by the blind spot, so that the number of chips or the like can be accurately recognized by using a self-learning function or the like according to an existing artificial intelligence utilizing type computer or control system and deep learning (structure) technique. In addition, the structure of detecting the position and type of the chip 9 in the betting area 8 is not limited thereto, but for example, the structure may be configured so that the position and the type can be detected by reading the ID buried in the chip.
As described heretofore, the control device 14 can recognize, through the camera 2 and the image analyzing apparatus 12, the position (position of player, banker, or pair wagered) on which each player 6 wagers the chips 9 and the type (different amount values are designated to different colors of the chips 9) and number of the chips 9, and the control device can detect who is the player 6 betting on the “player” (in the case where there are a plurality of the players 6 betting on the “player”, who is the player 6 wagering the highest amount) and who is the player 6 betting on the “banker” (in the case where there are a plurality of the players 6 betting on the “banker”, who is the player 6 wagering the highest amount). In this fraud detection system, each of the image analyzing apparatus 12 and the control device 14 has a structure including a computer configured with an integrated or plural components, a program, and a memory in a complex manner.
The control device 14 has a structure capable of determining match or mismatch by checking information on rank and suit obtained from the image (captured by using the camera 2) of each card 1 distributed in the gaming table 4 by the image analyzing apparatus 12 and information on rank and suit read by the card distribution device 3. The control device 14 determines by image analysis of a progress of the game through the image analyzing apparatus 12 according to the win or lose result of the game determined by the card distribution device 3 for each game whether or not the collection of the lost chips 9 wagered by the players (game participants) 6 and the redemption of the winning chips to the winning player (game participant) 6 are correctly performed in accordance with the win or lose result.
As remarkable functions of the invention, the control device 14 has functions described in the following 1) to 5) according to the rule of the baccarat game and determines whether or not fraud in discordance with the rule is performed. Namely, the functions are as follows: 1) Whether or not there is movement of the chips 9 is surveilled by the information obtained the image analyzing apparatus 12 using the camera 2 during the time interval from the signal starting the card extraction obtained from the card distribution device 3 or from the game start operation of the dealer 5 pushing a start button 4s before the win or lose result of the game is displayed by the card distribution device 3 in each game (illustrated in
The control device 14 performs analysis of the information obtained by using the camera 2 by the image analyzing apparatus 12. Namely, although the above-described surveillance of from 1) to 5) is performed by detecting the movement of the hands of the dealer 5 and the game participant 6, the movement of the chips, or the movement of the hands and the movement of the chips by the using the analysis result of the image analyzing apparatus 12, in a fundamental analysis, it needs to be found at least who the chips 9 is taken to. Hereinafter, a method of the analysis will be described with reference to
The chips 9 wagered by the game participant 6L losing the game are collected by the dealer 5. Whether or not the collection is accurately performed is surveilled by analyzing the information obtained by using the camera 2 in the image analyzing apparatus 12. First, a change from the state (
While the dealer 5 collects the chips 9 wagered by the game participant 6L losing the game, it is surveilled whether or not another person takes the lost chips 9 fraudulently (
First, with respect to the winning chips illustrated in
In addition, the control device 14 is configured to determine whether or not the amount of chips redeemed to the winner by the dealer 5 is correct according to the amount wagered by the winner 6W among the game participants 6. Hereinafter, a specific example thereof is described. It is assumed that, when the chips 9 are overlapped in a deviated manner or are in a blind spot from the position of the camera 2, the position and total amount of the chips 9 (which of the betting areas 8 of the player side and the banker side the chips 9 are wagered on) cannot be read normally. The control device 14 is configured to be capable of recognizing concealing or the like (including concealing of a portion of one chip and concealing of the entire chip) of the chip 9 caused by the blind spot, so that the number of chips or the like can be accurately recognized by using a self-learning function or the like according to an existing artificial intelligence utilizing type computer or control system and deep learning (structure) technique. In addition, the structure of detecting the position and type of the chip 9 in the betting area 8 is not limited thereto, but for example, the structure may be configured so that the position and the type can be detected by reading the ID buried in the chip.
As described heretofore, the control device 14 can recognize, through the camera 2 and the image analyzing apparatus 12, the position 8 (position of player, banker, or pair wagered) on which each player 6 wagers the chips 9 and the type (different amount values are designated to different colors of the chips 9) and the number of the chips, and the control device can detect who is the player 6 betting on the “player” (in the case where there are a plurality of the players 6 betting on the “player”, who is the player 6 wagering the highest amount) and who is the player 6 betting on the “banker” (in the case where there are a plurality of the players 6 betting on the “banker”, who is the player 6 wagering the highest amount).
In addition, the control device 14 of the fraud detection system in the game analyze the information obtained by the image analyzing apparatus 12 using the camera 2 by the above-described method in accordance with the rule of the baccarat game and performs surveillance. By performing the surveillance illustrated in the above-described 1) to 5), it is determined whether or not fraud in discordance with the rule is performed. When fraud is detected, a card distribution sensing device 14C turns on abnormality display lamps 16 provided to both of the card distribution device 3 and the gaming table 4 and outputs 15 the fraud detection to a casino management department or the like in a wireless or wired manner. A monitor or a lamp which receives the determination result to perform caution or display may be further provided to another site.
As described heretofore, the fraud is detected by the control device 14, and, at the detecting time or a proper timing, a display signal is output to the display lamp 13 of the card distribution device 3 or the abnormality display lamp 16. However, besides the performing of caution, after the time when the fraud or error is detected, a card distribution preventing function of the card distribution device 3 may be performed to prevent the distribution of the cards 1.
Hereinafter, an embodiment of the card distribution device 3 used in a table game system according to the invention will be described with reference to
Next, the distribution restricting device 30 which restricts the entering and exiting of the cards 1 from the card containing portion 102 will be described with reference to
Next, a modified example of the distribution restricting device 30 will be described with reference to
Next, details of the code reading unit 108 which reads a code 52 representing a digit (number, rank) of the card 1 from the card 1 when the card 1 is manually extracted from the card containing portion 102 will be described.
The object detection sensors 22 and 23 are optical-fiber type sensors of detecting the existence of the card 1 and can detect the movement of the card 1. One object detection sensor 22 is located at the upstream side of the card guiding portion 105 in the card 1 flowing direction, and the other object detection sensor 23 is located at the downstream side. As illustrated in the figure, the two object detection sensors 22 and 23 are provided at the respective upstream and downstream sides to interpose the UV sensors 20 and 21. The UV sensors 20 and 21 have LEDs (UV LEDs) emitting a UV ray and sensors. A mark M of the code 52 is printed on the card 1 by using UV ray emitting ink which exhibits color if the ink is hit by the UV ray. By irradiating the card 1 with the UV ray (black light), reflected light of the mark M of the code 52 of the card 1 is sensed by the sensor. The UV sensors 20 and 21 are connected to the code reading unit 108 and the control unit 109 through cables. In the code reading unit 108, a combination of the marks M is determined and the number (rank) corresponding to each code 52 is determined from the output signal of the sensors, that is, the UV sensors 20 and 21.
In the code reading unit 108, starting and ending of the UV sensors 20 and 21 are controlled by the control unit 109 based on the detection signals of the object detection sensors 22 and 23. In addition, the control unit 109 determines based on the detection signals of the object detection sensors 22 and 23 whether or not the card 1 passes through the card guiding portion 105 normally. As illustrated in
The relationship between the code 52 and the outputs of the “on” signals of the two UV sensors 20 and 21 is illustrated in
In addition, in the above-described embodiment, although the image analyzing apparatus 12 or the control device 14 is a device having an artificial intelligence utilizing type structure or a deep learning structure, specifically, the image analyzing apparatus 12 or the control device 14 may perform image analysis or the above-described various controls by using scale-invariant feature transform (SIFT) algorithm, convolution neutral network (CNN), deep learning, machine learning, or the like. Such a technique is a technique of performing image recognition on a captured image to recognize an object included in the image. Particularly, in recent years, object recognition at high accuracy is performed by using a deep learning technique utilizing a multilayered neutral network. In the deep learning technique, generally, layers covering multiple stages are overlapped in intermediate layers between an input layer and an output layer of the neutral network, so that the object is recognized at high accuracy. In the deep learning technique, particularly, a convolution neutral network has drawn attention because the convolution neutral network has higher performance than the object recognition based on image feature amounts in the related art.
In the convolution neutral network, recognition object images attached with label are learned, and main objects included in the recognition object image are recognized. In the case where a plurality of the main objects exist in the learned image, an area rectangle is specified, and the image corresponding to the specified area is attached with a label and the learning is performed. In addition, in the convolution neutral network, the main objects in the image and the positions of the objects can also be determined.
As the convolution neutral network is described more in detail, in the object recognition process, edge extraction process and the like is performed on the recognition object image, candidate areas are extracted based on localized features, the candidate areas are input to the convolution neutral network to extract feature vectors, classification is performed, and the candidate area having the highest degree of certainty among the classified candidate areas is acquired as a result of the recognition. The degree of certainty is a quantity representing how higher a degree of similarity between a certain image area and a subject of the image learned together with the label is than the degree of similarity of another class.
In addition, devices having an artificial intelligence utilizing type structure or a deep learning structure are disclosed in U.S. Pat. No. 9,361,577, US 2016-171336 A, US 2015-036920 A, JP 2016-110232 A, and these disclosures are incorporated into this specification by reference.
Heretofore, although various embodiments of the invention are described, the above-described embodiments can be modified within the scope of the invention by the skilled in the art, and if needed in a game to which the embodiment is applied, the apparatus according to the embodiment may be appropriately modified.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015-163213 | Aug 2015 | JP | national |
| 2015-206735 | Oct 2015 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 16/870,028 filed May 8, 2020, which is a continuation of U.S. patent application Ser. No. 15/749,643 filed Feb. 1, 2018 (now U.S. Pat. No. 10,930,112), which is a national phase application under 35 U.S.C. § 371 from International Application No. PCT/JP2016/072671 filed 2 Aug. 2016, which claims the benefit of JP Patent Application No. 2015-163213, filed on Aug. 3, 2015 and JP Patent Application No. 2015-206735, filed on Oct. 1, 2015, the disclosure of each of which is incorporated herein by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4026309 | Howard | May 1977 | A |
| 4814589 | Storch | Mar 1989 | A |
| 5361885 | Modler | Nov 1994 | A |
| 5479535 | Komatsu | Dec 1995 | A |
| 5651548 | French et al. | Jul 1997 | A |
| 6234294 | Defeo et al. | May 2001 | B1 |
| 6460848 | Soltys et al. | Oct 2002 | B1 |
| 6530837 | Soltys et al. | Mar 2003 | B2 |
| 7213812 | Schubert et al. | May 2007 | B2 |
| 7846020 | Walker et al. | Dec 2010 | B2 |
| 8342529 | Snow | Jan 2013 | B2 |
| 8870073 | Detwiller | Oct 2014 | B2 |
| 9262885 | Moore et al. | Feb 2016 | B2 |
| 9342529 | Lin et al. | May 2016 | B2 |
| 9361577 | Miyashita | Jun 2016 | B2 |
| 9779582 | Ben Hanan et al. | Oct 2017 | B1 |
| 10013847 | Chun | Jul 2018 | B2 |
| 10201745 | Moore et al. | Feb 2019 | B2 |
| 10235730 | Stasi et al. | Mar 2019 | B1 |
| 10366563 | Chun et al. | Jul 2019 | B2 |
| 10403090 | Shigeta | Sep 2019 | B2 |
| 10410475 | Grauzer et al. | Sep 2019 | B2 |
| 10474513 | Yoon et al. | Nov 2019 | B2 |
| 10529168 | Chun | Jan 2020 | B2 |
| 10650550 | McClellan et al. | May 2020 | B1 |
| 10930112 | Shigeta | Feb 2021 | B2 |
| 20020042298 | Soltys | Apr 2002 | A1 |
| 20020042299 | Solts et al. | Apr 2002 | A1 |
| 20020065130 | Soltys et al. | May 2002 | A1 |
| 20020096827 | Markowiak | Jul 2002 | A1 |
| 20020111205 | Beavers | Aug 2002 | A1 |
| 20030096643 | Montgomery | May 2003 | A1 |
| 20030139214 | Wolf et al. | Jul 2003 | A1 |
| 20040213448 | Jou et al. | Oct 2004 | A1 |
| 20050026680 | Gururajan | Feb 2005 | A1 |
| 20050051955 | Schubert et al. | Mar 2005 | A1 |
| 20050051965 | Gururajan | Mar 2005 | A1 |
| 20050272501 | Tran et al. | Dec 2005 | A1 |
| 20060019739 | Soltys et al. | Jan 2006 | A1 |
| 20060027970 | Kyrychenko | Feb 2006 | A1 |
| 20060108736 | Walker et al. | May 2006 | A1 |
| 20060128472 | Beavers | Jun 2006 | A1 |
| 20060160600 | Hill et al. | Jul 2006 | A1 |
| 20060160608 | Hill et al. | Jul 2006 | A1 |
| 20060177109 | Storch | Aug 2006 | A1 |
| 20060252521 | Gururajan et al. | Nov 2006 | A1 |
| 20060258427 | Rowe et al. | Nov 2006 | A1 |
| 20060287068 | Walker et al. | Dec 2006 | A1 |
| 20070015583 | Tran | Jan 2007 | A1 |
| 20070077987 | Gururajan et al. | Apr 2007 | A1 |
| 20070111773 | Gururajan et al. | May 2007 | A1 |
| 20070136741 | Stattenfield | Jun 2007 | A1 |
| 20070184898 | Miller et al. | Aug 2007 | A1 |
| 20080054568 | Lutnick et al. | Mar 2008 | A1 |
| 20080076529 | Richards et al. | Mar 2008 | A1 |
| 20080113767 | Nguyen et al. | May 2008 | A1 |
| 20080113783 | Czyzewski et al. | May 2008 | A1 |
| 20080153582 | Inamura | Jun 2008 | A1 |
| 20080188292 | Walker et al. | Aug 2008 | A1 |
| 20090291762 | Walker | Jan 2009 | A1 |
| 20090069090 | Moser et al. | Mar 2009 | A1 |
| 20090075725 | Koyama | Mar 2009 | A1 |
| 20090104981 | Koyama | Apr 2009 | A1 |
| 20090115133 | Kelly et al. | May 2009 | A1 |
| 20090118006 | Kelly et al. | May 2009 | A1 |
| 20090131151 | Harris et al. | May 2009 | A1 |
| 20090140492 | Yoseloff et al. | Jun 2009 | A1 |
| 20090169094 | Tsai | Jul 2009 | A1 |
| 20090186678 | Amaitis et al. | Jul 2009 | A1 |
| 20090201372 | O'Doherty et al. | Aug 2009 | A1 |
| 20090233699 | Koyama | Sep 2009 | A1 |
| 20100016050 | Snow et al. | Jan 2010 | A1 |
| 20100062845 | Wadds et al. | Mar 2010 | A1 |
| 20100093429 | Mattice et al. | Apr 2010 | A1 |
| 20100130282 | Bradshaw | May 2010 | A1 |
| 20100171267 | Walker | Jul 2010 | A1 |
| 20100240446 | Koyama et al. | Sep 2010 | A1 |
| 20100331085 | Nagano | Dec 2010 | A1 |
| 20110028204 | Schwartz | Feb 2011 | A1 |
| 20110052049 | Rajaraman et al. | Mar 2011 | A1 |
| 20110238510 | Rowen et al. | Sep 2011 | A1 |
| 20120040727 | Gururajan et al. | Feb 2012 | A1 |
| 20120080845 | Emori | Apr 2012 | A1 |
| 20120115590 | Rowe | May 2012 | A1 |
| 20120252564 | Moore et al. | Oct 2012 | A1 |
| 20120276969 | Watanabe | Nov 2012 | A1 |
| 20130275349 | Tashiro et al. | Oct 2013 | A1 |
| 20130277911 | Shigeta | Oct 2013 | A1 |
| 20130316797 | Gelinotte et al. | Nov 2013 | A1 |
| 20130320097 | Anderson, II et al. | Dec 2013 | A1 |
| 20140094298 | Lyons et al. | Apr 2014 | A1 |
| 20140121015 | Massing et al. | May 2014 | A1 |
| 20140132799 | Kim et al. | May 2014 | A1 |
| 20140194199 | DiGiovanni | Jul 2014 | A1 |
| 20140243651 | Kim et al. | Aug 2014 | A1 |
| 20140291399 | Koyama | Oct 2014 | A1 |
| 20140343404 | Razzaque et al. | Nov 2014 | A1 |
| 20140370960 | Mosley et al. | Dec 2014 | A1 |
| 20150006444 | Tamatsu et al. | Jan 2015 | A1 |
| 20150024818 | Chun | Jan 2015 | A1 |
| 20150036920 | Wu et al. | Feb 2015 | A1 |
| 20150087417 | George et al. | Mar 2015 | A1 |
| 20150189239 | Zhao et al. | Jul 2015 | A1 |
| 20150190707 | Shigeta | Jul 2015 | A1 |
| 20150312517 | Hoyt et al. | Oct 2015 | A1 |
| 20150356811 | Koyama et al. | Dec 2015 | A1 |
| 20160098606 | Nakamura et al. | Apr 2016 | A1 |
| 20160171336 | Schwartz | Jun 2016 | A1 |
| 20160328913 | Blazevic | Nov 2016 | A1 |
| 20170018140 | Yamaguchi et al. | Jan 2017 | A1 |
| 20170039807 | Shigeta | Feb 2017 | A1 |
| 20170193735 | Mandava et al. | Jul 2017 | A1 |
| 20180053377 | Shigeta | Feb 2018 | A1 |
| 20180061178 | Shigeta | Mar 2018 | A1 |
| 20180075690 | Moore et al. | Mar 2018 | A1 |
| 20180122187 | Moore et al. | May 2018 | A1 |
| 20180232987 | Shigeta | Aug 2018 | A1 |
| 20180247134 | Bulzacki et al. | Aug 2018 | A1 |
| 20190108710 | French et al. | Apr 2019 | A1 |
| 20190156623 | Thomas et al. | May 2019 | A1 |
| 20190172312 | Shigeta | Jun 2019 | A1 |
| 20190236891 | Shigeta | Aug 2019 | A1 |
| 20200053434 | Kudelski et al. | Feb 2020 | A1 |
| 20200273287 | Shigeta | Aug 2020 | A1 |
| 20200349797 | Moore et al. | Nov 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 101495198 | Jul 2009 | CN |
| 101620669 | Jan 2010 | CN |
| 101958892 | Jan 2011 | CN |
| 102089046 | Jun 2011 | CN |
| 102125756 | Jul 2011 | CN |
| 102441273 | May 2012 | CN |
| 102892472 | Jan 2013 | CN |
| 102945366 | Feb 2013 | CN |
| 103189112 | Jul 2013 | CN |
| 103592016 | Feb 2014 | CN |
| 64-500243 | Feb 1989 | JP |
| H03114435 | May 1991 | JP |
| H03-102917 | Oct 1991 | JP |
| H05237213 | Sep 1993 | JP |
| H06117836 | Apr 1994 | JP |
| H06-134140 | May 1994 | JP |
| 11253604 | Sep 1999 | JP |
| 2000-259796 | Sep 2000 | JP |
| 2002-007989 | Jan 2002 | JP |
| 2005-144032 | Jun 2005 | JP |
| 2005-312510 | Nov 2005 | JP |
| 2005-312510 | Nov 2005 | JP |
| 2005342175 | Dec 2005 | JP |
| 2006154961 | Jun 2006 | JP |
| 2006304873 | Nov 2006 | JP |
| 2007-164401 | Jun 2007 | JP |
| 2008-077140 | Apr 2008 | JP |
| 2008132267 | Jun 2008 | JP |
| 2009-018021 | Jan 2009 | JP |
| 2009-066172 | Apr 2009 | JP |
| 2009-066173 | Apr 2009 | JP |
| 2009165835 | Jul 2009 | JP |
| 2009-219588 | Oct 2009 | JP |
| 2009254589 | Nov 2009 | JP |
| 2010-128915 | Jun 2010 | JP |
| 2010-187807 | Sep 2010 | JP |
| 2010213940 | Sep 2010 | JP |
| 2011-067339 | Apr 2011 | JP |
| 2012018568 | Jan 2012 | JP |
| 2012075781 | Apr 2012 | JP |
| 2012157785 | Aug 2012 | JP |
| 2012-174222 | Sep 2012 | JP |
| 2012185684 | Sep 2012 | JP |
| 2013111171 | Jun 2013 | JP |
| 2013-198626 | Oct 2013 | JP |
| 2014012192 | Jan 2014 | JP |
| 2014504164 | Feb 2014 | JP |
| 2014-140576 | Aug 2014 | JP |
| 2014-203139 | Oct 2014 | JP |
| 2015011510 | Jan 2015 | JP |
| 2015014819 | Jan 2015 | JP |
| 2015032308 | Feb 2015 | JP |
| 2015052832 | Mar 2015 | JP |
| 2015053008 | Mar 2015 | JP |
| 2015061696 | Apr 2015 | JP |
| 2015070401 | Apr 2015 | JP |
| 2016110232 | Jun 2016 | JP |
| 2017664386 | Apr 2017 | JP |
| 6855429 | Mar 2021 | JP |
| 6855430 | Mar 2021 | JP |
| 2023103442 | Jul 2023 | JP |
| 1019920019198 | Oct 1992 | KR |
| 20030064124 | Jul 2003 | KR |
| 20070009132 | Jan 2007 | KR |
| 1020070119105 | Dec 2007 | KR |
| 1020140061033 | May 2014 | KR |
| 1020140108417 | Sep 2014 | KR |
| 2007011188 | Jan 2007 | WO |
| 2008063361 | May 2008 | WO |
| 2008120749 | Oct 2008 | WO |
| 2012058401 | May 2012 | WO |
| 2012091093 | Jul 2012 | WO |
| 2012161422 | Nov 2012 | WO |
| 2013177286 | Jan 2013 | WO |
| 2014049664 | Apr 2014 | WO |
| 2014118763 | Aug 2014 | WO |
| 2014182306 | Nov 2014 | WO |
| 2014210368 | Dec 2014 | WO |
| 2015066628 | May 2015 | WO |
| 2015107902 | Jul 2015 | WO |
| 2015096677 | Jul 2015 | WO |
| 2015103693 | Jul 2015 | WO |
| 2015107902 | Jul 2015 | WO |
| 2016191856 | Dec 2016 | WO |
| Entry |
|---|
| Australian Examination Report No. 3 dated Apr. 16, 2021 for AU Application No. 2016302657. |
| Japanese Office Action dated Aug. 30, 2022 issued for JP Application No. 2022-001140. |
| Korean Office Action dated Oct. 17, 2022 issued for KR Application No. 10-2018-7003280. |
| Malaysian Modified Substantive Examination Report dated Oct. 29, 2021 issued for MY Application No. PI2018000152. |
| Korean Notice of Allowance dated Apr. 29, 2022 issued for KR Application No. 10-2021-0190517. |
| U.S. Notice of Allowance dated Apr. 11, 2022 issued for U.S. Appl. No. 17/034,492. |
| Japanese Office Action dated Apr. 26, 2022 issued for JP Application No. 2019-113061. |
| Japanese Office Action dated Jul. 19, 2022 issued for JP Application No. 2021-210459. |
| Japanese Office Action dated Jul. 19, 2022 issued for JP Application No. 2021-201516. |
| Japanese Office Action dated Aug. 2, 2022 issued for JP Application No. 2021-180697. |
| Korean Notice of Allowance dated Sep. 16, 2021 issued for KR Application No. 10-2021-0071384. |
| Mathworks, “What is image recognition?”, Matlab and Simulink [retrieved from internet on Oct. 13, 2022]. Retrieved from <https://www.mathworks.com/discovery/image-recognitionmatlab.html>. |
| New Zealand Office Action dated Sep. 22, 2022 issued for NZ Application No. 739617. |
| U.S. Office Action dated Mar. 3, 2022 issued for U.S. Appl. No. 16/870,028. |
| Australian Patent Application No. 2016210614, Examination Report No. 1 dated Dec. 18, 2017. |
| Japanese Patent Application No. 2016-151812, Office Action dated Feb. 13, 2018. |
| Macau Patent Application No. I/001450, Office Action dated Dec. 13, 2017. |
| New Zealand Patent Application No. 722828, First Examination Report dated Aug. 14, 2017. |
| Singapore Patent Application No. 10201606360V, Written Opinion dated Sep. 11, 2017. |
| Singapore Patent Application No. 10201706673P, Written Opinion dated Oct. 30, 2017. |
| U.S. Appl. No. 15/226,200, Office Action dated Nov. 22, 2017. |
| PCT Application PCT/JP2016/072671, International Search Report dated Oct. 25, 2016. |
| Australian Patent Application No. 2017208255, Examination Report No. 1 dated Apr. 23, 2018. |
| New Zealand Patent Application No. 740620, First Examination Report dated Jul. 12, 2018. |
| Office Action dated Oct. 26, 2018 for U.S. Appl. No. 16/016,128. |
| Office Action dated Nov. 29, 2018 for U.S. Appl. No. 16/100,807. |
| Office Action dated Nov. 29, 2018 for U.S. Appl. No. 16/100,831. |
| Office Action dated Feb. 19, 2019 for JP Application 2018-076921. |
| Office Action dated Feb. 19, 2019 for JP Application 2018-076922. |
| New Zealand dated Mar. 19, 2020 for corresponding/family NZ Application 757091. |
| U.S. Office Action dated Mar. 26, 2020 for corresponding/family U.S. Appl. No. 16/564,440. |
| U.S. Notice of Allowance dated Mar. 26, 2020 for corresponding/family U.S. Appl. No. 16/270,824. |
| U.S. Office Action dated May 1, 2020 for corresponding/family U.S. Appl. No. 16/509,723. |
| U.S. Notice of Allowance dated May 22, 2020 for corresponding/family U.S. Appl. No. 16/395,414. |
| U.S. Notice of Allowance dated Jun. 26, 2020 for corresponding/family U.S. Appl. No. 16/395,457. |
| First Examination Report dated Jan. 28, 2020 for corresponding NZ Application 755281. |
| U.S. Office Action dated Sep. 25, 2019 for corresponding/family U.S. Appl. No. 16/509,723. |
| Office Action dated Nov. 12, 2019 for U.S. Appl. No. 16/202,290. |
| Office Action dated Jul. 30, 2019 for JP Application No. 2018-211053, which cites the JP references herein. |
| Office Action dated Jun. 10, 2019 for CN Application No. 201710622633, which cites the CN references herein. |
| Office Action dated Nov. 26, 2019 for related U.S. Appl. No. 16/509,780. |
| Office Action dated Jul. 22, 2020 for related U.S. Appl. No. 16/460,072. |
| Office Action dated Sep. 29, 2020 for JP Application No. 2019-113061. |
| International Search Report dated Oct. 3, 2017 in corresponding/family PCT Application PCT/JP2017/025796. |
| International Search Report dated Oct. 25, 2016 in corresponding/family PCT Application PCT/JP2016/072673. |
| Australian Office Action dated Aug. 28, 2020 in corresponding/family AU Application 2019204560. |
| New Zealand Office Action dated Sep. 15, 2020 in corresponding/family NZ Application 755281. |
| Office Action dated Oct. 6, 2020 for JP Application No. 2019-212469. |
| Office Action dated Oct. 6, 2020 for JP Application No. 2017-533090. |
| Office Action dated Nov. 18, 2020 for CN 201811441330.9. |
| Office Action dated Dec. 9, 2020 for KR 10-2020-0124628. |
| U.S. Office Action dated Jun. 30, 2021 issued in U.S. Appl. No. 16/934,283. |
| Chinese Office Action dated Jul. 8, 2021 issued in CN Application No. 202010093251.4. |
| U.S. Office Action dated Aug. 2, 2021 issued in U.S. Appl. No. 17/004,492. |
| Chinese 2nd Office Action dated Dec. 30, 2021 issued for CN Application No. 202010093251.4. |
| Korean Office Action dated Jan. 13, 2022 issued for KR Application No. 10-2021-0190519. |
| Japanese Office Action dated Jan. 25, 2022 issued for JP Application No. 2021-044180. |
| Japanese Office Action dated Jan. 25, 2022 issued for JP Application No. 2021-044181. |
| Chinese Office Action dated May 23, 2022 issued for CN Application No. 202010093251.4. |
| U.S. Office Action dated Aug. 9, 2021 issued in U.S. Appl. No. 16/987,710. |
| CN Office Action dated Aug. 3, 2021 issued in CN Application No. 201811441041.9. |
| Japanese Notice of Allowance dated Sep. 7, 2021 issued for JP Application No. 2020-109845. |
| Singaporean Office Action dated Dec. 20, 2022 issued for SG Patent Application 10202108956W. |
| European Search Report dated Mar. 21, 2023 issued for EP Patent Application 22213956.0. |
| Korean Office Action dated Feb. 14, 2023 issued for KR Patent Application 10-2023-0000109. |
| Japanese Office Action dated Jun. 13, 2023 issued for JP Patent Application 2022-103372. |
| Japanese Office Action dated Aug. 29, 2023 issued for JP Patent Application 2022-211069. |
| Japanese Office Action dated Sep. 19, 2023 issued for JP Patent Application 2022-197660. |
| Chinese Office Action dated Sep. 15, 2023 issued for CN Patent Application 202010928553.9. |
| Australian Examination Report dated Nov. 9, 2023 issued for AU Patent Application 2022235615. |
| Australian Examination Report dated Nov. 15, 2023 issued for AU Patent Application 2022271451. |
| Australian Examination Report dated Dec. 8, 2023 issued for AU Patent Application 2022287587. |
| Singaporean Office Action dated Jan. 2, 2024 issued for SG Patent Application 10202250864J. |
| U.S. Office Action dated Jan. 30, 2024 issued for U.S. Appl. No. 17/992,251. |
| Chinese Office Action dated Mar. 27, 2024 issued for CN Patent Application 202010928553.9. |
| Japanese Office Action dated Apr. 23, 2024 issued for JP Patent Application 2023-124882. |
| Number | Date | Country | |
|---|---|---|---|
| 20210233354 A1 | Jul 2021 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16870028 | May 2020 | US |
| Child | 17227990 | US | |
| Parent | 15749643 | US | |
| Child | 16870028 | US |
