Many self-deposit apparatuses may initiate a self-deposit for a specific item and physically receive an item for self-deposit without the adequately verifying that the item received is actually the item that was identified for self-deposit by the user. The lack of verification may cause problems as incorrect items may be physically deposited in the self-deposit apparatus.
Illustrative embodiments are shown by way of example in the accompanying drawings and should not be considered as a limitation of the present disclosure:
Described in detail herein are systems, apparatus, methods, and non-transitory computer-readable media associated with a self-depositing of items. In exemplary embodiments, a self-deposit apparatus can verify that items being deposited by users correspond to the items identified by the user for deposit. Exemplary embodiments of the self-deposit apparatus can include an optical reader, one or more scales, one or more image capturing devices, a controller, and a bin. An item to be deposited can be identified by the self-deposit apparatus based on an identifier that is read by the optical reader and/or based on user input received via a user interface of the self-deposit apparatus. A first scale can be coupled with the optical reader and image capturing device. The item may be placed on the first scale of the self-deposit apparatus and the first scale can determine the weight of the item. While the item is supported by the first scale, the image capturing device(s) can capture one or more images of the item. For example, an image capturing device can be disposed adjacent to the first scale and/or an image capturing device can be disposed opposite or above the first scale. In some embodiments, the image(s) can be captured substantially concurrently with the weighing of the item by the first scale. In some embodiments, an image capturing device can be disposed adjacent to or above the bin to capture images of items that have been deposited in the bin. The self-deposit apparatus can extract one or more dimensions of the item from the captured image. The self-deposit apparatus can verify the item intended for the self-deposit by the user corresponds to the item identified based on reading of the identifier and inputs from the user. For example, in exemplary embodiments of the present disclosure, the self-deposit apparatus can verify that the item placed on the first scale by matching the weight, dimensions, and image(s) to stored item weight, dimensions and image(s).
In exemplary embodiments, the bin can include side walls that define an interior area for receiving items after determining the weight of the item and capturing one or more images of the item. In exemplary embodiments, a bottom surface of the bin can be formed by or with a scale (e.g., a second scale), the scale can be configured to determine the weight of the item after the item is placed in the bin.
The controller can be configured to extract a set of dimensions of the item from the image(s) captured by the image capturing device(s) of the self-deposit apparatus. For example, the controller can use machine vision, image matching, pixel matching, and/or any other suitable techniques for determining the dimensions of an item from one or more images of the item. The controller can verify that the item deposited in the bin is associated with the identifier read by the optical reader based on, for example, the captured image(s) of the item, the dimensions of the item as extracted from the image(s) by the controller, and the measured weights of the item.
In exemplary embodiments, the controller can be configured to query a database using the identifier and/or user inputs associated with the item to be deposited to retrieve one or more stored images of the item, a stored weight of the item, and stored dimensions of the item. The controller can compare the one or more images of the item intended for deposit that are captured by the image capturing device(s) to the stored image of the item, compare the dimensions of the item intended for deposit that are extracted from the captured images to the stored dimensions of the item, and compare the weight of the item intended for deposit measured by the first scale to the stored weight of the item.
In exemplary embodiments, the controller can be configured to determine a probability that the item deposited in the bin is associated with the identifier read by the optical reader and/or the user inputs based on the captured image, the dimensions extracted from the captured images, and the measured weights of the item. For example, the captured images, extracted dimensions, and/or measured weights may not exactly match the stored images, dimensions, and/or weight of the item. Such difference can result in uncertainty that the item to be deposited is actually the item that has been deposited. The probability can be determined by assigning variable weighting factors to the outcome of the comparisons of the weight, image and dimensions. Using the probability, the controller verifies with a specified degree of certainty that the item deposited in the bin corresponds to the identifier read by the optical reader and/or the user inputs.
In exemplary embodiments, the optical reader 102 operatively coupled to the controller 114 and configured to read an identifier (e.g., an encoded machine readable representation) associated with an item intended for deposit. For example, the identifier can be a barcode and/or a QR code and the optical reader can be a barcode and/or QR code reader configured to read the barcode and/or QR code. The optical reader 102 can be configured to read encoded information from machine-readable representations and transmit the decoded information to the controller 114. Alternatively, the optical reader 102 can transmit encoded information to the controller and the controller can decode the encoded information.
In response to obtaining the decoded information, the controller 114 can retrieve an identification of an item to be deposited and/or can retrieve a list of items corresponding to the decoded information. The controller 114 control the display to render the identified item or the list of items, which can be selected by the user. For example, when the identification of the item is displayed the user can be asked to confirm that the displayed item corresponds to the item being deposited. When a list of items is displayed, the user can be prompted to select the item from the list to confirm which item the user intends to deposit.
The (first) scale 112 is operatively coupled to the controller 114 and can be configured to support an item to be deposited and to determine a weight of the item. In exemplary embodiments, the scale 112 can be disposed adjacent to the display 104. In exemplary embodiments, the scale 112 can be an electronic weighing machine configured to determine a weight of an item placed on the scale and to transmit the weight of the item to the controller 114.
The image capturing devices 110 can be operatively coupled to the controller and can be configured to capture one or more images of an item while the item is supported by the scale 112. In exemplary embodiments, the image capturing devices 110 can be disposed adjacent to the display 104. In exemplary embodiments, the image capturing devices 110 can be disposed adjacent to the scale 114 and/or can be positioned above the scale 112 to facilitate capture of images of the item placed on the scale 112. In exemplary embodiments, the scale 112 can have a planer horizontally disposed surface. The one or more image capturing device can be positioned and oriented to capture images of a volume above the scale surface from one or more points-of-view. In some embodiments, the one or more image capturing devices 110 can be positioned at or near the optical reader 102. In some embodiments, the image capture devices 110 can be configured to take moving images (e.g., video), still images or both. In exemplary embodiments, the image capturing device 110 can transmit captured images to the controller 114.
The bin 106 can be disposed adjacent to the scale 112 and/or the one or more image capturing devices 110. In exemplary embodiments, the bin 106 including side walls 118 that define an interior area 120 for receiving items after the self-deposit apparatus determines the weight and captures one or more images of the item. The interior area 120 of the bin 106 can have a volume that accommodates receipt of a single item or can have a volume that accommodates several items. A bottom surface of the bin can be formed with or by a (second) scale 122. The second scale 122 can be configured to determine a weight of the item or items after the item or items are placed in the bin 106. In some embodiments, the bin 106 can include a conveyer belt 125 to transport the item or items to another location after the item or items are disposed in the bin 106. The conveyer belt 125 may be disposed in belt cabinets, which may also include rollers (e.g., friction and drive rollers) and a drive motor. The driver motor can control one or more of the rollers to rotate the belt to provide a transport for moving items from one end of the belt cabinet to an opposite end of the belt cabinet.
In exemplary embodiments, a self-deposit can be initiated in response to reading an identifier of an item by the optical reader 102. The identifier can be displayed on the display 104. The item intended for self-deposit can be placed on the scale 112 and the scale 112 can output a weight of the item intended for self-deposit to the controller 114. The one or more image capturing devices 110 can capture one or more images of the item intended for self-deposit. The one or more images can be captured when the item is placed on the scale. For example, the image capturing device can capture one or more images of the item substantially concurrently to the weighing of the item on the scale. The controller 114 receives the weight of the item from the scale 112 and the one or more images of the item from the image capturing device 110. In exemplary embodiments, the controller 114 is configured to extract a set of dimensions of the item from the one or more images using machine vision, image mapping, and/or pixel matching. In exemplary embodiments, the controller 114 may extract the height, width, and length of the item. In other embodiments, the controller may only extract the height and width of the item, the height and the length, or the width and the length.
The controller 114 can query a central database using the identifier associated with the item to retrieve one or more stored images of the item, a stored weight of the item, and stored dimensions of the item. The controller 114 may compare the one or more images of the item intended for deposit to one or more stored images of the item, compare the set of dimensions of the item intended for deposit to stored dimensions of the item, and compare the weight of the item intended for deposit to the stored weight of the item to verify that the item intended for self-deposit is associated with the item identified by the identifier read by the optical reader 102. In exemplary embodiments, the controller 114 can compare the images using image recognition. In some embodiments, if the controller 114 is unable to retrieve one or more images from the central database, the controller 114 can be configured to verify the item being deposited corresponds to the identifier, by comparing the weight and dimensions of the item.
In exemplary embodiments, the controller 114 is further configured to determine a probability that the item intended for deposit is associated with the identifier read by the optical reader based on the captured image, the set of dimensions, and/or the first weight. In exemplary embodiments, the probability is calculated by assigning variable weighting factors to the outcome of the comparison of the weight, image and dimensions. For example, the comparison of the weight can be assigned a higher weighting factor than the comparison of the dimensions, and the comparison of the dimensions can be assigned a higher weighting factor than the comparison of the images. Consequently, if the weight of the item intended for self-deposit is substantially equal to the stored weight, the dimensions of the item intended for self-deposit are substantially equal to the stored dimensions, however, the image of the item intended for self-deposit does not substantially match the stored image, the controller 114 may calculate a high probability that the item intended for deposit is associated with the item identified by the identifier based on the assigned weighting factors. Conversely, if the first weight of the item intended for deposit and the stored weight are not substantially equal, the dimensions of the item intended for deposit and the stored dimensions are substantially equal, and the image of the item intended for deposit and the stored image do substantially match, the controller 114 can calculate a lower probability that the item intended for deposit is associated with the item identified by the identifier based on the assigned weighting factors. In exemplary embodiments, the controller 114 verifies the item intended for deposit is associated with the identifier read by the optical reader based on whether the probability is over a threshold. For example, the controller 114 may verify the intended for deposit is the associated with the identifier if the calculated probability is over 90%.
In exemplary embodiments, in response to the controller 114 verifying the item intended for deposit is associated with the item identified by the identifier, the user may be prompted to place the item in the bin 106 and the bin 106 may receive the item for collection. In exemplary embodiments, the scale 122 associated with the bin 106 and determines a weight of the item or items placed in the bin 106. For example, the controller 114 may receive the second weight to confirm the item placed on the first scale 112 is the same item received by the bin 106. That is, the scale 112 can used to determine that the item that was placed in the bin 106 has a weight that is substantially equal to the weight of the item that was weighed by the scale 112. For embodiments that permit multiple items to be deposited in the bin 106, the bin can determine the total weight of all items in the bin 106 and can determine that the incremental increases in weight as items are placed in the bin 106 correspond to the weight of each incrementally item determined by the scale 112.
In some embodiments, a second image capturing device 116 may be positioned over the bin 106. The second image capturing device may capture a second image of the item received by the bin 106. The controller 114 may receive the second weight and second image to confirm the item placed on the scale 112 is the same item received by the bin 106. In exemplary embodiments, the controller 114 may accept or deny the self-deposit based on the confirmation that the item placed on the scale 112 is the same as the item received by the bin 106. In some embodiments, the bin 106 is configured to receive a plurality of items for deposit, the scale 112 is configured to individually weigh each of the items, and the scale 122 is configured to collectively weigh the items.
Virtualization may be employed in the controller 114 so that infrastructure and resources in the controller 114 may be shared dynamically. A virtual machine 212 may be provided to handle a process running on multiple processors so that the process appears to be using only one computing resource rather than multiple computing resources. Multiple virtual machines may also be used with one processor.
Memory 206 may include a computer system memory or random access memory, such as DRAM, SRAM, EDO RAM, and the like. Memory 206 may include other types of memory as well, or combinations thereof.
A user may interact with the controller 114 through the visual display device 104, which can display one or more graphical user interfaces 216 generated by the controller 114, a multi touch interface 220, and a pointing device 218.
The controller 114 can also include one or more storage devices 226, such as a hard-drive, CD-ROM, or other computer readable media, for storing data and computer-readable instructions and/or software that implement exemplary embodiments of the present disclosure (e.g., applications). For example, exemplary storage device 226 can include one or more databases 228. The databases 228 may be updated manually or automatically at any suitable time to add, delete, and/or update one or more data items in the databases.
The controller 114 can include a network interface 208 configured to interface via one or more network devices 224 with one or more networks, for example, Local Area Network (LAN), Wide Area Network (WAN) or the Internet through a variety of connections including, but not limited to, standard telephone lines, LAN or WAN links (for example, 802.11, T1, T3, 56 kb, X.25), broadband connections (for example, ISDN, Frame Relay, ATM), wireless connections, controller area network (CAN), or some combination of any or all of the above. In exemplary embodiments, the controller 114 can include one or more antennas 222 to facilitate wireless communication (e.g., via the network interface) between the controller 114 and a network and/or between the controller 114 and the central database. The network interface 208 may include a built-in network adapter, network interface card, PCMCIA network card, card bus network adapter, wireless network adapter, USB network adapter, modem or any other device suitable for interfacing the controller 114 to any type of network capable of communication and performing the operations described herein.
The controller 114 may run any operating system 210, such as any of the versions of the Microsoft® Windows® operating systems, the different releases of the Unix and Linux operating systems, any version of the MacOS® for Macintosh computers, any embedded operating system, any real-time operating system, any open source operating system, any proprietary operating system, or any other operating system capable of running on the controller 114 and performing the operations described herein. In exemplary embodiments, the operating system 210 may be run in native mode or emulated mode. In an exemplary embodiment, the operating system 210 may be run on one or more cloud machine instances.
In an example embodiment, one or more portions of network 300 may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless wide area network (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, a wireless network, a WiFi network, a WiMax network, any other type of network, or a combination of two or more such networks.
The server 310 and the database 305 are connected to the network 300 via a wired connection. Alternatively, the server 310 and the database 305, can be connected to the network 300 via a wireless connection. The server 310 includes one or more computers or processors configured to communicate with the controllers 114 of the self-deposit apparatus 100 and the database 305, via the network 300. The server 310 hosts one or more applications configured to interact with one or more components of the controllers 114 of the self-deposit apparatus 100 and/or facilitates access to the content of the database 305. The database 305 can include one or more storage devices for storing data and/or instructions (or code) for use by the server 310 and the self-deposit apparatus 100. The database 305 and server 310 can be located at one or more geographically distributed locations from each other or from the self-deposit apparatus 100. Alternatively, the database 305 can be included within server 310.
In some embodiments, the controller 114 of a self-deposit apparatus 100 can include a client side application that allows the self-deposit apparatus 100 to communicate and interact with the self-deposit application 315 hosted by the server 310. In exemplary embodiments, the self-deposit application 315 residing on the server 310 can be executed in response to the controller 114 receiving, the identifier of an item from the optical reader 102, the weight of the item from the (first) scale 112, and/or the one or more images of the item from the image capturing device 110. In exemplary embodiments, the server can execute the self-deposit application 315 may extract the dimensions of the item from the one or more images of the item intended for self-deposit. For example, the server can execute the self-deposit application 315 to extract the height, length, and/or width of the item intended for self-deposit from the one or more images.
In exemplary embodiments, the server 310 can execute the self-deposit application 315 to query the database(s) 305 to retrieve, a stored weight of the item, stored dimensions of the item, and one or more stored image of the item. The server 310 can execute the self-deposit application 315 to compare the image(s) of the item intended for deposit to the stored image(s) of the item, compare the set of dimensions of the item intended for deposit to the stored dimensions of the item, and/or compare the weight of the item intended for deposit to the stored weight of the item to verify that the item intended for self-deposit is associated with the item identified in response to reading the identifier by the optical reader 102. In some embodiments, if the server 310 is unable to retrieve the image from the database(s) 305, the server 310 can execute the self-deposit application 315 to compare the weight and dimensions of the item to the stored weight and dimensions.
In exemplary embodiments, the server 310 can execute the self-deposit application 315 to determine a probability that the item intended for deposited is associated with the identifier read by the optical reader 102 based on the captured image(s), the set of dimensions, and/or the determined weight of the item. n exemplary embodiments, the probability is calculated by assigning variable weighting factors to the outcome of the comparison of the weight, image and dimensions. For example, the comparison of the weight can be assigned a higher weighting factor than the comparison of the dimensions, and the comparison of the dimensions can be assigned a higher weighting factor than the comparison of the images. Consequently, if the weight of the item intended for self-deposit is substantially equal to the stored weight, the dimensions of the item intended for self-deposit are substantially equal to the stored dimensions, however, the image of the item intended for self-deposit does not substantially match the stored image, the self-deposit application 315 may calculate a high probability that the item intended for deposit is associated with the item identified by the identifier based on the assigned weighting factors. Conversely, if the first weight of the item intended for deposit and the stored weight are not substantially equal, the dimensions of the item intended for deposit and the stored dimensions are substantially equal, and the image of the item intended for deposit and the stored image do substantially match, the self-deposit application 315 can calculate a lower probability that the item intended for deposit is associated with the item identified by the identifier based on the assigned weighting factors. In exemplary embodiments, the self-deposit application 315 verifies the item intended for deposit is associated with the identifier read by the optical reader based on whether the probability is over a threshold. In exemplary embodiments, if the self-deposit application 315 is unable to retrieve an image of the item from the database(s) 305, however is able to verify that the item intended for self-deposit is the associated with the item identified by the identifier, the self-deposit application 315 may store the image captured of the item intended for self-deposit by the image capturing device 110 in the database(s) 305 to be associated with the item.
In exemplary embodiments, the server 310 can execute the self-deposit application 315 to receive the weight from the (second) scale 122 located in the bin 106 to confirm the item placed on the first scale 112 is the same item received by the bin 106. In some embodiments, one or more image capturing devices can be positioned over the bin 106. The image capturing device(s) can capture one or more images of the item received by the bin 106. The server 310 can execute the self-deposit application 315 to receive the weight and the image(s) to confirm the item placed on the scale 112 is the same item received by the bin 106. In exemplary embodiments, the server 310 can execute the self-deposit application 315 to accept or deny the self-deposit based on the confirmation that the item placed on the scale 112 is the same as the item received by the bin 106. In some embodiments, the bin 106 is configured to receive a plurality of items for deposit, the scale 112 is configured to individually weigh each of the plurality of items, and the scale 122 is configured to collectively weigh the plurality of items.
In exemplary embodiments, in operation 402, the item intended for self-deposit is placed on the (first) scale 112. In operation 404, the scale determines a weight for the item intended for self-deposit. In operation 406, while the item intended for self-deposit is supported by the first scale 112, the one or more image capturing devices 112 capture one or more images of the item intended for self-deposit.
In operation 408, the self-deposit application 315 can be executed in response to the controller 114 receiving, the identifier of an item from the optical reader 102, the first weight of the item from the first scale 112, and/or the one or more images of the item from the image capturing device(s) 110 The dimensions of the item can be extracted from the one or more images of the item intended for self-deposit. For example, the self-deposit application 315 can be executed to extract the height, length, and/or width of the item intended for self-deposit from the image. In exemplary embodiments, the self-deposit application 315 may use image mapping to extract the dimensions of the item intended for self-deposit.
In operation 410 the self-deposit application 315 can be executed to query the database(s) 305 to retrieve, a stored weight of the item, stored dimensions of the item, and a stored image of the item. In operation 412, the self-deposit application 315 may compare the image of the item intended for deposit to the stored image of the item, compare the set of dimensions of the item intended for deposit to the stored dimensions of the item, and/or compare the first weight of the item intended for deposit to the stored weight of the item, to verify that the item intended for self-deposit is associated with the item identified by the identifier read by the optical reader 102. In some embodiments, if an image of the item cannot be retrieved from the database(s) 305, the weight and dimensions of the item can be compared to the stored weight and dimensions, respectively.
In operation 414, the self-deposit application 315 can be executed to determine a probability that the item intended for deposited is associated with the identifier read by the optical reader based on the one or more captured images, the set of dimensions, and/or the measured weight as described herein.
In exemplary embodiments, in operation 418, when the item has been verified, the display 104 can prompt the user to place the item in the bin 106. In operation 420, the self-deposit application 315 can be executed to receive a weight from the (second) scale 122 located in the bin 106 to confirm that the item placed on the scale 112 is the same item received by the bin 106. In operation, 422 the self-deposit application 315 can be executed to accept or deny the self-deposit based on the confirmation that the item placed on the scale 112 is the same as the item received by the bin 106. In some embodiments, the bin 106 is configured to receive a plurality of items for deposit, the scale 112 is configured to individually weigh each item to be deposited, and the scale 122 is configured to collectively weigh the items in the bin 106.
In exemplary embodiments, the controller 114 can extract the dimensions of the item from the one or more images of the item intended for self-return. The controller 114 can extract the height, length, and/or width of the item intended for self-deposit from the image.
In exemplary embodiments, controller 114 can query a store item file 520 to retrieve, a stored weight of the item, stored dimensions of the item, and one or more stored images of the item, using the scanned identifier. The controller 114 can compare the one or more images of the item intended for self-return to the one or more stored images of the item, compare the set of dimensions of the item intended for self-return to the stored dimensions of the item, and/or compare the first weight of the item intended for self-return to the stored weight of the item, to verify that the item intended for self-return is associated with the item identified by the identifier read by the optical reader 102.
In exemplary embodiments, controller 114 determines a probability that the item intended for self-return is associated with the identifier read by the optical reader based on the captured image, the set of dimensions, and the first weight. In exemplary embodiments, the probability is calculated by assigning weighting factors to the comparison of the weight, image and/or dimensions, as described herein.
In exemplary embodiments, the verified item is placed in the bin 106. The self-deposit controller 114 can receive a weight from the (second) scale 122 located in the bin 106 to confirm the item placed on the scale 112 is the same item received by the bin 106. The controller 114 can accept or deny the self-return based on the confirmation that the weight of the item placed on the scale 112 is substantially equal to the weight of the item received by the bin 106. In some embodiments, the bin 106 is configured to receive multiple items for self-return, the scale 112 can be configured to individually weigh each of the of items, and the scale 122 can be configured to collectively weigh the items.
In some embodiments, the controller 114 can query user information from the store receipts database 510 using the identifier. The controller 114 can deny the self-return based on past user return history. For example, if the user has a history of abusing the self-return system, the controller 114 can deny that user's self-return attempt.
In exemplary embodiments, once the self-return is accepted, the controller 114 queries the store receipts using the identifier, to retrieve user, price and payment device information at the time of purchase. In exemplary embodiments, the payment device was a credit card or debit card was used at the time of purchase, the controller 114 refunds the price of the item on the credit card or debit card, via the payment system 530. In some embodiments, if the payment device was cash at the time of the purchase the controller 114 issues a retail store gift card, via the payment system 530.
Exemplary flowcharts are provided herein for illustrative purposes and are non-limiting examples of methods. One of ordinary skill in the art will recognize that exemplary methods may include more or fewer steps than those illustrated in the exemplary flowcharts, and that the steps in the exemplary flowcharts may be performed in a different order than the order shown in the illustrative flowcharts.
This application claims priority to U.S. Provisional Application No. 62/290,177 filed on Feb. 2, 2016, the contents of the application is hereby incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
4803348 | Lohrey et al. | Feb 1989 | A |
6794586 | Mason | Sep 2004 | B1 |
7580860 | Junger | Aug 2009 | B2 |
8708233 | Hammond et al. | Apr 2014 | B2 |
8789748 | Waugh | Jul 2014 | B2 |
20010037207 | Dejaeger | Nov 2001 | A1 |
20020019783 | Chol | Feb 2002 | A1 |
20030018897 | Bellis et al. | Jan 2003 | A1 |
20030024340 | Toennesland | Feb 2003 | A1 |
20050240958 | Nguyen et al. | Oct 2005 | A1 |
20130001295 | Goncalves | Jan 2013 | A1 |
20130223673 | Davis et al. | Aug 2013 | A1 |
20130248593 | Bonner | Sep 2013 | A1 |
20140039998 | Hancock et al. | Feb 2014 | A1 |
20160210738 | Curlander | Jul 2016 | A1 |
Entry |
---|
3M(TM) Intelligent Return: Owner's Manual, Built to Exceed Expectations, 3M, 2011. |
International Search Report and Written Opinion from related PCT application PCT/US2017/016020 dated May 1, 2017. |
Number | Date | Country | |
---|---|---|---|
20170221030 A1 | Aug 2017 | US |
Number | Date | Country | |
---|---|---|---|
62290177 | Feb 2016 | US |