The present invention relates to autonomous vending systems and components for converting refrigerators or cabinets into autonomous points of sale through Artificial Intelligence systems (Machine Learning and Computer Vision), including arrangements and mounting of a plurality of video cameras with novel retractable mounting. And more particularly, the invention relates to a system that allows a user to remove merchandise from a refrigerator or cabinet without having to go through a checkout to pay for it and, at the same time, a system that automatically updates stock and billing data.
There are several systems for the dispensing of consumer products and merchandise, such as beverages and other foodstuffs, which include cabinets and/or refrigerators where they are kept conditioned for a consumer to access them in a condition to be purchased and consumed immediately. In order to avoid having operating and/or surveillance personnel for these systems, video cameras are included that constantly take images of the cabinet or refrigerator as well as of all the products housed therein. However, any camera added to a cabinet or refrigerator, either outside or inside, represents an obstacle. The use of one or more chambers on the outside of the refrigerator generates a volume that does not allow adequate transport in containers from the factory, and if they are placed inside, they take up space that would be useful for product storage.
One type of camera-based vending or vending system may be that disclosed in CN Publication 110136328A that teaches an AI (Artificial Intelligence) intelligent vending cabinet based on dynamic visual recognition. The vending cabinet is communicatively connected to a cloud server. The vending cabinet comprises a cabinet body provided with at least one shelf, a camera disposed on the cabinet body, and a control module connected with the camera and a wireless transmission module; the cloud server includes a dynamic visual recognition algorithm processing module and a storage space; the camera films the whole process in which an object exits the cabinet body in a video and the video is uploaded to the cloud server through the wireless transmission module; video processing calculation recognition is performed by the dynamic visual recognition algorithm; and the recognized result is sent to a user payment terminal through a network for fee deduction.
There are also system solutions that use scales and RFID systems for refrigerators, but they generate a very high operating, installation and maintenance cost. As well as there also exist other solutions with cameras, such as the mentioned Patent Publication CN110136328A, but not being a more simplified and embedded system as the one of the present invention with the compact hardware capable of being embedded in the sides makes such systems of the prior art not at a higher level as to the solution that this invention offers and to the novelty of the invention. Furthermore, the prior art does not offer the low operating and installation costs, having only corrective maintenances (if necessary) since the parts are of long service life, as provided by the present invention.
It is therefore an object of the invention to provide a new stand-alone, consumer-operable point-of-sale system, which among other advantages comprises a retractable arrangement of one or more video cameras that are mounted or embedded in the frame of cabinets or refrigerators without occupying volumes both on the outside and inside of the cabinet/refrigerator.
The invention also provides an absolutely autonomous system governed by artificial intelligence that allows the consumer to select the desired product, pay for it automatically and return it if he/she regretted to leave it and take another one instead, being all the action registered and the operation successfully concluded.
For greater clarity and understanding of the object of the present invention, the same has been illustrated in several figures, in which the invention has been represented in one of the preferred embodiments, all by way of example, wherein:
The invention provides a system for spending, selling, supplying consumer products, operable by the same consumer when purchasing the desired product or products, which has an arrangement of one or more retractable video cameras for refrigerators, for example in cabinet systems or Grab & Go refrigerators.
According to
As mentioned in the prior art section, such cabinets may be provided with RFID or dynamic visual technology. Unlike the prior art, particularly Publication CN 110136328A, the present invention provides retractable cameras that operate only when the user opens the door 6. That is, when the door is closed, see
Wherein the present invention provides at least one retractable side chamber 7 disposed in a side portion of said cabinet/refrigerator 1. According to
On the other hand, it is provided with at least one external support 11 mounted on the external part of said external plate 8 through respective screws 12, said external support 11 being provided with at least one external linear bearing 13 which may be a bearing of LM6UU type, this not being limiting for the present invention. In turn, said retractable side chamber 7 comprises at least one rod 14 acting as an actuating piston in conjunction with a spring 15, one end of said rod 14 being mounted on said internal linear bearing 9 mounted on the internal part of said external plate and retained by means of an external lock 16, while the other end is connected to a linear rod support 17 which may be a rod support of SHF10 type, this not being limiting for the invention.
As mentioned above, said side chamber 7 is retractable and is concealed within the “thickness” of the cabinet. To achieve this, at least one movable piston support 18 is provided on which said linear rod support 17 is mounted through respective screws 19. Also, at least one secondary rod 20 is provided mounted between said external linear bearing 13 and an orifice 21 of said movable piston support 18 which in turn presents a face 22 that comes in contact with the internal part of the door 6, as best illustrated in
On the other hand, there is provided at least one chamber support 23 mounted on said piston support 18 via respective screws 24 and at least one chamber 25 mounted on said chamber support 23 via a respective chamber-nut assembly 26 and screws 27. The chamber support 23 comprises an orifice for the passage of the chamber 25 and features a metal plate structure bent in such a way as to generate a certain angle of inclination for the chamber 25. The piston support 18 is designed to both house and protect said chamber 25.
It is emphasized that said retractable side camera 7 comprises a USB 3.0 side camera, and is angularly positioned about between 30° and 35° with respect to its X axis and about between 110° and 130° with respect to its Y axis. Preferably, but not limiting for the present invention, said retractable side camera 7 is angularly positioned 33° with respect to its X axis and 120° with respect to its Y axis. Thus, when the user opens the door 6, the bar 13—spring 14 “pushes” or displaces the piston support 18 outward so as to position the camera 25 in its operating position and begin recording or filming the sales or replenishment operation. At the end of the sales or replenishment operation, the door closes, coming into contact with the piston support 18 and moving it into the cabinet, thus concealing the camera.
The present invention further comprises a retractable upper central chamber 28 disposed within an upper central portion 73 of said cabinet/refrigerator 1, being concealed within the space or width bounded by the frame 5 so that it does not protrude beyond the height of the cabinet. According to
On the other hand, it is provided with at least one external support 32 mounted on the external part of said external plate 29 through respective screws 33 and nut 34, said external support 32 being provided with at least one external linear bearing 35 which may be a bearing of LM6UU type, this not being limiting for the present invention. In turn, said retractable upper central chamber 28 comprises at least one rod 36 in conjunction with a spring 37, one end of said rod 36 being mounted on said inner linear bearing 30 mounted on the inner side of said external plate and retained by means of an outer lock 38, while the other end is connected to a linear rod support 39 which may be a rod support of type SHF10, this not being limiting for the invention.
As mentioned above, said upper central chamber 28 is retractable as is said side chamber 7 and is concealed. To achieve this, at least one movable piston support 40 is provided on which said linear rod support 39 is mounted through respective screws 41. Also, at least one secondary rod 42 is provided mounted between said outer linear bearing 35 and an orifice 43 of said movable piston support 40. To carry out the filming or recording of what happens once the door 6 is opened, the invention provides at least one camera 44 mounted on said piston support 40 through a respective assembly support-nut-camera 45 and screws 46. The piston support 40 presents an orifice for the passage of the camera 44 and comprises a metal plate structure bent in such a way to provide an angle of inclination to the camera 44.
Likewise, a chamber protector 47 is provided which is mounted on said piston support 40 by means of respective screws 48 and which has a face 49 that comes in contact with the internal part of the door 6. In this way, when the door 6 is closed, see
On the other hand, said retractable upper central chamber 28 comprises a USB 3.0 side camera, and is angularly positioned about between 20° and 30° with respect to its X axis. Preferably, but not limiting for the present invention, said upper central camera 28 is angularly positioned 26° with respect to its axis X. Thus, when the user opens the door 6, the bar 36—spring 37 “pushes” or displaces the piston support 40 outward so as to position the camera 44 in its operating position and begin recording or filming the sales or replenishment operation. At the end of the sales or replenishment operation, the door 6 closes, coming into contact with the face 49 of the camera protector 47, displacing the assembly inside the cabinet, thus concealing the camera.
In order to cover a larger field of view at the time of recording and thus provide a better service and in turn, avoid possible accidents, the present invention further comprises a retractable upper side camera 50 disposed within an upper side portion 74 of said cabinet/refrigerator 1, being concealed within the space or width delimited by the frame 5 so that it does not protrude beyond the height of the cabinet. According to
On the other hand, it is provided with at least one external support 54 mounted on the external part of said external plate 51 through respective screws 55 and nut 56, said external support 54 being provided with at least one external linear bearing 57 which may be a bearing of LM6UU type, this not being limiting for the present invention. In turn, said retractable upper side chamber 50 comprises at least one bar 58 in conjunction with a spring 59, one end of said bar 58 being mounted on said internal linear bearing 52 mounted on the inner side of said external plate and retained by means of an external lock 60, while the other end is connected to a linear bar support 61 which may be a bar support of SHF10 type, this not being limiting for the invention.
As mentioned above, said upper side camera 50 is retractable and is concealed just like said upper side camera 7 and upper central camera 28. To achieve this, at least one movable piston support 62 is provided on which said linear rod support 61 is mounted through respective screws 63. Also, at least one secondary rod 64 is provided mounted between said outer linear bearing 57 and an orifice (not illustrated) of said movable piston support 62. To carry out the filming or recording of what happens once the door 6 is opened, the invention provides at least one camera 65 mounted on said piston support 62 through a respective assembly of camera-nut 66 and screws 67. The piston support 62 comprises an orifice for the passage of the camera 65 and comprises a bent metal plate structure determining a certain angle of inclination for said camera 65.
Likewise, it is provided with a chamber protector 68 mounted on said piston support 62 through respective screws 69 and which presents a face 70 that comes in contact with the internal part of the door 6. In this way, when the door 6 is closed, see
On the other hand, said retractable upper side camera 50 comprises an upper side USB 2.0 camera, and is angularly positioned about between 10° and 20° with respect to its X axis and about between 70° and 80° with respect to its Y axis. Preferably, but not limiting for the present invention, said retractable upper side camera 50 is angularly positioned 15° with respect to its X axis and 75° with respect to its Y axis. Thus, when the user opens the door 6, the bar 58—spring 59 “pushes” or displaces the piston support 62 outward so as to position the camera 65 in its operating position and begin recording or filming the sales or replenishment operation. At the end of the sale or replenishment operation, the door 6 closes, coming into contact with the face 70 of the camera protector 68, moving the assembly into the cabinet, thus concealing the camera.
Thus, by having three cameras 7, 28 and 50 strategically positioned in different parts of the cabinet, a greater visual width and height is covered to provide a better shopping and replenishment experience, as well as to alert to any incident or altercation that may occur.
Thus, the retractable video camera system or arrangement is embedded in the frame within the walls of the refrigerator or cabinet. Each camera has a metal housing with a spring system to which a USB camera is attached. This system is attached with screws and its functionality is to capture images to resolve transactions with the vending system of the invention. Each camera is connected to a CPU through respective data and power cables. The CPU is in turn connected to a server in a cloud. The server is managed so as to generate the different orders to the CPU to open the door, as well as for the generation of sales tickets, stock shortage alerts, replenishment, theft alerts, etc., as best illustrated in the diagrams of
Thus, the system of the present invention operates when a user unlocks the door of the cabinet or refrigerator which is closed by means of an intelligent locking system 71. Once the door is opened, see
These metal housings and cameras are preferably located at three different points and angles but more preferably between the frame walls so as to cover a larger field of view as mentioned above.
The invention thus provides a design and development of components to be installed in refrigerators or cabinets so as to convert them into self-contained outlets. As mentioned above, the invention comprises a CPU (not illustrated) to which are connected said side retractable cameras 7, upper central 28 and upper side 50 and other systems such as the intelligent lock 71 which can be an electronic padlock of the doors, as well as the different universal plates (external embedded system) that allow the operation of refrigerators with intelligent systems. All electrical/electronic parts or components are duly commanded by the CPU and powered by a power supply.
In order to install the equipment, the firmware (proprietary software running on the CPU) has a web interface so that the installation technician can perform the necessary tests of operation and connection to the WiFi network of the place to be installed.
The system of the invention allows a user to remove merchandise from a refrigerator or cabinet without having to go through a checkout to pay for it. The transaction basically consists of a person (the user) scanning a QR code with a web application (app) developed by the system provider, which goes through a registration process within the app. Once this registration is completed, the app unlocks the refrigerator or cabinet door, releasing an electric lock provided by the system supplier or, in some cases, by the refrigerator manufacturers. This lock, see
This program, based on Computer Vision and Machine Learning within the field of Artificial Intelligence, is in charge of processing the videos and creating a ticket to charge the user automatically with the credit/debit card registered at the beginning with the web application, or also generate an alert, for example, if an attempt has been made to hide products, or if the products are not seen properly in the videos, so that later, an employee of the establishment reviews them and resolves the transaction correctly. This review process is performed in a web-based dashboard program(*) provided by the system provider where there are also different user levels for operators, customers and managers. In this “dashboard” the customer can visualize the transactions and all the data that informs who is the user who made the purchase, the product purchased and the store of sale, as well as the real time stock of the machines (refrigerators, cabinets) and their different states. A dashboard is an information management tool that monitors, analyzes and visually displays key performance indicators (KPIs), metrics and key data to track the status of a company, a department, a campaign or a specific process.
For this process, through a web or native application where the employee who wants to replenish the refrigerator or cabinet can initiate this operation, the employee scans the QR code and manually inserts the products to be added, takes a general photo of the front of the refrigerator with the products for a record and then sends them to the system servers to update the data on the dashboard.
Thus, the buying user is provided with a shopping experience without the need to pay at the “cash register” and wait in long lines. Likewise, the seller user can easily know the real-time stock of his products. At the same time, being retractable cameras that do not occupy physical space that can be used for other purposes, they are easy to handle and move. Again, since the cameras are hidden inside the cabinet and retractable, they only operate when the door is opened. When the door is opened, see
This application claims priority under 35 U.S.C. § 119 to provisional application Ser. No. 63/324,830 filed Mar. 29, 2022, which is incorporated by reference in their entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2023/016745 | 3/29/2023 | WO |
Number | Date | Country | |
---|---|---|---|
63324830 | Mar 2022 | US |