A portion of the disclosure of this patent document contains material which is subject to copyright protection. This patent document may show and/or describe matter which is or may become trade dress of the owner. The copyright and trade dress owner has no objection to the facsimile reproduction by anyone of the patent disclosure as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright and trade dress rights whatsoever.
This patent claims priority from Spanish application no. 201630307 filed Mar. 15, 2016 entitled, “ROBOTIC EQUIPMENT FOR THE LOCATION OF ITEMS IN A SHOP AND OPERATING PROCESS THEREOF”.
Technical Field of the Invention
The present invention is framed within robotic equipment and systems capable of interacting with their surroundings. In particular, the present invention relates to an autonomous robotic equipment designed to help consumers or employees to locate items in a shop in a quick, simple manner.
Relevant Art
A robot is an electronic machine that may be programmed to move or perform certain operations. In recent years, advances in microelectronics and the development of computer science have made it possible to develop increasingly complex robots, capable of performing tasks and operations formerly reserved only to persons.
In regards to shop assistant robotic systems, US Published Application No. 20040217166 discloses a device that guides the shopper inside a shop, using a robotic cart that contains the shopping list. However, the way in which the robotic cart is to be able to locate the objects has not been resolved.
Currently, there are patents related to the positioning of a robot, the navigation thereof in structured or unstructured environments, etc., but their implementation cost is quite high and, at best, they are only capable of locating items horizontally, at ground level.
There are also automated dispensing systems and warehouses (e.g., U.S. Pat. No. 6,325,586) capable of storing an object and later recovering it, but they are all based on the assumption that the exact location of the item is known. There have also been developments in relation to packaging the purchased items in cardboard boxes (see US Published Application Nos. 20150059286, 20140180479). Some of these warehouses may offer customers the completed purchase when they supply a list of requests, but by taking the items from a warehouse that is closed to the public (see US Published Application No. 20050238465).
On the other hand, there are robotic systems that interact with humans (see U.S. Pat. No. 6,584,375), but in general they are very simple interfaces which are limited to exchanging certain phrases and gesticulating. These systems are not capable of locating objects, except under extremely controlled conditions.
Another very important disadvantage of the currently existing robotic systems for shops is their high cost, which is impossible to afford by a store chain.
The present invention describes a robotic equipment that makes it possible to locate the items in a shop such that the customers or consumers may obtain them as quickly as possible. The equipment of the invention facilitates the task of shopping by locating the items on a shelf (both horizontally and vertically, by setting up a spatial location with coordinates on the XYZ axes), thereby allowing for an assistant system to help the final consumers to quickly find the items in their shopping list. In this way, it is not necessary to automate a complete shop, which would have a very high implementation cost.
The invention involves a robotic equipment that is capable of locating items in racks or shelves in retail shops, although the application thereof to other types of larger or wholesale establishments is not excluded.
The robotic equipment comprises a mobile robot with autonomous odometry navigation that may move throughout the shop and locate the items located on the shelves thereof by means of artificial vision. The items are identified by means of codes, whether barcodes, QRs (Quick Response Codes), RFID (an acronym for Radio Frequency Identification), and/or optical signals, and may be at any height of the rack or shelf. The robot makes a map of the shop in order to identify the location of the racks and, subsequently, by reading the identification codes of the items and auxiliary signals originating from active tags, identifies all the items, both horizontally and vertically, thereby creating a map with the location of each item. Once the location of the different items is known, the robot may search the items requested by the customers.
In order to be able to perform these actions, the robotic equipment of the present invention comprises a mobile robot equipped with the following elements or devices:
The robot may include a charging dock to recharge the battery when it is empty.
Moreover, the mobile robot may include at least one articulated robotic arm which is also connected to the controller, the free end whereof is equipped with gripping means in the form of clamps or similar. In this case, the controller is configured so as to transmit instructions to the robotic arm such that it may collect the items.
The robot preferably includes a load platform which allows for it to be used as an assistant in the transport of items for the customers, such that said customers may deposit said items on the platform whilst doing their shopping.
The laser used in the scanning and obstacle detection system is preferably a LIDAR-technology (Laser Imaging Detection and Ranging) laser; this is a technology that makes it possible to determine the distance between a laser emitter and an object or surface using a pulsed laser beam. This type of lasers provides very reliable measurements due to their high precision in the measurements and their high angular resolution. The laser will allow the robot to draw the map of the shop and detect obstacles.
The active tag reader system with optical and/or electromagnetic signals preferably comprises an RFID (Radio Frequency Identification) radiofrequency tag reader; ultra-high frequencies (UHF) may be used due to its greater reading distance and speed; moreover, the greater directionality of the tag emission beams makes it possible to locate the products with greater precision. It is also possible to use a high-frequency (HF) reader. The active tag reader system with optical signals may be a vision camera or an optical sensor.
Preferably, the artificial vision system comprises a photographic camera, or webcam, and an infrared sensor. Thanks to the artificial vision system, the robot may take a large number of photographs per second of a shelf and these images will be processed in real time.
The controller may be a netbook controller (laptop), since these controllers are economical and have an acceptable power.
In the event that the robot controller does not have sufficient computational capacity, the robotic equipment may comprise an external computer wirelessly connected (wireless, wimax, XG, etc.) to the mobile robot. In this case, the robot would be configured so as to send the data (captured images) collected to the conveniently programmed external computer, which would perform the treatment and processing thereof in order to obtain the location of the items in the shop (both in the vertical and horizontal positions within a shelf or rack) and save them in a database. The external computer would simply execute those algorithms that require many computational resources.
Once they have been processed by the external computer, the data may be sent once again to the mobile robot or stored in the external computer database, if the latter is integrated with an ERP (Enterprise Resource Planning) software. In order to identify all the items on a shelf in a shop, the mobile robot, which navigates using odometry, stands parallel to the shelf using its laser sensor. To this end, it uses the identification codes associated with each product. The items are identified by means of artificial vision, by analysing the images obtained when the robot travels parallel to the shelf, using the information supplied by the active tags and the identification codes. The robot calculates the location of each item in absolute coordinates (XYZ) at the shop level.
The robotic equipment thus conceived makes it possible to locate products placed at any height of a shelf and remember the location thereof. Moreover, it is preferably based on the most widely spread, low-cost identifier in the retail sector, i.e. the barcode. The robot, which moves using odometry, creates a map of the shop as it travels through it, thanks to its laser sensor, and is equipped with obstacle detection and avoidance algorithms, which allow it to navigate autonomously in order to access the desired items.
The potential applications of the invention are in the retail shop sector, in the massive commercialisation of products or services to large numbers of final consumers, in enterprises in the catering, restaurant and coffee-shop sectors, and even in industry. It has potential applications in any environment wherein items need to be located within storage systems.
It may be applied to any manufacturing industry wherein it is necessary to locate items that may be identified by means of tags based on different technologies.
In order to contribute to a better understanding of the present invention, the following figures are included for illustrative, non-limiting purposes:
Throughout this description, elements appearing in figures are assigned three-digit reference designators, where the most significant digit is the figure number and the two least significant digits are specific to the element. An element that is not described in conjunction with a figure may be presumed to have the same characteristics and function as a previously-described element having a reference designator with the same least significant digits.
In a particular embodiment, the robotic equipment of the present invention is made up of a mobile robot 1 and an external computer, or PC 2, which is wirelessly connected to the mobile robot. As shown in
To this end, the items in the shop must be equipped with identification codes. The identification codes may be: barcodes or QR (Quick Response Code) codes, both of which are detected by the artificial vision system, RFID (Radio Frequency Identification) codes, and/or codes with optical signals, which would be detected by an active tag reader system with optical and/or electromagnetic signals.
The robot 1 includes a platform 9, where the customer may deposit the selected items.
The robot 1 may further include an articulated robotic arm (not represented), also connected to the controller, the free end whereof is equipped with gripping means, such as clamps or similar.
The operating process of the robotic equipment that comprises a mobile robot 1 and an external computer 2 for the location of items in a shop equipped with shelves where the items are placed comprises the following steps (see
In the event that the robotic equipment does not include an external computer 2, the mobile robot 1 controller 7 would be in charge of processing the data collected, in order to calculate the location of the items in the form of absolute coordinates XYZ at the shop level, and would save their location in a database in the controller 7 itself. Moreover, in this case, the controller software will previously have the code-product relationships.
When a customer requests a product from the robot (for example, through a point of sale or user interface), it consults the database in the external computer 2 or the robot controller 7 and move to where the requested item is located.
Number | Date | Country | Kind |
---|---|---|---|
201630307 | Mar 2016 | ES | national |