In a retail setting, the tracking of inventory on a retail floor is an important component of the efficient operation of the facility. Typically an inventory is performed for a rack of items based on how many items are remaining on the rack at a certain time. Based on the number of items remaining on a rack, a determination can be made regarding whether the rack should be replenished.
In one embodiment, an image-based replenishment system is provided. The system includes one or more imaging devices disposed in a facility. The facility includes racks configured to hold multiple items, each rack equipped with a location sensor. The system further includes one or more databases holding rack assignment information for the racks, the rack assignment information including an assigned volume for each of the racks, a category of item for items assigned to each of the racks, and an associated threshold value for each category. The system also includes a computing device communicatively coupled to the one or more imaging devices, the location sensors and the databases and configured to execute a replenishment module. The replenishment module when executed periodically obtains an image of a selected rack among the racks from the one or more imaging devices. The system determines, based on the image, a first volume indicative of a volume of items on the rack. The system retrieves a sales forecast for the items on the selected rack and determines an expected second volume of items on the rack based on the sales forecast for the item. The system then determines whether the first volume is within a predetermined threshold of the second volume and transmits instructions based on the whether the first volume is determined to be within the predetermined threshold of the second volume. The instructions can include submitting an order to a replenishment system for an additional quantity of the items on the selected rack to be delivered to the facility. The instructions may also reference location data from the location sensor associated with the selected rack and determine a particular rack needs to be replenished, and there are items in stock that can be used to replenish the rack of items. When the first volume is determined to not be within the predetermined threshold of the second volume, the instructions are transmitted to an individual in the facility and instruct the individual to perform an action, the action being at least one of changing a location of the rack of items, changing of a price of the items on the selected rack, and removal of the items from the selected rack, the instructions referencing location data from the location sensor associated with the selected rack.
In another embodiment, a computer implemented method for image-based replenishment is provided. The method includes periodically obtaining an image of a selected rack among a group of racks from the one or more imaging devices and determining, based on the image, a first volume indicative of a volume of items on the rack. The method further includes retrieving a sales forecast for the items on the selected rack from one or more databases and determining an expected second volume of items on the rack based on the sales forecast for the item. The method also includes determining whether the first volume is within a predetermined threshold of the second volume, and transmitting instructions based on the whether the first volume is determined to be within the predetermined threshold of the second volume and transmits instructions based on the whether the first volume is determined to be within the predetermined threshold of the second volume. The instructions can include submitting an order to a replenishment system for an additional quantity of the items on the selected rack to be delivered to the facility. The instructions may also reference location data from the location sensor associated with the selected rack and determine a particular rack needs to be replenished, and there are items in stock that can be used to replenish the rack of items. When the first volume is determined to not be within the predetermined threshold of the second volume, the instructions are transmitted to an individual in the facility and instruct the individual to perform an action, the action being at least one of changing a location of the rack of items, changing of a price of the items on the selected rack, and removal of the items from the selected rack, the instructions referencing location data from the location sensor associated with the selected rack.
In another embodiment, a non-transitory machine-readable medium is provided that stores instructions executable by a processing device. Execution of the instructions causes the processing device to implement a method for image-based replenishment. The method includes periodically obtaining an image of a selected rack among a group of racks from the one or more imaging devices and determining, based on the image, a first volume indicative of a volume of items on the rack. The method further includes retrieving a sales forecast for the items on the selected rack and determining an expected second volume of items on the rack based on the sales forecast for the item. The method also includes determining whether the first volume is within a predetermined threshold of the second volume, and transmitting instructions based on the whether the first volume is determined to be within the predetermined threshold of the second volume and transmits instructions based on the whether the first volume is determined to be within the predetermined threshold of the second volume. The instructions can include submitting an order to a replenishment system for an additional quantity of the items on the selected rack to be delivered to the facility. The instructions may also reference location data from the location sensor associated with the selected rack and determine a particular rack needs to be replenished, and there are items in stock that can be used to replenish the rack of items. When the first volume is determined to not be within the predetermined threshold of the second volume, the instructions are transmitted to an individual in the facility and instruct the individual to perform an action, the action being at least one of changing a location of the rack of items, changing of a price of the items on the selected rack, and removal of the items from the selected rack, the instructions referencing location data from the location sensor associated with the selected rack.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate one or more embodiments of the invention and, together with the description, help to explain the invention. The drawings are not necessarily to scale, or inclusive of all elements of a system, emphasis instead generally being placed upon illustrating the concepts, structures, and techniques sought to be protected herein. In the drawings:
Exemplary embodiments provide an image-based replenishment system. In one embodiment a system includes a computing device executing a replenishment module that obtains an image from one or more imaging devices in a facility of a selected rack among a group of racks. The replenishment module determines, based on the image, a first volume indicative of a volume of items on the rack and retrieves a sales forecast for the items on the selected rack. The replenishment module further determines an expected second volume of items on the rack based on the sales forecast for the item and determines whether the first volume is within a predetermined threshold of the second volume. As discussed further below, based on the determination as to whether or not the first volume is within the predetermined threshold of the second volume, the replenishment module transmits instructions to a replenishment system, a designated individual or a computing device for subsequent action.
The cameras 112, 114 and 116 periodically transmit images of the racks of items to computing device 102. The replenishment module 104 determines a first volume from the images of the racks captured by the cameras and compares the first volume to a second volume that is based on sales forecast for the particular item. The sales forecast may be retrieved by the replenishment module 104 from databases associated with sales forecast system 118. For example, the sales forecast 118 system may generate sales forecasts for different items based on historical sales data of that item at the present facility or at a similarly situated facility. The historical sales data may include sales data for different times of the year and may reflect historical sales data for different weather conditions. The replenishment module 104 determines whether the first volume of data for the rack is within a predetermined threshold of the second volume and transmits instructions based on whether the first volume is determined to be within the predetermined threshold of the second volume. Put another way, the replenishment module 104 determines whether or not the current volume of items remaining on the rack indicates whether the item is selling as quickly as expected. The instructions generated by replenishment module 104 can include submitting an order to a replenishment system for an additional quantity of the items on the selected rack to be delivered to the facility when items are selling well and the first volume is within the pre-determined threshold of the second volume. The instructions may also reference location data from the location sensor associated with the selected rack, determine a particular rack needs to be replenished, and that there are items in stock that can be used to replenish the rack of items. When the first volume is determined to not be within the predetermined threshold of the second volume, the instructions may be transmitted to an individual in the facility to instruct the individual to perform an action. For example, the instructions may be for the individual to the change a location of the rack of items in the facility, change a price of the items on the selected rack, and/or remove of the items from the selected rack. In one embodiment, the instructions are transmitted from computing device 102 to a mobile device associated with the individual.
In one embodiment to calculate volume the system has stocked images of full and empty racks, one image each. Current images of the racks are then captured and compared to determine current volume. The current volume may be determined by calculating how much x-y space is consumed by the items on the rack. This creates a single data point for “filled space”, rather than trying to count items. For example, an empty rack may have occupied volume of 1.347 ft2 of space, and the same rack filled with the particular item assigned to it may have an occupied volume of 6.934 ft2. If the camera sees 4.501 ft2 of filled space at the location, then the rack is 64% full (4501/6934). The determined volume may be compared to a sales forecast indicating an expected volume and/or compared to an inventory record indicating the expected volume of the rack. Pre-determined thresholds (e.g.: 5 or 10% as non-limiting examples) may be set to determine when the image-based volume meets expectations. . . . Racks not meeting expectations may result in item price-drops of the items, racks being moved to a more likely location in the facility for sales (or deemphasized to a back corner to make way for faster selling items), and items being removed from the rack. Racks meeting expectations may have their contents replenished and additional items may be automatically ordered. Different items occupy different volumes, so a different volume is needed in the inventory database for each type of item. For example, a rack completely jammed full of baby onesies if going to occupy a much smaller area than a rack filled with men's jackets.
Based on the image, a determination is made regarding a first volume measurement indicative of a volume of items on the rack (step 306). It should be noted that a volume determination is performed instead of counting the number of items remaining on the rack or keeping track of how many items are removed from the rack. The counting of items tends to be labor intensive and prone to error.
Next, a sales forecast for the items on the selected rack is received (step 308). The sales forecast is retrieved from a sales forecast system. The sales forecast system is used to predict volumes of sales for particular items. In one embodiment the sales forecast system may leverage historical facility sales data that includes data for different times of the year, different times of day and/or different weather conditions. As shown in processing block 310 the sales forecast is based on at least one of historical sales data for the present facility and historical sales data for a similarly-situated facility (e.g. a facility of the same size and/or the same type of geographic location).
A determination is made regarding an expected second volume of items on the rack based on the sales forecast for the item (step 312). As a non-limiting example, if the sales forecast indicates that half the items on the rack should have been sold by the current time, the second volume indicating the expected volume would be 50%.
A determination is then made whether the first volume is within a predetermined threshold of the second volume (step 314). This is performed to provide an indication of how sales for the item are meeting sales goals.
Instructions are transmitted based on whether or not the first volume is determined to be within the predetermined threshold of the second volume (step 316). The instructions may also be transmitted wherein the instructions are based on at least one of weather conditions and customer traffic patterns (step 318). For example, the instructions may be modified based on weather conditions outside the facility and/or traffic disruptions.
The database may be updated with the first volume for the selected rack (step 320). In this manner the database is kept up to date with the latest volume of items on the rack.
An order may be programmatically submitted to a replenishment system for an additional quantity of the items on the selected rack to be delivered to the facility based on a determination that the first volume is within a predetermined threshold of the second volume (step 322). In this instance, because the items are selling, more items are required to replenish the rack of items. The instructions reference location data from the location sensor associated with the selected rack.
Instructions may be transmitted to a mobile device associated with an individual in the facility for an additional quantity of the items to be delivered to the selected rack based on a determination that the first volume is within a predetermined threshold of the second volume, the instructions referencing location data from the location sensor associated with the selected rack. In this instance the rack needs to be replenished, and there are items in stock that can be used to replenish the rack of items (step 324). It will be appreciated that the instructions could also generate a display of instructions to the individual on a non-mobile device (such as a facility display screen) or generate audible instructions to the individual via a speaker system in the facility.
When the first volume is determined to not be within the predetermined threshold of the second volume, the instructions may also be transmitted to an individual in the facility. The instructions may instruct the individual to perform an action such as changing a location of the rack of items, changing a price of the items on the selected rack, and removing the items from the selected rack. The instructions may reference location data from the location sensor associated with the selected rack. In this instance where the threshold is not met, the items have not met the sales expectations. There could be several reasons for this, including the rack needing to be placed in an area that has more customer traffic, the price may need to be lowered to attract more sales of the items, and the items may not be popular in this particular facility (for example the demand for swim suits may be less in Alaska than in California).
In an example embodiment, one or more portions of network 405 may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless wide area network (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, a wireless network, a WiFi network, a WiMax network, another type of network, or a combination of two or more such networks.
The client devices 410, 420 may comprise, but are not limited to, mobile devices, hand-held devices, wireless devices, portable devices, wearable computers, cellular or mobile phones, portable digital assistants (PDAs), smart phones, smart watches, tablets, ultrabooks, netbooks, laptops, desktops, multi-processor systems, microprocessor-based or programmable consumer electronics, and the like. Each of client devices 410, 420 may connect to network 405 via a wired or wireless connection. In an example embodiment, the client devices 410, 420 may perform one or more of the functionalities of the image-based replenishment system 100 described herein, or transmit data or signals to the image-based replenishment system 100 described herein. The client device 410, 420 can include one or more components of computing device 500 of
In an example embodiment, the image-based replenishment system 100 may be included at least in part on the client device 410, 420, and the client device 410, 420 performs one or more of the functionalities of the system described herein. In an example embodiment, the image-based replenishment system 100 may be included at least in part on the server 430, and the server 430 performs one or more of the functionalities of the image-based replenishment system 100 described herein.
The database(s) 440 comprise one or more storage devices for storing data and/or instructions (or code) for use by the server 430 and/or the client devices 410, 420. Each of the database(s) 440 and the server 430 is connected to the network 405 via a wired connection. Alternatively, one or more of the database(s) 440 and server 430 may be connected to the network 405 via a wireless connection. The server 430 comprises one or more computers or processors configured to communicate with the client devices 410, 420 via network 405. The server 430 can include one or more components of device 500 of
In an example embodiment, the server 430 also includes various software services that facilitate the functionalities of the image-based replenishment system 100. Theses services include application services 432, security services 434, external services 436 and retail services 438. Database(s) 440 and server 430 may be located at one or more geographically distributed locations from each other or from client devices 410, 420. Alternatively, database(s) 440 may be included within server 430.
Virtualization can be employed in the computing device 500 so that infrastructure and resources in the computing device can be shared dynamically. A virtual machine 514 can be provided to handle a process running on multiple processors so that the process appears to be using only one computing resource rather than multiple computing resources. Multiple virtual machines can also be used with one processor.
Memory 506 can include a computer system memory or random access memory, such as DRAM, SRAM, EDO RAM, and the like. Memory 506 can include other types of memory as well, or combinations thereof. An individual can interact with the computing device 500 through a visual display device 518, such as a touch screen display or computer monitor, which can display one or more user interfaces 522 for receiving data from the individual (e.g., order data and travel data). The visual display device 518 can also display other aspects, elements and/or information or data associated with exemplary embodiments. The computing device 500 can include other I/O devices for receiving input from a individual, for example, a keyboard or another suitable multi-point touch interface 508, a pointing device 510 (e.g., a pen, stylus, mouse, or trackpad). The keyboard 508 and the pointing device 510 can be coupled to the visual display device 518. The computing device 500 can include other suitable conventional I/O peripherals.
The computing device 500 can also include one or more storage devices 524, such as a hard-drive, CD-ROM, or other computer readable media, for storing data and computer-readable instructions and/or software, such as one or more modules of the system 100 shown in
The computing device 500 can include a network interface 512 configured to interface via one or more network devices 520 with one or more networks, for example, Local Area Network (LAN), Wide Area Network (WAN) or the Internet through a variety of connections including, but not limited to, standard telephone lines, LAN or WAN links (for example, 802.11, T1, T3, 46 kb, X.25), broadband connections (for example, ISDN, Frame Relay, ATM), wireless connections, controller area network (CAN), or some combination of any or all of the above. The network interface 512 can include a built-in network adapter, network interface card, PCMCIA network card, card bus network adapter, wireless network adapter, USB network adapter, modem or another device suitable for interfacing the computing device 500 to a type of network capable of communication and performing the operations described herein. Moreover, the computing device 500 can be a computer system, such as a workstation, desktop computer, server, laptop, handheld computer, tablet computer (e.g., the iPad® tablet computer), mobile computing or communication device (e.g., the iPhone® communication device), or other form of computing or telecommunications device that is capable of communication and that has sufficient processor power and memory capacity to perform the operations described herein. The computing device can include an image capture device 532 such as a camera for capturing still pictures or for capturing videos.
The computing device 500 can run an operating system 516, such as versions of the Microsoft® Windows® operating systems, the different releases of the Unix and Linux operating systems, a version of the MacOS® for Macintosh computers, an embedded operating system, a real-time operating system, an open source operating system, a proprietary operating system, an operating systems for mobile computing devices, or another operating system capable of running on the computing device and performing the operations described herein. In exemplary embodiments, the operating system 516 can be run in native mode or emulated mode. In an exemplary embodiment, the operating system 516 can be run on one or more cloud machine instances.
The description is presented to enable a person skilled in the art to create and use a computer system configuration and related method and systems for image-based replenishment. Various modifications to the example embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Moreover, in the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art will realize that the invention may be practiced without the use of these specific details. In other instances, well-known structures and processes are shown in block diagram form in order not to obscure the description of the invention with unnecessary detail. Thus, the present disclosure is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
In describing exemplary embodiments, specific terminology is used for the sake of clarity. For purposes of description, each specific term is intended to at least include all technical and functional equivalents that operate in a similar manner to accomplish a similar purpose. Additionally, in some instances where a particular exemplary embodiment includes a multiple system elements, device components or method steps, those elements, components or steps can be replaced with a single element, component or step. Likewise, a single element, component or step can be replaced with multiple elements, components or steps that serve the same purpose. Moreover, while exemplary embodiments have been shown and described with references to particular embodiments thereof, those of ordinary skill in the art will understand that various substitutions and alterations in form and detail can be made therein without departing from the scope of the invention. Further still, other aspects, functions and advantages are also within the scope of the invention.
Exemplary flowcharts have been provided herein for illustrative purposes and are non-limiting examples of methods. One of ordinary skill in the art will recognize that exemplary methods can include more or fewer steps than those illustrated in the exemplary flowcharts, and that the steps in the exemplary flowcharts can be performed in a different order than the order shown in the illustrative flowcharts.
Having described certain embodiments, which serve to illustrate various concepts, structures, and techniques sought to be protected herein, it will be apparent to those of ordinary skill in the art that other embodiments incorporating these concepts, structures, and techniques may be used. Elements of different embodiments described hereinabove may be combined to form other embodiments not specifically set forth above and, further, elements described in the context of a single embodiment may be provided separately or in any suitable sub-combination. Accordingly, it is submitted that the scope of protection sought herein should not be limited to the described embodiments but rather should be limited only by the spirit and scope of the following claims.
This application claims the benefit of, and priority to, U.S. Provisional Patent Application No. 62/736,671, entitled “System and Method for Image-Based Replenishment”, filed Sep. 26, 2018, the contents of which are incorporated herein by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
7398232 | Renz | Jul 2008 | B2 |
7953632 | Salerno | May 2011 | B2 |
8091782 | Cato et al. | Jan 2012 | B2 |
9659272 | Birch | May 2017 | B2 |
20060085295 | Droste et al. | Apr 2006 | A1 |
20130235206 | Smith | Sep 2013 | A1 |
20150262116 | Katircioglu et al. | Sep 2015 | A1 |
20170286773 | Skaff et al. | Oct 2017 | A1 |
20180322448 | Nemati | Nov 2018 | A1 |
Entry |
---|
Cognizant, Planogram Compliance: Making It Work. cognizant 20-20 insights. 7 pages, Nov. 2013. |
Moorthy et al., Applying Image Processing for Detecting On-Shelf Availability and Product Positioning in Retail Stores. WCI '15 Proceedings of the Third International Symposium on Women in Computing and Informatics. pp. 451-457, (2015). |
Number | Date | Country | |
---|---|---|---|
20200097896 A1 | Mar 2020 | US |
Number | Date | Country | |
---|---|---|---|
62736671 | Sep 2018 | US |