A smart, movable closure system that allows access to the interior from the exterior of the cabinet, is disclosed. In some embodiments, the movable structure may be coupled with a cabinet interior that is adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. In particular, the smart, movable closure system may include electronic components that display graphical renderings corresponding to one or more products stored in the retail product container.
Although more and more people are purchasing items online, brick and mortar retail sales (for example, provided through cooling systems) are still substantial and are, in fact, growing in certain market segments such as grocery, drug, and convenience stores. Over 75 percent of shopping in brick and mortar stores is impulse purchasing. Research shows that impulse decisions are highly influenced by in-store messaging, and that most of in-store impulse shopping occurs at retail product containers, such as coolers and freezers. Consequently, a disruption of impulse shopping behavior at a retail product container could present an enormous value creation opportunity for both consumer packaged goods brands and retailers.
A computing platform comprises one or more retail product containers and a controller that generates different advertisements (ads) on displays of the one or more retail product containers in a cooling system. Each of the retail product containers includes an internal storage volume for stocking one or more retail products, a display (screen) on its door, and a customer detector to detect the presence of one or more customers in proximity to the retail product container. The controller communicates with each of the retail product containers over a communications channel (e.g., a wireless channel), for example, to display advertisements for viewing by the one or more customers. For example, the controller may be configured to instruct a retail product container to display a full screen advertisement on its display. The displaying of the full screen advertisement may be a default procedure or may be performed when no motion (e.g., of a customer) or a human form is detected by the customer detector. When motion (e.g., of a customer) or human form is detected within a predetermined distance, the controller may subsequently instruct the retail product container to terminate the full screen advertisement and to display a planogram of products located in the internal storage volume.
With another aspect, a customer detector of a retail product container may include one or more cameras and proximity sensors. The one or more cameras and proximity sensors may be situated on a door front of the retail product container.
With another aspect, when a customer is detected as being sufficiently close to a container door, an invitation indication may be displayed on the container's display. For example, a quick response (QR) code may be generated at the center of a planogram. The detected customer can scan the QR code through a wireless device if the customer desires to opt-in, in response to the invitation. When the customer opts-in, a computing platform may interact with the customer via a mobile app. In some examples, in lieu or in addition to a QR code, an image other than a QR code (e.g. an image with a machine-detectable watermark), a Bluetooth (or other short-range wireless protocol) beacon, or other mechanism may be provided to indicate an invitation to the customer.
With another aspect, when a customer opts-in in response to a displayed invitation on a container's display, a personalized advertisement may be displayed in accordance with customer information that is obtained through a mobile app. The personalized advertisement may be indicative of customized pricing for one or more products stocked at the retail product container.
With another aspect, when a customer does not opt-in in response to an invitation, the computer platform may continue to generate a planogram with inserted advertisements (for example, banner ads, spot deals, and hot spots) based on generalized information (for example, weather conditions, weather forecasts, and current or upcoming events).
With another aspect, a computing platform may download a set of advertisements (for example, from a cloud computing service) that is relevant to a retail product container. Further, the computing platform may generate one of the downloaded advertisements on a display of the retail product container. The set of downloaded advertisements may be based on a type of product stocked at the retail product container. The type of product may be determined from a container identification or from inventory information provided by the retail product container.
With another aspect, a computing platform may determine an advertisement presented on a display of the retail product container, based on a set of rules that may encompass weather conditions in proximity to the container, the date, and/or characteristics about a customer in proximity to the container. For example, the presented advertisement may be selected because a customer is standing by a beverage container for 20 seconds, it is 98 degrees outside, and the date is just before the Fourth of July.
With another aspect, a computing platform may determine a measure of effectiveness for an advertisement presented on a display of a retail product container. For example, the computing platform may detect whether a customer is within a determined distance of the retail product container and/or whether more than a predetermined number of customers are viewing the presented advertisement.
With another aspect, computing platform may generate an advertisement targeted at a product level. For example, a customer detector may detect that a customer is viewing a particular product displayed in a planogram at a retail product container.
With another aspect, a displayed advertisement at a first retail product container may promote a product that is stocked at a second retail product container. For example, a computing platform may predict that a customer will shop at the second retail product container after shopping at the first retail product container based on customer information.
The foregoing summary, as well as the following detailed description of exemplary embodiments, is better understood when read in conjunction with the accompanying drawings, which are included by way of example, and not by way of limitation with regard to the claimed invention.
According to an aspect of some of the embodiments, a smart, movable closure system is disclosed. The system may, in some embodiments, comprise electronic components that capture images and/or other media (e.g., audio, video, infrared data, or other media) of the interior of a cabinet or the exterior of the cabinet. Moreover, the system may also, in some embodiments, comprise electronic components that display, among other things, graphical renderings or other visual output corresponding to one or more products stored in cabinet. The cabinet may be adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. As such, the retail product container may provide a system that interfaces with users in a retail environment.
A computing platform generates displayed content at a retail product container of a cooling system based on information about a customer in proximity to the retail product container, one or more products stocked at the retail product container, and generalized information external to the retail product container. According to an aspect of some embodiments, the computing platform may generate selected advertisements (ads) at one or more retail product container. The retail product container includes an internal storage volume for stocking one or more products, a display on the container's door, and a customer detector to detect the presence of a customer in proximity to the retail product container. With an embodiment, when a customer is detected to be located within a predetermined distance from the retail product container, an invitation indicator is displayed on the container's display. When the customer opts-in, a personalized advertisement may be displayed in accordance with customer information that may be obtained through a mobile app. The personalized advertisement may also include customized pricing for one or more products stocked at the retail product container.
Coolers may be one of the most overlooked, least promoted, least technology sophisticated, and may be one of the most operationally challenged sections of a retail store. Conventional retail product containers (e.g., coolers, freezers, vending machines, etc.) may comprise a glass panel or door through which a customer can view products stored in the retail product container and which can be available for purchase. However, stored products may not be neatly presented, and stored products may be blocked by other products, such that a customer cannot easily see what products are available for purchase. Still further, store employees may often be required to maintain the appearance of the products stored therein, keep track of stock, or install and swap out promotional tags and other displays (such as displays relating to pricing and promotions) in order to keep those items current.
With these traditional approaches to retail product containers described above, coolers and refrigerators in grocery stores may be an area that is difficult for brands to conduct effective “on-the-spot” advertisements and promotions. Brands may typically rely on other advertising medias (for example, print, billboards, online and TV advertisements, and so forth) to promote products that are retailed on the shelves of coolers/freezers and/or refrigerators at retail and convenience stores.
Furthermore, with these traditional approaches described above, advertising efforts may not be as effective and impactful. Due to the limitations of traditional approaches, market penetration has been very small.
Retail product containers 102 and 103 may comprise a cooler, freezer, vending machine, and so forth and typically store different types of products (for example, milk, frozen meals, beer, ice cream, and so forth) in corresponding internal volumes.
In one embodiment of the system disclosed herein, edge processor (controller) 101 instructs retail product container 102 or 103 to display the selected advertisement based on customer information of a customer in proximity to the retail product container, products stocked at the retail product container, and generalized information (for example, weather conditions) that are not specific to the retail product container. Meanwhile, other embodiments of the system disclosed herein operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it is “identity-blind” in that it never gathers or uses personally identifiable or linkable information. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.
With some embodiments, controller 101 may communicate with retail product container via a wireless communication channel (for example, Wi-Fi, Bluetooth®, Zigbee®, and so forth) and may be near the retail product container or at any place in the world through the Internet.
Each retail product container 102 or 103 may support a wireless channel through a common communication interface for associated components (for example, sensors, cameras, and so forth) that is not explicitly shown. However, some embodiments may establish separate wireless communication channels for each of the different components supporting the Internet of Things (IOT) with controller 101.
With some embodiments, controller 101 may interact with additional computing facilities, for example, cloud services 104 or one or more computer servers (not explicitly shown) to obtain advertisement content and to interact with a customer via wireless device 106 through wireless service 105.
Each retail storage container 102 and 103 may have door 230. Display (screen) 216 is mounted on door 230 along with customer-detecting hardware 218, such as one or more proximity sensors (heat maps), cameras, facial sensors or scanners, and eye-sensors (iris-tracking sensors).
With some embodiments, display 216 comprises an LCD panel having one or more touch zones 232 which are interactive by the customer. Access panel 234 may be situated proximate to the bottom of the door 230 along with a media player 236, which provides display content to display 216.
A protective panel (not explicitly shown) may be mounted over the display 216.
A plurality of retail product containers (similar to retail product container 102) and associated displays may be arranged side-by-side down an aisle of a retail store (for example, a grocery store). Edge processor (controller) 101 (as shown in
With some embodiments, customer detector 318 may detect a customer when the detected object is deemed to be a human (person) (rather than, for example, a shopping cart). Customer detector 318 may further determine whether the detected person is an employee (for example, by a uniform of the employee or by a RFID tag on the employee). In such a situation, customer detector 318 may ignore the employee so that a display at a retail product container is not updated.
With some embodiments, display 316 comprises a non-transparent display which prohibits customers from viewing, through the display, products stored in the internal storage volume. Display 316 may comprise, for example, a touchscreen with which customers may interact.
Each retail product container 102 may further comprise customer detector 318 that may detect any or specific individuals (e.g., customers versus employees), motion (e.g., of a customer), a human form (e.g., a human face of a customer), heat, etc. (For example, customers may be individuals in the vicinity of a retail product container as detected by customer detector 318.) With some embodiments, the customer detector may utilize one or more of a proximity sensor (e.g., via a heat map), a camera, a facial sensor, a scanner, an eye-sensor (e.g., an iris-tracking sensor), etc. In addition to customer detector 318, the retail product container 102 may comprise other sensors/cameras 323 configured to detect activity in/around/on the retail product container 102. Although for illustrative purposes customer detector 318 has been described as an input to trigger/activate further steps (e.g., in
With some embodiments, one or more cameras 323 may be mounted on doors of retail product container 102. The one or more cameras may have a depth of field of view of twenty feet or more and may have a range of field of view of 170 degrees with, for example, 150 degrees of facial recognition ability. Computer-readable instructions may be employed in association with the cameras to monitor shopper interactions, provide relevant advertisement content on the display 316 via media player 317, and track advertisement engagement in-store. Controller 101 (as shown in
Each retail product container 102 may further comprise inventory tracker 320, e.g., to identify, quantify, and/or otherwise track stored retail products. In some aspects, the inventory tracker 320 may utilize additional cameras and/or sensors 323 that are disposed inside retail product container 102 and face the stored products.
As shown in
Each retail product container 102 may also include interface 322 that may be configured to facilitate, among other things, the networking and transfer of information between the controller 101 and retail product container 102 and control of display 316, customer detector 318, and inventory tracker 320.
With some embodiments, controller 101 may comprise a server having one or more processors, memory storage, a user interface, and so forth and may be configured to instruct what is displayed on the display 316 and to receive information and data from the retail product container 102. Additionally, controller 101 may be configured to perform analytics based on the received information and data.
Controller 101 may be configured to control the display 316 of each retail product container 102 to provide a planogram (for example, as shown in advertisements 402-406 in
While not explicitly shown in
Advertisement 401 shows a full screen advertisement while advertisements 402-405 (corresponding to a banner ad, hot spot, label/tag, and spot deal, respectively) show inserted offers within a planogram for retail product container 102. For example, display advertisement 404 may include labels at the bottom of the image of the product and tags at the top of the image of the product on the display screen. Labels and tags may be selected and activated from a pre-determined pool of animated icons. For example, the native advertisement for the pizza in display advertisement 404 may be substituted with an animated graphic rendering of a steaming pizza.
As will be discussed, in some examples, inserted offers may be customized based on customer information for a customer in proximity to retail product container 102.
Referring to advertisement 402, customer detector 318 may detect when a customer is looking at (viewing) region 451 of an advertisement (for example, advertisement 402). If so, an advertisement that is targeted to one or more products shown in region 451 may be displayed on screen 316.
Referring to full screen advertisement 401, while a single advertisement may occupy the entire area of screen 316, embodiments may support a plurality of advertisements (in different display regions) that may be simultaneously displayed on screen 316.
Referring to
Ad manager 507 may request a set of advertisements, varying from one advertisement to many (e.g., hundreds of) advertisements, to be downloaded for retail product container 102. The request may be based on the type of product stocked at retail product container 102. For example, this request by ad manger 507 may be based on inventory information received from inventory tracker 320 (as shown in
Ad manager 507 may select one of the downloaded advertisements based on sensor/camera information from door sensors/cameras 506 (for example, located at door 230 as shown in
As will be discussed in further detail, ad evaluator 502 may determine an effectiveness of a presented advertisement on screen 509 based on information from door sensor/camera 506 and phone app support module 503. For example, door sensor/camera 506 may indicate that a customer is viewing a particular region of the displayed advertisement and/or the customer may indicate the effectiveness through a mobile app. The level of effectiveness (as shown at blocks 1006-1010 in
While cloud services may be used to provide additional computer resources as needed by advertising computer system 500, computer resources may be provided by one or more computer servers that may be otherwise provided by cloud services 501. For example, ad manager 507, ad evaluator 502, phone app support 503, and/or third-party data 505 may all reside in the cloud 510. Moreover, the aforementioned systems may all be referred to together, or separately, as cloud services 501. For example, a vendor may provide ad content through ad storage 504 so that the ad manager 507 may download advertisement content from the cloud 510. Ad manager 507 may request selected advertisement content (for example, based on a product type and corresponding to a plurality of advertisements) from the cloud 510 an show it on screen (display) 509 through screen player 508. Although components in
Controller 600 may include processing device 601 where processes (for example, processes 700-1200 as shown in
In addition, processing device 601 may download advertisement content from cloud services via cloud interface 603, store the downloaded content at memory device 605, access the downloaded content (for example, a selected advertisement) from memory device 605, and provide the advertisement content to display 316 via screen interface 606.
As previously discussed, advertisement content may be presented to display 316 through media player 317 as shown in
As previously discussed, controller 600 may obtain advertisement content (via ad storage 504 as shown in
Computer storage media may include volatile and nonvolatile and removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media include, but is not limited to, random access memory (RAM), read only memory (ROM), electronically erasable programmable read only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by the computing device.
Communication media may include computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Modulated data signal can be a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media may include wired media, such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.
Processing device 601 may also obtain sensor/camera data from customer detector 318 and inventory tracker 320 through interface 602. Processing device 601 may use this data to determine a location of a customer (e.g., via customer detector 318) with respect to retail product container 102 and the current inventory of retail product container 102.
Controller 600 (executing computer readable instructions from memory 604) may be configured to control the display 316 of each retail product container 102 (as shown in
Controller 600 may be configured to detect customers from information provided customer detector 318 (as shown in
Controller 600 may effectively obtain inventory information of each retail product container 102 (via inventory tracker 320 along with image recognition software). Controller 600 may be configured to transmit data to a distributor via cloud interface 603 and/or store regarding overall stock relating to the inventory of the plurality of retail product containers. For example, system 150 (as shown in
Controller 600 may be configured to instruct display 316 to display full screen advertisements when a customer is not sufficiently close to a retail product container (for example, at block 801 as shown in
As an example, if motion or a human form were detected within twenty feet of retail product container 102 (where customer detector 318 mounted on the door of that retail product container 102), controller 600 may be configured to terminate displaying a full screen advertisement and transition to displaying a planogram of products which are located inside retail product container 102. Banner advertisements and pricing tags may also be loaded from memory 605 and displayed at the same time as displaying the planogram. Controller 600 may also be configured to manage merchandising advertising objects and layers.
Controller 600 may be configured such that as a shopper (e.g., a customer) approaches closer to retail product container 102, advertisement content on display 316 can subsequently change. For example, display 316 may change to include labels (for example, organic, non-gmo, and so forth as shown in
Controller 600 may be configured so that as a shopper stands or lingers in front of a given retail product container 102, the contents (e.g., graphical renderings) outputted at display 316 may change again. In some embodiments, controller 600 is able to use information from customer detector 318 to effectively learn more about that particular customer, such as gender, age, mood, and so forth. (Alternatively or in combination, as will be discussed, controller 600 may obtain customer information through a mobile app when a customer opts-in in response to a displayed invitation.) In such embodiments, controller 600 may be configured to process detected customer information to determine a specific or customized advertisement to present to that particular customer on display 316. By tracking shopper data in parallel with which advertising content is being presented on the displays of all retail product containers within the viewing range of the shopper, the retailer has new influence opportunities at the moment of purchasing decision, thus optimizing marketing spend and generating new revenue streams with respect to traditional approaches. Meanwhile, other embodiments of the system disclosed herein are designed with privacy and security features integrated into the technology platform and operating model. And, such embodiments operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it never gathers or uses personally identifiable or linkable information. In such embodiments, a retail consumer-safe platform is provided that is “identity-blind.” In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern. Controller 600 may be configured so that, while a shopper is standing in front of display 316 (as may be detected by a camera mounted on a door of that particular retail product container 102), relevant conditional advertisements are displayed on display 316 based on real-time data relating to news events, weather, sporting events, and so forth.
As discussed above, controller 600 may be configured to keep track of the inventory of retail product container 102 via inventory tracker 320, which may comprise one or more cameras and/or sensors on the inside of retail product container 102. When controller 600 has determined that a given product is out of stock, controller 600 may modify the displayed content on display 316. For example, out-of-stock artwork may be displayed and/or advertisements may be swapped.
As will be discussed, processes 700-1200 (as shown in
At block 701, controller 600 discovers the retail product containers (for example, containers 102 and 103) that are to be supported by controller 600. (A retail product container is supported by a controller when the controller controls the advertisements displayed at the retail product container.) Embodiments may utilize a known list of retail product containers and associated devices including sensors and cameras or may use a discovery procedure (for example, for discovering IoT devices including sensors and cameras and associating them to corresponding retail product containers).
When supported retail product containers are discovered, controller 600 determines the type of product/manufacturer stored in a given retail product container (for example, retail product container 103) at block 702. For example, the retail product container may report scanned universal product codes of its stocked products. Alternatively or in combination, controller 600 may access a mapping between each supported retail product container and corresponding stocked product types. At block 703, controller 600 may download relevant advertisements (which may be referred to as a set of advertisements) pertinent to the stocked products of the given retail product container.
If there are additional supported retail product containers, as determined at block 704, blocks 702-703 may be repeated for the next supported retail product container.
After content for pertinent advertisements have been downloaded, controller 600 may instruct each retail product container to display one of the downloaded advertisements based on various criteria (for example, as determined by processes 800, 900, 1100, and 1200).
When customer detector 318 (as shown in
When customer detector 318 determines that the customer approaches retail product container 102 even closer (within a predetermined distance—e.g., within twelve to fifteen feet) at block 804, controller 600 may generate an opt-in invitation within the displayed planogram at block 805. For example, the invitation may comprise a Quick Response (QR) code in the center of the display. If the customer wishes to opt-in, the customer can scan the QR code through the customer's smart phone to open a link or to download a mobile app associate with the QR code. In other examples, in lieu or in addition to a QR code, an image other than a QR code (e.g. an image with a machine-detectable watermark), a Bluetooth (or other short-range wireless protocol) beacon, or other mechanism may be provided to indicate an invitation to the customer. In some examples, multiple invitations may be simultaneously transmitted to that user's device to provide the customer an option to select whichever mechanism is most preferred. In other examples, the indicated invitations may be transmitted serially such that a first method (e.g., a wireless beacon) may be used when the customer is at a particular distance range from the retail product container 102 and a second method (e.g., a QR code) may be used when the customer is in a closer proximity to the container 102. Although an example of a predetermined distance of twelve to fifteen feet was described in one of the preceding examples, the disclosure is not so limited—e.g., depending on the mechanism used to indicate an invitation to the customer, the predetermined distance may be in a range greater than fifteen feet or in a range less than twelve feet.
When the customer opts-in, as determined at block 806, controller 600 may generate personalized advertisements on display of retail product container 102 based on customer information obtained through the mobile app. (For example, a customer opts-in when the customer accepts an invitation by scanning the presented QR code and accepting the usage agreement for the mobile app.) Pursuant to a retail consumer-safe platform, until the customer opts-in, the system may remain “identity-blind” in that it never gathers or uses personally identifiable or linkable information. The retail consumer-safe platform may be designed with privacy and security features integrated into the technology platform and operating model. Such embodiments operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.
At block 809, controller 600 may generate special offers via the customer's smart phone for one or more products stocked at retail product container 102. Process 800 continues in this mode at block 810 while customer detector 318 continues to detect the presence of the customer. Otherwise, process 800 reverts back to block 801, where a full screen advertisement is displayed.
When the customer does not opt-in, as determined at block 806, advertisements may be inserted within the displayed planogram at block 807 based on generalized information (not specific to the customer). Examples are shown as advertisements 402-405 in
When process 800 reverts to block 801 either from blocks 808 or 810, process 800 repeats executing blocks 803-810 when a subsequent customer is detected by customer detector 318 at block 802.
Referring to
When computing platform 100 has identified the appropriate advertisement at block 906, the identified advertisement may be displayed at the corresponding retail product container at block 907.
Referring to
At block 1002, computer platform 100 determines whether a customer is within a predetermined distance (in other words, deemed to be close enough to a retail product container). If so, at block 1004 customer detector 320 (for example, via iris-scanning sensors) may track eye movement of the customer and provide eye movement information to controller 101 to determine the level of effectiveness (for example, a success measure) based on the eye movement information.
At blocks 1005, 1006, and 1009 computing platform 100 may assess the customer information to determine a level of effectiveness at blocks 1007, 1008, 1010, and 1011. For example, the customer may be staring at display region 451 of advertisement 402 (as shown in
However, when computing platform 100 is unable to determine a level of effectiveness, process 1000 is terminated at block 1003.
Referring to
At block 1102, computing platform 100 may identify one or more products stocked at the detected display region. Computing platform 100 may identify the one or more products in a number of ways. For example, computing platform 100 may access a mapping of products to different regions of a displayed planogram. Alternatively or in combination, computing platform 100 may obtain inventory information about stock products at a retail product container from inventory tracker 320.
At block 1103, computing platform 100 may display an appropriate advertisement about the identified product on container's display.
Referring to
At block 1202, computing platform 100 may determine (e.g., via detection by the customer detector) whether the customer is at the first product container. If the customer is at the first product container, computing platform 100 may determine, at block 1203, whether the customer typically goes to a second retail product container, for example, where ice cream is stocked. Continuing the example, at block 1204 computing platform 100 may generate an advertisement at the first retail product container for the identified product (for example, ice cream) stocked at the second retail product container.
In some embodiments, a non-transitory computer readable medium storing instructions thereon is disclosed. When executed by a computing device, the instructions stored in the non-transitory computer readable medium may causes a computing device to: (1) determine a first product type stored in the first retail product container, and a second product type stored in the second retail product container, wherein the first product type is different from the second product type; (2) download a first set of files associated with the first product type, and a second set of files associated with the second product type, wherein the first set of files includes a first plurality of files, wherein the second set of files includes a second plurality of files, and wherein each file of the first set of files or of the second set of files corresponds to an associated advertisement; (3) initiate, from the first set of files, a first advertisement on a first display at the first retail product container; and (4) initiate, from the second set of files, a second advertisement on a second display at the second retail product container, wherein the second advertisement is different from the first advertisement. Moreover, in some embodiments in accordance with the disclosure, the aforementioned non-transitory computer readable medium may store instructions thereon that, when executed by the computing device, cause the computing device to executed steps (1)-(4) above, in addition to performing steps to: (5) detect motion of a customer within a predetermined distance of the first retail product container; and (6) in response to the detecting, generate an invitation indication to opt-in on the first display of the first retail product container. In addition, in some embodiments in accordance with the disclosure, the aforementioned non-transitory computer readable medium may store instructions thereon that, when executed by the computing device, cause the computing device to executed steps (1)-(4) above, in addition to performing steps to: (5) receive a notification when the customer opts-in; (6) in response to the receiving, interact with the customer through an application executing on a communication device of the customer to obtain customer information; (7) when the customer opts-in, receive customer information through the application; and (8) customize a customized advertisement on the first display of the first retail product container based on the customer information.
As can be appreciated by one skilled in the art, a computer system with an associated computer-readable medium containing instructions for controlling the computer system can be utilized to implement the exemplary embodiments that are disclosed herein. The computer system may include at least one computer such as a microprocessor, digital signal processor, and associated peripheral electronic circuitry.
This application is a continuation of U.S. patent application Ser. No. 17/082,270 (filed on Oct. 28, 2020) which is a continuation of U.S. patent application Ser. No. 16/741,581 (filed on Jan. 13, 2020), issued as U.S. Pat. No. 11,698,219, on Jul. 11, 2023, which is: first, a Continuation-in-Part of International Patent Application Serial No. PCT/US19/66869 (filed on Dec. 17, 2019), which is a Continuation-in-part of U.S. patent application Ser. No. 16/222,643 (filed on Dec. 17, 2018, and granted Sep. 8, 2020, as U.S. Pat. No. 10,769,666); second, a Continuation-In-Part of International Patent Application Serial No. PCT/US18/46103, (filed on Aug. 9, 2018,) which is a Continuation-In-Part of U.S. patent application Ser. No. 15/674,198 (filed Aug. 10, 2017, and granted Jun. 2, 2020, as U.S. Pat. No. 10,672,032); and third, a Continuation-In-Part of U.S. patent application Ser. No. 15/674,198 (filed Aug. 10, 2017, and granted Jun. 2, 2020, as U.S. Pat. No. 10,672,032. In addition, this application is a Continuation-In-Part of International Patent Application Serial No. PCT/US19/66869 (filed on Dec. 17, 2019), which is a Continuation-in-part of U.S. patent application Ser. No. 16/222,643 (filed on Dec. 17, 2018, and granted Sep. 8, 2020, as U.S. Pat. No. 10,769,666). All of the aforementioned applications in this paragraph are herein incorporated by reference in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
2002322 | Kraemer | May 1935 | A |
4371870 | Biferno | Feb 1983 | A |
4671582 | Stromquist et al. | Jun 1987 | A |
4893902 | Baughman et al. | Jan 1990 | A |
4998382 | Kostos et al. | Mar 1991 | A |
5024023 | Kostos et al. | Jun 1991 | A |
5111618 | Kaspar et al. | May 1992 | A |
5116274 | Artwohl et al. | May 1992 | A |
5255473 | Kaspar et al. | Oct 1993 | A |
5270843 | Wang | Dec 1993 | A |
5645330 | Artwohl et al. | Jul 1997 | A |
6005652 | Matsuhira | Dec 1999 | A |
6148563 | Roche et al. | Nov 2000 | A |
6377228 | Jenkin et al. | Apr 2002 | B1 |
6427772 | Oden et al. | Aug 2002 | B1 |
6475087 | Cole | Nov 2002 | B1 |
6476885 | Murray et al. | Nov 2002 | B1 |
6606832 | Richardson et al. | Aug 2003 | B2 |
6606833 | Richardson et al. | Aug 2003 | B2 |
6874903 | Yang et al. | Apr 2005 | B2 |
7072096 | Holman et al. | Jul 2006 | B2 |
7121675 | Ter-Hovhannisian | Oct 2006 | B2 |
7259359 | Davey et al. | Aug 2007 | B2 |
7290707 | Sawasaki | Nov 2007 | B2 |
7319407 | Jang et al. | Jan 2008 | B2 |
7377125 | Seiden et al. | May 2008 | B2 |
7413233 | Jung | Aug 2008 | B1 |
7513637 | Kelly et al. | Apr 2009 | B2 |
7593867 | Deakin et al. | Sep 2009 | B2 |
7824056 | Madireddi et al. | Nov 2010 | B2 |
7870686 | Hines | Jan 2011 | B2 |
7934384 | Tuskiewicz et al. | May 2011 | B2 |
7978184 | Morrison | Jul 2011 | B2 |
8009864 | Linaker et al. | Aug 2011 | B2 |
8189855 | Opalach et al. | May 2012 | B2 |
8219438 | Moon et al. | Jul 2012 | B1 |
8335254 | Fernandez et al. | Dec 2012 | B1 |
8468059 | Enqvist | Jun 2013 | B2 |
8630924 | Groenevelt et al. | Jan 2014 | B2 |
8672427 | Hammonds | Mar 2014 | B2 |
8683745 | Artwohl et al. | Apr 2014 | B2 |
8955261 | Kobe et al. | Feb 2015 | B2 |
8972291 | Rimnac et al. | Mar 2015 | B2 |
9046294 | Lee et al. | Jun 2015 | B2 |
9052536 | Artwohl et al. | Jun 2015 | B2 |
9098825 | Bashkin | Aug 2015 | B2 |
9144328 | Seeley | Sep 2015 | B2 |
9155405 | Artwohl et al. | Oct 2015 | B2 |
9230386 | Roh et al. | Jan 2016 | B2 |
9264151 | Emigh et al. | Feb 2016 | B1 |
9280757 | Parpia et al. | Mar 2016 | B2 |
9336508 | Soon-Shiong | May 2016 | B2 |
9349238 | Tkachenko et al. | May 2016 | B2 |
9361628 | Stark | Jun 2016 | B2 |
9504338 | Artwohl et al. | Nov 2016 | B2 |
9514661 | Riegel | Dec 2016 | B2 |
9524419 | Chang | Dec 2016 | B2 |
9560777 | Krietzman et al. | Jan 2017 | B2 |
9575558 | Almen et al. | Feb 2017 | B2 |
9689603 | Roh et al. | Jun 2017 | B2 |
9710992 | Borra | Jul 2017 | B2 |
9860491 | Park et al. | Jan 2018 | B2 |
9881528 | Dunn | Jan 2018 | B2 |
9911377 | Howard et al. | Mar 2018 | B2 |
9915471 | Kim et al. | Mar 2018 | B2 |
9959568 | Klearman | May 2018 | B2 |
9967109 | Nishimura et al. | May 2018 | B2 |
9972284 | Lee et al. | May 2018 | B2 |
10062257 | Chau | Aug 2018 | B2 |
10085571 | Schiffman et al. | Oct 2018 | B2 |
10089520 | Motukuri et al. | Oct 2018 | B2 |
10089952 | Nam et al. | Oct 2018 | B2 |
10122915 | Maayan et al. | Nov 2018 | B2 |
10126849 | Lee et al. | Nov 2018 | B2 |
10169677 | Ren et al. | Jan 2019 | B1 |
10258170 | Dunn et al. | Apr 2019 | B2 |
10282695 | McNamara et al. | May 2019 | B1 |
10304417 | Park et al. | May 2019 | B2 |
10360571 | Garel et al. | Jul 2019 | B2 |
10419647 | Park et al. | Sep 2019 | B2 |
10477162 | Jain et al. | Nov 2019 | B2 |
10514722 | Artwohl et al. | Dec 2019 | B1 |
10575660 | Artwohl et al. | Mar 2020 | B2 |
10580333 | Artwohl et al. | Mar 2020 | B2 |
10674569 | Luckhardt et al. | Jun 2020 | B2 |
RE48115 | Artwohl et al. | Jul 2020 | E |
10838453 | Artwohl et al. | Nov 2020 | B2 |
10937344 | Artwohl et al. | Mar 2021 | B2 |
11047614 | Kim et al. | Jun 2021 | B2 |
11107023 | Glasgow | Aug 2021 | B2 |
11141004 | Rolek | Oct 2021 | B1 |
RE49103 | Artwohl et al. | Jun 2022 | E |
11419434 | Artwohl et al. | Aug 2022 | B1 |
11435777 | Artwohl et al. | Sep 2022 | B2 |
11450247 | Artwohl et al. | Sep 2022 | B2 |
20010010516 | Roh et al. | Aug 2001 | A1 |
20010052741 | Yun | Dec 2001 | A1 |
20020007486 | Yun | Jan 2002 | A1 |
20030038912 | Broer et al. | Feb 2003 | A1 |
20030117790 | Lee et al. | Jun 2003 | A1 |
20030154141 | Capazario et al. | Aug 2003 | A1 |
20030205059 | Roche et al. | Nov 2003 | A1 |
20030207090 | Arora | Nov 2003 | A1 |
20030214619 | Masuda et al. | Nov 2003 | A1 |
20040073334 | Terranova | Apr 2004 | A1 |
20040093379 | Roh et al. | May 2004 | A1 |
20040144328 | Bonner et al. | Jul 2004 | A1 |
20040160388 | O'Keeffe | Aug 2004 | A1 |
20040194388 | Roche et al. | Oct 2004 | A1 |
20050068629 | Fernando et al. | Mar 2005 | A1 |
20050172654 | Rohrer et al. | Aug 2005 | A1 |
20050202178 | Roche et al. | Sep 2005 | A1 |
20050265019 | Sommers et al. | Dec 2005 | A1 |
20060103269 | Artwohl et al. | May 2006 | A1 |
20060127586 | Roche et al. | Jun 2006 | A1 |
20060145576 | Lee et al. | Jul 2006 | A1 |
20060158579 | Hasegawa | Jul 2006 | A1 |
20060174641 | Liu et al. | Aug 2006 | A1 |
20060192767 | Murakami | Aug 2006 | A1 |
20070003700 | Roche et al. | Jan 2007 | A1 |
20070016478 | Hill | Jan 2007 | A1 |
20070024822 | Cortenraad et al. | Feb 2007 | A1 |
20070058114 | Niiyama et al. | Mar 2007 | A1 |
20070076431 | Atarashi et al. | Apr 2007 | A1 |
20070138268 | Tuchman | Jun 2007 | A1 |
20070151274 | Roche et al. | Jul 2007 | A1 |
20070162182 | Marti et al. | Jul 2007 | A1 |
20070171647 | Artwohl et al. | Jul 2007 | A1 |
20070193280 | Tuskiewicz et al. | Aug 2007 | A1 |
20070195535 | Artwohl et al. | Aug 2007 | A1 |
20070216657 | Konicek | Sep 2007 | A1 |
20080004950 | Huang et al. | Jan 2008 | A1 |
20080024047 | Juo et al. | Jan 2008 | A1 |
20080158858 | Madireddi et al. | Jul 2008 | A1 |
20080172261 | Albertson et al. | Jul 2008 | A1 |
20080249857 | Angell et al. | Oct 2008 | A1 |
20090002990 | Becker et al. | Jan 2009 | A1 |
20090036208 | Pennington et al. | Feb 2009 | A1 |
20090052206 | Matsui et al. | Feb 2009 | A1 |
20090121970 | Ozbek | May 2009 | A1 |
20090146945 | Cho | Jun 2009 | A1 |
20090157472 | Burazin et al. | Jun 2009 | A1 |
20090276319 | Lungu et al. | Nov 2009 | A1 |
20090295731 | Kim et al. | Dec 2009 | A1 |
20090306820 | Simmons et al. | Dec 2009 | A1 |
20090313125 | Roh et al. | Dec 2009 | A1 |
20100013925 | Fowler et al. | Jan 2010 | A1 |
20100026912 | Ho | Feb 2010 | A1 |
20100043293 | Nicholson et al. | Feb 2010 | A1 |
20100062152 | Roche et al. | Mar 2010 | A1 |
20100068398 | Roche et al. | Mar 2010 | A1 |
20100083672 | Yoon et al. | Apr 2010 | A1 |
20100119705 | Roche et al. | May 2010 | A1 |
20100138037 | Adelberg et al. | Jun 2010 | A1 |
20100152892 | Gavra et al. | Jun 2010 | A1 |
20100180615 | Linder et al. | Jul 2010 | A1 |
20100214786 | Nichol | Aug 2010 | A1 |
20100268792 | Butler et al. | Oct 2010 | A1 |
20100275477 | Kim | Nov 2010 | A1 |
20100293827 | Suss et al. | Nov 2010 | A1 |
20110022980 | Segal et al. | Jan 2011 | A1 |
20110083460 | Thomas et al. | Apr 2011 | A1 |
20110098849 | Hudis et al. | Apr 2011 | A1 |
20110106624 | Bonner et al. | May 2011 | A1 |
20110116231 | Dunn et al. | May 2011 | A1 |
20110141011 | Lashina et al. | Jun 2011 | A1 |
20110150276 | Eckhoff et al. | Jun 2011 | A1 |
20110161160 | Carlson et al. | Jun 2011 | A1 |
20110173082 | Breitenbach et al. | Jul 2011 | A1 |
20110181792 | Hammonds | Jul 2011 | A1 |
20110191154 | Johnson et al. | Aug 2011 | A1 |
20110208569 | Fano et al. | Aug 2011 | A1 |
20120004769 | Hallenbeck et al. | Jan 2012 | A1 |
20120105424 | Lee et al. | May 2012 | A1 |
20120217254 | Cho et al. | Aug 2012 | A1 |
20120285089 | Artwohl et al. | Nov 2012 | A1 |
20120323620 | Hofman et al. | Dec 2012 | A1 |
20130027561 | Lee et al. | Jan 2013 | A1 |
20130063326 | Riegel | Mar 2013 | A1 |
20130110666 | Aubrey | May 2013 | A1 |
20130135455 | Hjelm et al. | May 2013 | A1 |
20130218721 | Borhan et al. | Aug 2013 | A1 |
20130271696 | Dunn | Oct 2013 | A1 |
20130325638 | Auclair et al. | Dec 2013 | A1 |
20140078407 | Green et al. | Mar 2014 | A1 |
20140126829 | Seeley et al. | May 2014 | A1 |
20140129354 | Soon-Shiong | May 2014 | A1 |
20140129393 | Soon-Shiong | May 2014 | A1 |
20140214547 | Signorelli | Jul 2014 | A1 |
20140232958 | Venturas et al. | Aug 2014 | A1 |
20140316561 | Tkachenko et al. | Oct 2014 | A1 |
20140344118 | Parpia et al. | Nov 2014 | A1 |
20140365272 | Hurewitz | Dec 2014 | A1 |
20150002660 | Lee | Jan 2015 | A1 |
20150073590 | Garcia Manchado et al. | Mar 2015 | A1 |
20150178654 | Glasgow | Jun 2015 | A1 |
20150269593 | Le | Sep 2015 | A1 |
20160027231 | Guzzone et al. | Jan 2016 | A1 |
20160040469 | Lietz et al. | Feb 2016 | A1 |
20160047587 | Sasaki et al. | Feb 2016 | A1 |
20160138860 | Kang | May 2016 | A1 |
20160143459 | Clein | May 2016 | A1 |
20160220039 | Chang et al. | Aug 2016 | A1 |
20160350715 | Minvielle | Dec 2016 | A1 |
20170027339 | Chang et al. | Feb 2017 | A1 |
20170046991 | Riegel | Feb 2017 | A1 |
20170124603 | Olson | May 2017 | A1 |
20170147971 | Morse et al. | May 2017 | A1 |
20170213184 | Lee | Jul 2017 | A1 |
20170228776 | Walden | Aug 2017 | A1 |
20170329078 | Dunn et al. | Nov 2017 | A1 |
20180020847 | Dunn et al. | Jan 2018 | A1 |
20180053226 | Hutton et al. | Feb 2018 | A1 |
20180061283 | Kim et al. | Mar 2018 | A1 |
20180103778 | Olovsson | Apr 2018 | A1 |
20180125404 | Bott et al. | May 2018 | A1 |
20180226056 | Chan | Aug 2018 | A1 |
20180268367 | Bryan et al. | Sep 2018 | A1 |
20180335252 | Oh | Nov 2018 | A1 |
20180365630 | Seals et al. | Dec 2018 | A1 |
20190050900 | Avakian | Feb 2019 | A1 |
20190122263 | Avakian | Apr 2019 | A1 |
20190149725 | Adato et al. | May 2019 | A1 |
20190156273 | Fisher et al. | May 2019 | A1 |
20190213545 | Adato et al. | Jul 2019 | A1 |
20200286032 | Bogolea et al. | Sep 2020 | A1 |
Number | Date | Country |
---|---|---|
102113033 | Mar 2014 | CN |
105513052 | Apr 2016 | CN |
10205405 | Aug 2003 | DE |
102009003127 | Nov 2010 | DE |
102015203150 | Aug 2016 | DE |
2194222 | Jun 2010 | EP |
2843336 | Mar 2015 | EP |
3379184 | Sep 2018 | EP |
3740103 | Nov 2020 | EP |
2506575 | Apr 2014 | GB |
2001294308 | Oct 2001 | JP |
2003125904 | May 2003 | JP |
3450907 | Sep 2003 | JP |
2004183987 | Jul 2004 | JP |
2006209550 | Aug 2006 | JP |
2012161413 | Aug 2012 | JP |
2014206320 | Oct 2014 | JP |
2015169412 | Sep 2015 | JP |
2015222138 | Dec 2015 | JP |
2016533544 | Oct 2016 | JP |
2018151923 | Sep 2018 | JP |
20120044874 | May 2012 | KR |
10-2015-0093289 | Aug 2015 | KR |
20150093289 | Aug 2015 | KR |
20170033083 | Mar 2017 | KR |
I373735 | Oct 2012 | TW |
I443606 | Jul 2014 | TW |
9838547 | Sep 1998 | WO |
03025805 | Mar 2003 | WO |
2009152078 | Dec 2009 | WO |
2014165171 | Oct 2014 | WO |
2014175643 | Oct 2014 | WO |
WO-2015095493 | Jun 2015 | WO |
2016183302 | Nov 2016 | WO |
2017127035 | Jul 2017 | WO |
2019032893 | Feb 2019 | WO |
Entry |
---|
Jul. 5, 2023—(CN) First Office Action—App 202180011384.5. |
Jul. 25, 2023—(CA) Office Action—App 3,123,879. |
Jul. 6, 2023—(JP) Office Action—App. No. 2020-520519. |
Sep. 7, 2023—(MX) Office Action—App. No. MX/a/2020/001634. |
Nov. 8, 2023—(CN) Office Action—App. No. 201980090632.2. |
Aug. 19, 2023—(CN) Office Action—App. No. 201880064016.5 w/ translation. |
Jan. 25, 2024—(JP) Decision to Grant—App. No. 2020-520519. |
Apr. 22, 2024—(TW) Office Action and Search Report—App. No. 112137447 w/machine translation. |
Feb. 29, 2024—(EP) Office Action—App 19900402.9. |
Advertising with Transparent LCD Displays; Jul. 28, 2016, URL: http://www.displays2go.com/Article/Advertising-Transparent-LCD-Displays-78>. |
http://emotivev.com/products; at least as early as Jun. 5, 2017. |
https://www.youtube.com/watchv=2tlM9lereLc; at least as early as Jun. 5, 2017, “Digital Signage Transparent LCD Beverage Cooler Demo”. |
Oct. 24, 2018—(WO) International Search Report and Written Opinion—App PCT/US2018/046103. |
Extended EP Search Report for EP 12782036, Dtaed Jun. 9, 2015, 7 Pages. |
(US) Notice of Allowance on U.S. Appl. No. 14/170,378, Dated Mar. 31, 2015, 10 Pages. |
File History of U.S. Appl. No. 16/547,288, filed Aug. 21, 2019. |
File History of U.S. Appl. No. 15/888,210, filed Feb. 5, 2018. |
File History of U.S. Appl. No. 14/819,257, filed Aug. 5, 2015, (U.S. Pat. No. 9,504,338). |
File History of U.S. Appl. No. 14/686,958, filed Apr. 15, 2015, (U.S. Pat. No. 9,155,405). |
File History of U.S. Appl. No. 14/170,378, filed Jan. 31, 2004, (U.S. Pat. No. 9,052,536). |
File History of U.S. Appl. No. 13/286,053, filed Oct. 31, 2011, (U.S. Pat. No. 8,683,745). |
File History of U.S. Appl. No. 61/484,616, filed May 10, 2011. |
International Search Report of PCT/US19/66869 Dated Mar. 16, 2020. |
Written Opinion of PCT/US19/66869 Dated Feb. 11, 2020. |
Neff, J., “New System Puts Video Ads on Store Cooler Doors”, (2015), AdAge, http://adage.com/article/cmo-strategy/system-puts-video-ads-store-cooler-doors/301395, pp. 1-3. |
Jul. 1, 2020—(US) Notice of Allowance—U.S. Appl. No. 16/222,643. |
Jul. 27, 2020—(TW) Search Report App 108146270. |
Jul. 29, 2020—(TW) Office Action—App 108146270—Eng Tran. |
Nov. 19, 2020—(EP) Search Report—U.S. Appl. No. 18/843,780. |
Jun. 1, 2021—(TW) Notice of Allowance App 108146270. |
Jun. 3, 2021—(TW) Search Report App 108146270. |
Jul. 28, 2021—(EP) Office Action—EP19900402.9. |
Jul. 22, 2021—(KR) Office Action—10-2020-7006998. |
Jun. 3, 2021—(WO) International Search Report and Written Opinion—App PCT/US2021/013247. |
May 4, 2022—(WO) International Preliminary Examination Report (Chapter II)—App PCT/US2021/013247. |
May 26, 2022—(KR) Notice of Allowance App 10-2020-7006998. |
Jul. 18, 2022—(EP) Search Report—App. No. EP19900402.9. |
Test for report. |
Jun. 17, 2022—(TW) Search Report App 110132225 with English Translation (related matter). |
Jun. 17, 2022—(TW) Search Report App 110132225 w/ Eng. Trans. |
Kamoda, Rena. “Monitoring Grocery Inventory in Refrigerators using Appearance and Load Balance Features.” (2013). (Year: 2013). |
Dec. 20, 2022—(US) Non-Final Office Action—U.S. Appl. No. 16/741,581. |
Jan. 9, 2023—(US) Notice of Allowance—U.S. Appl. No. 15/931,971. |
Jan. 9, 2023—(US) Notice of Allownace—U.S. Appl. No. 15/931,971. |
Oct. 28, 2022—(US) Notice of Allowance—U.S. Appl. No. 16/763,448. |
Feb. 22, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/763,448. |
Oct. 12, 2022—(CA) Office Action—App 3,123,879. |
Nov. 18, 2022—(EP) Office Action—App 18843780.0. |
Jan. 13, 2023—(CN) Office Action—App 201880064016.5. |
Jan. 31, 2023—(TW) Search Report—App 110132225. |
Apr. 4, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/741,581. |
Mar. 24, 2023—(US) Notice of Allowance—U.S. Appl. No. 17/082,270. |
May 1, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/763,448. |
May 2, 2023—(US) Notice of Allowance—U.S. Appl. No. 15/931,971. |
May 27, 2024—(CN) 2nd Office Action—App. No. 201980090632.2 w/ machine translation. |
May 18, 2024—(MX) 1st Office Action—App. No. MX/a/2021/007315 w/ translation. |
Jun. 25, 2024—(TW) Notice of Allowance—App. No. 112137447 w/translation. |
Number | Date | Country | |
---|---|---|---|
20240219102 A1 | Jul 2024 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17082270 | Oct 2020 | US |
Child | 18233041 | US | |
Parent | 16741581 | Jan 2020 | US |
Child | 17082270 | US | |
Parent | PCT/US2019/066869 | Dec 2019 | WO |
Child | 17082270 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2019/066869 | Dec 2019 | WO |
Child | 16741581 | US | |
Parent | 16222643 | Dec 2018 | US |
Child | PCT/US2019/066869 | US | |
Parent | PCT/US2018/046103 | Aug 2018 | WO |
Child | 16741581 | US | |
Parent | 15674198 | Aug 2017 | US |
Child | 16741581 | US | |
Parent | 15674198 | Aug 2017 | US |
Child | 16222643 | US | |
Parent | 15674198 | Aug 2017 | US |
Child | PCT/US2018/046103 | WO |