Intelligent marketing and advertising platform

Information

  • Patent Grant
  • 12104844
  • Patent Number
    12,104,844
  • Date Filed
    Friday, August 11, 2023
    a year ago
  • Date Issued
    Tuesday, October 1, 2024
    a month ago
Abstract
A smart, movable closure system that allows access to the interior from the exterior of the cabinet, is disclosed. In some embodiments, the movable structure may be coupled with a cabinet interior that is adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. In particular, the smart, movable closure system may include electronic components that display graphical renderings corresponding to one or more products stored in the retail product container. In addition, the smart, movable closure system may include a controller that, before a user opts-in, generates an opt-in invitation at the smart, movable closure system, wherein the user may interface with the system with a wireless communication device.
Description
TECHNICAL FIELD

A smart, movable closure system that allows access to the interior from the exterior of the cabinet, is disclosed. In some embodiments, the movable structure may be coupled with a cabinet interior that is adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. In particular, the smart, movable closure system may include electronic components that display graphical renderings corresponding to one or more products stored in the retail product container.


BACKGROUND

Although more and more people are purchasing items online, brick and mortar retail sales (for example, provided through cooling systems) are still substantial and are, in fact, growing in certain market segments such as grocery, drug, and convenience stores. Over 75 percent of shopping in brick and mortar stores is impulse purchasing. Research shows that impulse decisions are highly influenced by in-store messaging, and that most of in-store impulse shopping occurs at retail product containers, such as coolers and freezers. Consequently, a disruption of impulse shopping behavior at a retail product container could present an enormous value creation opportunity for both consumer packaged goods brands and retailers.


SUMMARY

A computing platform comprises one or more retail product containers and a controller that generates different advertisements (ads) on displays of the one or more retail product containers in a cooling system. Each of the retail product containers includes an internal storage volume for stocking one or more retail products, a display (screen) on its door, and a customer detector to detect the presence of one or more customers in proximity to the retail product container. The controller communicates with each of the retail product containers over a communications channel (e.g., a wireless channel), for example, to display advertisements for viewing by the one or more customers. For example, the controller may be configured to instruct a retail product container to display a full screen advertisement on its display. The displaying of the full screen advertisement may be a default procedure or may be performed when no motion (e.g., of a customer) or a human form is detected by the customer detector. When motion (e.g., of a customer) or human form is detected within a predetermined distance, the controller may subsequently instruct the retail product container to terminate the full screen advertisement and to display a planogram of products located in the internal storage volume.


With another aspect, a customer detector of a retail product container may include one or more cameras and proximity sensors. The one or more cameras and proximity sensors may be situated on a door front of the retail product container.


With another aspect, when a customer is detected as being sufficiently close to a container door, an invitation indication may be displayed on the container's display. For example, a quick response (QR) code may be generated at the center of a planogram. The detected customer can scan the QR code through a wireless device if the customer desires to opt-in, in response to the invitation. When the customer opts-in, a computing platform may interact with the customer via a mobile app. In some examples, in lieu or in addition to a QR code, an image other than a QR code (e.g. an image with a machine-detectable watermark), a Bluetooth (or other short-range wireless protocol) beacon, or other mechanism may be provided to indicate an invitation to the customer.


With another aspect, when a customer opts-in in response to a displayed invitation on a container's display, a personalized advertisement may be displayed in accordance with customer information that is obtained through a mobile app. The personalized advertisement may be indicative of customized pricing for one or more products stocked at the retail product container.


With another aspect, when a customer does not opt-in in response to an invitation, the computer platform may continue to generate a planogram with inserted advertisements (for example, banner ads, spot deals, and hot spots) based on generalized information (for example, weather conditions, weather forecasts, and current or upcoming events).


With another aspect, a computing platform may download a set of advertisements (for example, from a cloud computing service) that is relevant to a retail product container. Further, the computing platform may generate one of the downloaded advertisements on a display of the retail product container. The set of downloaded advertisements may be based on a type of product stocked at the retail product container. The type of product may be determined from a container identification or from inventory information provided by the retail product container.


With another aspect, a computing platform may determine an advertisement presented on a display of the retail product container, based on a set of rules that may encompass weather conditions in proximity to the container, the date, and/or characteristics about a customer in proximity to the container. For example, the presented advertisement may be selected because a customer is standing by a beverage container for 20 seconds, it is 98 degrees outside, and the date is just before the Fourth of July.


With another aspect, a computing platform may determine a measure of effectiveness for an advertisement presented on a display of a retail product container. For example, the computing platform may detect whether a customer is within a determined distance of the retail product container and/or whether more than a predetermined number of customers are viewing the presented advertisement.


With another aspect, computing platform may generate an advertisement targeted at a product level. For example, a customer detector may detect that a customer is viewing a particular product displayed in a planogram at a retail product container.


With another aspect, a displayed advertisement at a first retail product container may promote a product that is stocked at a second retail product container. For example, a computing platform may predict that a customer will shop at the second retail product container after shopping at the first retail product container based on customer information.





BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing summary, as well as the following detailed description of exemplary embodiments, is better understood when read in conjunction with the accompanying drawings, which are included by way of example, and not by way of limitation with regard to the claimed invention.



FIG. 1 shows a computing platform supporting one or more retail product containers in accordance with an embodiment.



FIG. 2 shows a front of a door of a retail product container in accordance with an embodiment.



FIG. 3 shows a retail product container in accordance with an embodiment.



FIG. 4 shows different types of advertisements that may displayed on a screen of a retail product container in accordance with an embodiment.



FIG. 5 shows an advertising computer system supporting one or more retail product containers in accordance with an embodiment.



FIG. 6 shows an edge computing apparatus that supports one or more retail product containers in accordance with an embodiment.



FIG. 7 shows a flowchart for configuring an advertising system in accordance with an embodiment.



FIG. 8 shows a flowchart for generating advertisements on a screen of a retail product container in accordance with an embodiment.



FIG. 9 shows a flowchart for displaying a selected advertisement from a set of rules in accordance with an embodiment.



FIG. 10 shows a flowchart for determining a level of effectiveness of a displayed advertisement in accordance with an embodiment.



FIG. 11 shows a flowchart for generating an advertisement targeted at a product level in accordance with an embodiment.



FIG. 12 shows a flowchart for displaying an advertisement at a first retail product container for a product stocked at a second retail product container in accordance with an embodiment.





DETAILED DESCRIPTION

According to an aspect of some of the embodiments, a smart, movable closure system is disclosed. The system may, in some embodiments, comprise electronic components that capture images and/or other media (e.g., audio, video, infrared data, or other media) of the interior of a cabinet or the exterior of the cabinet. Moreover, the system may also, in some embodiments, comprise electronic components that display, among other things, graphical renderings or other visual output corresponding to one or more products stored in cabinet. The cabinet may be adapted to be kept at a temperature cooler than the exterior cabinet ambient temperature, for example, to store perishable consumer goods in a retail setting. As such, the retail product container may provide a system that interfaces with users in a retail environment.


A computing platform generates displayed content at a retail product container of a cooling system based on information about a customer in proximity to the retail product container, one or more products stocked at the retail product container, and generalized information external to the retail product container. According to an aspect of some embodiments, the computing platform may generate selected advertisements (ads) at one or more retail product container. The retail product container includes an internal storage volume for stocking one or more products, a display on the container's door, and a customer detector to detect the presence of a customer in proximity to the retail product container. With an embodiment, when a customer is detected to be located within a predetermined distance from the retail product container, an invitation indicator is displayed on the container's display. When the customer opts-in, a personalized advertisement may be displayed in accordance with customer information that may be obtained through a mobile app. The personalized advertisement may also include customized pricing for one or more products stocked at the retail product container.


Coolers may be one of the most overlooked, least promoted, least technology sophisticated, and may be one of the most operationally challenged sections of a retail store. Conventional retail product containers (e.g., coolers, freezers, vending machines, etc.) may comprise a glass panel or door through which a customer can view products stored in the retail product container and which can be available for purchase. However, stored products may not be neatly presented, and stored products may be blocked by other products, such that a customer cannot easily see what products are available for purchase. Still further, store employees may often be required to maintain the appearance of the products stored therein, keep track of stock, or install and swap out promotional tags and other displays (such as displays relating to pricing and promotions) in order to keep those items current.


With these traditional approaches to retail product containers described above, coolers and refrigerators in grocery stores may be an area that is difficult for brands to conduct effective “on-the-spot” advertisements and promotions. Brands may typically rely on other advertising medias (for example, print, billboards, online and TV advertisements, and so forth) to promote products that are retailed on the shelves of coolers/freezers and/or refrigerators at retail and convenience stores.


Furthermore, with these traditional approaches described above, advertising efforts may not be as effective and impactful. Due to the limitations of traditional approaches, market penetration has been very small.



FIG. 1 shows computing platform 100 supporting one or more retail product containers in accordance with an embodiment. Computing platform 100, comprising controller 101 and retail product containers 102 and 103, may generate a selected advertisement at one of retail product containers based on stored products at the retail product container.


Retail product containers 102 and 103 may comprise a cooler, freezer, vending machine, and so forth and typically store different types of products (for example, milk, frozen meals, beer, ice cream, and so forth) in corresponding internal volumes.


In one embodiment of the system disclosed herein, edge processor (controller) 101 instructs retail product container 102 or 103 to display the selected advertisement based on customer information of a customer in proximity to the retail product container, products stocked at the retail product container, and generalized information (for example, weather conditions) that are not specific to the retail product container. Meanwhile, other embodiments of the system disclosed herein operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it is “identity-blind” in that it never gathers or uses personally identifiable or linkable information. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


With some embodiments, controller 101 may communicate with retail product container via a wireless communication channel (for example, Wi-Fi, Bluetooth®, Zigbee®, and so forth) and may be near the retail product container or at any place in the world through the Internet.


Each retail product container 102 or 103 may support a wireless channel through a common communication interface for associated components (for example, sensors, cameras, and so forth) that is not explicitly shown. However, some embodiments may establish separate wireless communication channels for each of the different components supporting the Internet of Things (IOT) with controller 101.


With some embodiments, controller 101 may interact with additional computing facilities, for example, cloud services 104 or one or more computer servers (not explicitly shown) to obtain advertisement content and to interact with a customer via wireless device 106 through wireless service 105.



FIG. 2 shows a front view 231 of door 230 of a retail product container (for example, containers 102 and 103 as shown in FIG. 1) in accordance with an embodiment.


Each retail storage container 102 and 103 may have door 230. Display (screen) 216 is mounted on door 230 along with customer-detecting hardware 218, such as one or more proximity sensors (heat maps), cameras, facial sensors or scanners, and eye-sensors (iris-tracking sensors).


With some embodiments, display 216 comprises an LCD panel having one or more touch zones 232 which are interactive by the customer. Access panel 234 may be situated proximate to the bottom of the door 230 along with a media player 236, which provides display content to display 216.


A protective panel (not explicitly shown) may be mounted over the display 216.



FIG. 3 shows retail product container 102 in accordance with an embodiment. Each retail product container 102 comprises at least one display 316, such as a display on a door of retail product container 102.


A plurality of retail product containers (similar to retail product container 102) and associated displays may be arranged side-by-side down an aisle of a retail store (for example, a grocery store). Edge processor (controller) 101 (as shown in FIG. 1) may be configured to operate the display 316 depending on what is detected, e.g., by the customer detector 318 and/or the inventory tracker 320.


With some embodiments, customer detector 318 may detect a customer when the detected object is deemed to be a human (person) (rather than, for example, a shopping cart). Customer detector 318 may further determine whether the detected person is an employee (for example, by a uniform of the employee or by a RFID tag on the employee). In such a situation, customer detector 318 may ignore the employee so that a display at a retail product container is not updated.


With some embodiments, display 316 comprises a non-transparent display which prohibits customers from viewing, through the display, products stored in the internal storage volume. Display 316 may comprise, for example, a touchscreen with which customers may interact.


Each retail product container 102 may further comprise customer detector 318 that may detect any or specific individuals (e.g., customers versus employees), motion (e.g., of a customer), a human form (e.g., a human face of a customer), heat, etc. (For example, customers may be individuals in the vicinity of a retail product container as detected by customer detector 318.) With some embodiments, the customer detector may utilize one or more of a proximity sensor (e.g., via a heat map), a camera, a facial sensor, a scanner, an eye-sensor (e.g., an iris-tracking sensor), etc. In addition to customer detector 318, the retail product container 102 may comprise other sensors/cameras 323 configured to detect activity in/around/on the retail product container 102. Although for illustrative purposes customer detector 318 has been described as an input to trigger/activate further steps (e.g., in FIG. 8, refs. 802 and 804), the customer detector 318 may be substituted with and/or supplemented with one or more other sensors/cameras 323, including but not limited to the following examples: a sensor configured to detect an open door; a sensor configured to detect movement of the door from one position to another (e.g., from closed to open, or from open to closed); a weight sensor on a shelf in the retail product container 102 to detect a change in inventory; an optical sensor (e.g., a camera) configured to detect out-of-stock products in the retail product container 102; and/or other kinds of sensor/camera operations.


With some embodiments, one or more cameras 323 may be mounted on doors of retail product container 102. The one or more cameras may have a depth of field of view of twenty feet or more and may have a range of field of view of 170 degrees with, for example, 150 degrees of facial recognition ability. Computer-readable instructions may be employed in association with the cameras to monitor shopper interactions, provide relevant advertisement content on the display 316 via media player 317, and track advertisement engagement in-store. Controller 101 (as shown in FIG. 1) may be configured to independently control each camera, as well as collectively control a plurality of displays to provide single-screen and/or multiple screen content and interactions. Controller 101 and display 316 may be configured to allow for both banner advertisements 402 and full-screen advertisements 401 to be displayed on display 316.


Each retail product container 102 may further comprise inventory tracker 320, e.g., to identify, quantify, and/or otherwise track stored retail products. In some aspects, the inventory tracker 320 may utilize additional cameras and/or sensors 323 that are disposed inside retail product container 102 and face the stored products.


As shown in FIG. 1, controller 101 may be networked with retail product container 102 through the Internet, Bluetooth, and so forth via wired Ethernet, wireless LAN, a cellular network, and the like. Controller 101 may be configured to control the display 316 of retail product container 102 as well as may be configured to receive information from retail product container 102, including information from the display 316 (for example, information regarding touchscreen interactions) as well as information from the customer detector 318 and inventory tracker 320.


Each retail product container 102 may also include interface 322 that may be configured to facilitate, among other things, the networking and transfer of information between the controller 101 and retail product container 102 and control of display 316, customer detector 318, and inventory tracker 320.


With some embodiments, controller 101 may comprise a server having one or more processors, memory storage, a user interface, and so forth and may be configured to instruct what is displayed on the display 316 and to receive information and data from the retail product container 102. Additionally, controller 101 may be configured to perform analytics based on the received information and data.


Controller 101 may be configured to control the display 316 of each retail product container 102 to provide a planogram (for example, as shown in advertisements 402-406 in FIG. 4). In some aspects, the planogram may relate to retail products physically contained in the internal storage volume of retail product container 102. The retail products may not necessarily be viewable through the display 316. For example, products stored in the retail product container 102 may not be neatly arranged or may be blocked from view by other products stored therein. However, the planogram may indicate (e.g., to a customer) the retail products stored within the internal storage volume, based on inventory information provided by inventory tracker 320. Consequently, the displayed planogram may effectively optimize what is presented to the customer.


While not explicitly shown in FIG. 3, embodiments of retail product container 102 may include other components (for example, a refrigeration unit and so forth) needed for physically storing products within its internal volume.



FIG. 4 shows different types of advertisements 401, 402, 403, 404, 405 that may be displayed on screen 316 (shown in FIG. 3) of retail product container 102 in accordance with an embodiment.


Advertisement 401 shows a full screen advertisement while advertisements 402-405 (corresponding to a banner ad, hot spot, label/tag, and spot deal, respectively) show inserted offers within a planogram for retail product container 102. For example, display advertisement 404 may include labels at the bottom of the image of the product and tags at the top of the image of the product on the display screen. Labels and tags may be selected and activated from a pre-determined pool of animated icons. For example, the native advertisement for the pizza in display advertisement 404 may be substituted with an animated graphic rendering of a steaming pizza.


As will be discussed, in some examples, inserted offers may be customized based on customer information for a customer in proximity to retail product container 102.


Referring to advertisement 402, customer detector 318 may detect when a customer is looking at (viewing) region 451 of an advertisement (for example, advertisement 402). If so, an advertisement that is targeted to one or more products shown in region 451 may be displayed on screen 316.


Referring to full screen advertisement 401, while a single advertisement may occupy the entire area of screen 316, embodiments may support a plurality of advertisements (in different display regions) that may be simultaneously displayed on screen 316.



FIG. 5 shows advertising computer system 500 supporting one or more retail product containers in accordance with an embodiment. Referring to FIG. 1, computer system 500 encompasses edge processor (controller) 101, retail product containers 102-103, and an interface with cloud services 104. For example, with some embodiments, components 502-505 and 507 may be implemented at edge processor 101, and components 506 and 508-509 may be implemented at retail product containers 102-103.


Referring to FIG. 5, ad manager 507 interacts with ad storage 504 to download advertisement content from cloud services 501. Ad manager 507 may request selected advertisement content (for example, based on a product type and corresponding to a plurality of advertisements) from cloud services 501 via ad storage 504 and may instruct that one of the plurality of advertisements be displayed on screen (display) 509 through screen player 508. As previously discussed, screen player 508 may comprise media player 317 and may be implemented at retail product container 102, 103 and/or controller 101.


Ad manager 507 may request a set of advertisements, varying from one advertisement to many (e.g., hundreds of) advertisements, to be downloaded for retail product container 102. The request may be based on the type of product stocked at retail product container 102. For example, this request by ad manger 507 may be based on inventory information received from inventory tracker 320 (as shown in FIG. 3) or from a mapping of a container identification to designated stored products.


Ad manager 507 may select one of the downloaded advertisements based on sensor/camera information from door sensors/cameras 506 (for example, located at door 230 as shown in FIG. 2), third party data module 505, and/or phone app support module 503.


As will be discussed in further detail, ad evaluator 502 may determine an effectiveness of a presented advertisement on screen 509 based on information from door sensor/camera 506 and phone app support module 503. For example, door sensor/camera 506 may indicate that a customer is viewing a particular region of the displayed advertisement and/or the customer may indicate the effectiveness through a mobile app. The level of effectiveness (as shown at blocks 1006-1010 in FIG. 10) may be determined in a numbers of ways. For example, the levels may be mapped to different values of time durations that the customer is looking at a product in the displayed advertisement or may be directly obtained from a customer's input via the mobile app.


While cloud services may be used to provide additional computer resources as needed by advertising computer system 500, computer resources may be provided by one or more computer servers that may be otherwise provided by cloud services 501. For example, ad manager 507, ad evaluator 502, phone app support 503, and/or third-party data 505 may all reside in the cloud 510. Moreover, the aforementioned systems may all be referred to together, or separately, as cloud services 501. For example, a vendor may provide ad content through ad storage 504 so that the ad manager 507 may download advertisement content from the cloud 510. Ad manager 507 may request selected advertisement content (for example, based on a product type and corresponding to a plurality of advertisements) from the cloud 510 an show it on screen (display) 509 through screen player 508. Although components in FIG. 5 are displayed as separate, the disclosure is not so limited; and one or more components may be conflated and/or bifurcated.



FIG. 6 shows edge computing apparatus (controller) 600 that may support one or more retail product containers (for example, retail product containers 102 and 103) in accordance with an embodiment.


Controller 600 may include processing device 601 where processes (for example, processes 700-1200 as shown in FIGS. 7-12, respectively) discussed herein may be implemented. Processing device 601 may control the overall operation of controller 600 and its associated components. Processing device 601 may access and execute computer readable instructions from memory device 604, which may assume a variety of computer readable media. For example, computer readable media may be any available media that may be accessed by processing device 601, and may include both volatile and nonvolatile media and removable and non-removable media. By way of example, and not limitation, computer readable media may comprise a combination of computer storage media and communication media.


In addition, processing device 601 may download advertisement content from cloud services via cloud interface 603, store the downloaded content at memory device 605, access the downloaded content (for example, a selected advertisement) from memory device 605, and provide the advertisement content to display 316 via screen interface 606.


As previously discussed, advertisement content may be presented to display 316 through media player 317 as shown in FIG. 3.


As previously discussed, controller 600 may obtain advertisement content (via ad storage 504 as shown in FIG. 5) and third party data (via third party data module 505) from cloud services 501 via cloud computing interface 603. In addition, controller 600 may interact with a customer via wireless communication (e.g., via phone app support module 503), and may provide advertisement evaluation (e.g., via ad evaluation 502) through cloud computing interface 603.


Computer storage media may include volatile and nonvolatile and removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media include, but is not limited to, random access memory (RAM), read only memory (ROM), electronically erasable programmable read only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by the computing device.


Communication media may include computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Modulated data signal can be a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media may include wired media, such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.


Processing device 601 may also obtain sensor/camera data from customer detector 318 and inventory tracker 320 through interface 602. Processing device 601 may use this data to determine a location of a customer (e.g., via customer detector 318) with respect to retail product container 102 and the current inventory of retail product container 102.


Controller 600 (executing computer readable instructions from memory 604) may be configured to control the display 316 of each retail product container 102 (as shown in FIG. 3) to display current pricing information about products physically contained in the internal storage volume of retail product container 102, where the pricing may be determined by controller 600.


Controller 600 may be configured to detect customers from information provided customer detector 318 (as shown in FIG. 3) through interface 602 and may be configured to display promotions on display 316 via screen interface 606 based on information from customer detector 318.


Controller 600 may effectively obtain inventory information of each retail product container 102 (via inventory tracker 320 along with image recognition software). Controller 600 may be configured to transmit data to a distributor via cloud interface 603 and/or store regarding overall stock relating to the inventory of the plurality of retail product containers. For example, system 150 (as shown in FIG. 1) may be configured to issue restock notifications, provide merchandising updates, pricing management, real time sales data, and behavioral consumer analytics.


Controller 600 may be configured to instruct display 316 to display full screen advertisements when a customer is not sufficiently close to a retail product container (for example, at block 801 as shown in FIG. 8) by customer detector 318. For example, as a customer is approaching an aisle but at a detected distance greater than a predetermined value, the customer may see full screen advertisements on display 316. As another example, when no customer is detected within the capability of customer detector 318, controller 600 may instruct display 316 to display a full screen advertisement in accordance with a default procedure. In one embodiment in accordance with the system disclosed herein, customer detector 318 may use motion to detect whether a customer is present. In other embodiments in accordance with the system disclosed herein, the customer detector 318 may operate by detecting a human form. For example, in one embodiment, the customer detector 318 may trigger when a human adult face is detected, but not simply when motion is detected. Such embodiments may reduce the quantity of false positives—e.g., a pet, a baby, or non-human movement such as wind might not trigger the customer detector 318. In some embodiments, the human form may be anonymized in that only a human form may be detected without any uniquely identifying characteristics of the person. In other embodiments, other levels of details may be detected, captured, and/or filtered by the customer detector 318 in conjunction with one or more other components of the system disclosed herein, including but not limited to sensors/cameras 323.


As an example, if motion or a human form were detected within twenty feet of retail product container 102 (where customer detector 318 mounted on the door of that retail product container 102), controller 600 may be configured to terminate displaying a full screen advertisement and transition to displaying a planogram of products which are located inside retail product container 102. Banner advertisements and pricing tags may also be loaded from memory 605 and displayed at the same time as displaying the planogram. Controller 600 may also be configured to manage merchandising advertising objects and layers.


Controller 600 may be configured such that as a shopper (e.g., a customer) approaches closer to retail product container 102, advertisement content on display 316 can subsequently change. For example, display 316 may change to include labels (for example, organic, non-gmo, and so forth as shown in FIG. 4) and tags (for example, sale with local card, locally made, trending, and so forth). Promotional labels and tags may be activated via the controller 600 and may be selected from a pre-determined set of static animated icons or may be customized by the retailer and/or brands based on business and marketing needs. In one embodiment in accordance with aspects of the system disclosed herein, controller 600 may be configured to incorporate customer rating scores (for example, 1-5 stars, trending, or favorites) using one or more consumer review sources (for example, using third party data 505 as shown in FIG. 5). Meanwhile, other embodiments of the system disclosed herein operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it is “identity-blind” in that it never gathers or uses personally identifiable or linkable information. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


Controller 600 may be configured so that as a shopper stands or lingers in front of a given retail product container 102, the contents (e.g., graphical renderings) outputted at display 316 may change again. In some embodiments, controller 600 is able to use information from customer detector 318 to effectively learn more about that particular customer, such as gender, age, mood, and so forth. (Alternatively or in combination, as will be discussed, controller 600 may obtain customer information through a mobile app when a customer opts-in in response to a displayed invitation.) In such embodiments, controller 600 may be configured to process detected customer information to determine a specific or customized advertisement to present to that particular customer on display 316. By tracking shopper data in parallel with which advertising content is being presented on the displays of all retail product containers within the viewing range of the shopper, the retailer has new influence opportunities at the moment of purchasing decision, thus optimizing marketing spend and generating new revenue streams with respect to traditional approaches. Meanwhile, other embodiments of the system disclosed herein are designed with privacy and security features integrated into the technology platform and operating model. And, such embodiments operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it never gathers or uses personally identifiable or linkable information. In such embodiments, a retail consumer-safe platform is provided that is “identity-blind.” In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern. Controller 600 may be configured so that, while a shopper is standing in front of display 316 (as may be detected by a camera mounted on a door of that particular retail product container 102), relevant conditional advertisements are displayed on display 316 based on real-time data relating to news events, weather, sporting events, and so forth.


As discussed above, controller 600 may be configured to keep track of the inventory of retail product container 102 via inventory tracker 320, which may comprise one or more cameras and/or sensors on the inside of retail product container 102. When controller 600 has determined that a given product is out of stock, controller 600 may modify the displayed content on display 316. For example, out-of-stock artwork may be displayed and/or advertisements may be swapped.


As will be discussed, processes 700-1200 (as shown in FIGS. 7-12, respectively) are some of the processes that may be executed in accordance with aspects of one or more embodiments. Referring to FIG. 6, processing device 601 may execute computer readable instructions from memory device 604 to perform processes 700-1200.



FIG. 7 shows flowchart 700 for configuring computing platform 100 (as shown in FIG. 1) supporting advertising computer system 500 in accordance with an embodiment.


At block 701, controller 600 discovers the retail product containers (for example, containers 102 and 103) that are to be supported by controller 600. (A retail product container is supported by a controller when the controller controls the advertisements displayed at the retail product container.) Embodiments may utilize a known list of retail product containers and associated devices including sensors and cameras or may use a discovery procedure (for example, for discovering IoT devices including sensors and cameras and associating them to corresponding retail product containers).


When supported retail product containers are discovered, controller 600 determines the type of product/manufacturer stored in a given retail product container (for example, retail product container 103) at block 702. For example, the retail product container may report scanned universal product codes of its stocked products. Alternatively or in combination, controller 600 may access a mapping between each supported retail product container and corresponding stocked product types. At block 703, controller 600 may download relevant advertisements (which may be referred to as a set of advertisements) pertinent to the stocked products of the given retail product container.


If there are additional supported retail product containers, as determined at block 704, blocks 702-703 may be repeated for the next supported retail product container.


After content for pertinent advertisements have been downloaded, controller 600 may instruct each retail product container to display one of the downloaded advertisements based on various criteria (for example, as determined by processes 800, 900, 1100, and 1200).



FIG. 8 shows flowchart 800 for generating advertisements on a screen of a retail product container in accordance with an embodiment. Initially, a full screen advertisement is displayed on a display of a retail product container at block 801. For example, as previously discussed, controller 600 may instruct retail product container 102 to display an appropriate advertisement based on products stocked at retail product container 102.


When customer detector 318 (as shown in FIG. 3) determines that a customer is within a predetermined range at block 802, controller 600 may instruct retail product container 102 to display a planogram at block 803 that reflects products stocked at retail product container 102.


When customer detector 318 determines that the customer approaches retail product container 102 even closer (within a predetermined distance—e.g., within twelve to fifteen feet) at block 804, controller 600 may generate an opt-in invitation within the displayed planogram at block 805. For example, the invitation may comprise a Quick Response (QR) code in the center of the display. If the customer wishes to opt-in, the customer can scan the QR code through the customer's smart phone to open a link or to download a mobile app associate with the QR code. In other examples, in lieu or in addition to a QR code, an image other than a QR code (e.g. an image with a machine-detectable watermark), a Bluetooth (or other short-range wireless protocol) beacon, or other mechanism may be provided to indicate an invitation to the customer. In some examples, multiple invitations may be simultaneously transmitted to that user's device to provide the customer an option to select whichever mechanism is most preferred. In other examples, the indicated invitations may be transmitted serially such that a first method (e.g., a wireless beacon) may be used when the customer is at a particular distance range from the retail product container 102 and a second method (e.g., a QR code) may be used when the customer is in a closer proximity to the container 102. Although an example of a predetermined distance of twelve to fifteen feet was described in one of the preceding examples, the disclosure is not so limited—e.g., depending on the mechanism used to indicate an invitation to the customer, the predetermined distance may be in a range greater than fifteen feet or in a range less than twelve feet.


When the customer opts-in, as determined at block 806, controller 600 may generate personalized advertisements on display of retail product container 102 based on customer information obtained through the mobile app. (For example, a customer opts-in when the customer accepts an invitation by scanning the presented QR code and accepting the usage agreement for the mobile app.) Pursuant to a retail consumer-safe platform, until the customer opts-in, the system may remain “identity-blind” in that it never gathers or uses personally identifiable or linkable information. The retail consumer-safe platform may be designed with privacy and security features integrated into the technology platform and operating model. Such embodiments operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


At block 809, controller 600 may generate special offers via the customer's smart phone for one or more products stocked at retail product container 102. Process 800 continues in this mode at block 810 while customer detector 318 continues to detect the presence of the customer. Otherwise, process 800 reverts back to block 801, where a full screen advertisement is displayed.


When the customer does not opt-in, as determined at block 806, advertisements may be inserted within the displayed planogram at block 807 based on generalized information (not specific to the customer). Examples are shown as advertisements 402-405 in FIG. 4. Process 800 continues in the mode at block 808 while the customer is detected. Otherwise, process 800 reverts to block 801.


When process 800 reverts to block 801 either from blocks 808 or 810, process 800 repeats executing blocks 803-810 when a subsequent customer is detected by customer detector 318 at block 802.



FIG. 9 shows flowchart 900 for displaying a selected advertisement from a set of rules in accordance with an embodiment. Computing platform 100 determines an advertisement presented on a container's display based on a set of rules that may encompass weather conditions, the date, and/or characteristics about a customer in proximity to the container. For example, the presented advertisement may be selected because a customer is standing by a beverage container for 20 seconds, it is 98 degrees outside, and the date July 3—just before the Fourth of July.


Referring to FIG. 9, set of rules 905 selects an appropriate advertisement to be displayed from set of advertisements 904 based on different factors. In one embodiment in accordance with various aspects of the disclosure, the factors may include customer characteristics 901, customer viewing information 902, and/or generalized information 903. For example, a customer may express that he/she dislikes broccoli and likes ice cream through a mobile app (e.g., after the customer opts-in). In addition, customer detector 318 may indicate that the customer is viewing a particular region of a displayed planogram where an ice cream product appears. In such a scenario, computer platform 100 may initiate an advertisement directed to the ice cream product. However, other embodiments of the system disclosed herein operate/function without any knowledge of the individual shopper/customer, such that set of rules 90 are “identity-blind.” And, those embodiments of the system never seek to identify individuals—i.e., it never gathers or uses personally identifiable or linkable information. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


When computing platform 100 has identified the appropriate advertisement at block 906, the identified advertisement may be displayed at the corresponding retail product container at block 907.



FIG. 10 shows flowchart 1000 for determining a level of effectiveness of a displayed advertisement in accordance with an embodiment. Computing platform 100 assesses an effectiveness of a presented advertisement on a display of a retail product container. For example, computing platform 100 may detect whether a customer is within a determined distance of the retail product container and/or whether one or more customers are viewing the presented advertisement.


Referring to FIG. 10, at block 1001 computing platform 100 may obtain customer information (for example, a distance of a detected customer from the container, an area of the display region that the customer is viewing, and/or a location from where the customer is viewing).


At block 1002, computer platform 100 determines whether a customer is within a predetermined distance (in other words, deemed to be close enough to a retail product container). If so, at block 1004 customer detector 320 (for example, via iris-scanning sensors) may track eye movement of the customer and provide eye movement information to controller 101 to determine the level of effectiveness (for example, a success measure) based on the eye movement information.


At blocks 1005, 1006, and 1009 computing platform 100 may assess the customer information to determine a level of effectiveness at blocks 1007, 1008, 1010, and 1011. For example, the customer may be staring at display region 451 of advertisement 402 (as shown in FIG. 4) versus scanning a plurality of regions. The level of effectiveness may be measured in a number of ways. For example, it may be measured by the amount of time that the customer is viewing a displayed product or by direct customer input through a mobile app (if the customer has opted-in).


However, when computing platform 100 is unable to determine a level of effectiveness, process 1000 is terminated at block 1003.



FIG. 11 shows flowchart 1100 for generating an advertisement targeted at a product level in accordance with an embodiment. Computing platform 100 may generate an advertisement targeted a product level on a display of a retail product container. For example, a customer detector may detect that a customer is viewing a particular product displayed in a planogram at a retail product container.


Referring to FIG. 11, customer detector 318 may determine a display region that a detected customer is viewing at block 1101. For example, the customer may be viewing a lower region 451 of advertisement 402.


At block 1102, computing platform 100 may identify one or more products stocked at the detected display region. Computing platform 100 may identify the one or more products in a number of ways. For example, computing platform 100 may access a mapping of products to different regions of a displayed planogram. Alternatively or in combination, computing platform 100 may obtain inventory information about stock products at a retail product container from inventory tracker 320.


At block 1103, computing platform 100 may display an appropriate advertisement about the identified product on container's display.



FIG. 12 shows flowchart 1200 for displaying an advertisement at a first retail product container for a product stocked at a second retail product container in accordance with an embodiment. A displayed advertisement at a first retail product container (for example, retail product container 102) may promote a product that is stocked at a second retail product container (for example retail product container 103). In one embodiment of the system disclosed herein, computing platform 100 may predict that a customer will shop at the second retail product container after shopping at the first retail product container based on customer information. Meanwhile, other embodiments of the system disclosed herein operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals—i.e., it is “identity-blind” in that it never gathers or uses personally identifiable or linkable information. In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


Referring to FIG. 12, at block 1201 computing platform 100 may obtain, in one embodiment of the system disclosed herein, customer information about a customer in proximity to a first retail product container—e.g., computing platform 100 may obtain customer information about the customer likes and dislikes through a mobile app when the customer opts-in. Continuing a previous example, the customer may hate broccoli but love ice cream. Meanwhile, other embodiments of the system disclosed herein are designed with privacy and security features integrated into the technology platform and operating model. Such embodiments operate/function without any knowledge of the individual shopper/customer, and the system never seeks to identify individuals or their likes/dislikes—i.e., it never gathers or uses personally identifiable or linkable information. In such embodiments, a retail consumer-safe platform is provided that is “identity-blind.” In some embodiments, selection of whether to execute an “identity-blind” set of features or otherwise may be determined on whether the system is located in a country or state where consumer desire privacy and/or applicable laws govern.


At block 1202, computing platform 100 may determine (e.g., via detection by the customer detector) whether the customer is at the first product container. If the customer is at the first product container, computing platform 100 may determine, at block 1203, whether the customer typically goes to a second retail product container, for example, where ice cream is stocked. Continuing the example, at block 1204 computing platform 100 may generate an advertisement at the first retail product container for the identified product (for example, ice cream) stocked at the second retail product container.


In some embodiments, a non-transitory computer readable medium storing instructions thereon is disclosed. When executed by a computing device, the instructions stored in the non-transitory computer readable medium may causes a computing device to: (1) determine a first product type stored in the first retail product container, and a second product type stored in the second retail product container, wherein the first product type is different from the second product type; (2) download a first set of files associated with the first product type, and a second set of files associated with the second product type, wherein the first set of files includes a first plurality of files, wherein the second set of files includes a second plurality of files, and wherein each file of the first set of files or of the second set of files corresponds to an associated advertisement; (3) initiate, from the first set of files, a first advertisement on a first display at the first retail product container; and (4) initiate, from the second set of files, a second advertisement on a second display at the second retail product container, wherein the second advertisement is different from the first advertisement. Moreover, in some embodiments in accordance with the disclosure, the aforementioned non-transitory computer readable medium may store instructions thereon that, when executed by the computing device, cause the computing device to executed steps (1)-(4) above, in addition to performing steps to: (5) detect motion of a customer within a predetermined distance of the first retail product container; and (6) in response to the detecting, generate an invitation indication to opt-in on the first display of the first retail product container. In addition, in some embodiments in accordance with the disclosure, the aforementioned non-transitory computer readable medium may store instructions thereon that, when executed by the computing device, cause the computing device to executed steps (1)-(4) above, in addition to performing steps to: (5) receive a notification when the customer opts-in; (6) in response to the receiving, interact with the customer through an application executing on a communication device of the customer to obtain customer information; (7) when the customer opts-in, receive customer information through the application; and (8) customize a customized advertisement on the first display of the first retail product container based on the customer information.


As can be appreciated by one skilled in the art, a computer system with an associated computer-readable medium containing instructions for controlling the computer system can be utilized to implement the exemplary embodiments that are disclosed herein. The computer system may include at least one computer such as a microprocessor, digital signal processor, and associated peripheral electronic circuitry.

Claims
  • 1. A system for inventory management, marketing, and advertising on a movable, non-transparent display on a surface of a retail product container, comprising: a server comprising: one or more server processors; anda server memory storing computer-executable instructions that, when executed by the one or more server processors, cause the server to:identify, via image recognition using inventory-taking hardware affixed to a first retail product container, an inventory of one or more retail products physically contained in the first retail product container of a plurality of retail product containers, wherein the inventory-taking hardware comprises at least one camera and the inventory-taking hardware is configured to: trigger the at least one camera at intervals based on motion sensed by the at least one camera; andreceive triggers, from one or more accelerometers affixed to the first retail product container based on a swing state and location of a door of the first retail product container;instruct the first retail product container to display, on at least one non-transparent display on the surface of the first retail product container, a full screen advertisement, wherein the at least one non-transparent display blocks viewability from outside of the first retail product container of the one or more retail products physically contained in the first retail product container;determining, via customer-detecting hardware at the first retail product container, that a customer is within a predetermined distance from the first retail product container;after the determining and based on the inventory identified by the inventory-taking hardware, generate a planogram of the one or more retail products physically contained in the first retail product container; andinstruct the first retail product container to terminate the full screen advertisement and display, on the at least one non-transparent display, the planogram.
  • 2. The system of claim 1, further comprising: an inventory management system, andwherein the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: determine, based on the inventory of the one or more retail products physically contained in the first retail product container, that a particular product is missing;send a signal to a content management system to update the planogram with an indication that the particular product is out of stock;instruct the first retail product container to display, on the non-transparent display of the first retail product container, the updated planogram with the indication that the particular product is out of stock; andnotify, based on determining that the particular product is missing, the inventory management system that re-stocking of the particular product in the first retail product container is needed.
  • 3. The system of claim 1, wherein the at least one non-transparent display on the surface of the first retail product container is movable from an open position to a closed position, and wherein when in the closed position, the one or more retail products physically contained in the first retail product container are blocked from viewability from outside the first retail product container.
  • 4. The system of claim 1, wherein the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: receive, via the customer-detecting hardware at the first retail product container, first sensor data corresponding to the customer; andinstruct the first retail product container to display, on the at least one non-transparent display on the surface of the first retail product container, a promotion of a retail product of the one or more retail products for the customer.
  • 5. The system of claim 4, wherein the first sensor data comprises eye movement information of the customer, wherein the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: determine, based on the eye movement information, a success measure of the promotion.
  • 6. The system of claim 4, wherein the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: receive, via customer-detecting hardware at a second retail product container of the plurality of retail product containers, a second sensor data of the customer, wherein the customer-detecting hardware is activated when the customer is within a second predetermined distance; andinstruct the second retail product container to display, on at least one non-transparent display on the surface of the second retail product container, the promotion of the retail product for the customer.
  • 7. The system of claim 1, wherein the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: determine, based on the inventory of the one or more retail products physically contained in the first retail product container of the plurality of retail product containers, a shortage of at least one of the one or more retail products; andgenerate, based on the shortage, a restock order or a direct store delivery (DSD) alert for at least one of the one or more retail products.
  • 8. The system of claim 1, wherein at least one camera is housed within an empty bezel space between the non-transparent display and a mechanical frame of the door on the first retail product container.
  • 9. The system of claim 1, wherein each retail product container of the plurality of retail product containers is communicatively linked to the server over a network, and wherein each retail product container comprises: an internal storage volume storing the one or more retail products;at least one non-transparent display on a surface of each retail product container that prohibits viewing of the internal storage volume of the retail product container;customer-detecting hardware; andan inventory-taking hardware, wherein the inventory-taking hardware comprises one or more cameras and is configured to collectively measure and learn to communicate the planogram.
  • 10. The system of claim 1, the computer-executable instructions that, when executed by the one or more server processors, further cause the server to: prior to instructing the first retail product container to terminate the full screen advertisement, determine that a movement of the movable, non-transparent display on the surface of the retail product container from a first position to a second position.
  • 11. A method for generating advertisement content on a display screen affixed to a movable door attached to a retail product container comprising an internal storage volume, the method comprising: identifying, via image recognition using inventory-taking hardware affixed to a first retail product container, an inventory of one or more retail products physically contained in the first retail product container of a plurality of retail product containers, wherein the inventory-taking hardware comprises at least one camera and the inventory-taking hardware is configured to: trigger the at least one camera at intervals based on motion sensed by the at least one camera;receive triggers, from one or more accelerometers affixed to the first retail product container based on a swing state and location of a door of the first retail product container;instructing the first retail product container to display, on at least one non-transparent display on a surface of the first retail product container, a full screen advertisement, wherein the at least one non-transparent display blocks viewability from outside of the first retail product container of the one or more retail products physically contained in the first retail product container;determining, via customer-detecting hardware at the first retail product container, that a customer is within a predetermined distance from the first retail product container;after the determining and based on the inventory identified by the inventory-taking hardware, generating a planogram of the one or more retail products physically contained in the first retail product container; andinstructing the first retail product container to terminate the full screen advertisement and display, on the at least one non-transparent display, the planogram.
  • 12. The method of claim 11, further comprising: determining, based on the inventory of the one or more retail products physically contained in the first retail product container, that a particular product is missing;sending a signal to a content management system to update the planogram with an indication that the particular product is out of stock;instructing the first retail product container to display, on the non-transparent display of the first retail product container, the updated planogram with the indication that the particular product is out of stock; andnotifying, based on determining that the particular product is missing, a inventory management system that re-stocking of the particular product in the first retail product container is needed.
  • 13. The method of claim 11, wherein the at least one non-transparent display on the surface of the first retail product container is movable from an open position to a closed position, and wherein when in the closed position, the one or more retail products physically contained in the first retail product container are blocked from viewability from outside the first retail product container.
  • 14. The method of claim 11, further comprising: receiving, via the customer-detecting hardware at the first retail product container, first sensor data corresponding to a customer; andinstructing the first retail product container to display, on the at least one non-transparent display on the surface of the first retail product container, a promotion of a retail product of the one or more retail products for the customer.
  • 15. The method of claim 14, wherein the first sensor data comprises eye movement information of the customer, the method further comprising: determine, based on the eye movement information, a success measure of the promotion.
  • 16. The method of claim 14, further comprising: receiving, via customer-detecting hardware at a second retail product container of the plurality of retail product containers, a second sensor data of the customer, wherein the customer-detecting hardware is activated when the customer is within a second predetermined distance; andinstructing the second retail product container to display, on at least one non-transparent display on the surface of the second retail product container, the promotion of the retail product for the customer.
  • 17. The method of claim 11, further comprising: determining, based on the inventory of the one or more retail products physically contained in the first retail product container of the plurality of retail product containers, a shortage of at least one of the one or more retail products; andgenerating, based on the shortage, a restock order or a direct store delivery (DSD) alert for at least one of the one or more retail products.
  • 18. The method of claim 11, wherein the comprises at least one camera is housed within an empty bezel space between the non-transparent display and a mechanical frame of the door on the first retail product container.
  • 19. The method of claim 11, wherein each retail product container comprises: an internal storage volume storing the one or more retail products;at least one non-transparent display on a surface of each retail product container that prohibits viewing of the internal storage volume of the retail product container;customer-detecting hardware; andinventory-taking hardware, wherein the inventory-taking hardware comprises one or more cameras and is configured to collectively measure and learn to communicate the planogram.
  • 20. The method of claim 11, wherein instructing the first retail product container to terminate the full screen advertisement comprises: prior to instructing the first retail product container to terminate the full screen advertisement, determining that a movement of the movable, non-transparent display on the surface of the retail product container from a first position to a second position.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 17/082,270 (filed on Oct. 28, 2020) which is a continuation of U.S. patent application Ser. No. 16/741,581 (filed on Jan. 13, 2020), issued as U.S. Pat. No. 11,698,219, on Jul. 11, 2023, which is: first, a Continuation-in-Part of International Patent Application Serial No. PCT/US19/66869 (filed on Dec. 17, 2019), which is a Continuation-in-part of U.S. patent application Ser. No. 16/222,643 (filed on Dec. 17, 2018, and granted Sep. 8, 2020, as U.S. Pat. No. 10,769,666); second, a Continuation-In-Part of International Patent Application Serial No. PCT/US18/46103, (filed on Aug. 9, 2018,) which is a Continuation-In-Part of U.S. patent application Ser. No. 15/674,198 (filed Aug. 10, 2017, and granted Jun. 2, 2020, as U.S. Pat. No. 10,672,032); and third, a Continuation-In-Part of U.S. patent application Ser. No. 15/674,198 (filed Aug. 10, 2017, and granted Jun. 2, 2020, as U.S. Pat. No. 10,672,032. In addition, this application is a Continuation-In-Part of International Patent Application Serial No. PCT/US19/66869 (filed on Dec. 17, 2019), which is a Continuation-in-part of U.S. patent application Ser. No. 16/222,643 (filed on Dec. 17, 2018, and granted Sep. 8, 2020, as U.S. Pat. No. 10,769,666). All of the aforementioned applications in this paragraph are herein incorporated by reference in their entireties.

US Referenced Citations (226)
Number Name Date Kind
2002322 Kraemer May 1935 A
4371870 Biferno Feb 1983 A
4671582 Stromquist et al. Jun 1987 A
4893902 Baughman et al. Jan 1990 A
4998382 Kostos et al. Mar 1991 A
5024023 Kostos et al. Jun 1991 A
5111618 Kaspar et al. May 1992 A
5116274 Artwohl et al. May 1992 A
5255473 Kaspar et al. Oct 1993 A
5270843 Wang Dec 1993 A
5645330 Artwohl et al. Jul 1997 A
6005652 Matsuhira Dec 1999 A
6148563 Roche et al. Nov 2000 A
6377228 Jenkin et al. Apr 2002 B1
6427772 Oden et al. Aug 2002 B1
6475087 Cole Nov 2002 B1
6476885 Murray et al. Nov 2002 B1
6606832 Richardson et al. Aug 2003 B2
6606833 Richardson et al. Aug 2003 B2
6874903 Yang et al. Apr 2005 B2
7072096 Holman et al. Jul 2006 B2
7121675 Ter-Hovhannisian Oct 2006 B2
7259359 Davey et al. Aug 2007 B2
7290707 Sawasaki Nov 2007 B2
7319407 Jang et al. Jan 2008 B2
7377125 Seiden et al. May 2008 B2
7413233 Jung Aug 2008 B1
7513637 Kelly et al. Apr 2009 B2
7593867 Deakin et al. Sep 2009 B2
7824056 Madireddi et al. Nov 2010 B2
7870686 Hines Jan 2011 B2
7934384 Tuskiewicz et al. May 2011 B2
7978184 Morrison Jul 2011 B2
8009864 Linaker et al. Aug 2011 B2
8189855 Opalach et al. May 2012 B2
8219438 Moon et al. Jul 2012 B1
8335254 Fernandez et al. Dec 2012 B1
8468059 Enqvist Jun 2013 B2
8630924 Groenevelt et al. Jan 2014 B2
8672427 Hammonds Mar 2014 B2
8683745 Artwohl et al. Apr 2014 B2
8955261 Kobe et al. Feb 2015 B2
8972291 Rimnac et al. Mar 2015 B2
9046294 Lee et al. Jun 2015 B2
9052536 Artwohl et al. Jun 2015 B2
9098825 Bashkin Aug 2015 B2
9144328 Seeley Sep 2015 B2
9155405 Artwohl et al. Oct 2015 B2
9230386 Roh et al. Jan 2016 B2
9264151 Emigh et al. Feb 2016 B1
9280757 Parpia et al. Mar 2016 B2
9336508 Soon-Shiong May 2016 B2
9349238 Tkachenko et al. May 2016 B2
9361628 Stark Jun 2016 B2
9504338 Artwohl et al. Nov 2016 B2
9514661 Riegel Dec 2016 B2
9524419 Chang Dec 2016 B2
9560777 Krietzman et al. Jan 2017 B2
9575558 Almen et al. Feb 2017 B2
9689603 Roh et al. Jun 2017 B2
9710992 Borra Jul 2017 B2
9860491 Park et al. Jan 2018 B2
9881528 Dunn Jan 2018 B2
9911377 Howard et al. Mar 2018 B2
9915471 Kim et al. Mar 2018 B2
9959568 Klearman May 2018 B2
9967109 Nishimura et al. May 2018 B2
9972284 Lee et al. May 2018 B2
10062257 Chau Aug 2018 B2
10085571 Schiffman et al. Oct 2018 B2
10089520 Motukuri et al. Oct 2018 B2
10089952 Nam et al. Oct 2018 B2
10122915 Maayan et al. Nov 2018 B2
10126849 Lee et al. Nov 2018 B2
10169677 Ren et al. Jan 2019 B1
10258170 Dunn et al. Apr 2019 B2
10282695 McNamara et al. May 2019 B1
10304417 Park et al. May 2019 B2
10360571 Garel et al. Jul 2019 B2
10419647 Park et al. Sep 2019 B2
10477162 Jain et al. Nov 2019 B2
10514722 Artwohl et al. Dec 2019 B1
10575660 Artwohl et al. Mar 2020 B2
10580333 Artwohl et al. Mar 2020 B2
10674569 Luckhardt et al. Jun 2020 B2
RE48115 Artwohl et al. Jul 2020 E
10838453 Artwohl et al. Nov 2020 B2
10937344 Artwohl et al. Mar 2021 B2
11047614 Kim et al. Jun 2021 B2
11107023 Glasgow Aug 2021 B2
11141004 Rolek Oct 2021 B1
RE49103 Artwohl et al. Jun 2022 E
11419434 Artwohl et al. Aug 2022 B1
11435777 Artwohl et al. Sep 2022 B2
11450247 Artwohl et al. Sep 2022 B2
20010010516 Roh et al. Aug 2001 A1
20010052741 Yun Dec 2001 A1
20020007486 Yun Jan 2002 A1
20030038912 Broer et al. Feb 2003 A1
20030117790 Lee et al. Jun 2003 A1
20030154141 Capazario et al. Aug 2003 A1
20030205059 Roche et al. Nov 2003 A1
20030207090 Arora Nov 2003 A1
20030214619 Masuda et al. Nov 2003 A1
20040073334 Terranova Apr 2004 A1
20040093379 Roh et al. May 2004 A1
20040144328 Bonner et al. Jul 2004 A1
20040160388 O'Keeffe Aug 2004 A1
20040194388 Roche et al. Oct 2004 A1
20050068629 Fernando et al. Mar 2005 A1
20050172654 Rohrer et al. Aug 2005 A1
20050202178 Roche et al. Sep 2005 A1
20050265019 Sommers et al. Dec 2005 A1
20060103269 Artwohl et al. May 2006 A1
20060127586 Roche et al. Jun 2006 A1
20060145576 Lee et al. Jul 2006 A1
20060158579 Hasegawa Jul 2006 A1
20060174641 Liu et al. Aug 2006 A1
20060192767 Murakami Aug 2006 A1
20070003700 Roche et al. Jan 2007 A1
20070016478 Hill Jan 2007 A1
20070024822 Cortenraad et al. Feb 2007 A1
20070058114 Niiyama et al. Mar 2007 A1
20070076431 Atarashi et al. Apr 2007 A1
20070138268 Tuchman Jun 2007 A1
20070151274 Roche et al. Jul 2007 A1
20070162182 Marti et al. Jul 2007 A1
20070171647 Artwohl et al. Jul 2007 A1
20070193280 Tuskiewicz et al. Aug 2007 A1
20070195535 Artwohl et al. Aug 2007 A1
20070216657 Konicek Sep 2007 A1
20080004950 Huang et al. Jan 2008 A1
20080024047 Juo et al. Jan 2008 A1
20080158858 Madireddi et al. Jul 2008 A1
20080172261 Albertson et al. Jul 2008 A1
20080249857 Angell et al. Oct 2008 A1
20090002990 Becker et al. Jan 2009 A1
20090036208 Pennington et al. Feb 2009 A1
20090052206 Matsui et al. Feb 2009 A1
20090121970 Ozbek May 2009 A1
20090146945 Cho Jun 2009 A1
20090157472 Burazin et al. Jun 2009 A1
20090276319 Lungu et al. Nov 2009 A1
20090295731 Kim et al. Dec 2009 A1
20090306820 Simmons et al. Dec 2009 A1
20090313125 Roh et al. Dec 2009 A1
20100013925 Fowler et al. Jan 2010 A1
20100026912 Ho Feb 2010 A1
20100043293 Nicholson et al. Feb 2010 A1
20100062152 Roche et al. Mar 2010 A1
20100068398 Roche et al. Mar 2010 A1
20100083672 Yoon et al. Apr 2010 A1
20100119705 Roche et al. May 2010 A1
20100138037 Adelberg et al. Jun 2010 A1
20100152892 Gavra et al. Jun 2010 A1
20100180615 Linder et al. Jul 2010 A1
20100214786 Nichol Aug 2010 A1
20100268792 Butler et al. Oct 2010 A1
20100275477 Kim Nov 2010 A1
20100293827 Suss et al. Nov 2010 A1
20110022980 Segal et al. Jan 2011 A1
20110083460 Thomas et al. Apr 2011 A1
20110098849 Hudis et al. Apr 2011 A1
20110106624 Bonner et al. May 2011 A1
20110116231 Dunn et al. May 2011 A1
20110141011 Lashina et al. Jun 2011 A1
20110150276 Eckhoff et al. Jun 2011 A1
20110161160 Carlson et al. Jun 2011 A1
20110173082 Breitenbach et al. Jul 2011 A1
20110181792 Hammonds Jul 2011 A1
20110191154 Johnson et al. Aug 2011 A1
20110208569 Fano et al. Aug 2011 A1
20120004769 Hallenbeck et al. Jan 2012 A1
20120105424 Lee et al. May 2012 A1
20120217254 Cho et al. Aug 2012 A1
20120285089 Artwohl et al. Nov 2012 A1
20120323620 Hofman et al. Dec 2012 A1
20130027561 Lee et al. Jan 2013 A1
20130063326 Riegel Mar 2013 A1
20130110666 Aubrey May 2013 A1
20130135455 Hjelm et al. May 2013 A1
20130218721 Borhan et al. Aug 2013 A1
20130271696 Dunn Oct 2013 A1
20130325638 Auclair et al. Dec 2013 A1
20140078407 Green et al. Mar 2014 A1
20140126829 Seeley et al. May 2014 A1
20140129354 Soon-Shiong May 2014 A1
20140129393 Soon-Shiong May 2014 A1
20140214547 Signorelli Jul 2014 A1
20140232958 Venturas et al. Aug 2014 A1
20140316561 Tkachenko et al. Oct 2014 A1
20140344118 Parpia et al. Nov 2014 A1
20140365272 Hurewitz Dec 2014 A1
20150002660 Lee Jan 2015 A1
20150073590 Garcia Manchado et al. Mar 2015 A1
20150178654 Glasgow Jun 2015 A1
20150269593 Le Sep 2015 A1
20160027231 Guzzone et al. Jan 2016 A1
20160040469 Lietz et al. Feb 2016 A1
20160047587 Sasaki et al. Feb 2016 A1
20160138860 Kang May 2016 A1
20160143459 Clein May 2016 A1
20160220039 Chang et al. Aug 2016 A1
20160350715 Minvielle Dec 2016 A1
20170027339 Chang et al. Feb 2017 A1
20170046991 Riegel Feb 2017 A1
20170124603 Olson May 2017 A1
20170147971 Morse et al. May 2017 A1
20170213184 Lee Jul 2017 A1
20170228776 Walden Aug 2017 A1
20170329078 Dunn et al. Nov 2017 A1
20180020847 Dunn et al. Jan 2018 A1
20180053226 Hutton et al. Feb 2018 A1
20180061283 Kim et al. Mar 2018 A1
20180103778 Olovsson Apr 2018 A1
20180125404 Bott et al. May 2018 A1
20180226056 Chan Aug 2018 A1
20180268367 Bryan et al. Sep 2018 A1
20180335252 Oh Nov 2018 A1
20180365630 Seals et al. Dec 2018 A1
20190050900 Avakian Feb 2019 A1
20190122263 Avakian Apr 2019 A1
20190149725 Adato et al. May 2019 A1
20190156273 Fisher et al. May 2019 A1
20190213545 Adato et al. Jul 2019 A1
20200286032 Bogolea et al. Sep 2020 A1
Foreign Referenced Citations (36)
Number Date Country
102113033 Mar 2014 CN
105513052 Apr 2016 CN
10205405 Aug 2003 DE
102009003127 Nov 2010 DE
102015203150 Aug 2016 DE
2194222 Jun 2010 EP
2843336 Mar 2015 EP
3379184 Sep 2018 EP
3740103 Nov 2020 EP
2506575 Apr 2014 GB
2001294308 Oct 2001 JP
2003125904 May 2003 JP
3450907 Sep 2003 JP
2004183987 Jul 2004 JP
2006209550 Aug 2006 JP
2012161413 Aug 2012 JP
2014206320 Oct 2014 JP
2015169412 Sep 2015 JP
2015222138 Dec 2015 JP
2016533544 Oct 2016 JP
2018151923 Sep 2018 JP
20120044874 May 2012 KR
10-2015-0093289 Aug 2015 KR
20150093289 Aug 2015 KR
20170033083 Mar 2017 KR
I373735 Oct 2012 TW
I443606 Jul 2014 TW
9838547 Sep 1998 WO
03025805 Mar 2003 WO
2009152078 Dec 2009 WO
2014165171 Oct 2014 WO
2014175643 Oct 2014 WO
WO-2015095493 Jun 2015 WO
2016183302 Nov 2016 WO
2017127035 Jul 2017 WO
2019032893 Feb 2019 WO
Non-Patent Literature Citations (57)
Entry
Jul. 5, 2023—(CN) First Office Action—App 202180011384.5.
Jul. 25, 2023—(CA) Office Action—App 3,123,879.
Jul. 6, 2023—(JP) Office Action—App. No. 2020-520519.
Sep. 7, 2023—(MX) Office Action—App. No. MX/a/2020/001634.
Nov. 8, 2023—(CN) Office Action—App. No. 201980090632.2.
Aug. 19, 2023—(CN) Office Action—App. No. 201880064016.5 w/ translation.
Jan. 25, 2024—(JP) Decision to Grant—App. No. 2020-520519.
Apr. 22, 2024—(TW) Office Action and Search Report—App. No. 112137447 w/machine translation.
Feb. 29, 2024—(EP) Office Action—App 19900402.9.
Advertising with Transparent LCD Displays; Jul. 28, 2016, URL: http://www.displays2go.com/Article/Advertising-Transparent-LCD-Displays-78>.
http://emotivev.com/products; at least as early as Jun. 5, 2017.
https://www.youtube.com/watchv=2tlM9lereLc; at least as early as Jun. 5, 2017, “Digital Signage Transparent LCD Beverage Cooler Demo”.
Oct. 24, 2018—(WO) International Search Report and Written Opinion—App PCT/US2018/046103.
Extended EP Search Report for EP 12782036, Dtaed Jun. 9, 2015, 7 Pages.
(US) Notice of Allowance on U.S. Appl. No. 14/170,378, Dated Mar. 31, 2015, 10 Pages.
File History of U.S. Appl. No. 16/547,288, filed Aug. 21, 2019.
File History of U.S. Appl. No. 15/888,210, filed Feb. 5, 2018.
File History of U.S. Appl. No. 14/819,257, filed Aug. 5, 2015, (U.S. Pat. No. 9,504,338).
File History of U.S. Appl. No. 14/686,958, filed Apr. 15, 2015, (U.S. Pat. No. 9,155,405).
File History of U.S. Appl. No. 14/170,378, filed Jan. 31, 2004, (U.S. Pat. No. 9,052,536).
File History of U.S. Appl. No. 13/286,053, filed Oct. 31, 2011, (U.S. Pat. No. 8,683,745).
File History of U.S. Appl. No. 61/484,616, filed May 10, 2011.
International Search Report of PCT/US19/66869 Dated Mar. 16, 2020.
Written Opinion of PCT/US19/66869 Dated Feb. 11, 2020.
Neff, J., “New System Puts Video Ads on Store Cooler Doors”, (2015), AdAge, http://adage.com/article/cmo-strategy/system-puts-video-ads-store-cooler-doors/301395, pp. 1-3.
Jul. 1, 2020—(US) Notice of Allowance—U.S. Appl. No. 16/222,643.
Jul. 27, 2020—(TW) Search Report App 108146270.
Jul. 29, 2020—(TW) Office Action—App 108146270—Eng Tran.
Nov. 19, 2020—(EP) Search Report—U.S. Appl. No. 18/843,780.
Jun. 1, 2021—(TW) Notice of Allowance App 108146270.
Jun. 3, 2021—(TW) Search Report App 108146270.
Jul. 28, 2021—(EP) Office Action—EP19900402.9.
Jul. 22, 2021—(KR) Office Action—10-2020-7006998.
Jun. 3, 2021—(WO) International Search Report and Written Opinion—App PCT/US2021/013247.
May 4, 2022—(WO) International Preliminary Examination Report (Chapter II)—App PCT/US2021/013247.
May 26, 2022—(KR) Notice of Allowance App 10-2020-7006998.
Jul. 18, 2022—(EP) Search Report—App. No. EP19900402.9.
Test for report.
Jun. 17, 2022—(TW) Search Report App 110132225 with English Translation (related matter).
Jun. 17, 2022—(TW) Search Report App 110132225 w/ Eng. Trans.
Kamoda, Rena. “Monitoring Grocery Inventory in Refrigerators using Appearance and Load Balance Features.” (2013). (Year: 2013).
Dec. 20, 2022—(US) Non-Final Office Action—U.S. Appl. No. 16/741,581.
Jan. 9, 2023—(US) Notice of Allowance—U.S. Appl. No. 15/931,971.
Jan. 9, 2023—(US) Notice of Allownace—U.S. Appl. No. 15/931,971.
Oct. 28, 2022—(US) Notice of Allowance—U.S. Appl. No. 16/763,448.
Feb. 22, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/763,448.
Oct. 12, 2022—(CA) Office Action—App 3,123,879.
Nov. 18, 2022—(EP) Office Action—App 18843780.0.
Jan. 13, 2023—(CN) Office Action—App 201880064016.5.
Jan. 31, 2023—(TW) Search Report—App 110132225.
Apr. 4, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/741,581.
Mar. 24, 2023—(US) Notice of Allowance—U.S. Appl. No. 17/082,270.
May 1, 2023—(US) Notice of Allowance—U.S. Appl. No. 16/763,448.
May 2, 2023—(US) Notice of Allowance—U.S. Appl. No. 15/931,971.
May 27, 2024—(CN) 2nd Office Action—App. No. 201980090632.2 w/ machine translation.
May 18, 2024—(MX) 1st Office Action—App. No. MX/a/2021/007315 w/ translation.
Jun. 25, 2024—(TW) Notice of Allowance—App. No. 112137447 w/translation.
Related Publications (1)
Number Date Country
20240219102 A1 Jul 2024 US
Continuations (3)
Number Date Country
Parent 17082270 Oct 2020 US
Child 18233041 US
Parent 16741581 Jan 2020 US
Child 17082270 US
Parent PCT/US2019/066869 Dec 2019 WO
Child 17082270 US
Continuation in Parts (6)
Number Date Country
Parent PCT/US2019/066869 Dec 2019 WO
Child 16741581 US
Parent 16222643 Dec 2018 US
Child PCT/US2019/066869 US
Parent PCT/US2018/046103 Aug 2018 WO
Child 16741581 US
Parent 15674198 Aug 2017 US
Child 16741581 US
Parent 15674198 Aug 2017 US
Child 16222643 US
Parent 15674198 Aug 2017 US
Child PCT/US2018/046103 WO