Three-dimensional decorating system for edible items

Information

  • Patent Grant
  • 11541651
  • Patent Number
    11,541,651
  • Date Filed
    Friday, December 27, 2019
    4 years ago
  • Date Issued
    Tuesday, January 3, 2023
    a year ago
Abstract
In one aspect, the present disclosure relates to the decorating and printing of three-dimensional edible media on a printable base media based on a user selected image. A base can be determined to support and couple the printed 3D edible media based on the user selected image to the printable base media. Using a user interface, the user selected image can be modified and adapted to print based on a 3D printer's capabilities. Maneuvers of either a platform or a printhead of the 3D printer can be tracked for secondary treatments to either the printed 3D edible media or the printable base media.
Description
BACKGROUND OF ILLUSTRATIVE EMBODIMENTS

Decorative food products, such as cakes, are popular items, particularly for special occasions, such as birthdays, holidays, weddings, anniversaries and other celebratory events. These items are typically purchased from bakeries since the items generally require some skill and/or apparatus to create. Previously, these items were created from colored frostings applied manually by trained bakery decorators. For example, pre-made decorative items can be placed on a food product. These pre-made items are generally produced in bulk in a factory and inventoried until use. The use of such pre-made decorative items precludes uniquely decorated and/or personalized decorations. Also, these pre-made decorative items are generally pre-ordered, which requires a long lead time, or stored in inventory at the risk of under-ordering or over-ordering, as well as the cost of such inventory.


Another alternative has been to utilize an automated system for decorating cakes. One such system is disclosed in U.S. Pat. No. 5,505,775, issued to Kitos. This system utilizes an integrated work surface controlled with a computer system. A 2-dimensional image is scanned into the computer system. The computer system then uses a motion control system to manipulate a drop-on-demand colorant expulsion system over a cake carried on the work surface to reproduce the scanned image. This system produces the decorations and images directly onto the food product.


An automated system for printing images onto edible media, that can then be applied to a food product or consumed as is, is disclosed in U.S. Pat. No. 7,286,258, issued to Schnoebelen et al., which is incorporated by reference herein. This system discloses a local processing unit and a number of image sources, including a scanner and a database of digital images stored on a local computer memory system. The user selects an image from one of the image sources and prints the image onto an edible media.


A decorating system for edible items is disclosed in U.S. Pat. No. 7,012,712, issued to Spurgeon et al., which is incorporated herein by reference. This system discloses creating a decorative edible item from a selected image. The system includes at least one image source, such as a scanner and/or a library of stored images, a controller unit and a printer for creating a high-quality pictorial rendition of the image. The printed edible media can then be applied onto a product, shipped to a separate location or eaten as is.


Various websites exist for allowing users to customize decorations. One such online website is www.genometri.com which allows users to decorate and purchase customized decorated cakes. Users can choose from pre-designed decorative templates or can choose to customize their cake decoration. Users can upload personal photographs to use in the cake decoration and can add text and clip art to the cake decoration. When the user is finished decorating the cake, the user purchases a cake decorated with the customized decoration. The purchase transaction is processed through the website.


SUMMARY OF THE ILLUSTRATIVE EMBODIMENTS

Disclosed herein are methods and systems for creating and decorating edible media. In certain embodiments, at least one local control device and a Graphical User Interface (GUI) can be used for selecting an image, receiving and/or transmitting the selected image via the Internet to and/or from a central control device containing a website with at least one image database, and printing licensed digital images at the local control device upon an edible medium using edible inks. In certain configurations, a principal user authorizes a secondary user to search and print specific, pre-authorized images from the central control device's image database. In certain implementations, the user purchases edible media via the Internet.


In selected implementations, the user decorates an edible media with images from multiple image sources. The image sources may include local image sources, such as a scanner or a digital camera, or remote image sources, such as an image library in an Internet website. The image sources may contain proportionate two dimensional images, as well as disproportionate two dimensional images that can be manipulated by a user.


In various embodiments, the user may print licensed digital images within a print environment provided internally by a software web browser used to navigate the website with at least one image database. In other implementations, a user may print licensed digital images in an external printing environment provided separately from the software web browser used to navigate the website with at least one image database. For example, the external printing environment could be a web-enabled standalone application on a local control device that accesses an image repository on a central control device through a secure connection originally authenticated via login procedures in a separate software web browser application. The web-enabled standalone application may, in selected implementations, prevent received license-controlled image data from unauthorized re-use, editing, or distribution, and permits image processing, such as applying the International Color Consortium's color correction process, at the local control device. The web-enabled standalone application may further generate a printer-specific byte stream based on post-image processed data, providing a color-managed workflow independent of local control device operating system print drivers.


The details of one or more implementations are set forth in the accompanying drawings and description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims.





DESCRIPTION OF DRAWINGS


FIG. 1A is an example system for decorating edible media;



FIGS. 1B-1E show examples of edible media that are 3D printed on a food product;



FIGS. 1F-H show a cross section of a 3D edible media according to an example;



FIG. 1I shows a perspective view of a printer having a printhead connected to a printer frame and a stationary platform according to an example;



FIG. 1J shows a drawing of a printer having a jointed movable printhead and a maneuverable platform according to an example;



FIG. 2A is an example computer system containing software modules in a central control device in a system for decorating edible media;



FIG. 2B is an example computer system containing software modules in a local control device in a system for decorating edible media;



FIG. 3 is an example swim lane diagram of a process for ordering edible media;



FIG. 4 is an example swim lane diagram of a process for a principle user to authorize secondary users and designate authorized images for the secondary users;



FIGS. 5A-5D depict an example swim lane diagram of a process for decorating an edible medium;



FIG. 6 is an example flow diagram of a process for displaying augmented reality content using a decorated edible medium with an augmented reality marker;



FIG. 7 is a flow diagram of a process for decorating edible media with licensed digital images;



FIGS. 8A and 8B are a flow diagram of a process for printing edible media that bypasses operating system print drivers;



FIGS. 9A-9D depict an example swim lane diagram of a process for printing edible media using a parallel browser module;



FIG. 10 depicts an example User Interface tree for a website in a system for decorating edible media;



FIGS. 11A-32 depict example webpages from a system for decorating edible media; and



FIG. 33 is a block diagram of an example computer system.





DETAILED DESCRIPTION OF ILLUSTRATIVE IMPLEMENTATIONS


FIG. 1A is an example system 100 for decorating an edible media 102. The system 100 provides an online environment for creating and decorating edible media. The online environment includes one or more website applications with which the user can interact to print edible content on edible substrates or edible media. The system 100 provides a mechanism to perform online or local searching of images and customization of images.


As used herein, an image can be any work protected by a copyright, registered copyright and/or a registered trademark including a regular image or photograph, a digital image, a fictional character, a celebrity, an emblem, a logo, a mascot, an illustration, a pictorial, a graphic, as well as works not in image form such as sculptural works, which include two- and three-dimensional works of fine, graphic, and applied art. An image can include an image protected by a commercial license. An image can include a series or collection of two or more images, a schematic, and a computer aided design (CAD) file for deriving or rendering a 2D or 3D form or object. In an example, the 2D or 3D form or object can be a figurine that is based on a copyrighted character or a generic body of a part of a figurine. Further, an image can also include derivatives of the copyrighted works and the trademarked works, as well as any other original work including non-copyright protected images or unpublished work such as personal photographs, digital images, videos, illustrations, clip art, and other original works. In an example, the 2D or 3D form or object can have 2D elements or 3D elements that can be customized, such as size, color, and features that can be merged with user data for a personalized birthday kid (e.g., image of face of kid on the figurine, etc.).


As used herein, edible media can be any two-dimensional or three-dimensional ingestible product. In an example, edible media may be a baked good such as a cake, cupcake, cookie, or pizza crust. In another example, edible media may be temperature-sensitive media such as an ice cream cake, ice form, or gelatin. In a further example, edible media may be a planar printable surface such as edible paper, wafer, or edible media sheet. In an additional example, edible media may be a three-dimensional edible confection such as an off-the-shelf edible decoration (e.g., SugarSoft® Decorations by DecoPac, Inc. of Anoka, Minn.), candy, or chocolate.


As used herein, printable base media can be any two-dimensional or three-dimensional nontoxic product used as a base for printing two-dimensional or three-dimensional edible decorations. In an example the printable base media can be the food product. In an example, the printable base media can include edible media, as described above. In another example, printable base media can include a planar nontoxic material such as a flat plastic base material, a flat metal base material, or a flat paper or cardboard base material (e.g., a cake board), a silicon transfer sheet, or a wax paper transfer sheet. In a further example, printable base media can include a formed nontoxic material such as a ring form (e.g., to be worn on the finger as a ring pop) or a stem form (e.g., popsicle stick with planar printing surface onto which an edible decoration can be printed). In additional examples, a printable base media may be printed prior to printing of an edible item. In a particular example, the printable base media can be a 3D printed flower stem form that can be made from an edible or inedible material unto which the secondary shape, edible or nonedible, may be printed, such as a flower.


The system 100 is operated by a user to print and/or customize images including both licensed and non-licensed digital images. The system 100 additionally provides digital rights management, print monitoring functions, user account management, and messaging functions.


The system 100 manages both licensed and non-licensed images for purposes of obeying licensing laws when printing the images on an edible medium. Licensed digital images, such as copyrighted images including fictional characters, celebrities, emblems, logos, mascots, illustrations, or photographs having licensing terms and conditions for usage can be purchased from one or more online sources. In an example, the image can be a grouping of multiple 3D elements such as a set of individual characters (e.g., a feature film character set).


Non-licensed digital images such as personal photographs, illustrations, clip art, or other non-copyright protected images can be uploaded locally to the system 100. Both licensed and non-licensed digital images are retrieved from an external device or the Internet, stored locally, and uploaded to the system 100. In some embodiments, a combination of licensed and non-licensed digital images are retrieved either locally or online and printed in combination on a single printable base media. In some embodiments, the uploaded digital files may be of a scanned three-dimensional shape such as a person or thing.


Users generally access the online environment in system 100 to search, select, edit, and purchase images. The purchased images can be printed onto the edible media 102 using edible inks. For example, a user of system 100 accesses the online environment to search for a particular image. The user selects the image, purchases and/or edits the image, and directs the system 100 to print the purchased image onto the edible media 102. The images available to system 100 can be retrieved from any number of sources including local, online, or remote storage repositories. For example, images can be retrieved from local image sources 104 which are communicably connectable to system 100. The local sources can include, but are not limited to a digital camera 106, a CD-ROM OR DVD 108, a video device 110, a flash drive 112, a scanner 114, a mobile device 116, a computer available on a local network 118, an external hard drive, a netbook, a laptop, a wireless device (e.g., Wi-Fi enabled, Bluetooth enabled, or other wirelessly enabled device), or a handheld device (not shown) such as a “smart” phone or tablet.


Images can also be retrieved via the network 118 from any number of websites containing digital images or libraries of digital images. Images can additionally be retrieved from other networked or remote storage repositories (not shown). Upon retrieving images, the system 100 provides access to additional features for handling retrieved images, such as photograph editing, social networking content insertion, or augmented reality content insertion.


Users can purchase edible media using one or more e-commerce sites. For example, users can purchase an edible sheet from an e-commerce site incorporated into system 100. E-commerce sites associated with system 100, for example, provide a number of selectable options for obtaining edible media. The user can choose standard “off-the-shelf” edible media items or custom edible media items.


In some configurations, the user is provided the option to purchase edible media locally using the system 100. For example, the user may be offered several sizes of edible media for decorating. The user can select a desired decoration size and choose an edible media (e.g., an edible sheet of paper) size comparable to the desired decoration size. The selected edible media (e.g., edible media 102) can be purchased through the system 100 by entering an appropriate edible media code or by simply selecting the desired edible media onscreen. The edible media code can, in effect, function as a part number for ordering a specific edible media sheet size. In some implementations, the edible media code is requested by the system 100 to prompt a user to select an edible medium available locally in a bakery, for example. The selected edible medium can be loaded into the system 100 and images can be printed upon the edible medium.


In certain embodiments, the system 100 requests that the user enter a unique code. The unique code may be sent to the user with edible media prior to accessing system 100. The unique code can be entered once by the user to enable printing of images a specific number of times. For example, the user can enter a code and receive up to twenty-four print sessions for selected images. In operation, once the user enters the code, the system verifies that the code is valid and has not been used before. In practice, the user may be limited to the specified print sessions.


Once the edible media has traveled through the printer and the image printed thereon with the edible inks, the printed edible media is removed from the printer. The printed edible media is then placed on a food product at the point of printing and transported to a separate location for application. In some configurations, the edible media is relatively thin and sturdy allowing for convenient transport and thus minimization of damage to the decorations. In certain embodiments, the edible media may also include an optional release sheet having a silicon coating functioning as a backing material, for example.


In some implementations, the system 100 includes an image uploading device. The image uploading device may be a wired or wireless storage device operable to upload licensed and non-licensed digital images. The image uploading device may be coupled to any number of alternate image sources for uploading additional images. For example, the image uploading device may represent a scanner, while the alternate image source represents a network drive accessed over the Internet. In another example, the image uploading device represents a mobile phone device while the alternate image source represents a USB fob.


User Interface

In the system 100, User Interface controls 120 are connected to the local control device 128. The User Interface controls 120 include a keyboard 122, a mouse 124, and a display device 126. Other implementations may use other devices, such as a touch screen device, a joy stick, or a voice command system. In one example the touch screen device can be the mobile device 116 or PDA. The User Interface controls 120 allow the user to operate the system 100 to decorate edible media 102 or to display edible media-related content on the display device 126. In one example a virtual headset can be used to display a virtual reality or an augmented reality.


The user is displayed a variety of navigation screens and menus on the display device 126. The user selects desired options from the navigation screens and menus using the keyboard 122, the mouse 124, or other input mechanism. The User Interface controls 120 relay signals from the user to a local control device 128, thereby operating the system 100.


The display device 126 is operable to display a Graphical User Interface GUI 127 for interacting with the hardware and software components of system 100. The GUI 127 can, for example, include application screens, website content, software controls, and other Graphical User Interface content. The GUI 127 is operable to receive user input for accessing one or more licensed or non-licensed digital images. The GUI 127 can, for example, include graphical elements provided in one or more applications. Users can interact with one or more graphical elements to control the behavior and output of system 100 components.


The GUI 127 is operable to control the local control device 128 and communicate with the central control device 132 over a network to retrieve at least one licensed digital image from the central control device. In an example where the User Interface controls 120 and the local control device 128 are combined into the tablet or touch screen device, the GUI 127 can be further configured to interpret and communicate through the network image manipulation input in order to execute a computational module 232. For example, a network image manipulation input through the GUI 127 can rotate a 3D image such to change its respective center of mass and effect a base 170 needed (See FIG. 1D-1E), as determined by the computational module 232 (See FIG. 2A).


The GUI 127 is also operable to cause to be printed at least one licensed digital image onto an edible medium. The GUI is also operable to switch between multiple software applications, including a software web browser and non-web browser software. In some configurations, the GUI 127 is operable to retrieve non-licensed images.


The GUI 127 can be presented within a software web browser. In certain implementations, a user may print licensed digital images within a print environment provided internally by a web browser used to navigate a website with at least one image database. In other embodiments, a user may print licensed digital images in an external printing environment provided separately from the software web browser.


Local Image Sources

The system 100 includes one or more devices which can be communicably coupled to system 100 as local image sources 104. In this example, a variety of local image sources 104 are connected to the local control device 128. One such local image source 104 is the scanner 114. The scanner 114 can be a flatbed scanner, or any other type of scanner such as a drum scanner or a through feed scanner. The scanner 114 allows an image to be rendered from personal photographs, drawings, books, magazines, etc. In some embodiments, the local image sources 104 may include a 3D scanning device resulting in one or more digital image files containing a 3D representation of an object. In certain embodiments, system 100 can evaluate acquired images for copyright indicators. In an example, the copyright indicators include copyright and trademarks for figurines of fictional characters, celebrities, emblems, logos, mascots, and the like. Based on the detection of copyright indicators, the user may be alerted to potential copyright limitations, or usage of the acquired image may be automatically denied.


Other local image sources 104 include the digital camera 106, the CD-ROM OR DVD 108, the video device 110, the flash drive 112, and the mobile device 116; however, other sources of digital image storage or repositories can be used in the system 100. In certain embodiments, the local image source 104 can be a personal electronic device such as a camera phone or PDA. In operation, when a particular local image source is connected to the local control device 128, a user can retrieve images from the connected local image source to use in the system 100 for decorating (e.g., printing on) the edible media 102.


Images retrieved from local image sources are uploaded to system 100 and stored. For example, scanned images retrieved from scanner 114 are uploaded into system 100, stored locally on system 100 and provided for use in the system. The stored images can be retrieved by users for editing, printing, and so on.


Local Video Device

The system 100 includes one or more local video devices 130. Any device that is capable of capturing and communicating a digital video signal can be used. In certain embodiments, the local video device 130 is a web camera. The local video device 130 is generally connected to the local control device 128 by a wireless or wireline means. The user uses the local video device 130 to send a digital video signal to the local control device 128. The local control device 128 transmits the digital video signal to a central control device 132 via the network 118. In certain embodiments, a single frame can be extracted from the digital video signal for printing. In other embodiments, a single image for printing can be generated based on a montage of image frames extracted from the digital video signal.


In certain embodiments, the local video device 130 is a personal electronic device such as a camera phone or PDA. The local video device 130 is generally connected to the local control device 128 by a wireless means such as Wi-Fi, Bluetooth, near-field communication, or wireline means such as USB or similar connectors. In an example, the local video device 130 can also function as the local control device 128 and the local image source 104.


Local Control Device

The local control device 128, in an example, is coupled to the User Interface controls 120, the local image sources 104, the local video device 130, and a printer 134. Local image sources 104 contain at least one local digital image. In certain embodiments, local digital images are selectively uploaded from the local control device 128 to the central control device 132 for storage, permitting printing of the local digital image onto the edible medium at a later time.


In some configurations, the local control device 128 is coupled to a printer 134 and an image uploading device for purposes of retrieving and transmitting a digital image from the image uploading device to the printer. The retrieval and transmission is typically in response to the user selection. For example, the user uses a scanner to upload an image to the local control device 128. The uploaded image is transferred to the printer 134 for printing.


The local control device 128 is operated by the user using the User Interface controls 120. For example, the user operates the local control device 128 to search, select, and purchase an image. The local control device 128 is operable to print the purchased image onto the edible media 102, for example. The local control device 128 includes a software web browser that allows the local control device 128 to communicate with the central control device 132 via network 118. In some implementations, the central control device 132 is a web server capable of communicating using standard Internet protocols.


In this example, the local control device 128 is depicted as a computer system. However, any processing unit which can digitally process signals from local image sources 104 or other sources can be used.


Central Control Device

The central control device 132 is connected via the network 118 to the local control device 128. The central control device 132 includes a plurality of licensed digital images for decorating edible media by authorized users. The licensed digital images are protected from unauthorized usage and unauthorized user access. The central control device 132 provides a tracking mechanism to authorize or de-authorize usage of licensed digital images. For example, the central control device 132 authorizes the use of particular licensed digital images according to user credentials. The user credentials can be stored in system 100, or externally. The user credentials typically include payment information, location information, and system usage data. The central control device 132 verifies whether specific users should be provided access to particular licensed images.


The central control device 132 may include a software web server which allows the local control device 128 to communicate with a website on the central control device 132. The web server can be any web server capable of communicating using standard network protocols compatible with local control device 128 using a variety of Internet connection types and operating systems. The web server may run on a variety of operating platforms, for example Windows, Linux, MAC OS, or UNIX.


The website (not shown) hosted on the central control device 132 includes a number of software modules. The software modules may include, but are not limited to, image library modules, user account modules, edible media modules, photograph editing modules, user location recognition modules, training modules, print modules, licensing restriction modules, social networking modules, augmented reality content modules, security modules, and/or messaging modules. Other modules are possible. The described software modules can be selectively combined to form a multifunctional software module, or split into multiple software modules.


The user can access the website and accompanying software modules on the central control device 132 using the local control device 128, for example. The user can search images, purchase images, edit images, print images, order edible media, view training content, and access social networking features and augmented reality content stored on the central control device 132. Example software modules will be discussed below in reference to FIG. 2A.


Central control device 132 may include media servers, for example, a FLASH multimedia server, and the local control device 128 may include corresponding media players, for example, a FLASH player. FLASH players may be implemented either as a plug-in to the software web browser, or as a stand-alone application.


Printing Device

The system 100 includes the printer 134 operable to receive and print images upon edible media 102 using edible inks. The printer 134 may include a feed path through which the edible media 102 is inserted and conveyed past one or more printheads. The printhead technology can be any type of printhead technology which can be controlled by digital signals including, for example, inkjet, thermal inkjet, piezo inkjet, continuous inkjet, valve jet, electrostatic inkjet, airbrush technology, and computerized numerical control (CNC) machines.


In one example, the printer 134 can be a 3D printer configured to print edible materials and/or edible inks. In an aspect, the 3D printer may be configured to print with an edible material supplied in various colors. In another aspect, the edible material can have a base coloring (e.g., white, off-white, etc.) and the 3D printer can be configured to print with a variety of edible ink colors upon the edible material. FIGS. 1B-1E show examples of a 3D edible media 160 on printable base media 150.



FIG. 1I shows a perspective view of a printer 134′ having a printhead 192 connected to a printer frame 190 and a stationary platform 180′ according to an example.


In certain embodiments, the printer 134 can have one or more fixed and/or moveable printheads and/or a maneuverable platform. FIG. 1J shows a drawing of a printer 134″ having a jointed movable printhead 192 and a maneuverable platform 180″ according to an example. The jointed movable printhead 192 can function similar to a multi-jointed CNC robotic arm. Similarly, the maneuverable platform 180″ can function similar to a multi-jointed CNC robotic arm. The maneuverable platform 180″ can alternatively be a rotating and/or orbiting gimbal platen and/or platform configured to rotate the food product while the printhead 192 is in operation. The maneuverable platform 180″ can have a set of securing mechanisms 182 configured to hold or grip the food product or the base 170. In an aspect the printer can coordinate tilting of the edible media and an angle of the printhead 192, with tracking a set of deposition coordinates to match a secondary treatment.


In an example, the printer 134 can print edible materials and edible inks on a large food product having one or more separated levels, sides, and contours such as a tiered cake. In an example, the maneuverable platform can rotate a tiered cake while printing on a side of the tiered cake. In another example, the printer 134 can print edible materials and edible inks on a small food product such as a cake pop. The cake pop can be easily rotated in multiple configurations as compared to the larger tiered cake. In another example, the printer 134 can print an entire cake pop with edible materials and edible inks, as well as non-edible materials. FIG. 1J shows an example of a cake pop being held in the set of securing mechanisms 182 while being created and/or decorated.


In an example, the printhead can be configured to extrude a first edible material to support a second edible material. For example, referring to FIGS. 1F-1H a combination of two or more edible materials can be printed in a coordinated manner. FIG. 1F shows a location of a cross section 164 of a 3D edible media 160, as shown in FIGS. 1G-1H. FIG. 1G shows the cross section 164 of a first edible material 160a surrounded by a second edible material 160b according to an example. The first edible material 160a can have a stiffness, density, and/or consistency to support the second edible material 160b, which may not have been able to support itself. In an example, the first edible material 160a can be a nougat material and the second edible material 160b can be a chocolate coating on the nougat material, where the combined nougat material and chocolate coating material form a three-dimensional object such as a candy bunny.



FIG. 1H shows the cross section 164 of a first edible material 160a and a second edible material 160b adhering to the first edible material 160a according to another example. Either the first edible material 160a or the second edible material 160b can have a surface feature or adhesive property to promote adhesion.


The printhead can have a set of one or more nozzles for extruding the two or more edible materials together according to an example. The nozzles can extrude each edible material separately or simultaneously by having one nozzle embedded in another nozzle.


The printheads can include one or more of an imaging device such as a camera, or a sensor such as a 3D scanner, a force transducer, a temperature detector, and an infrared detector as well as any other sensor related to 3D printing. In an example, the imaging device can be configured to index, scan, or read an indicator on or the shape of the food product to determine a location of the surface of the food product for printing.


In another example, the imaging device or sensor can be configured to create a digital scan or data on a shape and appearance of a real object such as a food product or printable base media 150, and to create a digital model based on the digital scan or sensor. The digital scan can be used to filter and to suggest different images that can be printed by the printer 134 at different locations on the food product.


In an aspect, the 3D printer can include a contour tool or reductive modeling tool (e.g., carver/cutter/suction), a painting tool (e.g., watercolor effect, airbrush, etc.), a curing head, and a set of multi-color printheads. In an example, the contour tool can be configured to shape, to remove, to cut, and to carve the food product or edible materials into a different contour. In an example, the contour tool can carve a fondant or a cake to a different shape. In another example, the contour tool can shape an ice cream cone or other dessert cup. In another example, heads may be interchangeable to provide multiple functionalities.


In an example, the printhead can include an in situ sensor and/or a biopsy probe configured to determine a mechanical or structural property of the food product such that the contour tool removes a portion of the food product without creating unintended instability. In an example, the situ sensor can be an acoustic or ultrasound sensor, a non-penetrating pressure sensor, or any other type of sensor. In an example, the biopsy probe can include a penetrating pressure sensor.


The curing head can be a cooler and/or a heater. In an aspect, the 3D printer can use edible materials, as well as inedible materials such as plastic and/or wax (e.g., to print candles). In an example, the curing head can be configured to lead or to follow a second printhead and apply cooling and/or heat. In an example, a first printhead can be configured to extrude an edible material such as cake batter, followed by a second printhead supplying heat to the cake batter such that the cake batter rapidly broils or bakes.


In some embodiments, the printer 134 is configured to function within and/or provide a temperature controlled environment. For example, when the edible media is a form of ice cream, the temperature controlled environment can be a freezer or a platform that is chilled. In another example, the printer 134 can include a temperature treatment to apply to the printed edible media. In a particular example, a liquid nitrogen treatment may be deployed by one or more liquid nitrogen applicators of the printer 134 to set chilled decorations such as ice cream embellishments. In another example, a dry ice treatment may be deployed for other freezing as well as visual effects. In an example, the secondary treatment can be a coating for the dry ice treatment to slow, delay, or pattern a fog emanating from the dry ice treatment.


In some embodiments, the printer 134 includes a setting treatment for setting the edible media after decoration. For example, the printer 134 may supply a setting treatment via one or more applicators as a functional layer, such as a hardening or stiffness support layer to promote structural integrity of the 3D edible media. In another example, the printer 134 may supply an aesthetic treatment via one or more applicators, such as adding a sheen, a glitter, or a glossy appearance, that may or may not contribute a functional benefit to the finished product. In particular examples, the printer 134 may be configured to apply one or more of a sugar, a starch, a wax, and a glazing agent to stabilize a decorated edible media.


In some printing systems, the edible inks described above are generally fed from a cartridge reservoir. Such cartridge reservoirs may be refilled as need. In some embodiments, images are printed onto a transfer layer, which in turn is applied onto the edible media 102.


In another example, the printer 134 can be used to dimensionalize a frosting sheet by printing a three-dimensionally textured background or scene for a corresponding non-printed decoration (e.g., DecoSet® Decorations by DecoPac, Inc. of Anoka, Minn.). In a particular example, train tracks and landscaping (e.g., mountains, trees, grass, water, etc.) can be three-dimensionally printed upon edible media, and a toy train may be placed upon the textured scene.


Edible Media

The system 100 includes edible media 102 on which images are printed. The edible media 102, in this example, includes at least one edible layer 136 and an edible coating 138. The edible medium may be a single layer of edible material. For example, the edible medium may be a single layer of sugar paper, sugar paste, starch paper, fondant, or some other edible form. Examples of options for edible material include but are not limited to standard media with sizes of ½, ¼, and ⅛ sheet, or precut media of sizes 8 inch round, 3 inch round, or 2 inch round, or edible strips.


One embodiment of the edible layer 136 of the edible media 102 includes a mixture of a sugar paste of varying thickness. The edible layer 136 is typically formulated for several key features. First, the edible layer 136 is mixed to depict high-quality pictorial images from particular edible inks disclosed herein. Second, the edible layer 136 travels through a printer (e.g., printer 134) without damaging the edible media 102, the edible layer 136, or the printer. For example, the edible layer 136 is mixed to ensure sufficient strength to be bent and manipulated through the conveying path of the printer 134, withstand the heat of the printing process, and still maintain suitable textural integrity as to not jam in the printer mechanism of printer 134. Third, the edible layer 136 is mixed to ensure there is no detraction from the taste of the food product on which it is to be applied. Other variations of edible layers and edible media may be used as well.


In some implementations, the edible layer 136 is formulated for use in decorating pizza or deli type items. For example, the edible layer 136 may be formulated as savory rather than sweet.


Other examples of edible layers 136 are described in U.S. Pat. No. 5,017,394, assigned to the Lucks Company, and incorporated herein by reference. This type of edible layer 136 is formed from a flour and/or starch base as opposed to the sugar base of a fondant. Another example of an edible layer 136 is disclosed in U.S. Pat. No. 5,334,404, issued to Garcia et al. and incorporated herein by reference. Other types of edible layers 136 can be used including, but not limited to rice paper, wafer paper, and other edible substrates on which an image may be printed.


The edible coating 138 enables the edible media 102 to render a high quality pictorial image on the surface of the edible layer 136. Without this coating 138, the inks tend to run or bead or form an imperfect image. In one example, the coating 138 is a very thin layer of calcium carbonate. This thin layer allows the inks to properly perform to render a high-quality pictorial image. Other coatings may be used in system 100.


In some embodiments, the edible media 102 may also include an optional release sheet 140 having a silicon coating functioning as a backing material, for example. In some implementations, the edible media 102 is a standard size or shape. Example sizes can include 8.5 inches by 11 inches, 9-inch round, and 8-inch round. The size can be a precut size or a selectable size. In some configurations, frosting layers, edible material and/or fondant layers can be malleable and/or stretchable to various sizes and shapes.



FIGS. 1B-1E show examples of a 3D edible media 160 on a food product 150, where the 3D edible media 160 has a center of mass 162 and a contact area 152 with the food product 150.


As shown in FIG. 1B, the center of mass 162′ of the 3D edible media 160 on the food product 150 can be within the 3D edible media 160. As shown in FIG. 1C, the center of mass 162″ of the 3D edible media 160 on the food product 150 can be outside of the 3D edible media 160. As shown in FIGS. 1D-1E, the center of mass 162′″ of the 3D edible media 160 on the food product 150 can be unsupported by the contact area 152 and thereby can move or tip due to gravity. In an example, the 3D edible media 160 can be made from a combination of edible materials such that the center of mass 162 can be shifted.


As shown in FIG. 1D, the 3D edible media 160 can include a base 170 that can be configured to support and mechanically compensate for the center of mass 162′″ in an example. As shown in FIG. 1E, the base 170 can include one or more attachment features 172 that can be configured to support, couple, and mechanically compensate for the center of mass 162′″ according to an example. In an example the base 170 and attachment features 172 can be made from one or more edible materials. In another example, the base 170 and attachment features 172 can be made from one or more non-edible materials. In another example the base 170 and attachment features 172 can be made from a combination of one or more edible materials and one or more non-edible materials.


Edible Inks

The edible inks used in the system 100 are typically formulated from food grade colors and ingredients to enable high quality, near-photographic images to be printed onto the edible media 102. These inks are edible and have precise color-matching properties, but additionally function in a manner similar to other commercially available inks in printers. Edible inks may include natural inks manufactured from a food grade base.


The edible inks are specifically formulated for use in a particular printer. The user selects to print the image using different color models, according to the requirements of the printer. Providing selectable color models improves the precision of the printed image by enabling adherence to particular color matching systems. The edible inks may be inks designed to be used for decorating numerous different types of food products, including, for example, cookies, cakes, pizza, cupcakes, candy bars, edible tattoos, temporary tattoos, cereal boxes, waffles, and pancakes.


In an example, the edible ink can be an edible printing material configured for 3D printing. The edible ink used for 3D printing can include any number of the following: icing, SugarSoft® by DecoPac, Inc. of Anoka, Minn., chocolate, frozen dessert material such as sorbet, yogurt, or ice cream, candy material, Royal icing, fondant, gelatin, and edible materials capable of being deposited by an airbrush style printhead tool.


The edible inks are additionally formulated to faithfully render images in accordance with the appropriate color model. Possible color models include, but are not limited to, the Cyan, Magenta, Yellow and Black (CMYK) color model, as well as the RGB, LAB, HSB, Pantone, Hexachrome, and other color models. In some embodiments, the edible inks are formulated to render images in accordance with the CMYK color model. Other examples of edible inks that provide faithful matching to the CMYK color model, as well as other color models, and that function within the constraints of commercially available printing technologies may be used in the system 100. In some configurations, the inks used in system 100 include a combination of edible inks, natural inks, synthetic inks, or other inks.


Central Control Device Software Modules


FIG. 2A is an example computer system 200a containing software modules of a website used in a system for decorating edible media. The system 200a can, for example, be analogous to central control device 132 (FIG. 1A). A user of the system 200a accesses a website on the central control device 132 to gain access to one or more software modules 202-234.


The software modules shown in FIG. 2A may include an image library module 202, an image editing module 204, an edible media module 206, a user account module 208, a license module 210, a print module 212, a user location module 214, a social networking module 216, an augmented reality module 218, a training module 220, an ordering module 222, a maintenance module 224, a reporting module 226, and a messaging module 228.


The image library module 202 is a software module including a plurality of digital images that can be printed onto an edible media. The image library module 202 includes both images available for purchase and free images. The images may be licensed or unlicensed images, and may include clip art, illustrations, photographs, text, three-dimensional images or other 2D and/or 3D file content. The image library module 202 generally contains different formats of the same image each of which are configured for printers that use differing color models.


The images in the image library module 202 may contain embedded augmented reality markers, which allow the user access to augmented reality content. The augmented reality marker can be any asymmetric geographical shapes of any color with sufficient contrast. The user can use the image containing the augmented reality marker to access augmented reality content on the augmented reality module 218, for example.


The image library module 202 allows the user to browse or search through the images using keyword criteria such as “Sports” or “Princess” or “Birthday.” The image library module 202 may be updated with new images and new image formats. In certain embodiments, image library module 202 may be updated with an image acquired through a local image source, such as a USB WebCam. In another illustrative embodiment, image library module 202 may be updated by a reference to Web content, such as a photograph posted on a social media network. In another implementation, image library module 202 may be updated based on changes in agreements with image suppliers, and/or alterations in files supported by the system 100.


The image library module 202 interacts with the license module 210 and the user location module 214 to allow or restrict users when finding and/or purchasing particular images. For example, the license module 210 may restrict access to a user based on a number of factors. One example factor may include barring image purchases based on a geographic location and/or an authorized list for the user. In this example, when a user selects to view images available from the image library module 202, the user location module 214 can automatically identify the geographic location of the user. The user's geographic location can then be used by the license module 210 to identify whether any of the images in the image library module 202 are restricted from being sold in the user's location. If a restriction is found, the license module 210 sends to the image library module 202 information on which images are unavailable to the user. The image library module 202 removes the restricted or unavailable images from the image library made available to the user. In certain embodiments, restriction of images based on the user's geographic location can be in addition to or in substitute for an authorized list of images containing available images for the user.


The image library module 202 also interacts with the user account module 208 to allow a secondary user to only search and purchase images that have been authorized for the secondary user by a principal user. For example, a principal user can designate specific secondary users. The principal user then searches through the image library module 202 and identifies which images can be sold to which secondary users. The principal user can designate different images for users in different geographic locations. When a secondary user accesses the website and selects to search the images in the image library module 202, the secondary user is only shown the images available at the user's geographic location, and/or on the user's authorized list, which is made of images previously authorized by the principal user.


The image library module 202 also interacts with the social networking module 216 to allow the user to identify the most popular images or designs and to access other social networking functions. For example, the user may be provided an option of viewing lists of the most popular designs. The user may also be provided an option of viewing consumer reviews of images in the image library. The provision of social networking options may be provided in an online fashion where the user can interact with social networking content using system 100.


The image library module 202 interacts with the print module 212 to ensure that the version of the image that is compatible with the color model of the printer is sent to the user's printer. When the user selects to print an image, the print module 212 sends to the image library module 202 the color model of the user's printer. The image library module 202 sends to the user's printer the correct format of the image. In certain embodiments, the print module 212 prompts or allows the user to identify the printer 134 attached to local control device 128. In other illustrative embodiments, the print module 212 auto detects the identity of printer 134.


The image library module 202 also interacts with the edible media module 206 to enable the user to identify images suitable for the particular edible media selected for decoration. The user enters into the edible media module 206 the specific type of edible media being decorated. The edible media module 206 contains characteristics of the edible media, and sends to the image library module 202 specific criteria for compatible images, such as image size. The image library module 202 removes the images which are not compatible with the edible media the user selected.


The edible media module 206 is a software module that includes a list of the edible media available to be used in the system 100 and which are available for purchase by the user. The user can search or browse through the edible media module 206 using various keyword criteria, such as “cupcakes” or “cake.” The edible media module 206 may also contain information about the cost and availability of edible media. Furthermore, the edible media module 206 also may contain a database of unique codes that are associated with particular edible media. The unique codes may function as part numbers, printing data, cost data, retrieval data, or other data. The edible media module 206 interacts with the user account module 208 to allow the user to purchase edible media. Once the user selects an edible media for purchase, the user account module 208 processes the financial transaction. In some implementations, if a licensed image is selected, the user account module 208 may require the user to checkout before proceeding to print the image on the edible media.


The edible media module 206 interacts with the image library module 202 to allow the user to identify images that are compatible with particular edible media. The edible media module 206 contains information about edible media compatible with the system. The user chooses the specific type of edible media and the edible media module 206 sends information about this edible media to the image library module 202. The image library module 202 then isolates specific images that are compatible with the particular type of edible media.


The edible media module 206 includes at least one repository (not shown) of unique codes that are associated with particular edible media. The edible media module 206 tracks whether or not a code has been used to authorize a print. The edible media module 206 interacts with the print module 212 to verify that the user is using authorized edible media using the codes. The print module 212 notifies the edible media module 206 upon receiving a purchase request, which prompts the user to enter the code from the edible media. The edible media module 206 verifies that the code is valid and that the code has not been previously used. If the code is valid, then the print module 212 proceeds with the print of the image. If the code is not valid, then the print module 212 notifies the user of the invalidity without printing the image.


The image editing module 204 is a software module that allows users to edit selected images. Example editing functions may include cropping, moving, rotating, re-touching, brightening, darkening, and adding text to images, as well as other image editing operations. The image editing module 204 interacts with the licensing module 210 to prevent users from editing images on which there are editing restrictions imposed by a license. The license module 210 informs the image editing module 204 if there are any restrictions on editing the selected image, and if so, how. The image editing module 204 then prevents the user from editing any images in violation of a license.


The user account module 208 is a software module that maintains profiles of individual users in user accounts. The user accounts include information pertaining to a number of users, such as address data, financial data, previous image usage, etc. In some embodiments, the user account module 208 maintains a list of usernames and passwords that provide or limit access to particular user accounts. The user account module 208 can process financial transactions, for example, to allow users to purchase edible media.


The user account module 208 can store purchase and order histories including selected images, designs, text content printed, notifications configured, edible media purchased, etc. The user account module 208 can also store user profiles, address data, financial data, and image restrictions.


The user account module 208 interacts with the edible media module 206 to allow the user to purchase edible media. Once the user selects the desired edible media, the user selects to purchase the edible media. The user account module 208 will then process the purchase. The user account module 208 may prompt the user for credit card information or bank account information for direct debit. Alternatively, the user account module 208 may already have this information on file. The user account module 208 will charge the user the designated amount.


In some configurations, the user account module 208 provides an option to purchase credits. The credits can be applied to a particular user account for purposes of purchasing images using the credits. The credits can be incremented when purchased by a user and decremented when the user purchases images using system 100. For example, if a user chooses to download and print a digital image, the user account module 208 can decrement the user's credits thereby providing payment, and print the requested images onto a requested edible medium.


Licensed digital images can be charged on a per use basis. Thus, if the user prints the same licensed digital image on six cupcakes, the user may be charged six credits for using the licensed digital image six times. In some implementations, the system 100 can allow printing of a licensed image multiple times on one sheet of edible media, for example, at the cost of one usage (e.g., one credit). The system 100 may allow a variable relationship between an image and the number of credits required to use the image.


In the event that the user is short on credits, the user may be prompted to purchase additional credits by using a credit card, for example. If, however, the user wishes to print non-licensed digital images, no credit charge will be transacted. Rather, the user will simply purchase any materials utilized.


In some embodiments, a selected licensed digital image can be instantaneously purchased from the central control device 132, for example, using the local control device 128 upon receiving (i) user-entered payment information and (ii) a user request for purchase of the selected licensed digital image. The payment information can, for example, allow access to an e-commerce system (e.g., within system 100) for purchasing licensed digital images using decrementable credits for printing licensed digital images. The e-commerce system can be adjustable for multiple currencies such as the U.S. Dollar, the Pound, and the Euro, just to name a few examples.


In some configurations, users can pre-purchase credits that will enable a print function to be selectable within the GUI 127, for example. The pre-purchased credits allow for users to easily access licensed content as part of a custom design and print the design in an accelerated fashion. For example, if the user pre-purchased credits, the user may have been asked to sign a licensing/usage agreement at the time of purchasing the credits. Thus, when the user performs a transaction with such credits, additional forms and/or steps are not required of the user during design and print stages.


In some implementations, the payment information includes credit card data rather than previously purchased credits. In some embodiments, the payment information includes credit card data presented for purchasing decrementable credits.


In general, the user account module 208 interacts with the image library module 202 to allow the user to purchase an image from the image library module 202. Once the user selects the desired image, the user chooses to complete the purchase. The user account module 208 will then complete the purchase. For example, the user account module 208 can verify whether the user has any available credits. If the user does have available credits, then one or more credits are debited from the user's credits and the user account module 208 authorizes the use of the image. If the user does not already have available credits, the user account module 208 may prompt the user for credit card information or bank account information for direct debit. Alternatively, the user account module 208 may already have this information and use previously stored financial information. The user account module 208 will charge the user the designated amount and authorize the use of the image to complete the purchase.


The user account module 208 allows a principal user to designate one or more secondary users. The user account module 208 interacts with the image library module 202, the license module 210, and the user location module 214 to allow the principal user to designate an authorized image list for the particular secondary user. A principal user accesses the user account module 208 and designates specific secondary users. The principal user then selects the image library module 202 and searches through the image library. The principal user designates which images are authorized for which secondary users. The principal user can also authorize different images for different secondary users. This information is generally stored in the user account module 208.


The license module 210 is a software module that includes information regarding the user's license to certain images. The license module 210 interacts with the image library module 202 and the user location module 214 to ensure that the user may only search and select for purchase authorized licensed images. The user location module 214 informs the license module 210 of the user's geographic location. The license module determines whether restrictions exist on the sales of particular images in the user's location. If restrictions exist, the license module 210 requests that the image library module 202 remove the unauthorized images from the images available to the user. In some configurations, authorized lists or pre-filtered searching options can be applied to the available licensed content such that a user is pre-approved for finding and/or downloading particular content.


The license module 210 interacts with the image editing module 204 to ensure that any licensing restrictions on images are followed. Once the user selects a particular image, the license module 210 informs the image editing module 204 if any licensing restrictions exist that prevent the user from editing the selected image. If restrictions exist, the license module 210 presents the restrictions to the user. The print module 212 is a software module that allows the user to print images using the system 100. Once the user has selected an image and is ready to print the image onto an edible media, the user selects to print the image. The print module 212 allows a user to preselect default printer model information, which can be stored within the print module 212. In some implementations, the print module 212 selects a color profile based on printer model information stored within print module 212. Alternatively, print module 212 can perform hardware communication with the printer to determine printer model information for the purposes of selecting a color profile. In another illustrative embodiment, print module 212 allows the user to select a color profile. The print module 212 provides data from the central control device 132 to the local control device 128 for printing on a printer attached to the local control device 128. In certain embodiments, the local control device 128 may print data provided by the print module 212 within a print environment provided internally by a software web browser used to navigate the website with at least one image database. In other configurations, a local control device 128 may print data provided by the print module 212 in an external printing environment provided separately from the software web browser used to navigate the website with at least one image database.


The print module 212 interacts with the edible media module 206 to verify that the user inputs a code, such as an edible media code, that corresponds to an authorized edible media. The edible media module 206 verifies that the code is valid and unused before the print module 212 proceeds with sending data to the local control device for printing.


The user location module 214 is a software module that identifies the user's geographic location. In certain implementations, this may be accomplished by comparing the user's IP address against publicly available databases. In other embodiments, the user location module 214 determines a user's geographic location from a stored user address list. For example, the user location module 508 accesses one or more user address lists to determine which users reside in a particular location. The user address list typically includes a number of users with corresponding physical mailing addresses. The user location module 508 accesses the user address lists to determine which geographic location is relevant for a particular user and provide a catalog of images having proper licensing for the determined geographic location. User address lists can be generated by a vendor or third-party and sent to individual systems (such as system 100). The secondary user address lists can be uploaded by a primary user (e.g., a store manager) using storage media or uploaded automatically over the Internet. Although detecting IP addresses and user address lists are discussed above, any available method of determining an Internet user's location may be used.


The user location module 214 interacts with the license module 210 and the image library module 202 to ensure that the user can only select and purchase images that are licensed in the geographical area. For example, if an image is licensed to be sold or used in Canada, the same image may have requirements for use in the United States. As such, the user location module 214 can use license module 210 and image library module 202 to ensure image licensing agreements are obeyed.


The user location module 214 interacts with the user account module 208 to ensure that a secondary user can only search and select for purchase images that have been authorized by a principal user. When a user selects to search for an image from the image library module 202, the user location module 214 identifies the user's location. The user location module 214 informs the user account module 208 of the user's location, so the user account module 208 can identify whether the user is a secondary user with geographic restrictions on the authorized images available to the user. In some configurations, authorized lists or pre-filtered searching options can be applied to the available licensed content such that a user is pre-approved for finding and/or downloading particular content, despite the user location falling within a geographic restriction.


The social networking module 216 is a software module that allows the user to access social networking content. For example, the social networking module 216 may inform the user which of the available images are the most popular overall, the most popular for certain genders or age groups, or the most popular for certain events, such as birthdays. The social networking module 216 may contain user or consumer reviews of certain images. The social networking module 216 may also suggest ways that images can be altered using the image editing module 204. The social networking module 216 interacts with the image library module 202 to allow the user to purchase images identified in the social networking module 216.


The augmented reality module 218 is a software module that allows the user to access augmented reality content when the system 100 detects a valid augmented reality marker. The system 100 can print images onto edible media that contain embedded augmented reality markers. The user can then display the decorated edible media to a video device. In certain configurations, this video device is a web camera. The local control device 128 sends the video data to the central control device 132. The augmented reality module 218 on the central control device 132 scans the incoming video signal, and identifies a valid augmented reality marker. The augmented reality module 218 will respond by displaying augmented reality content. For example, in certain implementations the augmented reality marker may be embedded in an image of a princess that is used to decorate a cake. The augmented reality module 218 may display a singing and dancing princess in response to recognizing the augmented reality marker. In a further example, a three-dimensional image (e.g., figurine) including an augmented reality marker may be augmented to display a portion of the three-dimensional image in animated form. In a particular illustration, the augmented reality module 218 may display an expressive, singing face upon a three-dimensional printed princess figurine in conjunction with accompanying audio.


The training module 220 is a software module that includes training content which instructs users on how to use the decorating system. The training module 220 may contain videos, lists of common questions and the answers thereto, diagrams, or any other training content that user may find useful.


The ordering module 222 is a software module that includes inventory items for a system owner (e.g., a bakery owner, store owner) to access for reordering edible media, edible ink, replacement parts, printheads, and other system supplies.


The maintenance module 224 is a software module that includes maintenance menus for updating software, hardware, or inventory. The maintenance module 224 can additionally provide troubleshooting instructions, printer maintenance features, testing functions, and cleaning functions.


The reporting module 226 is a software module that includes mechanisms for reporting on sales, inventory, customers, errors, malfunctions, and other events occurring in system 200a. In some embodiments, reporting data can be exported to comma delimited files, Excel files, or exported to particular reporting software. The reporting module 226 can additionally provide site metric reporting via NetInsight, Google analytics, or similar site metric reporting software.


The messaging module 228 is a software module that includes mechanisms for generating and sending electronic messages to users. For example, the messaging module 228 may send an electronic message to specific user accounts or groups of user accounts based on previous purchases. The messaging module 228 may send system users receipts or other billing information in the form of a message. The messaging module 228 may also send advertising content or fliers to known users. In some configurations, the messaging module 228 sends messages to system managers or store managers regarding system updates or image updates.


Security module 230 is a software module that handles secure socket connections from local control device 128. For example, following authentication through login procedures through a software web browser, central control device 132 can establish additional secure connections to the same local control device 128 with software modules separate from the software web browser. Functionality not incorporated into the software web browser on local control device 128 can interact with the software modules on central control device 132 through security module 230. Interaction with software modules on central control device 132 can proceed through multiple software applications on local control device 128. In certain implementations, security module 230 handles secure transmission of both licensed image data and financial data for purchases of licensed images. In other illustrative implementations, security module 230 handles secure transmission of financial data for purchases of licensed images, but does not apply security policies to licensed image data. In certain embodiments, HTTP (hypertext transfer protocol) can be used for transmitting payment and/or image data, such as in the form of unsecured HTTPS or secured HTTPS. In other embodiments, FTP (file transfer protocol) can be used for transmitting payment and/or image data. Alternatively, SMTP (simple mail transfer protocol) can be used for data transfer.


A computational module 232, in some implementations, is a software module that can perform computations for modeling and printing the 3D edible media. In an example, the computational module 232 can compute a finite element model in order to determine the center of mass 162 and stability of the 3D edible media 160 as shown in FIGS. 1B-1E. In an example, the computational module 232 can compute structural mechanics in order to determine the center of mass 162 and stability of the 3D edible media 160 as shown in FIGS. 1B-1E. In an example, the computational module 232 can compute a set of equations based on mechanical statics and dynamics in order to determine an interoperability of a 3D edible media 160 divided into multiple parts or two or more 3D edible media 160. In an aspect, the 3D edible media 160 can be configured to divide into multiple parts, or the one or more 3D edible media 160 can be configured to interact, based on an event such as melting, cutting, or breaking, of a part of the 3D edible media 160. In one example, a candle can be configured to melt a part of the 3D edible media 160 and create an event.


In an aspect each edible media material has a known density. In an aspect the computational module 232 can determine the center of mass 162 of the 3D edible media 160 based on the density of the edible media material. In an aspect the computational module 232 can determine a suitable base 170 and attachment features 172 for the 3D edible media 160 to prevent from dislocation or tipping. In an example, the computational module 232 can determine a base 170 with a set of attachment features 172 to compensate for the center of mass. In an aspect, the computational module 232 can determine one or more edible media materials to print the 3D edible media 160 such that it can have a center of mass to prevent tipping or other unplanned movement. In an aspect the computational module 232 can determine one or more edible media materials to print the 3D edible media 160 such that it can have a center of mass to result in a planned movement.


In some implementations, the computational module 232 can use a 3D scan or digital data of the shape and appearance of the food product 150 or other two or three dimensional element presented upon an edible media (e.g., frosting sheet, cake top, etc.) to determine a feature of the 3D edible media 160. In some embodiments, the computational module 232 identifies the location of a three dimensional element and decorates the three-dimensional element. In a first example, the 3D printer may first print a three-dimensional element (e.g., a frosting fish) and then later add decorative elements to the three-dimensional element (e.g., airbrush edible ink onto the frosting fish), In a second example, the computational module 232 may identify placement of an off-the-shelf three dimensional element positioned on the edible substrate by a user, and alter the appearance of the off-the shelf-three dimensional element using one or more printheads and/or other features of the 3D printer (e.g., airbrush tool, reductive modeling tool, etc.) to customize the appearance of the off-the-shelf three dimensional element. The customizations, for example, may be based upon user instructions supplied to the 3D printer. In a particular illustration, the computational module 232 may identify the position of a three-dimensional edible figurine and modify the figurine to conform to image data provided by the user matching or mimicking the supplied image data (e.g., by adding facial features, hair, etc. a figurine of the birthday girl created from an off-the-shelf avatar). In some examples, the computational module 232 may identify the off-the-shelf three dimensional element based in part upon one or more of a three-dimensional shape, a color, or a marking (e.g., barcode, QR code) on the off-the-shelf three dimensional element.


Additional modules 234 can be included in system 200a. For example, service oriented third party applications can be merged or supplied as add-ins as appropriate. Similarly, online advertising content, Internet access, FLASH applications, database management, online shopping, and other services may be offered in system 200a.


Local Control Device Software Modules


FIG. 2B is an example computer system 200b containing examples of software modules used in a system for decorating edible media. The system 200b can, for example, be analogous to local control device 128 (FIG. 1A). A user of the system 200b accesses a website on the central control device 132 to gain access to one or more software modules 202-234 (FIG. 2A).


The software modules on local control device 128 include authentication modules 240, parallel connection modules 242, parallel browser modules 244, color management modules 246, and/or printer communication modules 248. Additional modules 250 are possible. The described software modules can be selectively combined to form a multifunctional software module, or split into multiple software modules.


The authentication module 240 interacts with the parallel connection module 242. Upon successful verification of an authenticated session between the software web browser on local control device 128 and central control device 132 via network 118, the authentication module 240 causes parallel connection module 242 to establish a second connection to central control device 132 in parallel to the connection used by the software web browser on local control device 128. In some implementations, the parallel connection is established automatically after authentication of a secure connection for the software web browser by authentication module 240. In other embodiments, the second connection is established based on user request. The parallel connection module 242 connects with the security module 230 shown in FIG. 2A. In certain implementations, parallel connection module 242 may utilize the connection created by the software web browser for communication with central control device 132.


In certain configurations, the second connection occurs over the network 118 used by the software web browser. In other implementations, the second connection occurs over a network different from network 118. The connection established by the parallel connection module 242 can use identical networking protocols or encryption protocols to the connection utilized by the software web browser, or can use a different networking and/or encryption protocols.


In some embodiments, the second connection persists despite the initial connection between the software web browser on local control device 128 and central control device 132 being terminated. In other configurations, the second connection terminates concurrently with termination of the first connection between the software web browser on local control device 128 and the central control device 132.


The parallel connection module 242 interacts with parallel browser module 244. Parallel browser module 244 utilizes the secure socket connection with central control device 132 over the second connection created by the parallel connection module 242. Access to software modules on central control device 132, including the image library 202, are accessible to the parallel browser module 244 concurrently with accessibility from the software web browser on local control device 128. In certain implementations, the software web browser on local control device 128 is a generic web browser. The software web browser on central control device 132 can be implemented as 3.sup.rd party software, with closed, proprietary, or undocumented application programming interfaces, and/or security profiles that deny access to system functions including local file system access or low level printer control commands. In other embodiments, the software web browser on local control device 128 provides a documented application programming interface (API) for the software web browser to interact with other software installed on local control device 128. Parallel browser module 244 can co-exist on local control device 128 with either implementation of software web browser on local control device 128.


In certain configurations, parallel browser module 244 provides a streamlined user-interface for accessing software modules residing on central control device 132. The parallel browser module 244 can be implemented in a variety of programming languages or development environments. In certain implementations, the parallel browser module can be implemented as an Adobe Integrated Runtime (AIR) application. In the AIR application, the parallel browser module 244 acts as a cross-platform, browser-based runtime application. In other embodiments, parallel browser module can be implemented in C++ using Qt libraries. In the C++/Qt framework implementation, the parallel browser module 244 acts as a web-enabled cross-platform application and UI framework with access to system functions, such as the local file system.


The parallel browser module 244 is implemented as a Rich Internet Application, providing both local file system access and remote web content access. For example, remote web content including but not limited to thumbnail representations of licensed images from image library module 202 can be downloaded by parallel browser module 244 and stored in a local cache residing on the local file system of local control device 128, providing low latency rendering of images during image manipulation events including browsing and editing. In other embodiments, the parallel browser module 244 is implemented in a software package complying with security policies that permit remote web content access, but not local file system access, or vice versa. Local cache contents are in a custom format that prevents users from extracting local cache contents for unauthorized editing and/or printing of cached licensed images.


The parallel browser module 244 on local control device 128 exchanges data with central control device 132 over the same network connection established by the software web browser. In select implementations, the software web browser utilized an unsecured connection such as HTTP (Hypertext Transfer Protocol). The software web browser utilizes a secured connection such as HTTPS (HTTP with secure socket layer (SSL)/transport layer security (TLS)), performing security procedures including but not limited to server authentication, client authentication, and secure encryption key exchange.


The parallel browser module 244 on local control device 128 exchanges data with central control device 132 over a network connection different than the network connection established by the software web browser. The separate connection established by the parallel browser module 244 can either be secured or unsecured, independent of if the software web browser connection is secured or unsecured.


The parallel browser module 244 is capable of sending and receiving separate classes of data on different connections and/or different connection security profiles. For example, image data from image library module 202 may be received by the parallel browser module 244 over an unsecure HTTP connection between the parallel browser module 244 and the central control device 132, while financial data may be sent from the local control device 128 to central control device 132 over a secure connection established by the software web browser. In another example, embodiment, both image data and financial data may be sent over a secure connection established by either the software web browser or the parallel browser module 244.


Parallel browser module 244 bypasses existing print drivers provided by the operating system when printing. When bypassing operating system print drivers, parallel browser module 244 interacts with a color management module 246. The color management module 246 provides color matching and correction to print data provided by print module 212 on central control device 132. Color encoding on print data propagating from print module 212 may be indexed by a color representation scheme as known in the art.


In certain configurations, the color representation scheme is as described by the International Color Consortium (ICC). The ICC specification uses the CIE color profile and is widely used and is referred to in many International and other de-facto standards, and was approved as an International Standard, ISO 15076-1, which is incorporated herein by reference. A standardized color representation scheme such as the ISO 15076-1 ensures color rendition accuracy despite variations in color detection and production across image capture devices (e.g., scanners), image display devices (e.g., monitors), and image reproduction devices (e.g., printers). Color management module 246 provides a color managed workflow from source image to printer output, applying color representation transformations that ensure accurate color representation in each color domain. The general principles of color managed workflows using the ICC Color management Model have been described variously, for example in U.S. Pat. No. 7,161,710 to MacLoed, et al., assigned to Adobe Systems Incorporated, which is incorporated herein by reference.


In some implementations, color profile information is embedded in the image provided by the print module 212. In other embodiments, color profile information is retrieved separately from the image data provided by the print module 212. In certain configurations, a separate image color profile for the display device connected to the local control device 128 is applied to the retrieved image. In other implementations, the display device connected to local control device 128 is not color corrected using any color profile.


Application of color correction to print devices is independent of application of color correction to display devices. In certain embodiments, a user can automatically retrieve the corresponding color profile for a printing device connected to local control device 128 based on hardware model information for printer 134. In other cases, the user can provide their own color profile based on color spectrography measurements performed on printed outputs of printer 134.


The color management module 246 interacts with a printer communication module 248. The printer communication module 248 provides communication to a printer device connected to local control device 128 without utilizing printer drivers installed on the operating system on local control device 128. In certain configurations, printer communication module 248 automatically detects the model number of the attached printer 134, and downloads corresponding software through the second connection established by parallel connection module 242. In other implementations, printer communication module 248 includes pre-installed software for several different print hardware manufacturers and/or vendors. In further embodiments, printer communication capabilities provided by the printer communication module 248 are not dependent on specific cartridge reservoirs utilized by the printer.


Parallel web browser module 244 is associated with network address identification information. In certain embodiments, network address identification information allows modules residing on the local control device 128 to interact with one another without networks external to the local control device 128, such as a LAN, MAN, or the Internet. In other embodiments, network address identification information only allows modules residing on the local control device 128 to interact with one another through an external network connection, with or without messages passing through the central control device 132.


Parallel web browser module 244 and the software web browser on the local control device 128 communicate with a pre-defined message format and message exchange patterns. In an illustrative embodiment, the Simple Open Access Protocol (SOAP) is utilized. Alternatives communication schemes for exchanging complex data structures include but are not limited to Extensible Markup Language-Remote Procedure Call (XML-RPC).


Additional modules 250 can be included in system 200b. For example, media players, advertising displays, and other services may be offered in system 200b.


Account Management

User accounts can be managed by an administrator (e.g., a bakery or store owner). The administrator typically configures an administrative profile where administrative tasks can be carried out. For example, the system owner can log in to an administrative profile for configuring the system 100, reviewing inventory reports, and purchasing consumables. The administrative profile can also include options to create additional user accounts, update or modify users or passwords, generate contact lists, browse and order consumables, view order or purchase histories, modify language parameters (e.g., Spanish, English, Mandarin, French, etc.), manage licensed image assets, edit pricing, etc.


Web Host Server

A web host server within central control device 132 is configured by the administrator to allow users to select particular edible items, select customization options, and preview designed products before printing. The administrator can add or remove User Interface controls 120 to provide or remove functionality in the GUI 127. For example, the administrator can modify a User Interface within the web host server to ensure all design modification buttons are presented in one interface. This can provide the advantage of allowing the user to quickly modify designs without having to move through multiple screens.


In one example, the web host server includes updatable links with (i) helpful hints and exceptional cake design examples, (ii) how-to instructions, (iii) frequently asked questions, (iv) tips and tricks from other users, and (v) online demonstration videos, just to name a few example links. In some configurations, a full help section is integrated into the system including tool tips, videos, etc.


In some implementations, the web host server includes notification and messaging functionality. For example, the web host server may include calendar integration options complete with scheduling and reminder notifications for particular holidays, birthdays, etc. The notification functionality can also include customized templates or projects which can be attached to the notifications. For example, if a company provides customized birthday cakes for all employees, the company can create a birthday template coupled to each employee's birthday date in a reminder notification. The notifications can be configured to email a customer, for example, in advance of an event requiring configuration of an edible media item.


In some embodiments, the web host server includes advanced browsing options with predictive text and faceted search filters. As such, a customer can easily navigate images and enter text in an expedited fashion. The web host server is operable to attach metadata or categorical information to particular images, frames, characters, or reminders to facilitate users in improving design time for preparing an image for printing.


Website Content

The websites hosted in system 100 can include menus, buttons, and other controls. The websites generally include standard website content such as contact information, privacy policies, warranty information, a site map, advertising content, social media content, and licensing information. Other content may be provided in websites hosted in the system 100.


Image Manipulation

The systems disclosed herein can provide image manipulation functions. Image manipulation functions can be performed in the GUI 127 in a mocked up on-screen version of the final product. Users can modify image media, backgrounds, frames, and text within the system 100. Functions for modifying and editing images include, but are not limited to color skewing, cropping, zooming, rotating, conversion to black/white or grayscale, and filtering. Images can be previewed, stretched, scaled, skewed, or otherwise manipulated in a Graphical User Interface 127 to obtain a desired result for the user. Text can be added, removed, or otherwise modified. For example, text can be arced for a round design or angled for special effects. Text can be entered by a user or selected from a list of standard common phrases such as Happy Birthday, Congratulations, or Happy Anniversary, to name a few examples. In some configurations, watermarks can be added graphically and printed onto the edible media.


In an example, the image manipulation functions performed in the GUI 127 can be configured for 3D printing. In an example, the image media is a 3D media. In an example, each 3D media can have an expected center of mass 162 and a corresponding suggested base 170 or suggested attachment features 172 based on the edible materials and edible inks. In an aspect, the image manipulation functions performed in the GUI 127 can be based on the computational module 232. In one example, when the 3D media is manipulated, the computational module 232 can automatically suggest one or more combinations of edible materials that can be used to make the 3D edible media 160 based on the 3D media such that the center of mass 162 of the 3D edible media 160 would be within a tolerance to prevent tipping. In an example, the tolerance can be provided by a computation done by the computational module 232.


In one example, when the 3D media is manipulated, the computational module 232 can automatically suggest or determine a design for the base 170, as shown in FIGS. 1D-1E, to compensate for the center of mass 162 of the 3D edible media 160 within the tolerance to prevent tipping. In one example, when the 3D media is manipulated, the computational module 232 can automatically suggest or determine a design for the attachment features 172, as shown in FIG. 1E, such that a combined center of mass of the 3D edible media 160 and the base 170 would be within the tolerance to prevent tipping.


Media Authentication

The systems disclosed herein can provide media authentication for licensed images. For example, the system 100 validates particular licensed images for printing based on user information, image information, and/or product information. The system 100 provides an inventory system with trackable records. Each trackable record contains information regarding unique lot numbers assigned to each image to ensure image disclosures can be accounted for. Each trackable record can additionally contain quantity information for a product and media type compatible with such a product. Trackable records can be linked to user logs to determine customer accounts that activated particular products or images. This can be used to track lot numbers for recall purposes, for example. In some implementations, the trackable records can be used as an advertising tool to market to one or more specific customer.


In some embodiments, the system 100 prevents unauthorized usage of licensed images by preventing the system and/or user from locally saving a licensed image. In addition, the system 100 prevents unauthorized usage of licensed images by preventing the user from accessing a particular licensed image more than once in one session, for example. Other mechanisms of preventing unauthorized usage of licensed images can be implemented. Low level image processing, such as applying ICC color management, can still occur in the presence of the above mechanisms for preventing unauthorized image usage.


Checkout

Upon determining one or more items for purchase, users can choose to checkout and purchase such items. The checkout process generally leverages standard e-commerce functionality using application programming interfaces (APIs) for performing transactions. The APIs can integrate functionality such as shopping carts, shipping options, order preview, order confirmation, payment options, add/remove functions, etc. The checkout process guides the user through transactions. In some configurations, the checkout process can additionally manage reporting and accounting functions.


Process for Ordering Edible Media


FIG. 3 is an example swim lane diagram of a process 300 for ordering edible media. The process 300 can, for example, be performed in the online environment in system 100. Although the process 300 is described with reference to system 100, other systems, environments, or processors can perform the steps in process 300.


The online environment in system 100 may represent a website hosting one or more software modules. Software modules in this example include an edible media module 301 and a user account module 302. The edible media module 301 is a software module that includes information about edible media that is available for purchase, including current availability and inventory statistics. The user account module 302 is a software module that includes user accounts having profiles of information regarding particular users, such as financial information and address information. The user account module 302 can be configured to process financial transactions.


The user accesses a User Interface element in the website, such as GUI 127 to access the user account module 302. The user account module 302 presents a logon screen to the user and requests entry of a username and password. The user inputs the username and password to login (303) and the user is logged into the system 100. In certain illustrative embodiments, in the event that the user forgets login credentials, an additional prompt permits the user to input identification information, such as the answer to a preselected security question, a PIN, or an e-mail address, to authenticate the user's request either to reset login credentials, or request secure delivery of login credentials.


The username and password may or may not be secure when sent from the software web browser to central control device 132. For example, the username/password may be encapsulated in TCP/IP packets as unencrypted plain text. Alternatively, username and password information may be secured over SSL/TLS.


The user account module 302 displays navigation menus (304). The navigation menus include a number of options representing different ways that the user may use the system 100. Options can include, but are not limited to quick launch items (e.g., quick copy, quick upload, quick print, etc.), photograph manipulation options, framing configuration options, artwork selection and manipulation options, purchasing options (e.g., enter media codes, user data, etc.), ordering options (e.g., pre-order forms), PhotoCake configuring options, settings options, and administrative options (e.g., shut down, restart, test system, etc.). The user can also choose to open a prior design to print copies on new edible media. Other options are possible.


The edible media module 301 provides an option to select to search for edible media (305). For example, the edible media module 301 offers the user the option of searching for specific edible media or browsing through a catalogue of edible media. The user navigates through the catalogue (306) and selects the edible media that the user wishes to purchase (307). In some implementations, the user is provided an option to select multiple types of edible media in a single purchase. When the user has selected the desired edible media, the user instructs the user account module 302 that the user is ready to complete the purchase (308). The user is directed to the user account module 302, which processes the purchase of the edible media.


The user account module 302 prompts the user to enter the user's financial information (309). The user may enter credit card information or bank account information for direct debit. In certain embodiments, the user account module 302 may store the user's financial information. The user has the option of using previously used financial information that is remembered by the user account module 302. In an illustrative embodiment, the user is presented with a screen to allow verification of purchase details before finalizing a purchase. The user account module 302 then completes the purchase (310) by charging the user according to the information that has been entered. In certain embodiments, the user has agreement terms that do not require purchase procedures to be executed for each individual image, and instead, purchase procedures are applied to a batch of images periodically, such as at monthly billing cycle.


In some configurations, the user account module 302 provides an option for shipping purchased edible media to the user. The user account module 302 may request additional information, such as an address the edible media should be sent to, or which shipping method the user prefers. Alternatively, the user account module 302 may retain previously used address information, in which case the user may choose to use previously stored information. The user completes the process 300 by logging off of the system 100 (312).


Process for Establishing Secondary User Authorization


FIG. 4 is an example swim lane diagram of a process 400 for a principal user to authorize secondary users and designate authorized images for the secondary users. The process 400 can, for example, be performed in the online environment in system 100. Although the process 400 is described with reference to system 100, other systems, environments, or processors can perform the steps in process 400.


The online environment includes an Internet website hosting a user account module 401 and an image library module 402. The user account module 401 is a software module that includes user accounts containing profiles of information regarding particular users. The image library module 402 is a software module containing a searchable and browsable library of images.


The principal user accesses the user account module 401 and logs in to the principal user's account (403) by entering the principal user's username and password. The principal user is shown a navigation menu containing a number of selectable options (404).


The principal user selects to designate secondary users (405). The principal user is then prompted for information regarding the secondary users and how such secondary users will be identified (406). For example, the principal user may be asked to enter unique usernames and passwords for secondary users. Alternatively, the principal user may enter email or physical address information for the secondary users. The secondary users may be sent instructions on how to access their new secondary user accounts. The user account module 401 saves the information given on the secondary users, and associates the secondary user accounts with the principal user's account.


The image library module 402 allows the principal user to search for authorized images for the secondary users (407). The principal user searches or browses through available images, using keyword criteria such as “Princess” or “Birthday.” The principal user selects images, or groups or categories of images, that will be authorized for the secondary users and the image library module 402 receives the selections (408).


Once the principal user has finished searching through the images and selecting images, the principal user selects to associate particular images and the user account module 401 associates the selected images with the particular secondary users (409).


The user account module 401 displays the designated secondary users, and the principal user associates the selected images, groups or images, or categories of images with specific users (409). The principal user designates different authorized images for users in different geographic locations and/or authorized lists. The principal user can subsequently log off of the system 100 (410).


Process for Decorating an Edible Medium


FIGS. 5A-5D depict an example swim lane diagram of a process 500 for decorating an edible medium. The process 500 can be performed by system 100, for example, in the online environment in system 100. Although the process 500 is described with reference to system 100, other systems, environments, or processors can perform the steps in process 500. In other implementations, the process 500 for decorating an edible medium may include fewer or more events than shown in FIGS. 5A-5D.


Referring now to FIG. 5A, an Internet website includes a number of modules 501-509. An edible media module 501 is a software module that includes information about which edible media are compatible with the system 100 and characteristics of the individual types of edible media. The edible media module 501 includes a database of unique codes and information on whether or not the particular codes have been used or not.


A user account module 502 is a software module that includes profiles of information regarding particular users. The user account module 502 allows or disallows users to login to user accounts using a username and a password. The user account module 502 also stores financial information and address information about the user and processes financial transactions.


A license module 503 is a software module that includes information about system licensing to certain images. System licensing information may include data identifying where particular images can be sold by geographic location and if and/or how the images may be edited.


An image library module 504 is a software module that includes a searchable and browsable library of images. The image library module 504 also allows the user to upload images from local image sources to use in the system.


An image editing module 505 is a software module that allows a user to edit images. A print module 506 is a software module that provides data to a local control device 128 for printing of selected images onto edible media using a specific color profile for a particular printer. A training module 507 is a software module that includes training content that instructs users to use the system 100. A user location module 508 is a software module that identifies the geographic location of the user. The user location module 508 can ensure that licensing restrictions are obeyed. In addition, the user location module 508 can allow principal users to control which images are offered for sale to secondary users in certain geographic zones. A social networking module 509 is a software module that allows a user to access social networking content and resources.


In operation, the user inserts an edible media into the printer. The user accesses the user account module 502 using the GUI 127 and logs into the user's account (510) by entering the user's unique username and password. The system 100 displays a menu containing a number of navigation options (511).


The user selects the training module 507 to learn how to use the system to decorate edible media (512). The training content may be any content that aids the user in using the system 100. In certain embodiments, the training module 507 may contain video demonstrations, written instructions, and lists of common questions and answers. The user selects the training content for viewing (513) and the training module 507 presents the selected training content to the user (514).


After viewing the training content, the user can choose an image to use to decorate an edible media (515). The user can additionally select an image source. The user may choose a local image source, an online image source, or the image library in the image library module 504, for example. In this example, the user selects the image library as the image source (516).


The system 100 accesses the user location module 508 and determines the geographic location of the user (517). In certain configurations, the user location module 508 determines the geographic location by looking up the user's IP address and associating the user's IP address with a geographic location. Other methods of determining the user's geographic location may be used.


After the user's geographic location is determined (517), the system 100 accesses the license module 503 and determines whether any licensing restrictions exist for the selected images in the user's geographic location (518). For example, the system 100 may determine the user's physical address from an authorization list and verifies whether any licensing restrictions exist. If licensing restrictions exist for the user's geographic location, the system 100 narrows the number of images provided to the user.


If licensing restrictions do not exist for the user or the user's geographic location and/or the user is on an authorized list, the system 100 can provide the user with all licensed images. The system 100 can additionally provide free images, non-copyright images, or third party designed images.


Referring now to FIG. 5B, upon determining whether licensing restrictions exist, the license module 503 informs the image library module 504 whether any of the images are restricted and/or are on an authorized list that can override restrictions, such as restrictions based on the user's location (519). The system 100 identifies whether there are any restrictions from the user account module 502 on the images that the particular user is authorized to purchase (520). For example, the particular user may be a secondary user, in which case a principal user may have previously instructed the system 100 which images the secondary user is authorized to purchase. If the particular user has restrictions on which images the user is authorized to purchase, the user account module 502 sends the list of authorized images to the image library module 504 (521).


The image library module 504 receives information on which images are available to the particular user from both the user account module 502 and the license module 503. The image library module 504 restricts access to unauthorized images from the library of image options available to the user (522). The image library module 504 displays to the user a searchable and browsable library of images available to the user for purchase or use (523). The user may search through the images, using word searching, or alternatively by browsing through image categories and viewing all images in a category.


The edible media module 501 displays a list of the edible media that may be used with the system 100 (524). The image library module 504 then displays the images that are authorized for the user to purchase (523) and that are compatible with the edible media that the user is decorating (525). The user selects from the list of edible media the type of edible media that is being decorated (526). Examples of options for edible media include but are not limited to standard media with sizes of ½, ¼, and ⅛ sheet, or precut media of sizes 8 inch round, 3 inch round, or 2 inch round, or Designer Prints.


In some implementations, the user can choose to access the social networking module 509 to aid the user in choosing an image. The social networking module 509 can be used in a number of ways. For example, the social networking module 509 may inform the user which of the available images are the most popular overall, the most popular for certain genders or age groups, or the most popular for certain events, such as birthdays, holidays, or other events. The social networking module 509 may include user or consumer reviews of certain images. The social networking module 509 can suggest ways that images can be altered using the image editing module 505.


Referring now to FIG. 5C, the user can request to view one or more libraries of images. The image library module 504 displays at least one searchable library of authorized images for the user-selected media type (527). In an example of 3D images, the image library module 504 can display a GUI presentation of only the 3D elements and customization of the 3D elements, such as size, color, features that can be merged with user data for a personalized birthday kid (e.g., figurine, etc.), that are compatible with the target printing system. In an example, the image library module 504 can display a rotating or animating presentation of the 3D images (e.g., Graphics Interchange Format or GIF).


The user selects to view social networking options (528) and selects a social networking option to view the social networking content (529).


The user selects an image (530) and instructs the system that the user wishes to purchase the image (531). In an example, the user selects an image (530) and instructs the system that the user wishes to purchase the image (531) by dragging and dropping placement of the image, which can include the grouping of a set of 3D elements such as the set of individual characters (e.g., set of cartoon characters from popular feature film).


The user account module 502 checks to see whether the user has sufficient credit to purchase the image (532). If the user does not have sufficient credit, the user has the option of purchasing more credit (533). The user is prompted to enter financial information, such as a credit card to be charged or a bank account for direct debit. Alternatively, the user may choose to use previously-entered financial information stored in the user's account in the user account module 502. In some embodiments, the user may enter address information and request an invoice of a printing/purchasing transaction. In the event that the user has sufficient credit, the user is asked to confirm the purchase. Upon confirmation by the user, the purchase is completed and the credit is deducted from the user's account (534).


In some configurations, the user may choose to edit the purchased image (535). Editing a purchased image can be performed using the image editing module 505. Referring now to FIG. 5D, the image editing module 505 verifies with the license module 503 that the user is authorized to modify the image. The verification identifies restrictions on editing particular images (536). If a license does not prevent the image from being altered, then the user makes desired edits to the image (537). The user may be able to crop, rotate, resize, brighten, darken, re-touch, and perform other operations to the selected image. In certain embodiments, the user can save the edited image for later use or continued editing.


The user selects to print the image (538). The print module 506 prepares print data and the edible media module 501 prompts the user to enter a code (539). The user can find the code (e.g., edible media code) in a location on the edible media, or on the packaging and documentation sent to the user with the edible media.


The user inputs the edible media code (540). The edible media module 501 verifies that the inputted code is valid and that the code has not been previously used (541).


The user is prompted to input a printer type for use in printing on the edible media (542). The image library module 504 stores different versions of the same image that are compatible with different printer color profiles. The print module 506 ensures that an image compatible with the color profile of each selected printer is sent to local control device 128.


Once the printer information is input, the print module 506 provides the user the option of viewing a preview of the image printed onto the selected edible media. If the user wishes to see a preview, then the image is displayed to the user (543). If the user declines, or once the preview has been shown, then the user is asked to confirm the generation of print data. Once the user confirms the print, the print information is sent to the local control device 128, for printing onto an edible media (544). Upon completion of the printing process, the user selects to log off the system 100 (545). Alternatively, the user can remain logged on to process additional images to print.


At any point, the user can choose to clear a design in progress or reset the design in progress to a previous state. This option provides the user an efficient mechanism to remove mistakes or simply begin a new design.


Process for Viewing Augmented Reality Content


FIG. 6 is a flowchart diagram of a process 600 for viewing augmented reality content using the system 100. Although the process 600 is described with reference to system 100, other systems, environments, or processors can perform the steps in process 600. The system of FIG. 1A may be used to print an image containing an embedded augmented reality marker onto an edible media (601). The user can use the image with the embedded augmented reality marker to access augmented reality content.


The embedded augmented reality marker may be any asymmetrical geometric shape with at least two colors, of sufficiently high contrast to allow the augmented reality marker to be recognized when scanning image frames within a video signal. The augmented reality marker shape is not required to be related to the augmented reality content, but can be any geometric and asymmetrical shape.


The augmented reality content may be any content that combines reality with virtual reality. For example, the augmented reality marker may be embedded in an image of a popular cultural figure or may be the figure itself. The augmented reality content shown to the user could be a display of the cultural figure from the image singing and dancing on the GUI 127. In another example, the augmented reality content could be the opportunity to purchase items related to the image, which are otherwise unavailable for purchase.


In another example, the augmented reality content can be a virtual image that is projected on the food product, the edible media, and/or the edible ink. In an aspect, the projector projects different parts of the virtual image based on detection of the augmented reality marker with respect to the food product, the edible media, and the edible ink. In an example the projector projects different parts of the virtual image based on the augmented reality marker on the 3D edible media 160. For example, the projector can project a first part of the virtual image as a background on the food product and a second part of the virtual image as a two-dimensional or three-dimensional animation on a surface of the 3D edible media. In a particular example, the projector may project a koi fish swimming and jumping in a printed edible media pond.


The system 100 prints an image with an embedded augmented reality marker onto an edible media (601). For example, the printing can be performed using the process 500 of FIG. 5. After printing the image with an embedded augmented reality marker onto the edible media, the system 100 accesses the augmented reality module 218 on the website (602). In certain implementations, the user enters a web address into the web browser of the local control device 128 and selects the augmented reality module 218.


The user identifies the video device (603). For example, the user instructs the augmented reality module 218 of the source of the incoming video signal. The augmented reality module 218 prompts the user to enter a specific video device location. The augmented reality module 218 may communicate with the local control device 128 to determine which video devices are installed for use on the local control device 128. In some embodiments, the augmented reality module 218 can display to the user a list of possible video devices for the user to select a particular device. The user selects a video device.


The augmented reality module 218 scans incoming video signal (604). The augmented reality module 218 scans the incoming video signal to detect the video signal for a valid augmented reality marker.


The user displays the edible media containing the augmented reality marker to the video device (605). The video device thus captures video footage of the augmented reality marker and sends the video signal to the augmented reality module 218 on the system controller.


The augmented reality module 218 recognizes the augmented reality marker (606). The augmented reality module 218 can continually or periodically scan incoming video data to detect other valid augmented reality markers. When the user displays an edible media with an augmented reality marker printed upon the media to the video device, the augmented reality module 218 recognizes the marker in the incoming video signal. The augmented reality module 218 responds to the user by displaying augmented reality content (607). In an illustrative embodiment, augmented reality content transmitted over network 118 is displayed on the local control device 128.


Process for Decorating Edible Media with Licensed Digital Image


FIG. 7 is a flow diagram of a process 700 for decorating edible media with licensed digital images. The process 700 can be performed by system 100, for example, in the online environment in system 100.


The system 100 includes a printing system connected to the Internet which receives an edible medium (701). The edible medium may be selected by the user and placed within the system 100, for example.


The system 100 receives a first user input identifying a user of the system (702). For example, a user logs into the system using a username and password. The system 100 determines whether the user is a registered user or a new user (703).


The system 100 receives a second user input selecting at least one licensed image (704). For example, a user enters a request to select a copyrighted cartoon character for printing on a cake top. In some configurations, the system 100 can limit the available licensed images shown to the user according to the user's geographic location and/or authorization list. The system 100 retrieves the at least one licensed image from an Internet repository (705). Upon retrieving the licensed image of the copyrighted cartoon character, the system 100 generates an invoice for the user if the user is a registered user (706). If the user is an unregistered user or a new user, the system 100 requests payment information to ensure the licensed image is purchased before printing occurs (706). Upon verifying payment, the system 100 prints the selected licensed image onto the selected edible medium (707). In an example, the system 100 prints a 3D edible media 160 based on the selected licensed image. In some implementations, the system 100 enables the user to digitally edit the selected image prior to printing the selected image onto the edible medium.


Process for Printing Selected Image in Software Web Browser


FIG. 8A is a flow diagram of a process 800a for printing a selected image in a software web browser. The process 800a can be performed by system 100, for example, in the online environment in system 100.


The system 100 receives a print selected image request (801). Either licensed or unlicensed images can be printed using the process 800a.


The print module 212 checks the source of the incoming print request (802). In this example, the source is identified as the software web browser. In certain embodiments, the print module 212 checks the source by evaluating identifier packets within a data stream. In other configurations, the print module 212 recognizes network addresses to identify source applications for a particular data packet.


Upon identifying the source of the print request, print module 212 forwards print data over the corresponding secure connection. In this example, print data is forwarded over the secure connection between the software web browser on the local control device 128 and the central control device 132 in system 100 (803).


After the software web browser receives print data from print module 212 over a secure connection, the software web browser invokes an internal print environment (804).


Based on the software web browser's internal print environment, a particular print driver installed within the operating system on local control device 128 is invoked by the software web browser (805). In various implementations, the print driver is implemented by a vendor or manufacturer of the printer, in some cases using proprietary or not publicly documented code.


The invoked print driver generates a byte stream compatible with the target printer 134, and queues the print task in the operating system's printer spooler (806). For example, at 600 vertical dpi (dots per inch), 600 horizontal dpi, 8.5 by 11 inches, 4 colors, and 8 bits per color, a 134 Megabyte raw byte stream is created. In certain embodiments, the software web browser's internal print service and the print driver installed on the operating system are based on proprietary or non-documented code. In other configurations, certain elements of the software web browser's internal print service or the print driver installed on the operating system provide an open or documented interface, allowing print data propagated from print module 212 to be modified prior to being delivered to the operating system printer spooler.


The operating system's printer spooler queues print tasks for the particular printer hardware. The operating system can queue multiple print jobs in the spooler while the printer executes tasks on the queue at a throughput dependent on printing configuration and hardware technology. The printer eventually processes the print corresponding to the requested image (807). In certain implementations, tasks within the spooler can be rearranged such that the print request corresponding to (801) may be processed out of first in first out order.


Process for Printing Selected Image in Parallel Browser Module


FIG. 8B is a flow diagram of a process 800b for printing a selected image in parallel browser module 244. The process 800b can be performed by system 100, for example, in the online environment in system 100.


The system 100 receives a print selected image request (810). Either licensed or unlicensed images can be printed using the process 800b.


The print module 212 checks the source of the incoming print request. In this example, the source is identified as the parallel browser module 244 (811). In certain embodiments, the print module 212 checks the source by evaluating identifier packets within a data stream. In other configurations, the print module 212 recognizes network addresses to identify source applications for a particular data packet.


Upon identifying the source of the print request, print module 212 forwards print data over the corresponding secure connection. In this example, the print module 212 forwards print data over the secure connection between the parallel browser module 244 on the local control device 128 and the central control device 132 in system 100 (812).


After the parallel browser module 244 receives print data from print module 212 over a secure connection, the parallel browser module 244 bypasses the operating system's printer drivers (813) and forwards print data to the color management module 246 (814). The color management module 246 applies color correction by converting from the color profile of the image to the color profile of the particular printing device in order to maintain color consistency. In certain implementations, color management module 246 also provides color space conversion, such as between CMYK and RGB, as necessary, and converts to the bit depth required by the printer, such as 8 bits or 16 bits. In some embodiments, color management module 246 also performs linearization and half tone control to improve image reproduction. In an illustrative embodiment, color management module 246 does not entirely rely on operating system color management functions, resulting in an installation independent framework for color management. Color management functions may be implemented in an open source implementation, such as the Little Color Management System (LCMS), or in a proprietary implementation, such as EFI's Colorproof XF software.


Color corrected print data is propagated to printer communication module 248. The printer communication module 248 creates a byte stream compatible with the intended printer, and queues the print task in the operating system's printer spooler (815).


The operating system's printer spooler queues print tasks for particular printer hardware to print. The printer eventually processes the print corresponding to the requested image (816).


Process for Decorating Edible Medium Using Parallel Browser Module


FIGS. 9A-9D depict an example swim lane diagram of a process 900 for printing a decoration on an edible medium using the parallel browser module 244 shown in FIG. 2B. In other configurations, the process 900 for printing a decoration on an edible medium using the parallel browser module 244 may include fewer or more events than shown in FIGS. 9A-9D. The process 900 can be performed by system 100, for example, with central control device 132 and local control device 128 connected via network 118. Although the process 900 is described with reference to system 100, other systems, environments, or processors can perform the steps in process 900.


Referring now to FIG. 9A, a central control device 132 and local control device 128 shown in system 100 includes a number of modules 901-908. A parallel connection module 901 is a software module that establishes a secondary connection between central control device 132 and local control device 128. This secondary connection is in parallel with a connection between a software web browser residing on local control device 128 and the central control device 132.


A user account module 902 is a software module that includes profiles of information regarding particular users. The user account module 902 allows or disallows users to login to user accounts using a username and a password. The user account module 902 also stores financial information and address information about the user and processes financial transactions. Following successful login, central control device 132 provides local control device 128 with user identification data. In some embodiments, parallel web browser module 244 may receive user identification data directly from central control device 132. In other embodiments, parallel web browser module 244 may receive user identification data through the software web browser.


In certain embodiments, Parallel web browser module 244 receives user identification data through the associated network address identification information, and following reception of user identification data, parallel web browser module 244 remains independently operable from the software web browser during the duration of an active socket connection between parallel web browser module 244 and the software web browser.


In an illustrative embodiment, a valid user login session for parallel web browser module 244 is determined by the inclusion of unexpired user identification data, such as a unique token provided by central control device 132, in communications between the central control device 132 and local control device 128.


A license module 903 is a software module that includes information about system licensing to certain images. System licensing information may include data identifying where particular images can be sold and if and/or how the images may be edited.


A parallel browser module 904 is a software module that provides a GUI 127 to software modules shown in FIG. 2A, such as the image library module 202, which allows the user to upload images from local image sources to use in the system, and the image editing module 204, which allows a user to edit images. An authentication module 905 is a software module that verifies successful login to the user account module 902 before permitting parallel browser module 904 to establish a connection. A print module 906 is a software module that initiates the printing of selected images onto edible media using a specific color profile for a particular printer. A color management module 907 is a software module that applies color correction algorithms to images provided by print module 906. A printer communication module 908 is a software module that encodes color corrected output into a byte stream compatible with a particular printer.


Prior to process 900, the user utilizes a software web browser to log into a secure site, establish an account, and download an application installer. The application installer creates modules including but not limited to the parallel browser module 904, authentication module 905, color management module 907, and printer communication module 908 on the local control device 128.


Process 900 begins with execution of the authentication module 905 (910). Execution can occur manually through the GUI 127, or automatically through startup events during operating system bootup. Following execution, authentication module 905 enters an inactive state, and is activated manually via GUI 127, or automatically using a threshold condition such as elapsed time (911). Upon activation, authentication module 905 verifies if a secure session with user account module 902 through a software web browser has already been established (912). Following detection of no existing secure session with user account module 902, authentication module 905 initiates an instance of a software web browser residing on local control device 128 (913). Authentication module 905 causes the new instance of the software web browser to navigate to an Internet website providing access to the user account module 902, the website displaying a prompt for user login credentials (915).


Following successful login, the parallel browser module 904 is activated (916). In certain implementations, parallel browser module 904 can be activated from a navigation option shown within the software web browser used for login procedures. In other embodiments, parallel browser module 904 can be activated externally from the software web browser, such as an icon in GUI 127.


In each method of activating parallel browser module 904, parallel connection module 901 first establishes a second connection in parallel with the secure connection between the software web browser on local control device 128 and the website server on central control device 132 (917). In certain configurations, the second parallel connection is automatically terminated when the first secure connection is terminated. In other implementations, the second connection established by parallel connection module 901 persists after the first secure connection module is terminated.


Referring now to FIG. 9B, following establishment of a second connection by parallel connection module 901, parallel browser module 904 displays a menu containing a number of navigation options (920). In another embodiment, for instance, when parallel browser module 904 interacts with software modules that the software web browser is not capable of interaction with, parallel browser module 904 displays more navigation options than displayed in the software web browser, such as color correction, page layout, and printer configuration options. In other configurations, independent of if parallel browser module 904 is communicable with more software modules than the software web browser, parallel browser module 904 displays fewer navigation options. In this example, parallel browser module 904 displays options relating to designing edible media, and does not display options available in the software web browser such as subscription information, account management, and customer alerts.


After parallel browser module 904 displays navigation options, the user can choose an image to use to decorate an edible media. The user may choose images from a local image source, an online image source, or the image library in the image library module 202 of FIG. 2A. In this example, the user selects the image library as the image source (921).


The system 100 can perform operations not explicitly shown in FIG. 9A-9D. As one example, the system 100 can access the user location module 214, shown in FIG. 2A, and determine the geographic location of the user. After the user's geographic location is determined, the system 100 can access the license module 903, and determine whether any licensing restrictions exist for images in the user's geographic location. The system 100 narrows the number of images provided to the user in parallel browser module 904 based on licensing restrictions (922).


Parallel browser module 904 displays to the user a searchable and browsable library of images available to the user for purchase or use (923). The user may search through the images, using word searching, or alternatively by browsing through image categories and viewing all images in a category. While not shown in this example, in some embodiments, the user can choose to access the social networking module 216, shown in FIG. 2A, to aid the user in choosing an image.


The user selects an image and instructs the system 100 that the user wishes to purchase the image (924). In some configurations, the user account module 902 prompts the user through parallel browser module 904 to enter financial information, such as a credit card to be charged or a bank account for direct debit. Alternatively, as shown in this example, the user account module 902 operates in the background to utilize payment data associated with the unique username and password used for establishing the first secure connection between the software web browser and web server, without interrupting the process of designing the edible media.


Referring now to FIG. 9C, following image selection, the user selects an edible media type (930). Examples of options for edible media include but are not limited to standard media with sizes of ½, ¼, and ⅛ sheet, or precut media of sizes 8 inch round, 3 inch round, or 2 inch round.


In some implementations, the user may choose to edit the purchased image from within the parallel browser module 904 (931). The user may crop, rotate, resize, stretch to width, stretch to height, brighten, darken, re-touch, and perform other operations to the selected image. The parallel browser module 904 also permits the user to undo operations, navigate back to a previous options interface, or navigate to the next options interface.


In some embodiments, the user may choose to add text to the purchased image (932). In one option, the user can select from a list of phrases, such as “Congratulations,” “Bon Voyage,” or “Happy Birthday.” In another option, the user can type a custom phrase. The user may be able to bend a phrase upwards or downwards to varying degrees of curvature, straighten a phrase, change font type, font color, and select left, right, or centered justification. Furthermore, the user may be able to crop, rotate, resize, stretch to width, stretch to height, brighten, darken, re-touch, and perform other operations to the text independently or in conjunction with the selected image. The parallel browser module 904 also permits the user to undo operations, navigate back to a previous options interface, or navigate to the next options interface.


The user selects print options after the parallel browser module 904 prompts the user for print options, such as number of prints for the particular image (933). Other examples include but are not limited to print orientation, image tiling, and providing grayscale or color options for a given image or print region. Parallel browser module 904 passes on print options to print module 906. In some cases, the user is prompted to input a printer type for use in printing on the edible media.


The image library module 202, shown in FIG. 2A, stores different versions of the same image that are compatible with different printer color profiles. The print module 906 ensures that an image compatible with the color profile of each selected printer is transmitted to the local control device 128 for printing (934).


Upon receiving print data from print module 906 over the secure second connection between local control device 128 and central control device 132, parallel browser module 904 forwards print data to color management module 907 (935).


Referring now to FIG. 9D, color management module 907 applies color correction by converting from the color profile of the image to the color profile of the particular printing device in order to maintain color consistency across devices (940). Color management module 907 provides color correction capabilities to each graphical text, photo, and artwork element, flattening multiple layers into a single bitmap following color correction. Color management module 907 also provides any color space conversion, such as between CMYK and RGB, as necessary (941), and converts to the bit depth compatible with the printer, such as 8 bits or 16 bits (942). Color management module 907 also performs linearization and half tone control to further improve image reproduction (943).


Printer communication module 908 bypasses printer drivers installed in the operating system (944), and instead directly encodes a printer compatible byte stream and appends the byte stream to the printer spooler in the operating system (945). The operating system printer spooler proceeds to execute the print tasks in the queue, resulting in an edible media being printed. The printer communication module 908, together with parallel connection module 901, provides a user rights controlled low-level print management process for the edible media decorating system 100.


At any point in the process of FIG. 9A-D, the user can choose to clear a design in progress or reset the design in progress to a previous state. This option provides the user an efficient mechanism to remove mistakes or simply begin a new design.


Example User Interface Functionality

Any number of User Interface elements can be provided to a user of system 100. The User Interface elements may include multiple screens presented as web pages. As is typical, the GUI 127 in system 100 provides a home screen and various other screens available for user navigation. One example home screen may include user-selectable controls to perform a quick copy of an image, upload or print a photograph, select options such as frames or artwork, generate an order, create a design, and modify system settings.


The quick copy control can be selected by a user to initiate a scanner for uploading an image and quickly copying the image to a system repository. The quick copy control can provide instructions onscreen to the user for accomplishing the quick copy. The instructions may include text, graphics, and/or video content. The instructions can be provided in a user-selectable language.


The upload or print a photograph control can be selected to upload and print a photograph. The photograph control can instruct a user to identify a media source (e.g., scanner, CD, USB, Flash card, web camera, etc.). The photograph control can request that the user verify media settings and upon verification, the control can upload the photograph. The user can choose to edit the uploaded photograph and print the uploaded photograph with applied editing.


Options such as selecting frames or artwork are selected by the user to invoke the system to configure frames and/or artwork for printing. The configuration options can, for example, include verifying original media settings, and selecting a frame or artwork item. The system 100 can retrieve the frame and/or artwork and allow the user to perform edits. The users can additionally edit a particular edible media (e.g., topping) before printing the frame and/or artwork on the edible media.


The order form control can be used to generate an order. For example, users can choose to generate and complete a number of standard order forms. Example order forms include a licensed artwork order form, a licensed frames order form, a general order form, a customer cake order form, and a customer deli order form. In some configurations, users can print an order form and manually request an edible media print or product.


Other controls can be provided to present other information about the system 100 and or inventory available to the system 100. For example, controls can be provided to present inventory management items such as quarterly purchase reports, complete purchase history reports, on-hand inventory reports, and the like.


Another example control can include options or screens for modifying system settings including default color and default fonts. Users may also wish to customize a user account associated with the websites hosted on system 100. For example, a user may wish to change a color scheme or font size when logging into one or more websites hosted on system 100.


Another example control can provide maintenance checklists and tasks for an administrative user. The maintenance controls may only be visible to the administrative user upon login. Other standard system users may not view or access the maintenance controls and/or menus.


In some implementations, the User Interface can provide links to copyright release forms, copyright statement forms or other legal documents. Users can choose to preview and/or print the legal documents on demand.


Example User Interface Tree


FIG. 10 depicts an example User Interface Tree 1000 for a website in a system for decorating edible media, with each node representing a webpage. The hierarchy of the User Interface Tree 1000 shown in FIG. 10 is merely exemplary, with nodes capable of being re-positioned at different hierarchies, divided into separate nodes, or merged into a single node. The labels for nodes are also exemplary of subject matter contained within each webpage. All user interfaces in the User Interface Tree 1000 can be displayed in the software web browser on local control device 128, or certain user interfaces in the User Interface Tree 1000 can be displayed in the software web browser, and other user interfaces in the User Interface Tree 1000 can be displayed in a software environment external to the software web browser, such as the parallel browser module 244.



FIG. 11A depicts an example User Interface 1100a, corresponding to node 1001 of User Interface Tree 1000, for the main page of the system for decorating edible media. FIG. 11A contains a User Interface region 1102 to select between display languages. In certain embodiments, the languages can be selected from a drop down list. In other configurations, the central control device 132 can automatically detect the localization settings of local control device 128 accessing the website, and display a corresponding native language.



FIG. 11A contains a User Interface region 1104 that provides additional details on the various components of the system, such as the printer, scanner, display device, and local control device.



FIG. 11A depicts connectivity to the image library module 202 through User Interface region 1106. A subset of selected images, such as featured, new, or popular images are selected from the overall image library for preview on the User Interface 1100a. A scroll bar is included to enable viewing of images beyond the quantity that can concurrently be shown on User Interface 1100a.



FIG. 11A contains a User Interface region 1108 that provides information on the capabilities and services of the system for decorating edible media, such as a video tutorial of system operation. User Interface 1100a provides a region 1110 with a plurality of navigation choices to other webpages including a Why PhotoCake webpage, a webpage relating to an overview of services of the system for decorating edible media, an Image Library webpage, a webpage for browsing contents of the image library module 202, a Cake Ideas webpage, a webpage relating to examples of outputs of the system for decorating edible media, a Resource Center webpage, a webpage relating to technical support and customer service issues, and a Contact Us webpage, a webpage relating to modes of communication for reaching providers of the services of the system for decorating edible media.



FIG. 11B depicts an example User Interface 1100b, corresponding to a different state of node 1001 of User Interface Tree 1000, for the main page of the system for decorating edible media.



FIG. 11B additionally contains a User Interface region 1112 that prompts for user authentication through a username/password entry region. A region for providing information on account creation is also provided. In certain implementations, the authentication prompt can be a pop-up window overlaid above User Interface 1100b as shown in FIG. 11B. In other embodiments, the authentication prompt can be embedded within the User Interface 1100b.



FIG. 11B may contain a User Interface region 1114 that permits the user, in the event that the user forgets login credentials, to invoke a prompt to input identification information, such as the answer to a preselected security question, a PIN, or an e-mail address, to authenticate the user's request either to reset login credentials, or request secure delivery of login credentials.



FIG. 12 depicts an example User Interface 1200, corresponding to a state of node 1001 of User Interface Tree 1000 after successful login, with a region 1202 showing an updated plurality of navigation choices to other webpages. FIG. 12 also depicts a User Interface region 1204 for signing out of a user account. In certain configurations, after successful login, the User Interface regions relating to login, including but not limited to regions 1112 and 1114 shown in FIG. 11B are removed, and region 1110 is updated with a new plurality of navigation options. For example, the Why PhotoCake webpage can be substituted with a MyPhotoCake webpage, a webpage relating to account management, and the Create Cake webpage can be added, a webpage relating to designing decorative edible media for printing.



FIG. 13 depicts an example User Interface 1300, corresponding to node 1011 of User Interface Tree 1000, for the MyPhotoCake webpage. FIG. 13 provides a region 1302 with a plurality of navigation choices to other webpages. FIG. 13 also depicts a User Interface region 1304 for signing out of a user account. FIG. 13 includes a summary of account information region 1306, which displays information such as account number, expiration, and contact information. FIG. 13 depicts connectivity to the image library module 202 through image library subset display region 1308, which displays a subset of selected images, such as featured, new, or popular images, from the overall image library. An image library search region 1310 is included, allowing user input of keyword or image number to retrieve images from image library module 202. A favorite image library subset display region 1312 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1314 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1316 displays the number of licensed image credits available, and the number of print media available.



FIG. 13 includes an account management region 1318 which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, a webpage displaying historical statistics on images printed on edible media, Consumable Media, a webpage displaying historical statistics on edible media usage, Annual Subscription, a webpage displaying subscription information, Customer Alerts, a webpage relating to his play of alerts, Change Password, a webpage relating to password management, and Order Form, a webpage relating to purchasing of edible media.



FIG. 14 depicts an example User Interface 1400, corresponding to node 1021 of User Interface Tree 1000, for the Image Use webpage. FIG. 14 provides a region 1402 with a plurality of navigation choices to other webpages. FIG. 14 also depicts a User Interface region 1404 for signing out of a user account. A favorite image library subset display region 1406 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1408 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability region 1410 displays the number of licensed image credits available, and the number of print media available. FIG. 14 includes an account management region 1412, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 14 includes a purchase history region 1414, which allows a user to input the date range to display purchase history information. Purchase history filter region 1416 allows a user to input the choice of filtering purchase history by date or by image number. Purchase history display region 1418 displays a tabular representation of information relating to date of image use, image number, text description of image, number of credits utilized, and cost of utilization.



FIG. 15 depicts an example User Interface 1500, corresponding to node 1022 of User Interface Tree 1000, for the Consumable Media webpage. FIG. 15 provides a region 1502 with a plurality of navigation choices to other webpages. FIG. 15 also depicts a User Interface region 1504 for signing out of a user account. A favorite image library subset display region 1506 provides a thumbnail view of a subset of photos classified as favorites by the logged-in user. An alert timeline region 1508 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1510 displays the number of licensed image credits available, and the number of print media available. FIG. 15 includes an account management region 1512, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 15 also includes a media access code entry region 1514, which allows a user to enter a unique code corresponding to purchased edible media in order to increase the number of available prints to a user. Redemption history region 1516 allows a user to input the date range to display redemption history information. Redemption history display region 1518 displays a tabular representation of information relating to date of edible media redemption, media code number, and a text description of edible media type.



FIG. 16 depicts an example User Interface 1600, corresponding to node 1023 of User Interface Tree 1000, for the Annual Subscription webpage. FIG. 16 provides a region 1602 with a plurality of navigation choices to other webpages. FIG. 16 also depicts a User Interface region 1604 for signing out of a user account. A favorite image library subset display region 1606 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1608 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1610 displays the number of licensed image credits available, and the number of print media available. FIG. 16 includes an account management region 1612, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 16 also includes an account expiration date region 1614, which displays when the currently active subscription is targeted to expire. Subscription history display region 1616 displays a tabular representation of information including date of subscription, cost of subscription, subscription years purchased, and account expiration date corresponding to subscription type purchase.



FIG. 17 depicts an example User Interface 1700, corresponding to node 1024 of User Interface Tree 1000, for the Customer Alerts webpage. FIG. 17 provides a region 1702 with a plurality of navigation choices to other webpages. FIG. 17 also depicts a User Interface region 1704 for signing out of a user account. A favorite image library subset display region 1706 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1708 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1710 displays the number of licensed image credits available, and the number of print media available. FIG. 17 includes an account management region 1712, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 17 also includes a customer alert history display region 1714, which displays a tabular representation of information including date of customer alert, and a text description of the customer alert.



FIG. 18 depicts an example User Interface 1800, corresponding to node 1025 of User Interface Tree 1000, for the Change Password webpage. FIG. 18 provides a region 1802 with a plurality of navigation choices to other webpages. FIG. 18 also depicts a User Interface region 1804 for signing out of a user account. A favorite image library subset display region 1806 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1808 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1810 displays the number of licensed image credits available, and the number of print media available. FIG. 18 includes an account management region 1812, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 18 also includes a password update region 1814, which prompts a user for the current, new, and a confirmation of a new password.



FIG. 19 depicts an example User Interface 1900, corresponding to node 1026 of User Interface Tree 1000, for the Order Form webpage. FIG. 19 provides a region 1902 with a plurality of navigation choices to other webpages. FIG. 19 also depicts a User Interface region 1904 for signing out of a user account. A favorite image library subset display region 1906 provides a thumbnail view of a subset of photos classified as favorites by the logged in user. An alert timeline region 1908 displays a subset of alerts, including version updates, and image credit availability information. A credit and media count availability of region 1910 displays the number of licensed image credits available, and the number of print media available. FIG. 19 includes an account management region 1912, which contains a plurality of navigation choices to other webpages relating to account management, including Image Use, Consumable Media, Annual Subscription, Customer Alerts, Change Password, and Order Form webpages.



FIG. 19 also includes an itemized order form region 1914, which displays the items for purchase, such as licensed image credits and annual subscription renewals, along with respective unit prices and quantities. Region 1916 prompts the user for billing information to provide payment for the order described by region 1914.



FIG. 20 depicts an example User Interface 2000, corresponding to node 1031 of User Interface Tree 1000. In certain implementations, User Interface 2000 can be displayed in the same web browser used to access the User Interface 1100a. In other embodiments, User Interface 2000 can be displayed in an external software application from the software web browser, as shown in this example. The software web browser and the external application can run concurrently on the local control device 128, and the external software application can be installed on local control device 128 prior to the user login process on User Interface 1100a, or can be prompted for download when navigating to the Create Cake webpage 1012 for the first time. In configurations that use the external software application to display the Create Cake User Interface 2000, a separate parallel secure connection by the external software application can be established between the local control device 128 and central control device 132 to allow secure remote access of licensed images in the image library module 202.


The User Interface 2000 contains a region 2002 to select between display languages. Region 2004 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2006 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2008, shown without a text label in this example, provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. In alternative implementations, region 2008 can include a text label.


The User Interface 2000 also contains a region 2010 for the user to choose what to print on a topping, including Photo, Image, and Frame+Photo sources.



FIG. 21 depicts an example User Interface 2100, corresponding to node 1041 of User Interface Tree 1000, displayed when the user chooses the option to print a topping with the Photo type. User Interface 2100 includes a region 2102 to select between display languages. Region 2104 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2106 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2108 provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. Region 2110 provides the option to navigate backwards or forwards within the Create Cake User Interface sequence. User Interface 2100 also includes a local file selection region 2112 for allowing a user to select an image file stored on or accessible by local control device 128.



FIG. 22 depicts an example User Interface 2200, corresponding to node 1042 of User Interface Tree 1000, displayed after the user has completed local image file selection following user selection of the option to print a topping with the Photo type. User Interface 2200 includes a region 2202 to select between display languages. Region 2204 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2206 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2208 provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. Region 2210 provides the option to navigate backwards or forwards within the Create Cake User Interface sequence. User Interface 2200 also includes a photo editing region 2212, which allows modifications to the selected local file image. Editing capabilities include, but are not limited to, maximizing width, maximizing height, cropping to various shapes, and converting to grayscale. User Interface 2200 also includes manual photo editing region 2214, which allows a user to use a point-and-click interface to edit a photo, such as cropping.



FIG. 23, corresponding to node 1043 of User Interface Tree 1000, depicts an example User Interface 2300 displayed for selecting topping configuration. In the example User Interface Tree 1000 of FIG. 10, User Interface 2300 is a common user interface for the Photo, Image, and Frame+Photo print types, as depicted by the branches converging on node 1052 in FIG. 10.


User Interface 2300 includes a region 2302 to select between display languages. Region 2304 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2306 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2308 provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. Region 2310 provides the option to navigate backwards or forwards within the Create Cake User Interface sequence. User Interface 2300 also includes a topping selection region 2312 which provides multiple topping options including but not limited to standard media with sizes of ½, ¼, and ⅛ sheet, or precut media of sizes 8 inch round, 3 inch round, or 2 inch round. User Interface 2300 also includes topping selection preview region 2314, which allows a user to preview changes to the image based on a selected topping configuration in real-time.



FIG. 24 depicts an example User Interface 2400, corresponding to node 1044 of User Interface Tree 1000, displayed for editing a topping following selection of a topping in User Interface 2300. User Interface 2400 includes a region 2402 to select between display languages. Region 2404 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2406 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2408 provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. Region 2410 provides the option to undo or redo topping edits, and to navigate backwards or forwards within the Create Cake User Interface sequence.


User Interface 2400 also includes a topping editing region 2412, which provides multiple topping editing options. Editing options include, but are not limited to crop, rotate, resize, stretch to width and stretch to height.


Editing options also include the choice to add text. The user can select from a list of phrases, such as “Congratulations,” “Bon Voyage,” or “Happy Birthday,” or the user can type a custom phrase. The user may be able to bend a phrase upwards or downwards to varying degrees of curvature, straighten a phrase, change font type, font color, and select left, right, or centered justification.


User Interface 2400 also includes topping editing preview region 2414, which allows a user to preview changes to the image based on a selected edits in real-time.



FIG. 25 depicts an example User Interface 2500, corresponding to node 1045 of User Interface Tree 1000, displayed for print editing following topping editing User Interface 2400. User Interface 2500 includes a region 2502 to select between display languages. Region 2504 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2506 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2508 provides a quick link to a webpage in a software web browser providing technical support and frequently asked questions relating to the User Interface 2000. Region 2510 provides the option to navigate backwards or to initiate the print process of the final design. User Interface 2500 also includes a print configuration region 2512, which provides the user print options, such as the number of prints for the particular image.



FIG. 26 depicts an example User Interface 2600, corresponding to node 1051 of User Interface Tree 1000, displayed for selecting a frame from a frame image. As shown in the exemplary User Interface Tree of FIG. 10, the sequence of User Interface displays for creating a topping involving the Frame+Photo Type is similar with the exception of the additional User Interface 2600 for Frame image selection preceding User Interface 2100 for local image file selection.


User Interface 2600 includes a region 2602 to select between display languages. Region 2604 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2606 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2608 provides to the user a searchable and browsable library of frame images available to the user. The user may search through the frame images, using word searching, or alternatively by browsing through image categories and viewing all images in a category. Region 2610 provides a scrollable region displaying thumbnails of frame images available to the user based on search results or selected categories from region 2608. To select a particular frame image, the user clicks on a thumbnail displayed in region 2610. Following selection of a particular frame image, the User Interface 2100 of FIG. 21 is displayed for the purposes of selecting the local image file to be displayed within the framed area. Subsequent User Interface displays for creating a print of the Frame+Photo type proceeds in the same sequence as for the Photo type, as described earlier in regards to discussion of nodes 1041-1045 of User Interface Tree 1000.



FIG. 27 depicts an example User Interface 2700, corresponding to node 1061 of User Interface Tree 1000, displayed for selecting an image from Image Library Module 202 following user selection of the Image type print in User Interface 2000. As shown in the exemplary User Interface Tree of FIG. 10, the sequence of User Interface displays for creating a topping involving the Image type is similar to creating a Photo type print with the exception that following Image selection in User Interface 2700, the User Interface display sequence proceeds to User Interface 2300 for topping selection, bypassing photo selection User Interface 2100 and photo editing User Interface 2200.


User Interface 2700 includes a region 2702 to select between display languages. Region 2704 displays the subscriber's name, software version, number of licensed image credits available, and the number of print media available. Region 2706 provides a navigation option to return to the software web browser to display the User Interface 1300 for the MyPhotoCake webpage 1011. Region 2708 provides to the user a searchable and browsable library of images available to the user. The user may search through the images, using word searching, or alternatively by browsing through image categories and viewing all images in a category. Region 2710 provides a scrollable region displaying thumbnails of images available to the user based on search results or selected categories from region 2708. To select a particular image, the user clicks on a thumbnail displayed in region 2710. Following selection of a particular image, the User Interface 2100 of FIG. 21 is displayed for the purposes of selecting the local image file. Subsequent User Interface displays for creating a print of the Image type proceeds in the same sequence as described earlier in regards to discussion of nodes 1043-1045 of User Interface Tree 1000.



FIG. 28 depicts an example User Interface 2800, corresponding to node 1013 of User Interface Tree 1000, for the Image Library webpage. FIG. 28 provides a region 2802 with a plurality of navigation choices to other webpages. FIG. 28 also depicts a User Interface region 2804 for signing out of a user account. A region 2806 provides the option to only display images of the frame image type.


Region 2810 provides to the user a searchable and browsable library of images available to the user. The user may search through the images, using word searching, or alternatively by browsing through image categories and viewing all images in a category. Prior to entering a search term or category selection, region 2808 provides separate scrollable row regions displaying thumbnails of images corresponding to Featured, New, and Popular Images available to the user. Following entering a search term or category selection, region 2808 is replaced with a single scrollable region displaying a matrix of thumbnails corresponding to search or category selection results. New images in the Image Library Module 202 are labeled with a NEW marker on the respective thumbnails.


For each thumbnail, when the user performs a mouse-over, the thumbnail is overlaid with details, such as an image title and/or price, as shown in region 2902 of FIG. 29. When the user performs a click action on a thumbnail, a pop-up window appears, providing ever further information on the selected image, such as copyright information, and the option to Add to Favorites, or Create this Cake corresponding to the clicked image, as shown in region 2904 of FIG. 29. The Create this Cake option in FIG. 29 takes the user to the User Interface 2300, as depicted by the converging branches on node 1052 in FIG. 10.



FIG. 30 depicts an example User Interface 3000, corresponding to node 1014 of User Interface Tree 1000, for the Cake Ideas webpage 1014. FIG. 30 provides a region 3002 with a plurality of navigation choices to other webpages. FIG. 30 also depicts a User Interface region for signing out of a user account 3004.


Region 3008 provides to the user a searchable and browsable library of exemplary cake designs available to the user. The user may search through the cake designs, using word searching, or alternatively by browsing through design categories and viewing all cake designs in a category. Prior to entering a search term or category selection, region 3006 provides separate scrollable row regions displaying thumbnails of cake designs corresponding to Featured and New designs available to the user. Following entering a search term or category selection, region 3006 is replaced with a single scrollable region displaying a matrix of thumbnails corresponding to search or category selection results. New cake designs are labeled with a NEW marker on the respective thumbnails.


Similar to the Create Cake webpage 1012, for each thumbnail, when the user performs a mouse-over, the thumbnail is overlaid with details, such as a descriptive title. When the user performs a click action on a thumbnail, a pop-up window appears, providing ever further information on the selected image, such as the item number and the image used, and the option to Create Cake corresponding to the clicked image. The Create Cake option takes the user to the User Interface 2300, as depicted by the converging branches on node 1052 in FIG. 10.



FIG. 31 depicts an example User Interface 3100, corresponding to node 1015 of User Interface Tree 1000, for the Resource Center webpage. FIG. 31 provides a region 3102 with a plurality of navigation choices to other webpages. FIG. 31 also depicts a User Interface region 3104 for signing out of a user account 3104. FIG. 31 further provides a drop down menu region 3106 containing a plurality of navigation choices to other webpages, such as Frequently Asked Questions or Technical Requirements. Region 3108 provides a preview of common questions, such as how to create and save favorites, and upload images, in this example. A region 3110 provides alternative navigation options to either Frequently Asked Questions or Technical Requirements, with additional explanation of each link.



FIG. 32 depicts an example User Interface 3200, corresponding to node 1016 of User Interface Tree 1000, for the Contact Us webpage. FIG. 32 provides a region 3202 with a plurality of navigation choices to other webpages. FIG. 32 also depicts a User Interface region 3204 for signing out of a user account. FIG. 32 further provides a region 3206 with a user entry form for providing contact information at which operators of the online system for decorating edible media may contact the user. Region 3206 also provides for similar user entry form for providing contact information relating to general inquiries, and for technical support. FIG. 32 also includes a region 3208 for accessing a Why PhotoCake webpage, a webpage relating to an overview of services of the system for decorating edible media. FIG. 32 additionally may include a region 3210 for accessing a webpage for ordering inventory items for a system owner (e.g., a bakery owner, store owner), such as edible media, edible ink, replacement parts, printheads, and other system supplies.



FIG. 33 is a schematic diagram of a generic computer system 3300. The system 3300 is optionally used for the operations described in association with any of the computer-implemented methods described previously, according to one implementation. The system 3300 includes a processor 3310, a memory 3320, a storage device 3330, and an input/output device 3340. Each of the components 3310, 3320, 3330, and 3340 are interconnected using a system bus 3350. The processor 3310 is capable of processing instructions for execution within the system 3300. In one implementation, the processor 3310 is a single-threaded processor. In another implementation, the processor 3310 is a multi-threaded processor. The processor 3310 is capable of processing instructions stored in the memory 3320 or on the storage device 3330 to display graphical information for a User Interface on the input/output device 3340.


The memory 3320 stores information within the system 3300. In one implementation, the memory 3320 is a computer-readable medium. In one implementation, the memory 3320 is a volatile memory unit. In another implementation, the memory 3320 is a non-volatile memory unit.


The storage device 3330 is capable of providing mass storage for the system 3300. In one implementation, the storage device 3330 is a computer-readable medium. In various different implementations, the storage device 3330 is optionally a floppy disk device, a hard disk device, an optical disk device, or a tape device.


The input/output device 3340 provides input/output operations for the system 3300. In one implementation, the input/output device 3340 includes a keyboard and/or pointing device. In another implementation, the input/output device 3340 includes a display unit for displaying Graphical User Interfaces.


In some examples, the features described are implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. The apparatus is optionally implemented in a computer program product tangibly embodied in an information carrier, e.g., in a machine-readable storage device or in a propagated signal, for execution by a programmable processor; and method steps are performed by a programmable processor executing a program of instructions to perform functions of the described implementations by operating on input data and generating output. The described features are optionally implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. A computer program is a set of instructions that are optionally used, directly or indirectly, in a computer to perform a certain activity or bring about a certain result. A computer program is optionally written in any form of programming language, including compiled or interpreted languages, and it is deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.


Suitable processors for the execution of a program of instructions include, by way of example, both general and special purpose microprocessors, and the sole processor or one of multiple processors of any kind of computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memories for storing instructions and data. Generally, a computer will also include, or be operatively coupled to communicate with, one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory are optionally supplemented by, or incorporated in, ASICs (application-specific integrated circuits).


To provide for interaction with a user, the features in some instances are implemented on a computer having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user and a keyboard and a pointing device such as a mouse or a trackball by which the user provides input to the computer.


The features are optionally implemented in a computer system that includes a back-end component, such as a data server, or that includes a middleware component, such as an application server or an Internet server, or that includes a front-end component, such as a client computer having a Graphical User Interface or an Internet browser, or any combination of them. The components of the system are connected by any form or medium of digital data communication such as a communication network. Examples of communication networks include, e.g., a LAN, a WAN, and the computers and networks forming the Internet.


The computer system optionally includes clients and servers. A client and server are generally remote from each other and typically interact through a network, such as the described one. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.


A number of implementations have been described. Nevertheless, it will be understood that various modifications are optionally made without departing from the spirit and scope of this disclosure. Accordingly, other embodiments are within the scope of the following claims.

Claims
  • 1. A system for printing three-dimensional edible decorations, the system comprising: a graphical user interface configured for presentation to a user, the graphical user interface comprising at least one image of a plurality of images for printing a three-dimensional edible decoration, anda plurality of interactive controls for customizing the three-dimensional edible decoration, wherein the graphical user interface is configured to receive a plurality of decorating selections submitted by the user;a printer comprising at least one printhead configured to deposit an edible material,at least one reductive modeling tool configured to remove the edible material,a platform configured to support a base and rotate while the at least one printhead deposits the edible material onto a surface of the base, anda processor; anda plurality of instructions, wherein the processor of the printer is configured to receive at least a portion of the instructions as a plurality of print instructions generated for use by the printer to customize the three-dimensional edible decoration according to the plurality of decorating selections submitted by the user via the graphical user interface,the processor is configured to execute the print instructions to form the three-dimensional edible decoration on the surface of the base, andthe print instructions, when executed by the processor, cause the processor to affect deposition of the edible material on the surface of the base by the at least one printhead to form a printed portion of the three-dimensional edible decoration,coordinate rotation of the platform with some or all of the deposition of the edible material, andaffect alteration of a contour of the deposited edible material by removing one or more portions of the deposited edible material from the surface of the deposited edible material with one or more modeling tools of the at least one reductive modeling tool to alter an external shape of the three-dimensional edible decoration, thereby producing a substantially different visual presentation for the three-dimensional edible decoration.
  • 2. The system of claim 1, wherein: the platform comprises a gimbal configured to rotate and tilt the platform; andthe instructions, when executed by the processor, cause the processor to coordinate tilting of the platform at an angle relative to an active printhead of the at least one printhead, wherein the active printhead is depositing the edible material.
  • 3. The system of claim 2, wherein the platform further comprises a plurality of securing mechanisms configured to maintain position of the base during the tilting of the platform.
  • 4. The system of claim 2, wherein the instructions, when executed, cause the processor to track a set of deposition coordinates while maneuvering the gimbal.
  • 5. The system of claim 1, wherein the base comprises an edible media.
  • 6. The system of claim 1, wherein: the print instructions, when executed by the processor, cause the processor to identify, in the instructions, a decoration for applying to the base and/or the deposited edible material after printing; andremoving of the one or more portions of the deposited edible material comprises developing, on the surface of the deposited edible material, at least a portion of a three-dimensional background coordinated with the decoration selected by the user.
  • 7. The system of claim 1, wherein the print instructions, when executed by the processor, cause the processor to: identify an off-the-shelf three-dimensional decoration disposed on the platform; andaffect deposit, with one or more printheads of the at least one printhead, of customized features on the off-the-shelf three-dimensional decoration.
  • 8. The system of claim 7, wherein: identifying the off-the-shelf three-dimensional decoration comprises identifying a position of the off-the-shelf three-dimensional decoration; anddepositing the customized features comprises customizing the off-the-shelf three-dimensional decoration according to image data supplied by the user.
  • 9. The system of claim 8, wherein: the image data comprises an image of a person; andcustomizing the off-the-shelf three-dimensional decoration comprises adding facial features and hair to the off-the-shelf three-dimensional decoration.
  • 10. The system of claim 7, wherein identifying the off-the-shelf three-dimensional decoration comprises recognizing, by the printer, the off-the-shelf three-dimensional decoration based at least in part on a three-dimensional shape of the off-the-shelf three-dimensional decoration.
  • 11. The system of claim 1, wherein the graphical user interface comprises a rotating presentation of at least a selected image of the plurality of images.
  • 12. A method for printing three-dimensional edible decorations, the method comprising: presenting, by processing circuitry to a user at a computing device, a graphical user interface comprising at least one image of a plurality of images for printing a three-dimensional edible decoration, anda plurality of interactive controls for customizing the three-dimensional edible decoration;receiving, by the processing circuitry via the graphical user interface, a plurality of decorating selections submitted by the user, wherein the plurality of decorating selections comprises an indication of a selected image of the plurality of images, wherein the selected image corresponds to the three-dimensional edible decoration, andat least one of a color or a size corresponding to the selected image;generating, by the processing circuitry, print instructions for use by a printer to customize the three-dimensional edible decoration according to the plurality of decorating selections; andproviding, by the processing circuitry to the printer, the print instructions, wherein the printer comprises at least one printhead configured to deposit edible material on a surface of a base,at least one reductive modeling tool configured to remove portions of the edible material, anda platform to support the base,wherein a first printhead of the at least one printhead and/or the platform is configured to rotate while the first printhead deposits at least a portion of the edible material, anda processor;wherein the processor is configured to execute the print instructions to form the three-dimensional edible decoration; andwherein the print instructions, when executed by the processor, cause the processor to affect deposition of the edible material on the surface of the base by the at least one printhead to form the printed portion of the three-dimensional edible decoration,coordinate rotation of the platform and/or the first printhead with some or all of the deposition of the edible material, andaffect alteration of a contour of the deposited edible material by removing one or more portions of the edible material from the surface of the deposited edible material with one or more modeling tools of the at least one reductive modeling tool to alter an external shape of the three-dimensional edible decoration, thereby producing a substantially different visual presentation for the three-dimensional edible decoration.
  • 13. The method of claim 12, wherein: the selected image corresponds to an off-the-shelf three-dimensional decoration; andthe print instructions, when executed by the processor, cause the processor to affect the deposition, with one or more printheads of the at least one printhead, of customized features on the off-the-shelf three-dimensional decoration.
  • 14. The method of claim 13, further comprising receiving, by the processing circuitry from the user, image data, wherein the print instructions, when executed by the processor, cause the processor to affect the deposition of the customized features according to the image data.
  • 15. The method of claim 13, wherein the base is the off-the-shelf three-dimensional decoration.
  • 16. The method of claim 12, wherein: the base comprises an edible media; andthe plurality of decorating selections comprises a selected base of a plurality of bases.
  • 17. The method of claim 12, wherein: the plurality of decorating selections comprises a selected frosting sheet design configured for use as a background for a set of off-the-shelf decorations;the base comprises one of a frosting sheet or a frosted cake; andthe print instructions, when executed by the processor, cause the processor to affect the deposition of three-dimensional features on the base.
  • 18. The method of claim 17, wherein: the print instructions, when executed by the processor, cause the processor to affect development of at least a portion of the selected frosting sheet design using the at least one reductive modeling tool.
  • 19. The method of claim 12, wherein: the platform comprises a gimbal configured to rotate and tilt the platform; and the print instructions, when executed by the processor, cause the processor to affect tilting of the platform at an angle relative to an active printhead of the at least one printhead, wherein the active printhead is depositing the edible material.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 15/157,142, entitled “Three-Dimensional Decorating System For Edible Items” and filed May 17, 2016, now U.S. Pat. No. 10,543,671, which is a continuation-in-part of U.S. patent application Ser. No. 14/569,290, entitled “Online Decorating System for Edible Products” and filed Dec. 12, 2014, which is a continuation of U.S. patent application Ser. No. 13/287,023, entitled “Online Decorating System for Edible Items” and filed Nov. 1, 2011, now U.S. Pat. No. 9,713,342, which is a continuation-in-part of U.S. application Ser. No. 12/852,988, entitled “Decorating System for Edible Products” and filed on Aug. 9, 2010, each of which is incorporated herein by reference. This application is also related to the following: U.S. application Ser. No. 10/925,459, entitled “Decorating System for Edible Items” and filed on Aug. 25, 2004, now U.S. Pat. No. 7,012,712; U.S. application Ser. No. 14/553,884 filed Nov. 25, 2014, now U.S. Pat. No. 9,282,750 and is a continuation of U.S. application Ser. No. 13/287,023; U.S. application Ser. No. 14/569,224 filed Dec. 12, 2014, now U.S. Pat. No. 9,314,050 and is a continuation of U.S. application Ser. No. 13/287,023; U.S. application Ser. No. 14/569,042 filed Dec. 12, 2014, now U.S. Pat. No. 9,345,264, and is a continuation of U.S. application Ser. No. 13/287,023; U.S. application Ser. No. 14/194,000 filed Feb. 28, 2014, now U.S. Pat. No. 10,019,842, and is a continuation-in-part of U.S. application Ser. No. 12/852,988; and U.S. application Ser. No. 14/492,620 filed Sep. 22, 2014, now U.S. Pat. No. 10,455,096, and is a continuation-in-part of U.S. application Ser. No. 12/852,988, each of which is also incorporated herein by reference.

US Referenced Citations (107)
Number Name Date Kind
1605903 Schuler Nov 1926 A
2123215 Thomas Jul 1938 A
2353594 Seagren May 1941 A
2394322 McKee Sep 1941 A
2347022 Austin Apr 1944 A
2578150 Rathke Dec 1947 A
2526811 Dawson Oct 1950 A
2610588 Seagren et al. Sep 1952 A
2895832 Bersey Jul 1959 A
3057730 Morck Oct 1962 A
3192086 Gyurk Jun 1965 A
3649347 Battista Mar 1972 A
3654894 Rohrbacher et al. Apr 1972 A
3658977 Baker Apr 1972 A
3776185 Kawasaki Dec 1973 A
3852494 Williamson Dec 1974 A
4024287 Golchert May 1977 A
4038423 Hayward et al. Jul 1977 A
4061783 Hoffman et al. Dec 1977 A
4168662 Fell Sep 1979 A
4285978 Quinlivan Aug 1981 A
4292917 Ezaki Oct 1981 A
4388862 Thomas, Jr. Jun 1983 A
4409893 Newman et al. Oct 1983 A
4455320 Syrmis Jun 1984 A
4466994 Hubbard et al. Aug 1984 A
4531292 Pasternak Jul 1985 A
4537647 Foster Aug 1985 A
4548825 Voss et al. Oct 1985 A
4560562 Schroeder Dec 1985 A
4578273 Krubert Mar 1986 A
4592916 Akesson Jun 1986 A
4668521 Newsteder May 1987 A
4668523 Begleiter May 1987 A
4670271 Pasternak Jun 1987 A
4785313 Higuma et al. Nov 1988 A
4832966 Newsteder May 1989 A
4843958 Egosi Jul 1989 A
4910661 Barth et al. Mar 1990 A
4985260 Niaura et al. Jan 1991 A
5006362 Hilborn Apr 1991 A
5017394 Macpherson et al. May 1991 A
5032416 Niaura et al. Jul 1991 A
5035907 Phillips et al. Jul 1991 A
5081917 Masuda Jan 1992 A
5255352 Falk Oct 1993 A
5334404 Garcia et al. Aug 1994 A
5485189 Ebata Jan 1996 A
5505775 Kitos Apr 1996 A
5547507 Ciaramita Aug 1996 A
5555350 Strauss Sep 1996 A
5711791 Croker et al. Jan 1998 A
5795395 Ben-Matitayhu et al. Aug 1998 A
5834047 Ahn Nov 1998 A
5835242 Itoh Nov 1998 A
5862326 Bapat Jan 1999 A
5895682 Tsukioka Apr 1999 A
6045220 Kiyohara et al. Apr 2000 A
6058843 Young May 2000 A
6154172 Piccionelli et al. Nov 2000 A
6230073 Kofman et al. May 2001 B1
6285775 Wu et al. Sep 2001 B1
6536345 Young Mar 2003 B1
6543463 Jalayer et al. Apr 2003 B1
6623553 Russell et al. Sep 2003 B2
7161710 MacLeod Jan 2007 B1
7216092 Weber et al. May 2007 B1
7286258 Schnoebelen et al. Oct 2007 B2
7884953 Willcocks Feb 2011 B1
8219494 Pride et al. Jul 2012 B1
8944542 Nohilly et al. Feb 2015 B2
10231477 Salvatori Mar 2019 B1
20010012529 Genevieve Aug 2001 A1
20020047867 Mault et al. Apr 2002 A1
20020049638 Ito Apr 2002 A1
20020095231 Yu et al. Jul 2002 A1
20020109600 Mault et al. Aug 2002 A1
20020152927 Russell et al. Oct 2002 A1
20030007191 Herbert Jan 2003 A1
20030198719 Stewart Oct 2003 A1
20040172149 Eto Sep 2004 A1
20050088693 Schnoebelen et al. Apr 2005 A1
20050157148 Baker et al. Jul 2005 A1
20050254073 Braun et al. Nov 2005 A1
20060015012 Sato Jan 2006 A1
20060155645 Sainsbury-Carter et al. Jul 2006 A1
20060158685 Spurgeon et al. Jul 2006 A1
20060207433 Sadakata et al. Sep 2006 A1
20060279771 Ludwig et al. Dec 2006 A1
20080144883 Kacker et al. Jun 2008 A1
20080174676 Squilla et al. Jul 2008 A1
20080209509 Koike et al. Aug 2008 A1
20080232686 Ohashi Sep 2008 A1
20080313011 Rose et al. Dec 2008 A1
20090285480 Bennett et al. Nov 2009 A1
20100017491 Johns et al. Jan 2010 A1
20100185529 Chesnut et al. Jul 2010 A1
20110025735 Nohilly et al. Feb 2011 A1
20110071894 Nesamoney et al. Mar 2011 A1
20110090541 Harper Apr 2011 A1
20120251689 Batchelder Oct 2012 A1
20130089642 Lipson et al. Apr 2013 A1
20140176608 Boysen Jun 2014 A1
20140210947 Finn et al. Jul 2014 A1
20150015919 Anderson et al. Jan 2015 A1
20170265492 Cohen Sep 2017 A1
20200184530 Anderson Jun 2020 A1
Foreign Referenced Citations (13)
Number Date Country
1702544 Sep 2006 EP
196885 Mar 1924 GB
422430 Jan 1935 GB
543427 Feb 1942 GB
628886 Sep 1949 GB
786428 Nov 1957 GB
9501735 Jan 1995 WO
9727759 Aug 1997 WO
2007013061 Feb 2007 WO
2010151202 Dec 2010 WO
2014190168 Nov 2014 WO
2016113318 Jul 2016 WO
2016207368 Dec 2016 WO
Non-Patent Literature Citations (30)
Entry
Supplemental European Search Report dated Jun. 19, 2008 in EP 06 76 6166, 2 Pages.
“From Phone To Foam—Steam CC Launches the Coffee Ripples App Putting Consumers in Control of “Coffee Art Content” In a Cup” PR Newswire, Jan. 6, 2016, 4 Pages http://www.prnewswire.com/news-releases/from-phone-to-foam—steam-cc-launches-the-coffee-ripples-app-putting-consumers-in-control-of-coffee-art-content-in-a-cup-300200121.html.
Icing Images, About iPrint Image Printing, web page accessed Aug. 24, 2016, 3 pages, http://www.icingimages.com/iprint.
Icing Images, iPrint Image Printing Template Designer, web page accessed Aug. 24, 2016, 2 pages, http://www.icingimages.com/iprint-template-designer.
United States Office Action dated Nov. 20, 2015 in U.S. Appl. No. 14/616,929, filed Feb. 9, 2015, 7 Pages.
International Search Report and Written Opinion dated Jan. 5, 2012 in Application No. PCT/US11/47096.
Genometri: Canvas, Retrieved from the Internet at: http://genometri.com/canvas.htm. Aug. 4, 2010, 1 page. (Previously submitted in related U.S. Appl. No. 15/157,142).
Ferguson Plarre Blakehouses, Birthday cakes, wedding cakes, corporate cakes online & morel, Retrieved from the Internet at: https://www.fergusonplarre.com.au (Previously submitted in related U.S. Appl. No. 15/157,142).
International Search Report and Written Opinion dated Aug. 22, 2017 for PCT Application No. PCT/JS2017/032948.
International Preliminary Report on Patentability issued in inernational application No. PCT/US2017/032948 dated Nov. 20, 2018.
Non-Final Office Action issued in U.S. Appl. No. 14/569,290 dated Mar. 27, 2015.
Final Office Action issued in U.S. Appl. No. 14/569,290 dated Jul. 16, 2015.
Non-Final Office Action issued in U.S. Appl. No. 14/569,290 dated Mar. 14, 2016.
Non-Final Office Action issued in U.S. Appl. No. 13/287,023 dated Feb. 27, 2015.
Final Office Action issued in U.S. Appl. No. 13/287,023 dated Jun. 3, 2015.
Non-Final Office Action issued in U.S. Appl. No. 13/287,023 dated Oct. 2, 2015.
Final Office Action issued in U.S. Appl. No. 13/287,023 dated Feb. 3, 2016.
Non-Final Office Action issued in U.S. Appl. No. 13/287,023 dated Aug. 31, 2016.
Notice of Allowance issued in U.S. Appl. No. 13/287,023 dated Mar. 20, 2017.
Non-Final Office Action issued in U.S. Appl. No. 12/852,988 dated May 18, 2012.
Final Office Action issued in U.S. Appl. No. 12/852,988 dated Feb. 14, 2013.
Non-Final Office Action issued in U.S. Appl. No. 12/852,988 dated Dec. 11, 2014.
Final Office Action issued in U.S. Appl. No. 12/852,988 dated Jun. 24, 2015.
Non-Final Office Action issued in U.S. Appl. No. 12/852,988 dated Jun. 2, 2016.
Notice of Allowance issued in U.S. Appl. No. 15/157,142 dated Jul. 16, 2018.
Non-Final Office Action issued in U.S. Appl. No. 15/157,142 dated Nov. 13, 2018.
Final Office Action issued in U.S. Appl. No. 15/157,142 dated Mar. 14, 2019.
Notice of Allowance issued in U.S. Appl. No. 15/157,142 dated Sep. 30, 2019.
Extended European Search Report dated Jan. 3, 2020 from European Patent Application No. 17800029.5.
European Examination Report mailed in EP Application No. 17800029.5 dated Jun. 2, 2022, 5 pages.
Related Publications (1)
Number Date Country
20200376826 A1 Dec 2020 US
Continuations (2)
Number Date Country
Parent 15157142 May 2016 US
Child 16728236 US
Parent 13287023 Nov 2011 US
Child 14569290 US
Continuation in Parts (2)
Number Date Country
Parent 14569290 Dec 2014 US
Child 15157142 US
Parent 12852988 Aug 2010 US
Child 13287023 US