Patent Application
20220104654
This application claim priority to German Patent Application No. 102020126249.3, filed on Oct. 7, 2020 which is incorporated herein by reference in its entirety.
The present disclosure relates to a cooking appliance, in particular in the form of commercial cooking and/or holding devices which comprise an optical recognition system, image recording device and an evaluation device which utilizes an evaluation algorithm to determine the positioning of one or more food product carriers in the cooking or holding chamber or space and/or the positioning of at least one food product arranged on the food product carrier or tray from previously stored image data concerning the carrier and/or the form or dimension of the food product, thereby enabling the controller of the cooking and/or holding device or appliances to preferably recognize when mixed or rolling loads of food products are placed in the cooking and/or holding device(s) and to determine the precise location, i.e., level, of each food product and carrier or tray within the cooking or holding chamber or interior space, thereby enabling the controller to run different cooking recipe parameters at different locations, i.e., shelves, within the cooking chamber or interior space, or to determine when a particular food product carrier should be removed from the chamber, thereby ensuring the proper cooking or holding time of each particular food product on the respective food product carriers.
Such a cooking appliance is known from DE 10 2016 119 230 A1 and comprises a housing in which a cooking space is arranged having a cooking space opening. This cooking space opening can be released by opening a cooking space door or covered by closing the cooking space door, so that the cooking space is made accessible when opening the cooking space door, while it is closed when closing the cooking space door.
An insert rack is arranged in the cooking space including a plurality of pairs of insert rails arranged one above the other, wherein a food product carrier can be inserted into each pair of the insert rails. This results in at least one, but usually several insertion levels at different height levels.
The cooking appliance of the generic kind further comprises a recognition system which is arranged above the cooking space opening and includes an image recording device, in particular in the form of a camera. Since this camera is in signal connection with a control unit of the cooking appliance and this control unit performs the image processing by means of an evaluation algorithm in the control unit and for this purpose, as known data, the size of the detection area, the size of the baking sleeve, the size of the food support and the edge area of the food support and the resolution of the image must be entered into the control unit, this modification of the control unit results in a high technical effort, although a camera is used as the image recording device in the generic cooking device including a lens with a fixed focus.
It is therefore an object of the present disclosure to provide a cooking appliance, in particular in the form of a commercial cooking appliance, of the kind indicated in the preamble of claim 1, whose recognition system is technically simpler and thus more cost-effective to set up.
The cooking appliance according to the disclosure comprises an optical recognition system, whose image recording device is connected to a separate evaluation device via a data line. The evaluation device can use the cooking space image data recorded by the image recording device and transmitted to the evaluation device to determine the positioning of one or more food product carriers in the interior or cooking space of the foodservice device or equipment, or the spatial positioning within a foodservice device or equipment, e.g., cooking appliance, in particular a heat-retention device (e.g., a holding cabinet), and the positioning of at least one food product arranged on a food product carrier, respectively. Here, the term “spatial positioning” in a foodservice device, e.g., a cooking appliance, refers in particular to the horizontal and vertical insertion position.
This takes advantage of the fact that the size and shape of the food product carriers, the number of insert rails and, thus, the number of insertion levels, and the distances between the insertion levels, as well as the shape and size of different food products, are known variables that can be entered as basic data in the separate evaluation unit, whereas the appliance control does not have to be programmed in a complex manner with the data required for image processing and an evaluation algorithm, as is necessary in the case of the cooking appliance of the generic kind. That is, the present disclosure provides the evaluation unit with the necessary location of the food product carrier and the type of food product disposed on each respective carrier, thereby enabling the evaluation unit to provide such information to the controller such that it can provide different recipe parameters to the cooking appliance to uniquely enable it to operate the appliance such that it can cook the various food products in a mixed load cooking chamber based upon its specific cooking recipe at the same time.
The location of the carrier or tray and the food product disposed on the carrier is an important piece of information when utilizing product recognition technology to automatically set the cooking recipe parameters in any cooking appliance. This is particularly true when the cooking appliance is asked to simultaneously cook a mix of different food products at the same or substantially the same time. The controller stores each carrier's position or location, food product disposed thereon, and cook or hold time remaining pertaining to each carrier for the particular food product disposed thereon.
If a customer is using the cooking appliance in a “rolling load” mode, the same of different types of food product will be inserted and removed continuously from the cooking or holding chambers. For examples, if two food product carriers or trays with chicken are inside the cooking chamber or oven, it is critical to know which carrier or tray is ready for unloading and which is required to remain in the cooking chamber, e.g., interior space, to complete the pre-set cooking process.
Regarding the location of the food items on the carrier, some end users are placing to many items on the carrier or tray. This results in uneven cooking of the food items. The present disclosure is capable of alerting the user that the food items need to be more evenly distributed on the carrier or tray, so that the hot air can stream around the items.
Furthermore, it can be taken into account that in the case of a plurality of insertion levels, a change in the edge lengths of the food product carriers detected by the image recording device occurs in dependance on the distance from the image recording device, which is reflected in the recorded image data, so that the evaluation device can determine, for example, the insertion level on which a food product carrier has been arranged from the previously entered data and the recorded image data.
Such a determination of the insertion level can also be carried out by comparing the product size recorded by the image recording device with the known actual product size, since a food product located closer to the image recording device is recorded as being larger than a food product located further away from the image recording device in the cooking space. These size differences can be transmitted as image data to the evaluation device, which uses a comparison unit to compare the actual size of the cooked product as a preset parameter with the recorded image data of the food products arranged in the cooking space and can determine the relevant insertion level. Here should be mentioned that due to the increase in the degree of industrialization of food production, the size and shape of a specific food product is standardized to a large extent. An exemplary baked product, such as a commercially available Kaiser-roll, has a fixed size and outer geometry.
Alternatively, it is possible for the image recording device to record the number of insert rail pairs not provided with food product carriers, which are then transmitted as image data to the evaluation device, which in turn can determine the occupancy of the respective rack levels in its comparison unit by comparing the recorded number of unloaded insert rail pairs with the total number of insert rail pairs present.
The disclosure also relates to a cooking appliance which is also characterized in that the image recording device is connected via a data line to a separate evaluation device which can determine the image section to be analyzed from the cooking or interior space image data recorded by the image recording device and transmitted to the evaluation device.
For this is used that the image recording device, in particular in the form of a camera with fixed optics and thus fixed focal length, always captures a standard area, usually a circular area of a capture cone of the camera. The image recorded by the image recording device in the form of the standard area falls on the sensor area of an image sensor (e.g., CCD sensor), the sensor area of this image sensor usually being a square or a rectangle. In this way, areas beyond the sensor area that do not need to be evaluated are cut away from the image sensor. The resulting image is transmitted to the evaluation device, which, on the basis of the insertion position of the food product carrier known to it, cuts away all image areas that extend beyond the image area actually to be analyzed, on which, for example, a food product is arranged, so that only the actually relevant image section remains for the evaluation device, which must be considered with regard to food product to be analyzed. Since the number of pixels of the commonly used image sensors is extremely high anyway, the remaining image area to be analyzed has such a high number of pixels that also a high resolution is possible, which ensures a high analysis quality, but on the other hand can advantageously considerably reduce the computing power to be provided by the evaluation device, since only the image area that is actually relevant for the desired analysis result is analyzed. As explained above, an image recording device, in particular in the form of a camera, with fixed optics and thus a fixed focal length, is advantageously used for this embodiment of the cooking device according to the disclosure.
For example, the CCD sensor mentioned above is used as the image sensor.
A method for determining a position of a food product carrier in a foodservice device comprising: activating an optical recognition system; determining if the food product carrier is detected by the optical recognition system; if the food product carrier is detected by the optical recognition system, activating an image recording device to record an interior space of the foodservice device with the food product carrier disposed therein; transmitting the recorded interior space image from the image recording device to an evaluation device; and determining via the evaluation device the position of the food product carrier in the interior space, or the spatial positioning within the interior space.
The spatial positioning within the interior space is determined by either (1) a fixed focal length of the image recording device, and/or (2) an edge length of the food product carrier.
A method for determining a position of a food product on a carrier in a foodservice device comprising: activating an optical recognition system; determining if the food product carrier is detected by the optical recognition system; if the food product carrier is detected by the optical recognition system, determining if a food product is on the food product carrier by the optical recognition system; if the food product is detected on the food product carrier by the optical recognition system, then activating an image recording device to record an image of the detected food product within the interior space; transmitting the recorded food product image from the image recording device to an evaluation device; and determining the position of the food product on the food product carrier by comparing the recorded food product image from the image recording device to a previously stored food product.
A method for determining the occupancy of rack levels in a foodservice device comprising: activating an optical recognition system; detecting by the optical recognition system if there are any insert rail pairs in an interior space of the foodservice device without a food product carrier disposed thereon; if there are any insert rail pairs without a food product carrier disposed thereon, then activating an image recording device to record the number of insert rail pairs without the food product carrier disposed thereon; transmitting a recorded image of the insert rail pairs without a food product carrier to an evaluation device; and determining the occupancy of the respective rack levels by comparing the recorded number of the insert rail pairs without a food product carrier to the maximum number of the insert rail pairs in the interior space.
A method for minimizing an image section of a food product carrier which is to be analyzed comprising: activating an optical recognition system; determining if the food product carrier is detected by the optical recognition system; if the food product carrier is detected by the optical recognition system, then activating an image recording device to record an image of an interior space of a foodservice device with the food product carrier disposed therein; transmitting the recorded image of the interior space from the image recording device to an evaluation device; determining via the evaluation device an image section of the food product carrier within the recorded image of the interior space to be analyzed from the food product space image data recorded by the image recording device; and cutting away all image areas that extend beyond the image section to be analyzed.
A method for transferring a food product carrier between at least a first foodservice device and a second foodservice device, which method comprises: activating a first optical recognition system for a first foodservice device; detecting by the first optical recognition system if a food product carrier is in the first foodservice device; if the first optical recognition system detects that the food product carrier is in the first foodservice device, detecting by the first optical recognition system if a food product is on the food product carrier; if the food product is detected on the food product carrier, activating an image recording device to record an image of the detected food product within an interior space of the first foodservice device; transmitting the recorded food product image from the image recording device to an evaluation device; determining the position of the food product on the food product carrier by comparing the recorded food product image to a previously stored known food product; activating a first timer regarding the food product in the first foodservice device; detecting if the food product carrier is removed from the first foodservice device; if the food product carrier is removed from the first foodservice device, transmitting information pertaining to the food product and the food product carrier from the first foodservice device to the second foodservice device; detecting by a second optical recognition system if the food product carrier has been received by the second foodservice device; if the food product carrier has been received by the second foodservice device, detecting if the food product is on the food product carrier which was detected by the second optical recognition system; activating an image recording device to record an image of the detected food product on the food product carrier in the second foodservice device; comparing the information transmitted from the first foodservice device with information received by the second foodservice device; determining the position of the food product on the food product carrier by comparing the recorded food product image from a previously stored food product; and activating a remaining timer on the second foodservice device if the information that was transmitted from first foodservice device matches the information received by the second foodservice device.
Further details, advantages and features of the disclosure will be apparent from the following description of the drawing. It shows:
Before discussing the principles of the present disclosure in detail, it should be emphasized that, in the context of the present application, the term “cooking appliance” is understood to include commercial cooking devices as well as household cooking devices and, more generally, food processing devices that can perform both cold and hot treatment of food products and may include, for example, hot air steamers, combi steamers, beverage dispensers, beverage mixers, microwave ovens and other foodservice devices.
A combination of
The cooking appliance 1 comprises a housing 2, in which a cooking space 3 is arranged having an internal space or cabinet opening 4.
An insert rack 5 is arranged in the cooking space 3. In the example shown, this insert rack 5 includes a plurality of pairs of insert rails arranged one above the other, whose pairs 6, 7 and 8, 9 are identified by reference signs as representative of all pairs. These pairs of insert rails each serve to accommodate a food product carrier 10 on insertion levels of different heights, which in
Furthermore,
According to the disclosure, the image recording device 12 is connected via a data line 13 to an evaluation device 14, which is shown schematically in a greatly simplified manner. Image data, symbolized in
The image data BD1, BD2, BD3 and BD4 recorded by the image recording device 12 result in the example shown from the arrows symbolizing these image data, which extend from the image recording device 12 to corner points P1, P2, P3 and P4 of the rectangular food product carrier 10 in the example and symbolize the image section which results from projecting the image of the food product carrier 10 recorded by the image recording device 12 onto an image sensor not shown in detail in the figures.
It should also be noted that the cooking appliance 1 according to the disclosure can include a cooking space door 17, which is shown in
Furthermore, the cooking appliance 1 includes a cooking appliance control 16 which is connected to the evaluation device 14 via a second data line 15 in order, among others, to enable the cooking device 1 to be controlled or regulated in accordance with the data supplied by the evaluation device 14.
With regard to the second previously explained embodiment of the cooking appliance 1 according to the disclosure, reference can be made to the preceding description of
The circle 18 symbolizes a standard recording area of the image recording device 12, which is projected by the latter onto an image sensor not shown in detail in the figures. The image sensor includes a sensor area 19, shown as a square in the example, which is smaller than the standard image recording area 18 of the image recording device 12. The resulting excess areas 18A to 18D are cut away by the image sensor so that only the image of the sensor area 19 is fed to the evaluation device 14 with the respectively intended number of pixels P19. Based on the basic data made available to the evaluation device 14, such as in particular the possible insertion positions in the insertion rack 5, it is possible for the latter to determine a partial area 20 on which, for example, the food products A1 or A2 shown in
The disclosure further relates to a food foodservice device system comprising at least two food foodservice devices. Such a known food foodservice device system may comprise a cooking appliance, in particular in the form of a commercial cooking appliance, and a heat retention appliance. Here, after the end of the cooking process, food product carriers can be removed from the cooking appliance and transferred to the heat retention appliance. In this case, it can typically happen that the food product carriers are slide in and out of the heat retention appliance and sometimes the position is also changed and, furthermore, if several heat retention devices are provided, these are also changed. It should be noted that every food has a maximum retention time in the heat retention appliance. When this has expired, the food should be removed from the heat retention appliance.
For determining the expiry of the maximum permissible dwell time, timers are usually provided on the holding device, which are started by inserting the food product carrier, which is often a tray. Various mechanisms, such as RFID stickers, are known for this start function.
However, investigations carried out during the disclosure have shown that the techniques used to start timers, for example of heat retention devices, are often complex and thus expensive.
It is therefore an object of the present disclosure to provide a food foodservice device system which permits a technically simple and reliable design with at least reduced manufacturing and operating costs.
In accordance with the technical principles of the present disclosure, there is provided a food foodservice device system comprising at least a first foodservice device, which may be, for example, a cooking appliance. This first foodservice device comprises a first optical recognition system, which may be provided with a first image recording device, for example in the form of a camera.
Furthermore, at least one second food foodservice device is provided which, as explained above, can be, for example, a heat retention appliance. This second foodservice device comprises a second optical recognition system, which can also be provided with an image recording device, such as a camera. This second optical recognition system is provided for observing an interior of the second foodservice device, the interior having at least one insertion level, but generally a plurality of insertion levels arranged one above the other, for receiving food product carriers (for example in the form of trays). Furthermore, the second foodservice device comprises a timer for recording the expiry of a maximum permissible dwell time of the cooked food brought into the interior. The timer is initiated depending on the cooked food brought in, and the initiated timer is visually displayed on a display of the second treatment device, taking into account its insertion position in the interior of the second foodservice device. Here, the positioning of the timer on a display is to be equated with the real positioning of the food product carrier. As an example, a carrier inserted at the bottom right would also be shown on the display at the top right. This visualization enables the user a clear identification of the running timer and the remaining dwell time of the food in the food foodservice device, respectively.
Advantageously, in addition to the insertion position and the insertion time of the food product carrier, it is also possible to carry out an object detection for the food product on it. In this context, the term “object recognition” describes methods for identifying known objects within an object space by means of optical, acoustic and/or physical recognition methods. Known algorithms use, for example, edge detection or Canny Edge detection and/or Hough Line interpolation in recorded images of the objects. Alternatively, object recognition methods are possible with which recorded images are compared with patterns of known objects (template matching) or object detections are performed with artificial neural networks.
Overall, it can be stated that the food foodservice device system according to the disclosure can be operated in principle with any type of known object recognition. The dependent claims contain advantageous developments of the disclosure.
Further details, advantages and features of the disclosure will be apparent from the following description of an exemplary embodiment with reference to
The combination of
In the example shown, this foodservice device system 21 includes a first foodservice device 1 which comprises a first optical recognition system 11 with an image recording device 12.
The second foodservice device 22 further comprises a timer 26, which is displayable in a display 25 after insertion of the food product carriers 29 and 30. A position indication 27 is further possible on the display 25, so that it results for the example shown in
Like the foodservice device 1, the foodservice device 22 further comprises an optical recognition system 23, in the example with a camera 24 as image recording device, wherein the optical recognition system 23 can be connected via a data line 32 to an evaluation device 28, which with regard to its function can correspond to the evaluation device 14 of the cooking appliance 1. In the foodservice device according to
A combination of
In the example shown, the cloud 35 is connected via a data line 36 to the device controller 27 of the second foodservice device 22.
Due to the explained and illustrated constellation of the foodservice devices 1 and 22 and their components, it is possible, after removal of cooked food from the cooking device 1, for example to detect its quality 11 as well as their quantity and arrangement on a food product carrier via the first optical recognition system 11.
This is also possible with the second optical recognition system 23 of the second foodservice device 22 upon insertion of a corresponding food product carrier, such as the food product carriers 29 and 30 shown, in order to determine, for example, that the food products inserted into the second foodservice device 22 are those which have been taken from the cooking appliance 1 as the first foodservice device, this preferably being possible solely by determining the local position of the food products on the food product carrier. This is possible even if a displacement of the food products on the food product carrier has occurred within certain limits during the transport from the foodservice device 1 to the foodservice device 22, for which it is possible, due to the connection of the first and second foodservice devices 1 and 22, respectively, to the cloud 35 to use the artificial intelligence KI contained in the cloud 35 for this evaluation. Analysis methods that are available here are, for example, the above-mentioned pattern recognition and edge analysis, which are available to the person skilled in the art in the field of optical recognition.
In a schematically simplified illustration, an optical sensor 38 (e. g. CMOS) is shown, which interacts with a lens 39 which is arranged at a distance f from the optical sensor 38 corresponding to the focal length of the lens 39.
According to the illustration chosen in
As
The same applies to a lateral offset symbolized by the dashed food product carrier 43.
Computer 805 includes a user interface 810, a processor 815, and a memory 825. Computer 805 may be implemented on a general-purpose microcomputer. Although computer 805 is represented herein as a standalone device, it is not limited to such, but instead can be coupled to other devices (not shown) via network 820.
Processor 815 is configured of logic circuitry that responds to and executes instructions.
Memory 825 stores data and instructions for controlling the operation of processor 815. Memory 825 may be implemented in a random access memory (RAM), a hard drive, a read only memory (ROM), or a combination thereof. One of the components of memory 825 is a program module 830.
Program module 830 contains instructions for controlling processor 815 to execute the methods described herein. For example, as a result of execution of program module 830, processor 815. The term “module” is used herein to denote a functional operation that may be embodied either as a stand-alone component or as an integrated configuration of plurality of sub-ordinate components. Thus, program module 830 may be implemented as a single module or as a plurality of modules that operate in cooperation with one another. Moreover, although program module 830 is described herein as being installed in memory 825, and therefore being implemented in software, it could be implemented in any of hardware (e.g., electronic circuitry), firmware, software, or a combination thereof.
User interface 810 includes an input device, such as a keyboard, touch panel or speech recognition subsystem, for enabling a user to communicate information and command selections to processor 815. User interface 810 also includes an output device such as a display, loudspeaker, or a printer. A cursor control such as a mouse, track-ball, or joystick, allows the user to manipulate a cursor on the display for communicating additional information and command selections to processor 815.
Processor 815 outputs, to user interface 810, a result of an execution of the methods described herein. Alternatively, processor 815 could direct the output to a remote device (not shown) via network 820.
While program module 830 is indicated as already loaded into memory 825, it may be configured on a storage medium 835 for subsequent loading into memory 825. Storage medium 835 can be any conventional storage medium that stores program module 830 thereon in tangible form. Examples of storage medium 835 include a floppy disk, a compact disk, a magnetic tape, a read only memory, an optical storage media, universal serial bus (USB) flash drive, a digital versatile disc, or a zip drive. Alternatively, storage medium 835 can be a random access memory, or other type of electronic storage, located on a remote storage system and coupled to computer 805 via network 820.
System 800 is by laterally connected to first foodservice device 836 and second treatment application 837 via network 820. First foodservice device 836 can be either a cooking appliance or a heat retention or holding cabinet which comprises a timer 845, display 846, evaluation device 842, position indicator 803, and a first optical recognition system (ORS) 839. ORS 839 comprises an image recording device (IRD) 801. Similarly, second foodservice device 837 can be either a cooking appliance or a heat retention or holding cabinet which comprises a timer 838, display 840, evaluation device 841, position indicator 844 and second ORS 843. ORS 844 comprises an image recording device 802.
System 800 thereafter checks 1509 to see if food product carrier 10 has been detected by ORS 843 of second foodservice device 837. If detected, then system 800 check 1510 to see if the food product is detected on carrier 10 by ORS 843. If no, then the system returns to step 1509. If yes, system 800 activates 1511 image recording device 802 to record an image of the detected food product within a food space or cabinet and compares with key information received from first foodservice device 836. Thereafter, system 800 determines 1512 the position, i.e., insertion level, of the food product on carrier 10 by comparing the recorded food product image from IRD 802 to the previously stored form, shape and/or dimension of a known food product and activates a remaining timer 838 that is on display 840 of second foodservice device 837 if the key information that was received from first foodservice device 836 is matching.
In addition to the foregoing written disclosure of the disclosure, reference is hereby made explicitly to the graphic representation of the disclosure in
| Number | Date | Country | Kind |
|---|---|---|---|
| 102020126249.3 | Oct 2020 | DE | national |
