The present disclosure relates to a cooking support method and a cooking support system.
There has been proposed a method of detecting boiling over of a content from cookware such as a pot. For example, there has been disclosed a method of equipping a weight detector to an electromagnetic cooking heater, also called an induction heating (IH) cooking heater, which operates only with electricity without using gas or fire, and detecting boiling over from a cookware heated by the electromagnetic cooking heater based on the position of the center of gravity of and a change in weight of the cookware.
However, the above conventional technique has a problem that such boiling over from the cookware cannot be dealt with only after the actual occurrence thereof. Therefore, it is troublesome to wipe off and clean up the content and the like which have boiled over onto the electromagnetic cooking heater.
In one general aspect, the techniques disclosed here feature a cooking support method for a cooking support system which is connected through a network to a thermal image camera that takes a thermal image of a region including a cookware during cooking and to a notification device capable of notifying the user of information, and which supports cooking by a user, comprising: acquiring, through the network from the thermal image camera, a thermal image of the region including the cookware at predetermined time intervals taken from the obliquely above the cookware by the thermal image camera; calculating a value indicating a change in level of a content in the cookware from the acquired thermal image; determining whether or not the calculated value indicating the change in level is not less than a predetermined threshold; determining that there is a possibility of the content boiling over the cookware during cooking when it is determined that the calculated value indicating the change in level is not less than the predetermined threshold; and transmitting notification information indicating information notifying the user that there is the possibility of boiling over to the notification device.
These general and specific aspects may be implemented using a system, a method, and a computer program, and any combination of systems, methods, and computer programs.
According to the present disclosure, a cooking support method and a cooking support system can be provided, which can prevent boiling over from cookware by detecting occurrence thereof beforehand.
Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
There has been proposed a method of detecting boiling over of a content from a cookware such as a pot (see, for example, Japanese Unexamined Patent Application Publication No. 2013-72637 (JP2013-72637A)).
JP2013-72637A discloses a method of equipping a weight detector to an electromagnetic cooking heater which operates only with electricity without using gas or fire, and detecting boiling over from a cookware heated by the electromagnetic cooking heater based on the position of the center of gravity of and a change in weight of the cookware.
However, the technique disclosed in JP2013-72637A has a problem that such boiling over from the cookware cannot be dealt with only after the actual occurrence thereof. Therefore, it is troublesome to wipe off and clean up the content and the like which have boiled over onto the electromagnetic cooking heater.
Meanwhile, Japanese Unexamined Patent Application Publication No. 2007-303804 (JP2007-303804A) discloses, for example, a method of using an infrared sensor to detect the temperature of a cookware, and thereby detecting boiling over from a cookware heated by an electromagnetic cooking heater before the occurrence thereof.
However, the technique disclosed in JP2007-303804A has a problem that only surface temperature information on one side of the cookware can be acquired due to a positional relationship between the installation position of the infrared sensor and the position where the cookware is placed. Therefore, if the cookware is a stainless steel pot, temperature information on the content cannot be acquired with the infrared sensor. Moreover, the technique disclosed in JP2007-303804A also has a problem that, since a sensor to detect the cookware is installed in addition to the infrared sensor to detect the temperature of the cookware, it is difficult to install and set these sensors and thus introduction thereof is not realistic.
In consideration of the above problems, the inventors have conceived the aspects disclosed below.
(1) A cooking support method according to aspect of the present disclosure provides a cooking support method for a cooking support system which is connected through a network to a thermal image camera to take a thermal image of a region including a cookware during cooking and to a notification device capable of notifying the user of information, and which supports cooking by a user, including: acquiring, through the network from the thermal image camera, a thermal image of the region including the cookware at predetermined time intervals taken from the obliquely above the cookware by the thermal image camera; calculating a value indicating a change in level of a content in the cookware from the acquired thermal image; determining whether or not the calculated value indicating the change in level is not less than a predetermined threshold; determining that there is a possibility of the content boiling over the cookware during cooking when it is determined that the calculated value indicating the change in level is not less than the predetermined threshold; and transmitting notification information to the notification device, the notification information indicating information notifying the user that there is the possibility of boiling over.
According to this aspect, a cooking support method and a cooking support system can be provided, which can prevent boiling over from cookware by detecting occurrence thereof beforehand.
(2) In the described-above aspect, the cooking support system may be further connected through the network to a cooking heater that enables cooking with the cookware, the cooking support method may further include transmitting a control signal indicating an instruction to lower an output of the cooking heater to the cooking heater when it is determined that the calculated value indicating the change in level is not less than the predetermined threshold.
(3) In the described-above aspect, the control signal may indicate an instruction to stop a cooking operation by the cooking heater.
(4) In the described-above aspect, the cooking support method may further include calculating a value indicating a change in area of a predetermined temperature region that is a region having a predetermined temperature or higher in the thermal image of the cookware acquired at the predetermined time intervals, as the value indicating the change in level.
(5) In the described-above aspect, the cooking support method may further include determining whether or not there is a lid on the cookware during cooking based on the thermal image; when it is determined that there is no lid, determining whether or not the value indicating the change in level is not less than the predetermined threshold; and when it is determined that there is the lid, detecting an outside edge of the lid of the cookware based on the thermal image, calculating a value of a temperature change in the outside edge as the value indicating the change in level, and determining whether or not the value of the temperature change in the outside edge is not less than a predetermined threshold.
(6) In the described-above aspect, the cooking support method may further include calculating a value indicating a change in area of a region having a predetermined temperature or higher at and around the outside edge in the thermal image of the cookware at the predetermined time intervals, as the value of the temperature change in the outside edge.
(7) In the described-above aspect, the cooking support method may further include checking if the region of the acquired thermal image includes a human temperature region that is a temperature region indicating a human in a background region other than a cookware region that is a specific region including the cookware; and resetting the value indicating the change in level when it is confirmed that there is the human temperature region in the background region.
(8) In the described-above aspect, the notification device may be portable by the user and includes a display viewable by the user, and the cooking support method may further include transmitting the notification information through an e-mail to the notification device when it is determined that the calculated value indicating the change in level is not less than the predetermined threshold.
(9) A cooking support method according to aspect of the present disclosure provides a cooking support system which is connected through a network to a thermal image camera to take a thermal image of a region including a cookware during cooking and to a notification device capable of notifying the user of information, and which supports cooking by a user, including: a data acquirer that acquires, through the network from the thermal image camera, a thermal image of the region including the cookware at predetermined time intervals taken from the obliquely above the cookware by the thermal image camera; a change calculator that calculates a value indicating a change in level of a content in the cookware from the acquired thermal image; a boil-over determiner that determines whether or not the calculated value indicating the change in level is not less than a predetermined threshold, and determines that there is a possibility of the content boiling over the cookware during cooking when it is determined that the calculated value indicating the change in level is not less than the predetermined threshold; and a notifier that transmits notification information indicating information notifying the user that there is a possibility of boiling over to the notification device when the boil-over determiner determines that there is the possibility of the content boiling over.
It should be noted that general or specific embodiments may be implemented as a system, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, and may be realized by any combination of a system, a method, an integrated circuit, a computer program, and a recording medium.
With reference to the drawings, specific description is given below of a cooking support method and the like according to one embodiment of the present disclosure. Note that embodiments described below are all specific examples of the present disclosure. Values, shapes, materials, components, placements of components, and the like described in the following embodiments are only exemplary, and do not restrict the present disclosure. Components in the following embodiments which are not included in an independent claim indicating the highest concept are described as being optional components. cl Embodiment 1
With reference to the drawings, a cooking support system according to Embodiment 1 is described below.
A cooking support system 1 is connected to the thermal image camera 2, a cooking heater 3, and a notification device 6 through a network 7 as shown in
The cooking heater 3 is a device that enables cooking with the cookware 5. The cooking heater 3 is, for example, an IH cooking heater that cooks the content in the cookware 5 by operating only with electricity, without using gas or fire, to heat the cookware 5. Note that the cooking heater 3 is not limited to the IH cooking heater but may also be a cooking heater that performs cooking with the cookware 5 by using gas or fire if the cooking heater can stop cooking according to a control signal from the cooking support system 1 as described later.
The cookware 5 is, for example, a pot or the like, having its content cooked by the cooking heater 3.
The thermal image camera 2 is installed to be able to take a thermal image from obliquely above the cookware 5, and takes a thermal image of a region including the cookware 5 during cooking of the content. In this embodiment, the thermal image camera 2 is attached to a kitchen stove hood 4 or the like, for example, above the cooking heater 3 as shown in
The notification device 6 is a device capable of notifying the user of information. In this embodiment, the notification device 6 is a portable device that can be carried by the user and includes a display viewable by the user, such as a smartphone and a cell-phone, for example. Note that the notification device 6 is not limited to such a device that can be carried by the user and includes the display viewable by the user, but may also be a sound generator capable of notifying the user of information such as an alert by generating a sound.
The network 7 is a network such as a wireless communication network such as Bluetooth (registered trademark) and Wi-Fi or a wireless or wired LAN.
As shown in
When the boil-over detector 10 detects the possibility of boiling over (occurrence of boiling over), the notifier 20 transmits notification information indicating information notifying the user of the possibility of boiling over. In this embodiment, for example, the notifier 20 transmits the notification information indicating the possibility of boiling over through e-mail, for example, to the notification device 6.
When the boil-over detector 10 detects the possibility of occurrence of boiling over, the heating controller 30 transmits a control signal indicating an instruction to lower the output of the cooking heater 3 to the cooking heater 3. Here, the control signal may indicate an instruction to stop a heating operation by the cooking heater, for example.
As shown in
The data acquirer 11 acquires the thermal image of the region including the cookware 5 at predetermined time intervals from the thermal image camera 2.
The cookware detector 13 detects whether or not there is the cookware 5, based on the thermal image acquired by the data acquirer 11. In this embodiment, the cookware detector 13 performs image processing of binarizing and smoothing the thermal image acquired by the data acquirer 11 and then performs detection processing of detecting an edge of the cookware 5 in the thermal image subjected to the image processing, thereby detecting whether or not there is the cookware 5. When having succeeded in the detection processing, the cookware detector 13 stores positional information on the cookware 5 in the thermal image acquired by the data acquirer 11 and temperature information that can be acquired from the thermal image of the cookware 5 in the storage 14.
The hot portion detector 12 detects a hot portion of the cookware 5 from the thermal image acquired by the data acquirer 11. In this embodiment, the hot portion detector 12 detects a hot region having 70° C. or higher, for example, in the thermal image acquired by the data acquirer 11, and stores the detected hot region as temperature information in the storage 14.
The storage 14 includes, for example, an SD card or a flash memory, and stores the temperature information (thermal image of the hot region) described above and positional information on the cookware 5 in the thermal image acquired by the data acquirer 11.
The change calculator 15 calculates a value indicating a change in level of the content in the cookware 5 from the thermal image acquired by the data acquirer 11. Here, as the value indicating a change in level, for example, the change calculator 15 calculates a value indicating a change in area of a predetermined temperature region that is a region having a predetermined temperature or higher in the thermal image of the cookware 5 acquired at predetermined time intervals. In this embodiment, the change calculator 15 detects the content level in the cookware 5 from the hot region having 70° C. or higher, for example, in the cookware 5 within the thermal image detected by the cookware detector 13. Then, the change calculator 15 calculates a difference distance between the detected content level (upper edge of the hot region) in the cookware 5 and the edge (upper edge) of the cookware 5 detected by the cookware detector 13. The change calculator 15 stores information (upper edge of the hot region) indicating the detected content level and the calculated difference distance in the storage 14. When information indicating the content level detected a predetermined time ago is stored in the storage 14, the change calculator 15 calculates an increase in the detected content level. Here, as the increase in content level, the change calculator 15 calculates an increase indicating a change in area of the hot region that is a region having 70° C. or higher, for example, in the thermal image of the cookware 5 acquired at predetermined time intervals.
Note that, as the value indicating a change in content level in the cookware 5, the change calculator 15 may also calculate a ratio of the hot region of the thermal image indicating the content in the cookware 5 to the region of the thermal image indicating the cookware 5.
The boil-over determiner 16 determines whether or not the value indicating a change in level calculated by the change calculator 15 is not less than a predetermined threshold. When determining that the value indicating a change in level calculated by the change calculator 15 is not less than the predetermined threshold, the boil-over determiner 16 determines that there is the possibility of the content boiling over the cookware 5 during cooking. In this embodiment, the boil-over determiner 16 determines whether or not the increase calculated by the change calculator 15 is not less than a predetermined threshold (hereinafter referred to as the first threshold). When determining that the increase calculated by the change calculator 15 is not less than the first threshold, the boil-over determiner 16 determines that there is the possibility of the content boiling over the cookware 5 during cooking.
Note that, when determining that the increase calculated by the change calculator 15 is not less than the first threshold, the boil-over determiner 16 may further determine whether or not the calculated increase is not less than a second threshold. When determining that the calculated increase is not less than the second threshold, the boil-over determiner 16 may determine boil-over occurrence, meaning that the content is to actually boil over the cookware 5 during cooking within a few seconds, for example. On the other hand, when determining that the calculated increase is less than the second threshold, the boil-over determiner 16 may determine boil-over anticipation, meaning that there is the possibility of the content boiling over the cookware 5 during cooking within several ten seconds to several minutes, for example.
Note that, as described above, the change calculator 15 may calculate the ratio of the hot region of the thermal image indicating the content in the cookware 5 to the region of the thermal image indicating the cookware 5, as the value indicating a change in content level in the cookware 5. In this case, the boil-over determiner 16 may determine the boil-over anticipation, when the hot region of the thermal image indicating the content in the cookware 5 during cooking is 50% to 80% of the region of the thermal image indicating the cookware 5. Also, the boil-over determiner 16 may determine the boil-over occurrence, when the hot region of the thermal image indicating the content in the cookware 5 during cooking exceeds 80% of the region of the thermal image indicating the cookware 5.
Next, description is given of operations of the cooking support system 1 configured as described above.
First, the cooking support system 1 performs thermal image acquisition processing to acquire a thermal image of a region including the cookware 5 at the predetermined time intervals from the thermal image camera 2 through the network 7 (S1).
Next, the cooking support system 1 performs cookware detection processing to detect the cookware 5 based on the thermal image acquired in S1 (S3). Here, with reference to
As shown in
Next, the cooking support system 1 performs boil-over determination processing (S5). Here, with reference to
As shown in
Next, the cooking support system 1 calculates a difference distance between the content level in the cookware 5 detected in S51 and the edge (upper edge) of the cookware 5 (S52). In this embodiment, the cooking support system 1 calculates a difference distance between the periphery of the hot region having 70° C. or higher indicating the content level in the cookware 5 detected in S51 and the edge of the cookware 5 indicated by the positional information on the cookware 5 detected in S3 and stored in the storage 14.
Then, the cooking support system 1 checks if information indicating the content level detected a predetermined time ago is stored in the storage 14 (S53). Here, the information indicating the content level detected a predetermined time ago is, for example, a thermal image indicating the periphery of the hot region having 70° C. or higher. Note that, when it is confirmed that the information indicating the content level detected a predetermined time ago is not stored in the storage 14 (No in S53), the cooking support system 1 stores the information indicating the content level detected in S51 and the difference distance calculated in S52 in the storage 14 (S55).
On the other hand, when it is confirmed in S53 that the information indicating the content level detected a predetermined time ago is stored in the storage 14 (Yes in S53), the cooking support system 1 calculates an increase in the content level detected in S51 (S54). Here, the increase in the content level detected in S51 corresponds to a value indicating a change in the content level in the cookware 5, and is calculated from an increase indicating a change in area of the hot region having 70° C. or higher, for example, in each of the thermal images of the cookware 5 acquired at the predetermined time intervals.
Thereafter, the cooking support system 1 determines whether or not the increase calculated in S54 is not less than a first threshold (predetermined threshold) (S56). Note that, when the increase calculated in S54 is less than the first threshold (No in S56), the cooking support system 1 moves to S55 to store the information indicating the content level detected in S51 and the difference distance calculated in S52 in the storage 14.
On the other hand, when it is determined in S56 that the increase calculated in S54 is not less than the first threshold (Yes in S56), the cooking support system 1 determines that there is the possibility of the content boiling over the cookware 5 during cooking, and further determines whether or not the increase calculated in S54 is not less than a second threshold (S57).
When it is determined that the increase calculated in S54 is not less than the second threshold (Yes in S57), the cooking support system 1 determines boil-over occurrence (S58). Here, as described above, the boil-over occurrence means that the content is to boil over the cookware 5 during cooking within a few seconds, for example. On the other hand, when it is determined that the increase calculated in S54 is less than the second threshold (No in S57), the cooking support system 1 determines boil-over anticipation (S59). Note that the boil-over anticipation means that there is a risk (possibility) of the content boiling over the cookware 5 during cooking within several ten seconds to several minutes, for example.
Hereinafter, further description is given referring back to
Next, when it is determined in S5 that there is the possibility of boiling over, the cooking support system 1 performs notification processing to transmit notification information indicating information notifying the user of the possibility of boiling over to the notification device 6 (S7).
Then, when it is determined in S5 that there is the possibility of boiling over, the cooking support system 1 performs heating control processing to transmit a control signal indicating an instruction to lower the output of the cooking heater 3 to the cooking heater 3 (S9). Here, with reference to
As shown in
When it is confirmed in S91 that the boil-over occurrence has been determined (Yes in S91), the cooking support system 1 stops the heating operation by the cooking heater 3 (S92) and notifies the user of the cooking heater 3 that boiling over will occur (S93). In this embodiment, the cooking support system 1 transmits a control signal indicating an instruction to stop the heating operation by the cooking heater 3 to the cooking heater 3, thereby stopping the heating operation by the cooking heater 3. Also, the cooking support system 1 notifies the user that boiling over will occur by transmitting notification information indicating information notifying the user that boiling over will occur to the notification device 6. Note that the cooking support system 1 may perform either S92 or S93 first.
On the other hand, when it is confirmed in S91 that the boil-over occurrence has not been determined (No in S91), the cooking support system 1 checks if the boil-over anticipation has been determined in the boil-over determination processing in S5 (S94). When it is confirmed in S94 that the boil-over anticipation has been determined (Yes in S94), the cooking support system 1 controls the heat of the cooking heater 3 (S95) and notifies the user of the cooking heater 3 of the boil-over anticipation (S96). In this embodiment, the cooking support system 1 transmits a control signal indicating an instruction to lower the output of the cooking heater 3, thereby controlling the heat of the cooking heater 3. Also, the cooking support system 1 transmits notification information indicating information notifying the user of the boil-over anticipation to the notification device 6, thereby notifying the user of the boil-over anticipation. Note that the cooking support system 1 may perform either S95 or S96 first. On the other hand, when it is confirmed in S94 that the boil-over anticipation has not been determined (No in S94), the cooking support system 1 moves to S1 to start over from the thermal image acquisition processing.
As described above, the cooking support system and the cooking support method according to this embodiment can prevent the content in the cookware 5 from boiling over by detecting occurrence thereof beforehand, regardless of the material of the cookware 5, with the thermal image taken from obliquely above the cookware 5.
When the thermal image taken from the side of the cookware 5 is used, for example, as the comparative example, no temperature information can be acquired from the thermal image if the cookware 5 has low thermal conductivity, such as a stainless steel pot. Therefore, the content level cannot be detected, and thus boil-over determination cannot be made. Furthermore, when multiple cookwares 5 are arranged in parallel when seen from the thermal image camera 2, even if the cookwares 5 have high thermal conductivity, such as an enamel pot, temperature information on the respective cookwares 5 cannot be acquired from the thermal image, and thus the content levels cannot be detected.
Alternatively, when a thermal image taken from immediately above (above) the cookware 5 is used, for example, temperature information on the content can be detected even if the cookware 5 has low thermal conductivity, such as a stainless steel pot. However, in the early stage of shooting when the temperature of the content is low, it is difficult to distinguish the cooking heater 3 from the cookware 5 in the acquired thermal image. This reduces the accuracy of detecting the edge of the cookware 5. Therefore, temperature information on the content in the cookware 5 cannot be accurately acquired. Furthermore, when the thermal image taken from immediately above (above) the cookware 5 is used, it is difficult to distinguish the upper edge of the content from the edge of the cookware 5. Thus, the content level cannot be accurately detected from the thermal image. Therefore, when the thermal image taken from immediately above (above) the cookware 5 is used, accurate boil-over determination cannot be made.
On the other hand, the cooking support system and the cooking support method according to this embodiment make it easier to distinguish the upper edge of the content from the edge of the cookware 5, regardless of the material of the cookware 5, by use of the thermal image taken from obliquely above (oblique above angle) the cookware 5. Therefore, it is made easier to more accurately detect the content level, and to calculate a change in level (shift in level) of the content. Thus, accurate boil-over determination can be made. As a result, the content in the cookware 5 can be prevented from boiling over the cookware 5 by detecting occurrence thereof beforehand, regardless of the material of the cookware 5.
In Embodiment 1, the description is given of the cooking support method and the cooking support system when the cookware 5 such as a pot is not covered, for example. However, the present disclosure is not limited thereto. In Embodiment 2, description is given of a cooking support method and a cooking support system considering a case where a cookware 5 is covered. In the following description, description of the same points as Embodiment 1 is omitted, and differences are mainly described.
As shown in
As shown in
The lid determiner 17 determines whether or not there is a lid on the cookware 5 during cooking, based on the thermal image. When determining that there is the lid on the cookware 5 during cooking, the lid determiner 17 further detects an outside edge of the lid of the cookware 5 based on the thermal image.
When the lid determiner 17 determines that there is the lid on the cookware 5 during cooking, the change calculator 15A calculates a value of a temperature change in the outside edge detected by the lid determiner 17, as a value indicating a change in content level in the cookware 5. Here, the change calculator 15A calculates a value indicating a change in area of a region having a predetermined temperature or higher at and around the outside edge in the thermal image of the cookware 5 acquired at the predetermined time intervals, as the value of a temperature change in the outside edge.
The boil-over determiner 16A determines whether or not the value indicating a change in level calculated by the change calculator 15A is not less than a predetermined threshold. To be more specific, when the lid determiner 17 determines that there is no lid on the cookware 5 during cooking, the boil-over determiner 16A determines whether or not the value of a temperature change in the outside edge calculated by the change calculator 15A is not less than a predetermined threshold (fourth threshold). When determining that the value of a temperature change in the outside edge calculated by the change calculator 15A is not less than the predetermined threshold (fourth threshold), the boil-over determiner 16A determines that there is the possibility of the content boiling over the cookware 5 during cooking.
Next, description is given of operations of the cooking support system 1A configured as described above.
First, the cooking support system 1A performs thermal image acquisition processing to acquire a thermal image of a region including the cookware 5 at predetermined time intervals from the thermal image camera 2 through the network 7 (S1).
Next, the cooking support system 1A performs cookware detection processing to detect the cookware 5 based on the thermal image acquired in S1 (S3).
Then, the cooking support system 1A performs lid detection processing to detect a lid of the cookware 5 based on the thermal image acquired in S1 (S4). Here, with reference to
As shown in
Then, the cooking support system 1A performs boil-over determination processing (S5A). Here, with reference to
As shown in
When determining in S502 that there is no lid on the cookware 5 (No in S502), the cooking support system 1A moves to S51 shown in
On the other hand, when determining in S502 that there is the lid on the cookware 5 (Yes in S502), the cooking support system 1A stores edge temperature information on the cookware 5 in the storage 14 (S503). In this embodiment, the cooking support system 1A specifies the position of the edge (outside edge) of the cookware 5 in the thermal image, based on the positional information on the cookware 5 acquired from the storage 14. Then, the cooking support system 1A extracts temperature information (thermal image) at the position of the concerned edge of the cookware 5 from the temperature information (thermal image) acquired from the storage 14, and stores the extracted temperature information as temperature information (thermal image) of the edge of the cookware 5 in the storage 14. Note that the position of the concerned edge (outside edge) of the cookware 5 may be a position at and around the concerned edge, and may be a position at and outside or at and inside the concerned edge, or an outside position slightly away from the concerned edge.
Next, the cooking support system 1A checks if the edge temperature information of a predetermined time ago is stored in the storage 14 (S504). Note that, when it is confirmed in S504 that the edge temperature information of the predetermined time ago is not stored in the storage 14 (No in S504), the cooking support system 1A moves to S1 shown in
On the other hand, when it is confirmed in S504 that the edge temperature information of the predetermined time ago is stored in the storage 14 (Yes in S504), the cooking support system 1A calculates a change from the previous temperature of the edge (S505). To be more specific, the cooking support system 1A calculates a change that is a difference between the previous temperature and the latest temperature, from the thermal image (previous temperature) of the edge before the elapse of the predetermined time and the thermal image (latest temperature) of the edge after the elapse of the predetermined time.
Thereafter, the cooking support system 1A determines whether or not the calculated change is not less than a threshold (fourth threshold) (S506). When determining that the change calculated in S505 is less than the fourth threshold (No in S506), the cooking support system 1A moves to S1 shown in
On the other hand, when determining in S506 that the change calculated in S505 is not less than the fourth threshold (Yes in S506), the cooking support system 1A determines boil-over occurrence (S507). This boil-over occurrence means, as described above, that the content is to boil over the cookware 5 during cooking within a few seconds, for example. Note that the cooking support system 1A may determine that the change calculated in S505 is not less than the fourth threshold, when a temperature region having 75° C. or higher appears in the thermal image at and around the position of the concerned edge (outside edge). The cooking support system 1A may also determine that the change calculated in S505 is not less than the fourth threshold, when the temperature region having 75° C. or higher loses its shape (is no longer circular) in the thermal image at and around the position of the concerned edge (outside edge), depending on the material of the cookware 5.
Here, with reference to
For example, as shown in (a) of
Note that the same goes for the cookware 52 with the lid 52a on, which is an enamel pot, shown in
As described above, for the cookware 5 having low thermal conductivity, such as a stainless steel pot, boil-over determination cannot be made by detecting the content level directly from the thermal image if the cookware has the lid on. However, with the cooking support system and the cooking support method according to this embodiment, the boil-over determination can be made by detecting the hot portion in the thermal image indicating boil-off bubbles appearing on the edge (edge portion) of the lid or the loss of shape of the hot portion in the thermal image appearing across the lid. Thus, the content in the cookware 5 can be prevented from boiling over the cookware 5 by detecting occurrence thereof beforehand, regardless of the material of the cookware 5.
In Embodiments 1 and 2, the description is given of the cooking support method and the cooking support system when no human is involved until boiling over from the cookware 5 occurs. However, the present disclosure is not limited thereto. In Embodiment 3, description is given of a cooking support method and a cooking support system considering a case where a user (human) engages with the cookware 5 by stirring the content or opening the lid. In the following description, description of the same points as Embodiments 1 and 2 is omitted, and differences are mainly described.
As shown in
As shown in
The human presence detector 18 checks if there is a human temperature region that is a temperature region indicating a human in a background region other than a cookware region that is a predetermined region including the cookware 5, within the concerned region of the thermal image acquired by the data acquirer 11. Thus, the human presence detector 18 detects the presence of the human in the background region of the thermal image acquired by the data acquirer 11.
The boil-over determiner 16B determines whether or not the value indicating a change in level calculated by the change calculator 15A is not less than a predetermined threshold. To be more specific, when the human presence detector 18 confirms that there is the human temperature region in the background region, the boil-over determiner 16B resets the value indicating a temperature change in the content level in the cookware 5. Note that, when the human presence detector 18 cannot confirm that there is the human temperature region in the background region, i.e., when the human presence detector 18 confirms that there is no human in the background region, the boil-over determiner 16B operates in the same manner as the boil-over determiner 16A described in Embodiment 2, and thus description thereof is omitted here.
Next, description is given of operations of the cooking support system 1B configured as described above.
First, the cooking support system 1B performs thermal image acquisition processing (S1B). To be more specific, the cooking support system 1B acquires a thermal image of a region including the cookware 5 at predetermined time intervals from the thermal image camera 2 through the network 7 (S11) and then performs region-by-region thermal image generation processing (S12). Here, with reference to
Thereafter, the cooking support system 1B performs human detection processing by using the thermal image of the background region created in S1B (S2B). Here, with reference to
When there is no temperature region indicating a human in the acquired thermal image of the background region in S202 (No in S202), the cooking support system 1B moves to processing in S3. On the other hand, when it is confirmed that there is the temperature region indicating a human in the acquired thermal image of the background region in S202 (Yes in S202), the cooking support system 1B further checks if determination of boil-over anticipation has been made (S203).
When it is confirmed in S203 that no determination of boil-over anticipation has been made (No in S203), the cooking support system 1B returns to S1B to perform the thermal image acquisition processing. On the other hand, when it is confirmed in S203 that the determination of boil-over anticipation has been made (Yes in S203), the cooking support system 1B resets the information to be used for boil-over determination (S204) and then returns to S1B to perform the thermal image acquisition processing again. In this embodiment, in S204, the cooking support system 1B resets the value indicating the temperature change in the content level in the cookware 5 stored in the storage 14. When a thermal image of a hot portion acquired a predetermined time ago in the cookware 5 is stored in the storage 14, for example, as information indicating the content level in the cookware 5 detected a predetermined time ago, the thermal image of the hot portion acquired the predetermined time ago may be deleted. Also, when an increase in the content level in the cookware 5 is stored, for example, in the storage 14 as the value indicating the temperature change in the content level in the cookware 5, the increase may be set to 0. Moreover, when the edge temperature information (thermal image) acquired a predetermined time ago is stored, in the storage 14 as the value indicating the temperature change in the content level in the cookware 5, the edge temperature information acquired the predetermined time ago may be deleted.
Hereinafter, further description is given referring back to
Next, the cooking support system 1B performs cookware detection processing to detect the cookware 5 based on the thermal image of the background region created in S1B (S3B). Here, with reference to
Then, the cooking support system 1B performs lid detection processing on the cookware 5 based on the thermal image of the cookware region created in S1B (S4). Since the processing of S4 to S9 is as described in Embodiment 2, description thereof is omitted.
As described above, the cooking support system and the cooking support method according to this embodiment can prevent the content from boiling over the cookware 5 by detecting occurrence thereof beforehand, regardless of the material of the cookware 5, considering the case where the user (human) engages with the cookware 5 by stirring the content or opening the lid.
Note that, in the above embodiment, the description is given of the case where the predetermined region including the cookware 5 in the thermal image taken by the thermal image camera 2 is set as the cookware region and the region other than the cookware region is set as the background region. However, the present disclosure is not limited thereto. As for the background region, a region indicating the cooking heater 3 in the thermal image may be set as the cookware region and a region other than the region indicating the cooking heater 3 may be set as the background region.
The cooking support method and the cooking support system according to one or more aspects of the present disclosure have been described above based on the embodiments. However, the present disclosure is not limited to those embodiments. Embodiments obtained by applying various modifications conceived by those skilled in the art to the above embodiments and embodiments configured by combining constituent elements in different embodiments may be included within the scope of one or more aspects of the present disclosure without departing from the spirit of the present disclosure. For example, the following cases are also included in the present disclosure.
(1) In Embodiments 1 to 3 described above, the description is given of the case where the cooking support system and the cooking support method determines the possibility of boiling over by acquiring the thermal image of the region including the cookware 5 at the predetermined time intervals from the thermal image camera 2. However, the present disclosure is not limited thereto.
For example, when the content in the cookware 5 starts boiling, the possibility of boiling over may be determined by acquiring thermal images of the region including the cookware 5 at time intervals shorter than the predetermined time described above. Thus, the accuracy of determining the boil-over occurrence can be further improved.
(2) It is also conceivable that a pattern of a temperature change in content or of a change in content level may vary depending on the kind or material of the cookware 5. Therefore, the possibility of boiling over may be determined by using learning data obtained by previously learning the correspondence between change patterns of the temperature and level of the content in the cookware 5 and the heating state of the cookware 5. Particularly, when the cookware 5 has the lid on, the size and movement of bubbles adhering to the edge of the lid are not uniform immediately before the occurrence of boiling over. Therefore, improvement in the accuracy of determining the boil-over occurrence can be expected by previously learning the correspondence between change patterns of the temperature and level of the content in the cookware 5 and the heating state of the cookware 5.
Note that the learning data may be stored in a specific local device disposed in the cooking support system. Alternatively, the learning data may be acquired from a cloud server or the like disposed in a location different from the local device.
Moreover, it is also conceivable that, in the case of using the learning data, the possibility of boiling over can be determined by using not only the thermal image but also a normal image. This is because the correspondence between change patterns of the temperature and level of the content in the cookware 5 and the heating state of the cookware 5 in the normal image can be previously learned.
(3) Each of the devices described above is a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a display unit, a keyboard, a mouse, and the like. The RAM or the hard disk unit stores computer programs. The microprocessor operates according to the computer program, thereby allowing each of the devices to accomplish its functions. The computer program herein includes a combination of multiple command codes indicating instructions to a computer in order to accomplish predetermined functions.
(4) Some of or all of the constituent components included in the devices described above may be achieved by a single system LSI (Large Scale Integration) circuit. The system LSI circuit is a super-multifunctional LSI circuit fabricated by integrating a plurality of components on a single chip and, more specifically, a computer system including a microprocessor, a ROM, a RAM, and the like. The RAM stores a computer program. When the microprocessor operates in accordance with the computer program, the system LSI circuit achieves functions thereof.
(5) Some of or all of the constituent components included in the devices described above may be achieved by an IC card removably attached to each device or a separate module. The IC card or the module is a computer system including a microprocessor, a ROM, a RAM, and the like. The IC card or the module may include the super-multifunctional LSI circuit described above. When the microprocessor operates in accordance with the computer program, the IC card or the module achieves functions thereof. The IC card or the module may be tamper-resistant.
(6) The present disclosure may be the methods described above. Alternatively, the present disclosure may be a computer program with which a computer achieves these methods, or a digital signal including the computer program.
Alternatively, the present disclosure may be a computer-readable recording medium, namely, for example, a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), or a semiconductor memory, storing the computer program or the digital signal. Alternatively, the present disclosure may be the digital signal recorded on one of these recording media.
Alternatively, the present disclosure may be the computer program or the digital signal transmitted through an electrical communication line, a wireless or wired communication line, a network typified by the Internet, datacasting, or the like.
Alternatively, the present disclosure may be a computer system including a microprocessor and a memory. The memory may store the computer program, and the microprocessor may operate in accordance with the computer program.
Alternatively, the present disclosure may be implemented by an independent computer system using the computer program or the digital signal transported in one of the recording media or through the network or the like.
(7) The above embodiments may be combined with one another.
The present disclosure is applicable to a cooking support method and a cooking support system for detecting and preventing boiling over during cooking with a cookware such as a pot, and is particularly applicable to a cooking support method and a cooking support system used for a cooking heater such as an IH cooking heater and a stove capable of externally controlling gas and fire.
Number | Date | Country | Kind |
---|---|---|---|
2016-119305 | Jun 2016 | JP | national |