This application claims priority under 35 U.S.C. §119 to Korean Application No. 10-2011-0095557 filed on Sep. 22, 2011, whose entire disclosure(s) is/are hereby incorporated by reference.
1. Field
This relates to a method for controlling an electric device.
2. Background
Various electric devices may manage/process information and provide various functions using electricity as a power source. In, for example a refrigerator, a user may manage and process much of the management information (e.g., an amount of stock, expiration date and the like) of food stored in the refrigerator in order to consume food having an imminent expiration date or to plan to replenish certain food items. In, for example, a washing machine, properties of materials of clothes or washing methods may be checked by the user before operating the washing machine. In, for example, a cooking apparatus cooking methods may be checked by the user before cooking.
The embodiments will be described in detail with reference to the following drawings in which like reference numerals refer to like elements wherein:
Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings.
Referring to
The terminal 100 may include an input device 110 for inputting certain commands to the items stored in the refrigerator 10 and a first display 120 for displaying information related to the items. For example, the terminal 100 may be a cell phone or smartphone, a desktop or laptop computer, or other such device as appropriate.
The network system 1 may include a first interface 310 defined between the terminal 100 and the server 200, a second interface 320 defined between the server 200 and the refrigerator 10, and a third interface 330 defined between the terminal 100 and the refrigerator 10. At least one of a variety of communication techniques, such as WiFi, ZigBee, Bluetooth, and Internet for transmitting information, may be adopted as the first, second and third interfaces 310, 320 and 330.
As shown in
The server 200 may include a second communication device 230 capable of communicating with the first communication device 130 and a database 240 which stores the information related to the items stored in the refrigerator 10.
The refrigerator 10 may include a third communication device 30 capable of communicating with the first communication device 130 and the second communication device 230, a second display 20 for displaying the information related to the items, a second memory 40 which stores the information related to the items, and a refrigerator controller 50 which controls an operation of the refrigerator 10.
The food-related information may include information, for example, related to the food itself, or food management information. The information related to the food itself may include, for example, a food name, an amount of food, a number of pieces of food, and the like and the food management information may include, for example, a location of the food stored in the refrigerator, a period of storage, an amount of stock, a freshness period/expiration date, a storage method and the like. This type of food-related information may be obtained from various sources, such as, for example, a certain object to be recognized, such as, for example, a receipt, a food container, a barcode, or encrypted information.
The first memory 140, the second memory 40, and/or the database 240 may include the food-related information. The information stored in one of the first or second memory 140/40 may be synchronized with that of the other of the first or second memory 140/40. Herein, the first memory 140, the second memory 40, and the database 240 may be collectively referred to as a storage device.
While the first memory 140 is synchronized with the second memory 40, the database 240 of the server 200 may be used. As a matter of course, the terminal 100 may directly communicate with the refrigerator 10 to synchronize the first and second memory 140 and 40. For example, information recognized via the terminal 100 may be transmitted to the refrigerator 10 via the server 200 or may be directly transmitted to the refrigerator 10.
Further, information that is not stored in the terminal 100 or the refrigerator 10 of the information stored in the database 240 of the server 200 may be transmitted to the terminal 100 or to the refrigerator 10. That is, the terminal 100 or the refrigerator 100 may download or update the information stored in the database 240.
Referring to
The consumable reader may include an image-capturing device (or camera), an RFID reader, or a barcode reader, and a consumable holder may include a shelf or a basket. The shelf or basket may include, for example, a weight sensor for detecting the weight of food, and the weight of food may be read by the weight sensor.
Such a weight sensor may be considered a consumable reader in that the weight sensor detects certain information, i.e., the weight of the particular food item in a particular container, or may be considered the consumable holder in that the sensor is provided with a device for supporting the item in the refrigerator.
The recognition target 400 may include a receipt 410 including a certain letter, symbol, number, shape, color, or pattern that corresponds to a certain item. The letter, symbol, number, shape, color, and pattern are together referred to as appointed information.
The recognition target 400 may also include a food container 420 accommodating food therein. The food container 420 may include the appointed information.
The recognition target 400 may also include encrypted information 430 encrypted according to a certain rule. The encrypted information 430 may include a barcode, a QR code, or an RFID tag. The encrypted information 430 may be included on the receipt 410 or the food container 420.
The information provided on the recognition target 400 may be recognized by the recognition device 160. For example, the appointed information may be recognized by the camera, and the encrypted information 430 may be recognized by the camera, barcode reader, or RFID.
By operating the terminal 100, operation of the recognition device 160 may be initiated in operation S11. In operation S12, the recognition target 140 is checked via the first display 120. In operation S13, the recognition target 400 is displayed on the first display 120 so as to be focused, or an image is obtained by performing a recognizing operation, for example, an image-capturing operation of the camera.
In certain embodiments, the recognized information may be stored in the first memory 140 or the database 240.
By using an information recognizing program, the recognized image may be interpreted in operation S14, and the image may be converted into text in operation S15 on the basis of the interpreted information. More specifically, in order to interpret the recognized information, the information recognizing program may be installed on the terminal 100 or the server 200. The information recognizing program may interpret the recognized information (or image) to convert the recognized information to food-related information corresponding to the recognized information.
The food-related information may be displayed in a text format. The displayed information may include information related to the food itself (e.g., food name and amount of food) or food management information (e.g., expiration date). As a matter of course, the information related to the food itself or the food management information may be previously stored in the first memory 140 or the database 240, in operations S14 and S15.
The converted text may be displayed on the display 120 and stored in the first memory 140 or the database 240 in operation S16. Further, information on the converted text may be synchronized with the refrigerator 10 so as to be displayed on the second display 20 in operation S16.
The information stored in the first memory 140 or the database 240 may be synchronized with the second memory 40 of the refrigerator 10 and may be used as food management information in operation S17.
For example, in the case in which food information to be stored in the second memory 40 of the refrigerator 10 is recognized by controlling the recognition device 160, the recognized information may be stored in the terminal 100, the refrigerator 10, or the server 200. More specifically, when food related to the recognized information is determined (e.g., inputted to a certain input unit) to be included in a management target of the refrigerator, the determined information may be stored in the first memory 140, the second memory 40, or the database 240.
While food is stored (or stocked) in the refrigerator, information related to a storage location or storage period of the food may be additionally recognized (manually or automatically), and the additionally recognized information may be stored in connection with the corresponding food. In certain embodiments, the automatic recognition may be performed by at least one of the consumable reader or the consumable holder.
While food is taken out from the refrigerator, the recognized information or the additionally recognized information may be displayed on the first display 120 or the second display 20. Further, when the food is completely taken out from the refrigerator, the recognized information or the additionally recognized information may be deleted in operation S17.
As described above, the information recognized and stored in the recognition device 160 may be used for managing food stored in the refrigerator. Further, the terminal 100 may perform remote monitoring or remote control to manage food stored in the refrigerator 10.
Referring to
More specifically, when the recognition device 160 (e.g., camera) of the terminal 100 faces the recognition target 400, e.g., the receipt 410, information on the item written on the receipt 410 may be displayed on the first display 120. As illustrated in
Further, a recognition area 122 defined by, for example, a line is displayed on the first display 120 in order to provide a guide to a location of an item to be recognized. The recognition area 122 may be displayed in the form of a box so as to be easily recognized by a user. A location of the recognition device 160 may be adjusted so that one piece of item information, for example, “milk”, is located within the recognition area 122.
In a state in which the item information is located within the recognition area 122, when a set time has elapsed or the input device 110 provided on the terminal 100 is pushed, an operation for recognizing the item information may be performed. The recognizing operation may interpret the information written on the recognition target 400 and convert the information to text.
When the recognizing operation is performed, a food list may be displayed on the first display 120 as illustrated in
When particular item information, for example, “milk”, is recognized, the recognition result display 124 may display a message of “milk has been selected”, and the list display 123 may include the recognized item information, i.e., “milk”, in the list. The item information included in the list may then become an object of management or processing and stored in the first memory 140.
As described above, since the item information may be selected by focusing the recognition area on the item information displayed on the first display 120, ease of use may be improved.
Hereinafter, various alternative embodiments will be described. Since these embodiments may be different from the first embodiment with respect to selection of item information or recognition technique, detailed description will focus on the differences. Further, the same reference numerals and descriptions will be maintained for the same or similar elements as the first embodiment and the previous embodiment.
In the embodiment shown in
A user may use a selection device to select item information corresponding at least one item to be recognized, such as, for example, a touch pen, a user's hand or finger, an input device, or other pointing/selection implement as appropriate.
For example, a user may touch (or click once) a location adjacent to one piece of item information from among a plurality of pieces of item information, e.g., “pineapple”, by using a finger. Further, item information located on an area laterally extended from the touch location may be selected as an object to be recognized. When the selected item information is recognized, as illustrated in
More specifically, a message of “pineapple has been selected” may be displayed on the recognition result display 124, and “pineapple” may be displayed on the list display 123. The item information displayed on the list display 123 may then become an object of management or processing and be stored in the first memory 140.
Although it has been described, in connection with
As described above, since the item information to be managed or processed may be selected by a touching technique or the like in a state in which the item information is displayed on the first display 120, ease of use may be improved.
In a state in which the item information is displayed on the captured-image information display 221, when a certain command is received at the input device 110, an information recognizing operation for displaying the item information on a list may be performed. While the information recognizing operation is performed, the recognition progress display 222 may display progress, e.g., from 0% to 100%, as time passes.
When the progress ratio reaches 100%, i.e., when the recognizing operation is completed, the first display 120 may display the at least one piece of item information which has been displayed on the captured-image information display 221, as illustrated in
More specifically, in this embodiment the first display 120 may include a recognized-list display 223 which displays names of the item information and selection button(s) 224 for selecting whether to include the item information displayed on the recognized-list display 223 with objects to be managed or processed.
A user may select the selection button(s) 224 corresponding to the item information to be managed or processed by using a selection implement, i.e., a user's finger, a touch pen, a stylus or other input device as appropriate. When particular item information is selected, the selection display 224 corresponding to the selected item information may be marked with a tick, as illustrated in
Further, when a confirmation input button 225 displayed on the first display 120 is selected, the first display 120 may display a stored-list display 226 as illustrated in
As described above, since desired item information may be easily selected after recognizing a plurality of pieces of item information by capturing an image via the recognition device 160, ease of use may be improved.
A user may select at least one item from the item information displayed on the captured-image display 221 by using an appropriate selection device. For example, as illustrated in
The touch start point 227a and/or the touch end point 227b does not necessarily refer to a certain single point, but may be considered as a boundary defining a certain area for selecting the corresponding item information. Therefore, within the whole display area of the first display 120, the touch start point 227a and/or the touch end point 227b may be formed at various different locations and may be defined at an inner area or outer area of the item information. For example, when the plurality of pieces of item information are vertically arranged, the touch start point 227a and the touch end point 227b may be horizontally arranged.
Although it is illustrated in
Further, when the confirmation input button 225 is selected, the first display 120 may display the stored-list display 226 on which recognized pieces of item information are sequentially displayed, as illustrated in
As described above, since the item information may be selected by using a touching technique, ease of use may be improved.
A user may select at least one item from the item information displayed on the captured-image display 221 using an appropriate selection device. For example, as illustrated in
That is, the touch start point 237a and the touch end point 237b may define a start point and an end point for sequentially selecting different pieces of the item information at once. For example, when a plurality of pieces of item information are vertically arranged, the touch start point 237a and the touch end point 237b may be horizontally separated from each other.
As described above, in a state in which one piece of the item information is touched, if the touch area is extended to an area on which another piece of the item information is displayed, pieces of the item information located within the touch area may be recognized at once. Therefore, a plurality of item information may be easily selected and recognized.
When the touch start point 237a and the touch end point 237b are located within an area where one piece of the item information is displayed, the number of selected pieces of the item information may be one.
Further, in a state in which at least one piece of the item information is selected, if the confirmation input button 225 is then selected, the first display 120 may display the stored-list display 226 on which recognized pieces of the item information are sequentially displayed, as illustrated in
For example, as illustrated in
At least one piece of the item information displayed on the first, second and third captured-image information display 321, 322 and 323 may be selected or recognized in the same manner as described above with respect to the previous embodiments. According to this configuration, a plurality of pieces of item information may be selected or controlled.
In the exemplary embodiments described above with respect to
Referring to
That is, without making use of an additional terminal 100, information included in the recognition target 400 may be directly recognized by the recognition device 260 provided with the electric device 15. Further, on the basis of the recognized information, management of the food to be managed or processed by the electric device 15 may be performed. Additionally, the recognized information related to the food may be stored in the server 200 or the terminal 100, and the terminal 100 may perform remote monitoring or remote control for items to be managed or processed by the electric device 15. Thus, since the recognition device 260 may be provided with either the terminal 100 or the electric device 15, the display device for obtaining or recognizing an image of item information may be the first display 120 of the terminal 100 or the second display 20 of the electric device.
According to embodiments as broadly described herein, information on a particular object used in an electric device may be checked, and according to a result of the checking, management or processing of the particular object may be efficiently performed.
A recognition device may be provided with an electric device or a terminal so that information written on a receipt or a food container or encrypted information may be recognized. Therefore, recognition of information on a particular object may be easily performed.
Further, on the basis of the information recognized by the recognition device, the object may be managed or processed according to characteristics of the electric device, thereby reducing errors on the management or processing of the object.
Further, information related to the object may be recognized a user having to memorize or track the contents perform a special recognizing operation. Thus, ease of use may be improved.
Embodiments provide a method for controlling an electric device to allow the electric device to recognize information on an object that is to be processed using a terminal.
In one embodiment as broadly described herein, a method for controlling an electric device may include displaying, on a display unit, information on at least one item to be managed or processed by the electric device, selecting at least one piece of the item information displayed on the display unit, recognizing the selected piece of the item information, and storing the recognized piece of the item information into a memory unit as an object to be managed or processed by the electric device.
Any reference in this specification to “one embodiment,” “an embodiment,” “example embodiment,” etc., means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with any embodiment, it is submitted that it is within the purview of one skilled in the art to effect such feature, structure, or characteristic in connection with other ones of the embodiments.
Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure. More particularly, various variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
Number | Date | Country | Kind |
---|---|---|---|
10-2011-0095557 | Sep 2011 | KR | national |