Patent Application
20100283573
This application claims the benefit of Korean Application No. 10-2009-0041006, filed on May 11, 2009, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
1. Field of the Invention
The present invention relates to a mobile terminal which is capable of readily controlling a refrigerator, an operating method thereof, and a refrigerator.
2. Description of the Related Art
Recently, home network technologies have been developed. A home network signifies a network in which a variety of home appliances are interconnected to enable the user to enjoy a convenient, safe and economical life service at any time inside and outside of a home. With the advance of digital signal processing technologies, refrigerators, washing machines, etc. have been gradually digitized, home appliance operating system technologies and high-speed multimedia communication technologies have been intensively deployed on digital home appliances, and a new type of information home appliance has appeared. Therefore, the home network has been developed still further.
A home network system constructed in a home includes a master device that is an electric appliance capable of controlling the operation of each home appliance or monitoring the state thereof, and one or more home appliances each having a function of responding to a request from the master device and a function of notifying information about a variation in the state thereof
However, the construction of the above-mentioned home network system has the inconvenience of having to separately provide a separate master device which is capable of controlling the operation of each home appliance or monitoring the state thereof.
Moreover, in the case where a home appliance is a refrigerator, in order to know which foods there is a shortage of in the refrigerator at any place or time, there is a need to display state information of the refrigerator including kinds and freshness degrees of foods stored in the refrigerator using a mobile terminal.
Therefore, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a mobile terminal which is capable of readily controlling a refrigerator, an operating method thereof, and a refrigerator.
In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of an operating method of a mobile terminal including receiving state information of a refrigerator from the refrigerator, displaying the state information of the refrigerator on a screen, and transmitting a control signal based on a control operation to the refrigerator.
In accordance with another aspect of the present invention, there is provided a mobile terminal for controlling a refrigerator, the mobile terminal including a wireless communication unit for transmitting/receiving data to/from the refrigerator, a controller for generating information about foods stored in the refrigerator based on state information of the refrigerator received from the refrigerator, and a display unit for displaying a menu picture including a refrigerator management menu, and displaying the generated food information on a screen when a food management item in the refrigerator management menu is selected.
In accordance with a further aspect of the present invention, there is provided a refrigerator including a display unit for displaying an operating state of the refrigerator, a wireless communication unit for transmitting/receiving data to/from a mobile terminal, and a controller for controlling the wireless communication unit to transmit information about foods stored in the refrigerator to the mobile terminal.
The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. It is to be noted that the suffixes of constituent elements used in the following description, such as “module” and “unit”, are simply used by considering the ease of writing this specification, but do not have any particular importance or role. Accordingly, the terms “module” and “unit” can be used interchangeably.
Referring to
The wireless communication unit 110 may include a mobile communication module 111, a wireless Internet module 113, a short-range communication module 115, and a global position system (GPS) module 117. radio signals to/from at least one of a base station, an external terminal and a server over a mobile communication network. The radio signals may include a voice call signal, a video telephony call signal or various forms of data based on text/multimedia message transmission/reception.
The wireless Internet module 113 refers to a module for wireless Internet access. This module may be installed inside or outside of the mobile terminal 100.
When a service call menu item is selected, the wireless Internet module 113 may make a connection to a service center and transmit refrigerator diagnosis data to the service center.
The short-range communication module 115 refers to a module for short-range communication. For example, short-range communication technologies may include Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), and ZigBee.
Also, the short-range communication module 115 may transmit/receive data to/from a refrigerator using, for example, Bluetooth. In detail, the short-range communication module 115 may receive state information of the refrigerator. The state information of the refrigerator may include at least one of food information, an expiration date of a food, a storage period of the food, a freezing chamber temperature, a refrigerating chamber temperature, an outdoor air temperature, door opening/closing information, operation diagnosis information, and an error content.
The global position system (GPS) module 117 receives location information from a plurality of GPS satellites.
The A/V input unit 120 is configured to input an audio signal or video signal. The A/V input unit 120 may include a camera module 121 and a microphone module 123. The camera module 121 processes frames of a still image or moving image acquired by an image sensor in a video call mode or image capture mode. The processed image frames may be displayed on a display unit 151.
The image frames processed by the camera module 121 may be stored in the storage unit 160 or externally transmitted via the wireless communication unit 110. Two or more camera modules 121 may be provided depending on embodiments of the configuration of the terminal.
Also, if the user captures an image of a food to be stored in a refrigerator through the camera module 121, the mobile terminal 100 may store the captured image in the storage unit 160. Also, the mobile terminal 100 may set and store information about the food, for example, a storage date, an expiration date, etc.
The microphone module 123 receives an external sound signal through a microphone in a call mode, a recording mode, a voice recognition mode, or the like and processes the received sound signal to convert it into electrical audio data. In the call mode, the converted audio data may be converted into that of a format transmittable to a mobile communication base station through the mobile communication module 111 and then outputted to the mobile communication base station. Various noise removal algorithms may be employed in the microphone module 123 to remove noise generated in the course of receiving the external sound signal.
The manipulating unit 130 generates key input data that the user inputs to control the operation of the terminal. The manipulating unit 130 may include a key pad, a dome switch, a touch pad (static pressure/capacitance), a jog wheel, a jog switch, and a finger mouse. In particular, the touch pad and the display unit 151 to be described later may constitute a layered structure, which may be called a touch screen.
The sensing unit 140 senses the current state of the mobile terminal 100, such as the open/closed state of the mobile terminal 100, the location of the mobile terminal 100 or the presence or absence of user contact with the mobile terminal 100, and generates a sense signal for control of the operation of the mobile terminal 100 as a result of the sensing. For example, in the case where the mobile terminal 100 is a slide phone, the sensing unit 140 may sense whether the slide phone is open or closed. Also, the sensing unit 140 may perform a sensing function associated with whether the power supply 190 supplies power or whether the interface unit 170 is coupled with an external device.
The output unit 150 is provided to output an audio signal, a video signal or an alarm signal. To this end, the output unit 150 may include the display unit 151, an audio output module 153, and an alarm output module 155.
The display unit 151 displays and outputs information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, the display unit 151 may display a user interface (UI) or graphic user interface (GUI) associated with a call. When the mobile terminal 100 is in the video call mode or image capture mode, the display unit 151 may display captured or received images, respectively or simultaneously, and also displays a UI or GUI.
Also, the display unit 151 displays state information of a refrigerator on a screen. In detail, for the display of the state information of the refrigerator, the display unit 151 may display a menu picture including a refrigerator management menu having a plurality of items and, when any one of the refrigerator management menu items is selected, display a picture corresponding to the selected refrigerator management menu item.
For example, in the case where a food management item is selected, the display unit 151 may arrange and display a plurality of foods in the order of expiration dates or storage periods thereof. Also, the display unit 151 may arrange and display a plurality of foods according to kinds thereof. Also, the display unit 151, when any one of foods stored in the refrigerator is selected, may display at least one of an image, name, current date, storage date, elapsed period, expiration date and barcode information of the selected food.
For example, the display unit 151 may display a list of periods in a first area and display images of one or more foods corresponding to a selected period in the period list in a second area. Also, in the case where any one of the images of the one or more foods displayed in the second area is selected, the display unit 151 may display the selected food image and information about a corresponding food. The food information may include one or more of a name, current date, storage date, elapsed period, expiration date and barcode information. On the other hand, the display unit 151 may display a list of food kinds in the first area and display images of one or more foods corresponding to a selected food kind in the food kind list in the second area.
On the other hand, in the case where a monitoring item is selected, the display unit 151 may display one or more of freezing chamber temperature information, refrigerating chamber temperature information, outdoor air temperature information, door opening/closing information, operation diagnosis information, error content information and a service call item. At this time, if the service call item is selected, the display unit 151 may display a service center connection state picture. Meanwhile, in the case where a software upgrade item is selected, the display unit 151 may display a software upgrade progress picture.
The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the storage unit 160 in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. The audio output module 153 also outputs sound signals related to particular functions performed by the mobile terminal 100, for example, a call signal reception sound, a message reception sound, etc. This audio output module 153 may include a speaker and a buzzer.
The alarm output module 155 outputs a signal to notify the user of occurrence of an event in the mobile terminal 100. The event occurring in the mobile terminal 100 may be, for example, call signal reception, message reception or key signal input. The alarm output module 155 may also output a signal in any form other than an audio signal or video signal to notify the user of occurrence of an event in the mobile terminal 100. For example, the alarm output module 155 may output a signal in the form of a vibration. When a call signal is received or when a message is received, the alarm output module 155 may output a vibration to notify the user of such a situation. Alternatively, when a key signal is inputted, the alarm output module 155 may output a vibration as a feedback for the key signal input. This vibration output may enable the user to recognize occurrence of an event. Of course, the signal for event occurrence notification may also be outputted through the display unit 151 or audio output module 153.
The storage unit 160 may store programs for processing and control of the controller 180 and may also function to temporarily store input/output data.
The storage unit 160 may include at least one type of storage media including a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory), a random access memory (RAM), and a read-only memory (ROM). The mobile terminal 100 may also manage a Web storage that performs the storage function of the storage unit 160 on the Internet.
The interface unit 170 acts as an interface between the mobile terminal 100 and all external devices connected to the mobile terminal 100. The external devices connected to the mobile terminal 100 may include, for example, a wired/wireless headset, an external charger, a wired/wireless data port, a memory card socket, a SIM/UIM card socket, an audio input/output (I/O) terminal, a video I/O terminal, and an earphone. The interface unit 170 may receive data transmitted from the external devices and transfer the received data or power to each internal component of the mobile terminal 100 or transmit internal data of the mobile terminal 100 to the external devices.
The controller 180 typically controls the operation of each of the above-stated components of the mobile terminal 100, so as to control the overall operation of the mobile terminal 100. For example, the controller 180 may perform control and processing associated with a voice call, data communication, and a video call.
Also, the controller 180, when any one item in a refrigerator management menu is selected, controls the display unit 151 to display a picture corresponding to the selected item. Here, the refrigerator management menu may include at least one of a food management item, a monitoring item, a software upgrade item and a remote control item.
For example, in the case where the food management item is selected, the controller 180 may control the display unit 151 to arrange and display a plurality of foods in the order of expiration dates or storage periods thereof. Also, the controller 180 may control the display unit 151 to arrange and display a plurality of foods according to kinds thereof. When any one of foods stored in a refrigerator is selected, the controller 180 may control the display unit 151 to display at least one of an image, name, current date, storage date, elapsed period, expiration date and barcode information of the selected food.
Also, the controller 180 may control the display unit 151 to display a list of periods in a first area of a refrigerator state picture, which displays information about the foods stored in the refrigerator, and display images of one or more foods corresponding to a selected period in the period list in a second area of the refrigerator state picture.
Also, in the case where any one of the images of the one or more foods displayed in the second area is selected, the controller 180 may control the display unit 151 to display the selected food image and information about a corresponding food. Here, the food information may include one or more of a name, current date, storage date, elapsed period, expiration date and barcode information.
Also, in the case where the monitoring item is selected, the controller 180 may control the display unit 151 to display one or more of freezing chamber temperature information, refrigerating chamber temperature information, outdoor air temperature information, door opening/closing information, operation diagnosis information, error content information and a service call item.
At this time, if the service call item is selected, the controller 180 may make a connection to a service center server and transmit refrigerator diagnosis data to the service center server. Also, in this case, the controller 180 may control the display unit 251 to display a service center connection state picture.
Also, in the case where the software upgrade item is selected, the controller 180 may control the display unit 151 to display a software upgrade progress picture. Also, the controller 180 may transmit and upload upgraded software to the refrigerator.
Also, in the case where the remote control item is selected, the controller 180 may transmit a refrigerator control signal inputted by the user to the refrigerator.
In this case, when the remote control item is selected, the controller 180 may display a refrigerator remote control picture through the display unit 151 and, when any one of refrigerator control items displayed in the remote control picture is selected, transmit a corresponding refrigerator control signal to the refrigerator.
The power supply 190, under the control of the controller 180, receives external power or internal power and supplies power necessary for the operation of each constituent element.
The constituent elements of the mobile terminal related to the present invention have been described in terms of the functionality of the mobile terminal. Hereinafter, the constituent elements of the mobile terminal related to the present invention will be described in detail in terms of the outer appearance of the mobile terminal with reference to
The display unit 151, a first audio output module 153a, a first camera module 121a, and a first manipulating unit 130a may be disposed in a body, more particularly the front case. A second manipulating unit 130b, a third manipulating unit 130c, and the microphone module 123 may be disposed on side surfaces of the rear case.
The display unit 151 may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or the like to visually express information. A touch pad may be overlaid on the display unit 151 in a layered manner, so that the display unit 151 may operate as a touch screen to enable the input of information by the user's touch.
The first audio output module 153a may be implemented in the form of a receiver or speaker. The first camera module 121a may be implemented appropriately to capture an image of the user or the like or a moving image. The microphone module 123 may be implemented in an appropriate form to input the user's voice or other sounds.
The first to third manipulating units 130a, 130b and 130c may be collectively referred to as a ‘manipulating portion’, which is the manipulating unit 130, and may adopt any method as long as it has a tactile manner that allows the user to manipulate the manipulating units 130a, 130b and 130c while receiving tactile feedback.
For example, the manipulating unit 130 may be implemented with a dome switch or touch pad that can input a command or information by the user's pushing or touching or implemented in a wheel or jog scheme in which a key is rotated or in a joystick scheme. In terms of functionality, the first manipulating unit 130a may input commands such as START, END and SEND, and the second manipulating unit 130b may input operation mode selection, etc. The third manipulating unit 130c may operate as a hot-key to activate a special function in the mobile terminal 100.
The second camera module 121b may have an image capturing direction substantially opposite to that of the first camera module 121a and a different number of pixels from that of the first camera module 121a. For example, the first camera module 121a may have a low pixel density not to be too extreme to capture an image of the user's face and transmit the captured image to another party, in the case of a video call or the like, and the second camera module 121b may have a high pixel density in that an image of a general subject is sometimes not transmitted immediately after being captured.
A sixth manipulating unit 130f may be installed around the second camera module 121b. A jog wheel or the like capable of performing rotational input may be employed as the sixth manipulating unit 130f.
A flash 125 and a mirror 126 may be additionally disposed adjacent to the second camera module 121b. The flash 125 irradiates light to a subject when an image of the subject is captured by the second camera module 121b. The mirror 126 enables the user to see his/her face, etc. reflected thereon when intending to capture an image of himself/herself using the second camera module 121b (self-portrait).
A second audio output module (not shown) may be additionally disposed in the rear case. The second audio output module may implement a stereo function with the first audio output module 153a and may be used for a call in a speakerphone mode.
An antenna (not shown) for reception of broadcast signals may be further disposed at one side of the rear case in addition to an antenna for calls. The broadcast signal reception antenna may be installed to be extractable from the rear case.
The interface unit 170 acts as a passage for data exchange, etc. between the mobile terminal 100 and external devices connected to the mobile terminal 100. For example, the interface unit 170 may include at least one of a connection terminal for wired/wireless connection to an earphone, a port for short-range communication, and a power supply terminal for supply of power to the mobile terminal 100. Also, the interface unit 170 may include a card socket for receiving an external card, such as a subscriber identification module (SIM) card, a user identity module (UIM) card or a memory card for storage of information.
The power supply 190 is mounted in the rear case to supply power to the mobile terminal 100. The power supply 190 may be, for example, a rechargeable battery, which may be detachably mounted in the rear case for charging, etc.
The mobile terminal described in this specification may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), or the like.
Referring to
Also, the mobile terminal determines whether the food management item is selected (S204), and arranges information about foods stored in the refrigerator according to set periods if the food management item is selected (S206).
On the other hand, the mobile terminal may display a refrigerator state picture 800 including a first area 810 for displaying a list of periods, and a second area 820 for displaying one or more food images 822, 824, 826 and 828, as shown in
Also, the mobile terminal determines whether any one of the food images in the second area 820 is selected (S210), and, if any one of the food images is selected, displays the selected food image and information about a corresponding food by displaying a food management picture 900 including a food image area 902, a stored food information display area 904, a barcode recognition area 906, and a delete button 908, as shown in
On the other hand, the mobile terminal may capture and store images of foods stored in the refrigerator through a food image capture picture 1002 shown in
Also, the mobile terminal may display, for example, a first foods-by-storage periods picture 1012 shown in
Also, the mobile terminal may display, for example, a first foods-by-effective terms picture 1018 shown in
Also, the mobile terminal may display an ‘expiration date approaching’ notification picture 1022 shown in
Referring to
Referring to
Also, the mobile terminal determines whether the monitoring item is selected (S304), and displays a monitoring picture 1200 as shown in
Also, the mobile terminal determines whether the service call item is selected (S308), and, if the service call item is selected, makes a connection to a service center server and transmits refrigerator diagnosis data to the service center server (S310).
On the other hand, the mobile terminal displays a service center connection state picture 1220 as shown in
Referring to
Door handles 2121 are provided at front surfaces of the freezing chamber door 2120 and refrigerating chamber door 2140 in such a manner that they are forwardly protruded from the front surfaces. The user may readily grasp the door handles 2121 to pivot the freezing chamber door 2120 and refrigerating chamber door 2140.
On the other hand, a home bar 2180, for convenience, may further be provided at the front surface of the refrigerating chamber door 2140 to enable the user to remove a food stored in the refrigerating chamber, such as a beverage, without opening the refrigerating chamber door 2140.
A dispenser 2160, for convenience, may further be provided at the front surface of the freezing chamber door 2120 to enable the user to easily take out ice or water without opening the freezing chamber door 2120. A control panel 2200 may be provided at an upper side of the dispenser 2160 to control a driving operation of the refrigerator 2000 and display the state of the refrigerator 2000 in operation on a screen.
The control panel 2200 may include an input unit 2220 consisting of a plurality of buttons, and a display unit 2230 for displaying a control picture, an operating state, etc.
The display unit 2230 displays a control picture, an operating state, and information such as an internal temperature of the refrigerator. For example, the display unit 2230 may display a service type (cubed ice, water, crushed ice or the like) of the dispenser, a set temperature of the freezing chamber, and a set temperature of the refrigerating chamber.
This display unit 2230 may be implemented in various forms including a liquid crystal display (LCD), a light emitting diode (LED) display, and an organic light emitting diode (OLED) display. Also, the display unit 2230 may be implemented in the form of a touch screen that can also perform the function of the input unit 2220.
The input unit 2220 may include a plurality of manipulating buttons. For example, the input unit 2220 may include a dispenser setting button (not shown) for setting a service type (cubed ice, water, crushed ice or the like) of the dispenser, a freezing chamber temperature setting button (not shown) for setting the temperature of the freezing chamber, and a refrigerating chamber temperature setting button (not shown) for setting the temperature of the refrigerating chamber.
Here, it will be understood that the refrigerator according to the present embodiment is not limited to a double door type shown in
Referring to
The compressor 2112, compressor driver 2113, refrigerating chamber fan 2142, refrigerating chamber fan driver 2143, freezing chamber fan 2144, freezing chamber fan driver 2145 and temperature sensing unit 2320 generally operate for air conditioning within the refrigerating chamber or freezing chamber of the refrigerator, as well known in the art, and a description thereof will thus be omitted.
The wireless communication unit 2100 transmits/receives data to/from the mobile terminal 100.
The wireless communication unit 2100 transmits state information of the refrigerator, more particularly information about kinds, expiration dates and storage periods of foods stored in the refrigerator. Also, the wireless communication unit 2100 may transmit freezing chamber temperature information, refrigerating chamber temperature information, outdoor air temperature information, door opening/closing information, operation diagnosis information, error content information, etc.
Also, the wireless communication unit 2100 receives a refrigerator control signal from the mobile terminal 100. The refrigerator control signal may be, for example, a control signal for setting of a refrigerating chamber temperature, a freezing chamber temperature or the like, which may correspond to the above-stated remote control item of the mobile terminal 100. Also, the wireless communication unit 2100 may receive refrigerator management software from the mobile terminal 100.
The controller 2310 controls the operation of the wireless communication unit 2100. For example, the controller 2310 may control transmission of state information of the refrigerator including food related information, freezing chamber temperature information and refrigerating chamber temperature information. Also, the controller 2310 may perform a control operation corresponding to a received refrigerator control signal. Meanwhile, in the case where refrigerator management software is received, the controller 2310 may perform upgrade based on the received refrigerator management software.
In this manner, it is possible to simply and conveniently control the refrigerator using the mobile terminal 100.
On the other hand, the refrigerator may further include a camera unit (not shown) for acquiring images of foods stored in the refrigerator. The acquired images may be transmitted to the mobile terminal 100 through the wireless communication unit 2100 together with corresponding food information.
As is apparent from the above description, according to the present invention, it is possible to readily determine the state of a refrigerator using a mobile terminal. Also, it is possible to simply control the refrigerator using the mobile terminal.
In detail, in order to know which foods there is a shortage of in the refrigerator at any place or time, it is possible to display information about foods stored in the refrigerator including kinds and freshness degrees of the stored foods using the mobile terminal.
Moreover, in the case where an error occurs in the refrigerator, the mobile terminal may make a connection to a service center server in real time to transmit refrigerator diagnosis data to the service center server, and display a service center connection state picture.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2009-0041006 | May 2009 | KR | national |
