This application claims the priority benefit of Korean Patent Application Nos. 10-2013-0000340, filed on Jan. 2, 2013 and 10-2013-0001664, filed on Jan. 7, 2013, in the Korean Intellectual Property Office, the disclosures of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates to a home appliance and an operation method thereof and, more particularly, to a home appliance that is capable of sharing voice data of a user with another home appliance and an operation method thereof.
2. Description of the Related Art
A refrigerator, which is a home appliance disposed in a house, stores food for users, a laundry treatment machine, which is another home appliance, treats laundry, an air conditioner, which is another home appliance, adjusts room temperature, and a cooking device, which is yet another home appliance, cooks food.
With development of various communication modes, research has been conducted into various methods of improving user convenience through communication with the home appliance.
It is an object of the present invention to provide a home appliance that is capable of sharing voice data of a user with another home appliance and an operation method thereof.
It is another object of the present invention to provide a home appliance that is controllable through voice recognition and an operation method thereof.
In accordance with one aspect of the present invention, the above and other objects can be accomplished by the provision of an operation method of a home appliance including entering a voice recognition mode, receiving a voice through a microphone, recognizing the received voice, and, in a case in which the recognized voice data contains information related to another home appliance, transmitting the recognized voice data to the corresponding home appliance.
In accordance with another aspect of the present invention, there is provided an operation method of a home appliance including receiving voice data from an external home appliance or a mobile terminal, in a case in which the voice data corresponds to an operation control command, perform a corresponding operation, and, in a case in which the voice data corresponds to a voice memo, storing the voice data in a memory.
In accordance with another aspect of the present invention, there is provided a home appliance including a microphone, a wireless communication unit to exchange data with an external device, and a controller to control the wireless communication unit to receive a voice through the microphone upon entering a voice recognition mode and to, in a case in which the recognized voice data contains information related to another home appliance, transmit the recognized voice data to the corresponding home appliance.
In accordance with a further aspect of the present invention, there is provided a home appliance including a memory, a wireless communication unit to receive voice data from an external home appliance, and a controller to, in a case in which the voice data corresponds to an operation control command, control a corresponding operation to be performed and, in a case in which the voice data corresponds to a voice memo, control the voice data to be stored in the memory.
The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
The terms “module” and “unit,” when attached to the names of components, are used herein to aid in understanding of the components and thus should not be considered as having specific meanings or roles. Accordingly, the terms “module” and “unit” may be used interchangeably.
Referring to
The home appliance 200, the AP device 400, and the mobile terminal 500 of the communication system 50 may constitute an internal network 10. The home appliance 200 may perform wireless data communication with the server 300, which is located outside the internal network 10, via an external network 55.
The home appliance 200 may be an electric device for home use. For example, the home appliance 200 may be a refrigerator 200a (see
The home appliance 200 may include a communication unit (not shown) provided therein such that the home appliance 200 exchanges data with electric devices in the internal network 10 or electric devices accessible via the external network 55 through the communication unit (not shown). To this end, the communication unit (not shown) may exchange data with the AP device 400 in a wired or wireless fashion.
Meanwhile, in connection with an embodiment of the present invention, the home appliance 200 may share received voice data with another home appliance in the internal network 10 using a voice recognition function. As a result, user convenience may be improved.
To this end, the home appliances in the internal network 10 may access the AP device 400 in a wired or wireless fashion. Alternatively, the home appliances may communicate with each other one to one.
The AP device 400 may provide the internal network 10 to an electric device adjacent thereto. Specifically, the AP device 400 may provide a wireless network.
Meanwhile, the AP device 400 may assign a wireless channel based on a predetermined communication mode to the electric devices in the internal network 10 and perform wireless data communication through the assigned channel. The predetermined communication mode may be a Wi-Fi communication mode.
In this case, the mobile terminal 500 located in the internal network 10 may access the home appliance 200 via the AP device 400 to monitor or remotely control the home appliance 200.
On the other hand, the AP device 400 may perform data communication with an external electric device via the external network 55 in addition to the internal network 10.
For example, the AP device 400 may perform data communication with a mobile terminal 500 located outside the internal network 10 via the external network 55.
At this time, the mobile terminal 500 located in the external network 55 may access the home appliance 200 via the external network 55 and the AP device 400 to monitor or remotely control the home appliance 200.
In another example, the AP device 400 may perform wireless data communication with the server 300, which is located outside the internal network 10, via the external network 55.
The server 300 may be provided with a voice recognition algorithm. In addition, upon receiving voice data, the server 300 may convert the received voice data into text format data and output the converted data.
Meanwhile, the server 300 may store firmware information regarding the home appliance 200 and operation information (course information, etc.) and register product information regarding the home appliance 200. For example, the server 300 may be a server managed by a manufacturer of the home appliance 200. In another example, the server 300 may be a server managed by an open application store administrator.
In another embodiment of the present invention, the mobile terminal 500 may receive a voice using a microphone and transmit voice data to the home appliance 200 in a voice transmission mode. At this time, in order to recognize the received voice, the mobile terminal 500 may use a voice recognition algorithm provided therein or access the external server 300 to use the voice recognition algorithm provided in the external server 300.
In addition, the mobile terminal 500 may transmit the recognized voice data to the home appliance 200.
In a case in which the voice data received by the home appliance 200 corresponds to an operation control command, the home appliance 200 may perform a corresponding operation. On the other hand, in a case in which the voice data received by the home appliance 200 corresponds to a voice memo, the home appliance 200 may store the voice data in a memory. In addition, in a case in which the voice data received by the home appliance 200 corresponds to a request for telephone conversation, the home appliance 200 may receive a call to perform telephone conversation.
As described above, the mobile terminal 500 may variously control the home appliance 200 through voice recognition.
Referring to
The input unit 220 may include a local key to allow a user input as previously described with reference to
The drive unit 245 may include different drive units according to kind of the home appliance.
For example, in a case in which the home appliance is a refrigerator, the drive unit 245 may include a refrigerating compartment drive unit to drive a refrigerating compartment fan configured to supply cooled air into a refrigerating compartment, a freezing compartment drive unit to drive a freezing compartment fan configured to supply cooled air into a freezing compartment, and a compressor drive unit to drive a compressor configured to compress a refrigerant.
In another example, in a case in which the home appliance is a washing machine, the drive unit 245 may include a drive unit to drive a drum or a tub.
In another example, in a case in which the home appliance is an air conditioner, the drive unit 245 may include a compressor drive unit to drive a compressor mounted in an outdoor unit, an outdoor unit fan drive unit to drive an outdoor unit fan configured to perform heat exchange, and an indoor unit fan drive unit to drive an indoor unit fan configured to perform heat exchange.
In another example, in a case in which the home appliance is a cooking device, the drive unit 245 may include a microwave drive unit to output microwaves into a cavity.
In a further example, in a case in which the home appliance is a cleaner, the drive unit 245 may include a fan motor drive unit to drive a fan motor configured to suction air.
Meanwhile, the communication unit 222 may include a wireless communication unit (not shown) to perform wireless communication at least.
The communication unit 222 may include a wireless communication unit (not shown) to perform wireless communication with the AP device 400 (see
On the other hand, the communication unit 222 may receive power information from a power information transmission device (not shown). To this end, the communication unit 222 may further include a communication module (not shown) in addition to the wireless communication unit (not shown).
The communication unit 222 may be provided in the home appliance. Alternatively, the communication unit 222 may be fixed to a case of the home appliance 200 in a state in which the communication unit 222 is connected to an internal circuit of the home appliance in a wired fashion.
The memory 240 may store various kinds of data necessary to operate the home appliance 200. On the other hand, the memory 240 may be provided with a voice recognition algorithm.
The audio input unit 252 may allow input of a user's voice. To this end, the audio input unit 252 may include a microphone. The received voice may be converted into an electric signal, which may be transmitted to the controller 270.
The audio output unit 254 converts the electric signal received from the controller 270 into an audio signal and outputs the audio signal. To this end, the audio output unit 254 may include a speaker.
The controller 270 may control overall operation of the home appliance. Specifically, the controller 270 may control operations of the input unit 220, the display unit 230, the communication unit 222, the drive unit 245, the memory 240, the audio input unit 252, and the audio output unit 254.
Meanwhile, in connection with an embodiment of the present invention, the controller 270 may receive a voice through the microphone at the time of entering a voice recognition mode and, in a case in which information related to another home appliance is included in recognized voice data, control the wireless communication unit to transmit the recognized voice data to the corresponding home appliance.
Referring to
The input unit 220 may include a plurality of manipulation buttons. The input unit 220 transmits a freezing compartment set temperature or a refrigerating compartment set temperature input thereto to the controller 270.
The display unit 230 may display information regarding a state of the refrigerator according to a user input. For example, the display unit 230 may display a current freezing compartment temperature or a current refrigerating compartment temperature.
The temperature sensing unit 221 senses an internal temperature of the refrigerator and transmits a signal regarding the sensed temperature to the controller 270. Specifically, the temperature sensing unit 221 senses a refrigerating compartment temperature and a freezing compartment temperature. In addition, the temperature sensing unit 221 may sense each space in the refrigerating compartment or each space in the freezing compartment.
The memory 240 may store various kinds of data necessary to operate the refrigerator. On the other hand, the memory 240 may be provided with a voice recognition algorithm.
The audio input unit 252 may allow input of a user's voice. To this end, the audio input unit 252 may include a microphone. The received voice may be converted into an electric signal, which may be transmitted to the controller 270.
The audio output unit 254 converts the electric signal received from the controller 270 into an audio signal and outputs the audio signal. To this end, the audio output unit 254 may include a speaker.
As previously described, the communication unit 222 operates to exchange data with an external electric device in a wired or wireless fashion. For example, the communication unit 222 may exchange data with the AP device 400 and exchange data with the electric device in the internal network 10 via the AP device 400. Alternatively, the communication unit 222 may exchange data with various electric devices outside the internal network 10 via the AP device 400 and the external network 55.
As shown in
For example, the controller 270 may include a microprocessor provided therein to output a signal regarding a speed command value to the compressor drive unit 213 or the fan drive unit 243 or 245.
The compressor drive unit 213, the refrigerating compartment fan drive unit 243, and the freezing compartment fan drive unit 245 include a compressor motor (not shown), a refrigerating compartment fan motor (not shown), and a freezing compartment fan motor (not shown), respectively. Each motor (not shown) is driven at a target rotation speed under control of the controller 270.
In a case in which each motor is a three phase motor, the motor may be controlled according to switching in an inverter (not shown) or may be controlled at a constant speed using alternating current power. Each motor (not shown) may be any one selected from among an induction motor, a brushless direct current (BLDC) motor, and a synchronous reluctance motor (synRM).
On the other hand, the controller 270 may control overall operation of the refrigerator 200a in addition to controlling the operations of the compressor 212 and the fan 242 or 244 as described above. That is, the controller 270 may control overall operation of a refrigerant cycle according to the temperature set through the input unit 220. For example, the controller 270 may further control a three-way valve (not shown), a refrigerating compartment expansion valve (not shown), and a freezing compartment expansion valve (not shown) in addition to the compressor drive unit 213, the refrigerating compartment fan drive unit 243, and the freezing compartment fan drive unit 245. In addition, the controller 270 may also control operation of a condenser (not shown). Furthermore, the controller 270 may also control operation of the display unit 230.
Referring to
The wireless communication unit 510 may include a broadcast reception module 511, a mobile communication module 513, a wireless Internet module 515, a near field communication (NFC) module 517, and a global positioning system (GPS) module 519.
The broadcast reception module 511 may receive a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel.
The broadcast signal and/or the broadcast-related information received through the broadcast reception module 511 may be stored in the memory 560.
The mobile communication module 513 transmits and receives a wireless signal to and from at least one selected from among a base station, an external terminal, and a server via a mobile communication network. The wireless signal may include a voice call signal, a video communication call signal, and various types of data based on text/multimedia message transmission and reception.
The wireless Internet module 515 is a module for wireless Internet access. The wireless Internet module 515 may be mounted inside or outside the mobile terminal 500. For example, the wireless Internet module 515 may perform wireless communication based on Wi-Fi or wireless communication based on Wi-Fi Direct.
The NFC module 517 may perform wireless communication. In a case in which the NFC module 517 is within a predetermined distance from a home appliance equipped with an NFC tag or an NFC module, i.e., the NFC module 517 performs tagging, the NFC module 517 may receive or transmit data from or to the home appliance.
In addition, Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), or ZigBee may be used as short range communication technology.
The GPS module 519 may receive position information from a plurality of GPS satellites.
The A/V input unit 520 is provided to allow an audio signal or video signal input. The A/V input unit 520 may include a camera 521 and a microphone 523.
The user input unit 530 generates key input data inputted by a user to control the operation of the terminal. To this end, the user input unit 530 may include a keypad, a dome switch, and a touch pad (static pressure or electrostatic). Particularly, in a case in which the touch pad forms a layered structure together with an output display unit 551, an assembly of the touch pad and the output display unit 551 may be called a touchscreen.
The sensing unit 540 may sense a current state of the mobile terminal 500, such as an open or closed state of the mobile terminal 500, the position of the mobile terminal 500, and whether user contact with the mobile terminal 500 has been performed, to generate a sensing signal to control the operation of the mobile terminal 500.
The sensing unit 540 may include a proximity sensor 541, a pressure sensor 543, and a motion sensor 545. The motion sensor 545 may sense the motion or position of the mobile terminal 500 using an acceleration sensor, a gyro sensor, a gravity sensor, or any other suitable sensor known to one of skill in the art. In particular, the gyro sensor is a sensor to measure angular velocity of the mobile terminal 500. The gyro sensor may sense a direction (angle) of the mobile terminal 500 rotated from a reference direction.
The output unit 550 may include a output display unit 551, an acoustic output module 553, an alarm unit 555, and a haptic module 557.
The display unit 551 outputs, i.e., displays, information processed by the mobile terminal 500.
Meanwhile, in a case in which the output display unit 551 and the touch pad are disposed as a layered structure to form a touchscreen as previously described, the output display unit 551 may also be used as an input device that allows a user to input information by touch in addition to an output device.
The acoustic output module 553 outputs audio data received from the wireless communication unit 510 or stored in the mobile terminal memory 560. The acoustic output module 553 may include a speaker and a buzzer.
The alarm unit 555 outputs a signal to inform about generation of an event of the mobile terminal 500. For example, the alarm unit 555 may output a signal in the form of vibration.
The haptic module 557 generates a variety of tactile effects that a user may feel. A typical example of the tactile effects generated by the haptic module 557 is a vibration effect.
The mobile terminal memory 560 may store a program for processing or control of the mobile terminal controller 580 or temporarily store input or output data (for example, phonebooks, messages, still images, moving images, etc.).
The interface unit 570 interfaces between the mobile terminal 500 and all external devices connected to the mobile terminal 500. The interface unit 570 may receive data or power from the external devices and transmit the received data or power to the respective components of the mobile terminal 500. In addition, data may be transmitted from the mobile terminal 500 to the external devices via the interface unit 570.
The mobile terminal controller 580 controls operations of the respective components of the mobile terminal 500, thereby controlling overall operation of the mobile terminal 500. For example, the controller 580 may perform control or processing for voice communication, data communication, and video communication. In addition, the mobile terminal controller 580 may further include a multimedia reproduction module 581 to reproduce multimedia. The multimedia reproduction module 581 may be incorporated into the mobile terminal controller 580 in the form of hardware. Alternatively, the multimedia reproduction module 581 may be configured in the form of software separate from the mobile terminal controller 580.
The power supply unit 590 supplies external power or internal power to the respective components of the mobile terminal 500 under control of the mobile terminal controller 580.
The block diagram of
Referring to
The server communication module 330 may receive voice data from the home appliance 200 or the mobile terminal 500. In addition, the server communication module 330 may transmit voice-recognized text format voice data to the home appliance 200 or the mobile terminal 500.
In addition, the server communication module 330 may receive product information related to the home appliance 200 from the home appliance 200 or the mobile terminal 500. When registration of the home appliance is completed, therefore, the communication module 330 of the server 300 may transmit information regarding completion of the registration.
In addition, the communication module 330 of the server 300 may receive a firmware update request for the home appliance 200 from the home appliance 200 or the mobile terminal 500. Consequently, the server communication module 330 may transmit updated firmware to the home appliance 200 or the mobile terminal 500.
The storage unit 340 may store data regarding overall operation of the refrigerator. In addition, the storage unit 340 may store a voice recognition algorithm. In addition, the storage unit 340 may store the product information related to the home appliance 200 received from the home appliance 200 or the mobile terminal 500.
The server processor 320 may control overall operation of the server 300. For example, the server processor 320 may convert voice data received from the home appliance 200 or the mobile terminal 500 into text format voice data using a voice recognition algorithm and control the converted voice data to be transmitted to the home appliance 200 or the mobile terminal 500.
In another example, upon receiving production information from the home appliance 200 or the mobile terminal 500, the server processor 320 may control the product to be registered.
In a further example, upon receiving a firmware update request from the home appliance 200 or the mobile terminal 500, the server processor 320 may control updated firmware to be transmitted to the home appliance 200 or the mobile terminal 500.
Referring first to
The voice recognition mode may be a mode to recognize a voice input to the first home appliance 200a. The controller 270 of the home appliance may enter the voice recognition mode according to a user input. Upon entering the voice recognition mode, the controller 270 of the home appliance may activate the microphone of the audio input unit 252.
Subsequently, the home appliance may receive a voice through the microphone (S612). Meanwhile, step S812 of
Upon receiving a voice input from a user in a state in which the microphone of the audio input unit 252 of the home appliance is activated, the microphone of the audio input unit 252 may receive the voice and transmit the received voice to the controller 270.
Subsequently, the home appliance recognizes the received voice (S615). Meanwhile, step S815 of
The controller 270 may perform signal processing with respect to the input voice and perform voice recognition.
For example, in a case in which the memory 240 of the home appliance is provided with a voice recognition algorithm, the controller 270 may recognize the voice of the user using the voice recognition algorithm. That is, the controller 270 may convert a voice signal into a text signal.
In another example, in a case in which the memory 240 of the home appliance is not provided with a voice recognition algorithm, the controller 270 may access the server 300 using the communication unit 222 and recognize the voice of the user using the voice recognition algorithm provided in the server 300. That is, the controller 270 may convert a voice signal into a text signal.
Subsequently, the home appliance determines whether the recognized voice data includes information related to another home appliance (S616). Upon determining that the recognized voice data includes the information related to the corresponding home appliance, the home appliance determines whether the home appliance can access the corresponding home appliance (S619). Upon determining that the home appliance can access the corresponding home appliance, the home appliance transmits the recognized voice data information to the corresponding home appliance (S620). Meanwhile, steps S816, S819, and S820 of
The controller 270 determines whether the recognized voice data includes information related to another home appliance. For example, in a case in which the recognized voice data includes name (cooking device, TV, etc.) of another home appliance or terms (broadcast view, broadcast program, temperature, etc.) related to a main operation of another home appliance, the controller 270 may decide to transmit the recognized voice data to the corresponding home appliance.
Upon deciding to transmit the voice data to another home appliance, the controller 270 may determine whether the home appliance can access the corresponding home appliance. For example, in a case in which the corresponding home appliance is on and the communication unit of the corresponding home appliance normally operates, the home appliance can access the corresponding home appliance. Consequently, the controller 270 may control the communication unit 222 to transmit an access signal to the corresponding home appliance such that the home appliance can access the corresponding home appliance. In a case in which a response signal to the access signal is received within a predetermined time, the controller 270 may determine that the home appliance can access the corresponding home appliance.
Subsequently, the controller 270 may control the recognized voice data to be transmitted to the corresponding home appliance which the home appliance can access.
Next, referring to
The communication unit of the second home appliance 200b may receive the voice data from the first home appliance 200a.
Subsequently, the second home appliance 200b may determine whether the received voice data is an operation control command (S725). Upon determining that the received voice data is the operation control command, the second home appliance 200b is controlled to perform an operation according to the operation control command (S730). Meanwhile, steps S825 and S830 of
For example, in a case in which the received voice data is voice data of “Turn the washing machine on,” it is possible to turn on the second home appliance 200b, i.e., the washing machine. Specifically, the washing machine, which is in a standby mode, may be turned on to activate the display unit and the input unit of the washing machine.
Subsequently, upon determining at step S725 that the received voice data is not the operation control command, step S735 and the following steps may be performed.
The second home appliance 200b may determine whether the received voice data is a voice memo (S735). Upon determining that the received voice data is the voice memo, the second home appliance 200b stores the voice memo in the memory 240 (S740). Upon receiving a reproduction input (S742), the second home appliance 200b reproduces and outputs the stored voice memo (S745). Meanwhile, steps S835, S840, S842, and S845 of
In a case in which the received voice data is voice data of “I will attend a company dinner today. Wash the laundry in the washing machine,” therefore, the controller of the second home appliance 200b may control the received voice data to be stored in the memory 240.
Meanwhile, upon receiving the voice memo, the controller of the second home appliance 200b may control a message indicating the reception of the voice memo to be output. As a result, the user may intuitively recognize the reception of the voice memo.
When the user pushes a specific button in the input unit 220 of the second home appliance 200b, the voice memo stored in the memory may be reproduced and outputted. As a result, the user may easily and conveniently confirm the stored memo.
That is, the refrigerator 200a, the washing machine 200b, the air conditioner 200c, the cooking device 200d, the cleaner 200e, and the TV 200f may access the AP device 400 in a wireless fashion. On the other hand, the mobile terminal 500 may also access the AP device 400 in a wireless fashion. Consequently, it is possible to share voice data of the user in the internal network 10.
Meanwhile, the home appliances 200a to 200f may access the external server 300 via the AP device 400 and the external network 55.
The refrigerator 200a may transmit voice data Sa to the external server 300 via the AP device 400 and the external network 55. The server 300 may transmit voice data Sb converted into text through voice recognition to the refrigerator 200a via the AP device 400 and the external network 55. The communication unit 222 of the refrigerator 200a may receive the voice data Sb converted into text.
The refrigerator 200a may transmit voice data S1 to the external server 300 via the AP device 400 and the external network 55. The server 300 may transmit voice data S2, converted into text through voice recognition, to the refrigerator 200a via the AP device 400 and the external network 55. The communication unit 222 of the refrigerator 200a may receive the voice data S2 converted into text.
The refrigerator 200a may transmit voice data Se to the external server 300 via the AP device 400 and the external network 55. The server 300 may transmit voice data Sf converted into text through voice recognition to the refrigerator 200a via the AP device 400 and the external network 55. The communication unit 222 of the refrigerator 200a may receive the voice data Sf converted into text.
The cooking device 200d may transmit voice data S4 to the external server 300 via the AP device 400 and the external network 55. The server 300 may transmit voice data S5 converted into text through voice recognition to the cooking device 200d via the AP device 400 and the external network 55. The communication unit 222 of the cooking device 200d may receive the voice data S5 converted into text.
In addition, the controller of the TV 200f may control the TV 200f to be turned on or switching between channels to be performed according to the start time of program A.
The distance between the washing machine 200b and the refrigerator 200a may be L1, the distance between the refrigerator 200a and the cooking device 200d may be L2, the distance between the cooking device 200d and the TV 200f may be L3, and the distance between the TV 200f and the air conditioner 200c may be L4.
In a case in which the user 900 inputs a voice 1410 of “Turn the air conditioner on.” to the washing machine 200b, corresponding voice data or voice data converted into text may be transmitted to the air conditioner 200c in various manners.
Referring first to
The mobile terminal controller 580 may enter the voice transmission mode according to a user input.
The voice transmission mode may be a mode to transmit a voice input to the mobile terminal 500 to, for example, a home appliance.
Upon entering the voice transmission mode, the mobile terminal controller 580500 may activate the microphone 523.
Subsequently, the mobile terminal 500 may receive a voice through the microphone (S1515). Meanwhile, step S1715 of
Upon receiving a voice input from a user in a state in which the microphone 523 of the mobile terminal 500 is activated, the microphone 523 may receive the voice and transmit the received voice to the controller 580.
The mobile terminal controller 580 may perform signal processing with respect to the input voice and perform voice recognition.
For example, in a case in which the mobile terminal memory 560 is provided with a voice recognition algorithm, the mobile terminal controller 580 may recognize the voice data 920 of the user using the voice recognition algorithm. That is, the mobile terminal controller 580 may convert a voice signal into a text signal.
In another example, in a case in which the mobile terminal memory 560 is not provided with a voice recognition algorithm, the mobile terminal controller 580 may access the server 300 using the wireless communication unit 510 and recognize the voice data 920 of the user using the voice recognition algorithm provided in the server 300. That is, the mobile terminal controller 580 may convert a voice signal into a text signal.
Subsequently, the mobile terminal 500 transmits the received voice data to the home appliance 200 via a network (S1520). Meanwhile, step S1720 of
In a case in which the mobile terminal 500 is located in the internal network 10 of
Subsequently, the home appliance 200, specifically the refrigerator 200a, may determine whether the received voice data is an operation control command (S1625). Upon determining that the received voice data is the operation control command, the home appliance 200, specifically the refrigerator 200a, is controlled to perform an operation according to the operation control command (S1630). Meanwhile, steps S1725 and S1730 of
Consequently, the controller 270 of the home appliance 200, specifically the refrigerator 200a, may control the compressor to be driven such that the temperature of the freezing compartment is lowered based on the voice data of “Set the freezing compartment temperature of the refrigerator to −50 t.” As a result, the user may easily and conveniently control the home appliance.
Subsequently, upon determining at step S1625 that the received voice data is not the operation control command, step S1635 and the following steps may be performed.
That is, the home appliance 200, specifically the refrigerator 200a, may determine whether the received voice data is a voice memo (S1635). Upon determining that the received voice data is the voice memo, the home appliance 200, specifically the refrigerator 200a, stores the voice memo in the memory 560 (S1640). Upon receiving a reproduction input (S1642), the home appliance 200, specifically the refrigerator 200a, reproduces and outputs the stored voice memo (S1645). Meanwhile, steps S1735, S1740, S1742, and S1745 of
Consequently, the controller 270 of the home appliance 200, specifically the refrigerator 200a, may control the received voice data to be stored in the memory 560 based on the voice data of “I will attend a company dinner today. Eat pizza in the refrigerator for dinner.”
Meanwhile, upon receiving the voice memo, the controller of the home appliance 200, specifically the refrigerator 200a, may control a message indicating the reception of the voice memo to be output.
When the user 902 pushes a specific button 220a in the input unit 220 of the refrigerator 200a, a voice memo 1030 stored in the memory may be output as shown in
Subsequently, upon determining at step S1635 that the received voice data is not the voice memo, step S1650 and the following steps may be performed.
That is, the home appliance 200, specifically the refrigerator 200a, may determine whether the received voice data is a request for telephone conversation (S1650). Upon determining that the received voice data is a request for telephone conversation, the home appliance 200, specifically the refrigerator 200a, receives a call (S1652) and then performs telephone conversation (S1655). Meanwhile, steps S1750, S1752, and S1755 of
Consequently, the controller of the home appliance 200, specifically the refrigerator 200a, may receive a call related to the voice data of “May I talk to you over the telephone through the refrigerator now?” and transmit a call access signal to the mobile terminal. In addition, the controller of the home appliance 200, specifically the refrigerator 200a, may control the telephone conversation to be performed.
In a case in which the user 902 inputs a voice data 2040 of “Yeah, what's up?” while pushing the specific button 220a in the input unit 220 of the refrigerator 200a as shown in
The controller 270 of the refrigerator 200a may perform signal processing with respect to the voice data received through the audio input unit 252 and control the signal-processed voice data to be transmitted to the mobile terminal 500.
Hereinafter, an operation method of a home appliance will be described based on the refrigerator 200a.
Referring first to
The user of the mobile terminal may generate a desired QR code using a QR code generation program. The QR code may include voice data. For example, the QR code may include an address and details of a business card of the user.
The generated QR code may be transmitted from the mobile terminal 500 to another electric device as an image.
Specifically, the predetermined data may image data including a QR code.
The controller 270 of the refrigerator 200a may perform signal processing with respect to the QR code image 2210 received through the communication unit 222. For example, in a case in which the memory 240 of the refrigerator 200a is provided with a QR code analysis program, the controller 270 of the refrigerator 200a may interpret the QR code image 2210 using the QR code analysis program. In another example, in a case in which the memory 240 of the refrigerator 200a is not provided with a QR code analysis program, the controller 270 may access the server 300 to interpret the QR code image 2210.
The controller 270 of the refrigerator 200a may confirm details of the QR code image 2210 and, in a case in which a voice memo is contained in the QR code image 2210, control the QR code image 2210 to be stored in the memory 240.
At this time, the display unit 230 may output a message 1325 indicating the reception of the voice memo. As a result, the user may intuitively recognize the reception of the voice memo.
When the user pushes a specific button 220a in the input unit 220 of the refrigerator 200a, a voice memo 2220 stored in the memory may be outputted as shown in
The home appliance and the operation method thereof according to the present invention are not limitedly applicable to the constructions and methods of the embodiments as described above. For example, all or some of the embodiments may be selectively combined to achieve various modifications.
Meanwhile, the operation method of the home appliance according to the present invention may be realized as code, which is readable by a processor included in the home appliance, in recording media readable by the processor. The recording media readable by the processor include all kinds of recording devices to store data which are readable by the processor. Examples of the recording media readable by the processor may include a read only memory (ROM), a random access memory (RAM), a compact disc read only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device. In addition, the recording media readable by the processor may also be realized in the form of a carrier wave, such as transmission through the Internet. Furthermore, the recording media readable by the processor may be distributed to computer systems connected to each other through a network such that code readable by the processor is stored or executed in a distributed manner.
As is apparent from the above description, according to an embodiment of the present invention, a home appliance may recognize an input voice and, in a case in which the recognized voice data includes information related to another home appliance, transmit the recognized voice data to the corresponding home appliance. Consequently, the home appliances may share the voice data. As a result, user convenience may be improved.
Meanwhile, the home appliance may transmit the voice data to the corresponding home appliance via at least one home appliance adjacent thereto, thereby easily and conveniently transmitting the voice data.
Meanwhile, in a case in which the home appliance receives voice data from another home appliance and the received voice data corresponds to an operation control command, the home appliance may perform a corresponding operation. On the other hand, in a case in which the received voice data corresponds to a voice memo, the home appliance may store the voice data in a memory. Consequently, the home appliance may perform a variety of operations. As a result, user convenience may be improved.
According to another embodiment of the present invention, a home appliance receives voice data from an external device, such as a mobile terminal, and, in a case in which the received voice data corresponds to an operation control command, the home appliance may perform a corresponding operation. On the other hand, in a case in which the received voice data corresponds to a voice memo, the home appliance may store the voice data in a memory. Consequently, the home appliance may be controlled through voice recognition.
Meanwhile, in a case in which the received voice data corresponds to a request for telephone conversation, the home appliance may perform telephone conversation. Consequently, a user may easily and conveniently perform a desired operation.
In particular, the mobile terminal may transmit the voice data recognized through voice recognition to the home appliance. Consequently, the home appliance may be easily and conveniently controlled.
According to a further embodiment of the present invention, a home appliance may receive image data and, in a case in which the received image data is a QR code image related to voice data, the home appliance may extract the voice data from the QR code and store the extracted voice data in a memory. Consequently, a user may easily and conveniently store desired details.
Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2013-0000340 | Jan 2013 | KR | national |
10-2013-0001664 | Jan 2013 | KR | national |
Number | Name | Date | Kind |
---|---|---|---|
6418324 | Doviak | Jul 2002 | B1 |
7634065 | Fukunaga | Dec 2009 | B2 |
8340975 | Rosenberger | Dec 2012 | B1 |
8472935 | Fujisaki | Jun 2013 | B1 |
20010041982 | Kawasaki | Nov 2001 | A1 |
20060267741 | Park | Nov 2006 | A1 |
20100090862 | Dubrow | Apr 2010 | A1 |
20100156666 | Choi | Jun 2010 | A1 |
20100205655 | Mokuya | Aug 2010 | A1 |
20110054644 | Baek | Mar 2011 | A1 |
20110287753 | Choi | Nov 2011 | A1 |
20120061480 | Deligiannis | Mar 2012 | A1 |
20120078959 | Cho | Mar 2012 | A1 |
20120085829 | Ziegler | Apr 2012 | A1 |
20120226502 | Ouchi | Sep 2012 | A1 |
20130223279 | Tinnakornsrisuphap | Aug 2013 | A1 |
20140167929 | Shim | Jun 2014 | A1 |
20140167931 | Lee | Jun 2014 | A1 |
20140224138 | Tokumaru | Aug 2014 | A1 |
Number | Date | Country |
---|---|---|
102148031 | Aug 2011 | CN |
Entry |
---|
Akyildiz et al. “A survey on sensor networks.” IEEE communications magazine 40.8 (2002): 102-114. |
Prema et al., “Power Aware Routing Protocol (PARP) for Wireless Sensor Networks.” Wireless Sensor Network4.5 (2012): 133. |
Number | Date | Country | |
---|---|---|---|
20140188463 A1 | Jul 2014 | US |