Some exemplary embodiments of the present disclosure relates to a robot cleaner and a controlling method thereof.
Generally, a robot has been developed for an industrial use, and has managed some parts of factory automation. As the robot is applied to various fields recently, medical robots, space robots, home robots, etc. are being developed.
A representative of the home robot is a robot cleaner, a kind of home electronic appliance capable of performing a cleaning operation by sucking peripheral dust or foreign materials with autonomously moving on a predetermined region.
This robot cleaner is provided with a chargeable battery, and cleans a predetermined region with autonomously moving.
According to one aspect of the present disclosure, there is provided a robot cleaner, comprising: an image sensor unit configured to capture image information when an operation instructing command is received; and a controller configured to analyze the image information captured by the image sensor unit, and to control a cleaning operation based on a first cleaning algorithm selected from a plurality of pre-stored cleaning algorithms based on a result of the analysis.
According to another aspect of the present disclosure, there is also provided a controlling method of a robot cleaner, the method comprising: capturing first image information when an operation instructing command is received; analyzing the captured first image information; selecting, from a plurality of cleaning algorithms, a first cleaning algorithm corresponding to an analysis result; and controlling a cleaning operation based on the selected first cleaning algorithm.
The foregoing and other objects, features, aspects and advantages of the present disclosure will become more apparent from the following detailed description of the present disclosure when taken in conjunction with the accompanying drawings.
Therefore, one aspect of the detailed description is to provide a robot cleaner capable of performing a cleaning operation by using at least one cleaning algorithm selected from a plurality of cleaning algorithms based on an analysis result with respect to a captured image, and a controlling method thereof.
Another aspect of the detailed description is to provide a robot cleaner capable of performing a cleaning operation by selecting a cleaning algorithm suitable for the peripheral circumstances based on image information captured during a cleaning operation, and a controlling method thereof.
Another aspect of the detailed description is to provide a robot cleaner capable of performing a cleaning operation by recognizing peripheral circumstances during a cleaning operation, and by selecting an optimized cleaning algorithm according to the recognized peripheral circumstances, and a controlling method thereof.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
In the drawings:
Description will now be given in detail of the present invention, with reference to the accompanying drawings.
For the sake of brief description with reference to the drawings, the same or equivalent components will be provided with the same reference numbers, and description thereof will not be repeated.
Hereinafter, preferred embodiments of the present invention will be explained in more detail with reference to the attached drawings. The same components will be provided with the same reference numerals, and detailed explanations thereof will be omitted.
As shown in
The input unit 110 receives a signal as a user manipulates buttons or selects any function, or receives a generated command or a control signal by touching/scrolling a displayed screen.
The input unit 110 receives a signal corresponding to information inputted by a user, and may be implemented as various devices such as a keypad, a touch screen, a Jog & shuttle, a microphone, a mouse, a stylus pen and a touch pen.
The input unit 110 includes an operation instructing command button, a preset specific button for capturing image information, a running button, a stopping button, etc.
The image sensor unit 120 captures image information under control of the controller 150.
As shown in
The image sensor unit 120 is provided on a front surface (or side surface) of the robot cleaner 10, and includes one or more cameras configured to capture a front side (a moving direction of the robot cleaner 10) or a lateral side. Alternatively, the image sensor unit 120 may be provided with one or more cameras on an upper surface and a front surface of the robot cleaner 10, respectively.
The detection unit 130 is provided on a side surface of the robot cleaner 10, and is configured to detect an object (or obstacle) located within a predetermined region (cleaning region).
The detection unit 130 is configured to transmit a signal generated from a supersonic sensor, an infrared sensor, a radio frequency (RF) sensor, etc., and includes a distance detection sensor configured to detect a position of an obstacle and a distance from the obstacle through a signal received in response to the transmitted signal, a collision sensor configured to detect an obstacle by colliding with the obstacle, etc.
The storage unit 140 stores therein each kind of information including each type of menu screens, a plurality of cleaning algorithms, preset priority information corresponding to the plurality of cleaning algorithms, and a cleaning map.
The storage unit 140 also stores therein various user interfaces (UI) and/or graphic user interfaces (GUI).
The storage unit 140 also stores therein data and programs necessary for the robot cleaner 10 to be operated.
In a case that the robot cleaner 10 performs a cleaning operation, the storage unit 140 also stores therein a moving path of the robot cleaner 10, a cleaning algorithm used for each moving path, etc.
The storage unit 140 stores therein each kind of information received through the communication unit 190 (map data, cleaning algorithm, each kind of control signals, etc.).
The controller 150 is configured to entirely control the robot cleaner 10.
The controller 150 may determine a location of the robot cleaner 10 based on image information outputted from the image sensor unit 120, and/or location information recognized by a location recognition unit (not shown).
The controller 150 may receive a signal transmitted from an external beacon through the communication unit 190, and may determine a location of the robot cleaner 10 based on the received signal.
When an operation instructing command button (not shown) provided at the input unit 110 is selected (or an operation instructing command is received), or when an operation instructing command button (not shown) displayed on the display unit 160 is selected, the controller 150 generates a first control signal for capturing image information to output the generated signal to the image sensor unit 120.
The controller 150 analyzes image information captured by the image sensor unit 120, and selects one of a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis. Also, the controller 150 controls a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the selected cleaning algorithm (e.g., first cleaning algorithm).
Also, the controller 150 generates a second control signal for capturing image information at a preset time interval, and outputs this generated signal to the image sensor unit 120. When a preset specific button (not shown) provided at the input unit 110 or displayed on the display unit 160 is selected, the controller 150 generates a second control signal for capturing image information to output the generated signal to the image sensor unit 120.
Also, the controller analyzes the image information captured by the image sensor unit 120 based on the second control signal, and selects at least one (e.g., second cleaning algorithm) of a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis.
Also, the controller 150 compares the first cleaning algorithm by which the current cleaning operation is performed, with the second cleaning algorithm selected through analysis of the image information captured according to the second control signal. If the two algorithms are different from each other as a result of the comparison, the controller 150 performs a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the second cleaning algorithm.
On the other hand, if the two algorithms are equal to each other as a result of the comparison, the controller 150 performs a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the first cleaning algorithm for the current cleaning operation.
Also, the controller 150 compares preset first priority information corresponding to the first cleaning algorithm for the current cleaning, with preset second priority information corresponding to the second cleaning algorithm selected through analysis of the image information captured according to the second control signal. Then, the controller 150 controls the running unit 170 and the cleaning unit 180 based on a cleaning algorithm having a higher priority, thereby performing a cleaning operation.
Also, the controller 150 controls each information of the robot cleaner 10 including a button selection state (or button input state), an operation state of the robot cleaner 10, etc. selected by the input unit 110 or the display unit 160, to be displayed on the display unit 160.
In a case that the robot cleaner 10 performs a cleaning operation, the controller 150 makes a cleaning map based on a moving path of the robot cleaner 10. If the robot cleaner 10 performs a cleaning operation based on the cleaning map, the controller 150 distinguishes a cleaned region having been cleaned within the cleaning map, from a non-cleaned region.
The display unit 160 is installed on an upper surface or a side surface of the robot cleaner 10, and displays each information generated by the controller 150. Here, the display unit 160 may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor-Liquid Crystal Display (TFT LCD), an Organic Light-Emitting Diode (OLED), a Flexible Display, a Field Emission Display (FED) and a 3D Display.
Some of these display units 160 may be configured to be transparent or semi-transparent so that outside (or inside of the robot cleaner 10) can be viewed therethrough. These types of display units may be called as transparent displays. And, representative transparent displays include TOLED (Transparent OLED), etc.
The robot cleaner 10 may include two or more display units 160 according to an implementation method thereof. For example, the robot cleaner 10 may include a plurality of display units integrally or separately disposed on one surface, or a plurality of display units disposed on different surfaces.
Meanwhile, when a sensor (referred to as a touch sensor, hereinafter) for detecting a touch operation of the display unit 160 is overlaid in a layered manner (referred to as a touch screen), the display unit 160 may function as both an input device and an output device. The touch sensor may have, for example, the form of a touch film, a touch sheet, a touch pad, and the like.
The touch sensor may be configured to convert the pressure applied to a particular portion of the display unit 160 or a change in capacitance generated at a particular portion of the display unit 160 into an electrical input signal. The touch sensor may be configured to detect a touch input pressure as well as a touch input location and a touch input area. When there is a touch input with respect to the touch sensor, the corresponding signal(s) are sent to a touch controller. The touch controller processes the signal(s) and transmits corresponding data to the controller 150. Accordingly, the controller 150 can recognize a touched region of the display unit 160.
When displaying each information generated by the controller 150, the display unit 160 may display various contents by using a user interface and/or a graphic user interface included in the storage unit 140. Here, the contents outputted on the display unit 160 may include menu screens for outputting various text or image data, and data such as icons, list menus, combo boxes and the like.
The robot cleaner 10 may further comprise a voice output unit (not shown) configured to output voice information included in each information generated by the controller 150. Here, the voice output unit may be implemented as a speaker.
The running unit 170 includes one or more wheels, which are driven by a driving unit (not shown) such as a motor.
The running unit 170 performs running operations such as moving, stopping and direction change under control of the controller 150.
Sensors including an encoder may be connected to the running unit 170.
The cleaning unit 180 is provided on a lower surface of the robot cleaner 10, and performs a cleaning operation by sucking foreign materials disposed at a lower side, under control of the controller 150, when the robot cleaner 10 is in a moving state or a stopped state.
The cleaning unit 180 may include an air purifier configured to purify pollutants included in the air.
The communication unit 190 is connected with an external terminal such as a remote controller, a mobile terminal and an information providing center, through a wired/wireless communication method. Here, the radio internet module may include wireless LAN (WLAN), Wi-Fi, Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), IEEE 802.16, Long Term Evolution (LTE), Wireless Mobile Broadband Service (WMBS), etc. And, the short-range communication module may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), Zigbee, etc.
The communication unit 190 also receives each information (including information on a control signal, a cleaning map, etc.) transmitted from the external terminal.
The power unit 200 stores or charges power supplied from an external power supply device.
The power unit 200 may include a battery consisting of a single device, or may include one pack (battery pack) consisting of a plurality of batteries.
In the case that the power unit 200 is provided with a plurality of batteries, the plurality of batteries may be serially connected to each other, and one or more safety switches may be disposed between the plurality of batteries.
The power unit 200 may be supplied with power by a wired/wireless charging method with the external power supply device. That is, the power unit 200 may be charged by being directly connected to the external power supply device by a power socket. Alternatively, the power unit 200 may be charged by applying one of a magnetic resonance coupling method, an electromagnetic induction method and a radio wave method between a transceiver provided at the power unit 200 and a transceiver provided at the external power supply device. That is, the power unit 200 and the external power supply device may be configured to be charged by radio. Here, the configurations of the transceivers may be easily designed by those skilled in the art.
The robot cleaner of the present invention may efficiently perform a cleaning operation by analyzing information on captured images, and by using at least one of a plurality of cleaning algorithms based on a result of the analysis.
Furthermore, the robot cleaner of the present invention may perform a cleaning operation suitable for the peripheral circumstances by selecting a cleaning algorithm suitable for the peripheral circumstances based on image information captured during the cleaning operation.
Hereinafter, a controlling method of a robot cleaner according to the present invention will be explained in more detail with reference to
Firstly, the image sensor unit 120 captures first image information when the operation instructing command button provided at the input unit 110 or displayed on the display unit 160 is selected. Here, the image sensor unit 120 is provided on one side surface (upper surface or side surface) of the robot cleaner 10, and captures the upper side or front side (or lateral side). And, the image sensor unit 120 outputs information on the captured first upper or front image.
A selected state of the operation instructing command button, and a captured state by the image sensor unit 120 (or image information captured by the image sensor unit 120) may be displayed on the display unit 160, under control of the controller 150 (S110).
Then, the controller 150 analyzes the first image information (including first upper image information, first front image information, etc.) outputted from the image sensor unit 120. Then, the controller 150 selects at least one cleaning algorithm among a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis.
More concretely, if image information can be analyzed as an analysis result with respect to the first image information outputted from the image sensor unit 120, the controller 150 selects any cleaning algorithm based on image information among the plurality of pre-stored cleaning algorithms. On the other hand, if image information cannot be analyzed, the controller 150 selects any cleaning algorithm not based on image information among the plurality of pre-stored cleaning algorithms. Here, the cleaning algorithm not based on image information may be a cleaning algorithm (e.g., cleaning algorithm for avoiding an obstacle) among a plurality of cleaning algorithms which are not based on image information.
As one example, if it is determined that no obstacle exists based on the first image information outputted from the image sensor unit 120, the controller 150 selects a cleaning algorithm based on image information (e.g., optimized cleaning algorithm for cleaning a place having no obstacle) among the plurality of pre-stored cleaning algorithms.
As another example, if it is determined that the number of obstacles is more than a predetermined number based on the first image information outputted from the image sensor unit 120, the controller 150 selects an optimized cleaning algorithm for avoiding an obstacle among the plurality of pre-stored cleaning algorithms (S120).
Then, the controller 150 performs a cleaning operation by controlling the running unit 170 and/or the cleaning unit 180 based on the selected cleaning algorithm.
While the robot cleaner 10 performs a cleaning operation, the controller 150 may make a cleaning map based on a moving path of the robot cleaner 10, and may display the made cleaning map (including information on a cleaned region and a non-cleaned region) on the display unit 160 (S130).
Then, the image sensor unit 120 captures second image information based on a control signal generated by the controller 150 when a preset time interval has passed, or when a preset specific button provided at the input unit 110 or the display unit 160 has been selected (S140).
Then, the controller 150 analyzes the second image information (including second upper image information, second front image information, etc.) outputted from the image sensor unit 120. Then, the controller 150 selects at least one cleaning algorithm among a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis.
More concretely, if image information can be analyzed as an analysis result with respect to the second image information outputted from the image sensor unit 120, the controller 150 selects any cleaning algorithm based on image information among the plurality of pre-stored cleaning algorithms. On the other hand, if image information cannot be analyzed, the controller 150 selects any cleaning algorithm not based on image information among the plurality of pre-stored cleaning algorithms. Here, the controller 150 may select a plurality of cleaning algorithms (S150).
Then, the controller 150 compares the cleaning algorithm by which the current cleaning operation is performed, with the cleaning algorithm selected through analysis of the second image information (S160). If the two algorithms are different from each other as a result of the comparison, the controller 150 performs a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the cleaning algorithm selected based on an analysis result of the second image information.
When the previous cleaning operation (e.g., cleaning operation using a cleaning algorithm selected based on an analysis result of the first image information) is changed into a new cleaning operation (e.g., cleaning operation using a cleaning algorithm selected based on an analysis result of the second image information), the controller 150 may generate guidance information indicating the change of the cleaning operation to output the guidance information on the display unit 160.
As one example, when the current cleaning operation is changed from a cleaning operation including image information selected based on an analysis result of the first image information (e.g., optimized cleaning algorithm for cleaning a place having no obstacle) into a cleaning operation not based on image information selected based on an analysis result of the second image information (e.g., optimized cleaning algorithm for avoiding an obstacle), the controller 150 may generate guidance information including a message, The current cleaning operation has changed into a cleaning operation based on obstacle avoidance from a cleaning operation based on image information, and output the guidance information on the display unit 160 (S170).
When the cleaning algorithm selected based on an analysis result of the second image information is consistent with the cleaning algorithm for the current cleaning operation as a check result in S160, the controller 150 performs a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the cleaning algorithm for the current cleaning operation.
Firstly, the image sensor unit 120 captures first image information when the operation instructing command button provided at the input unit 110 or displayed on the display unit 160 is selected. Here, the image sensor unit 120 is provided on one side surface (upper surface or side surface) of the robot cleaner 10, and captures the upper side or front side (or lateral side). And, the image sensor unit 120 outputs information on the captured first upper or front image.
A selected state of the operation instructing command button, and a captured state by the image sensor unit 120 (or image information captured by the image sensor unit 120) may be displayed on the display unit 160, under control of the controller 150 (S210).
Then, the controller 150 analyzes the first image information (including first upper image information, first front image information, etc.) outputted from the image sensor unit 120. Then, the controller 150 selects at least one cleaning algorithm among a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis.
More concretely, if image information can be analyzed as an analysis result with respect to the first image information outputted from the image sensor unit 120, the controller 150 selects any cleaning algorithm based on image information among the plurality of pre-stored cleaning algorithms. On the other hand, if image information cannot be analyzed, the controller 150 selects any cleaning algorithm not based on image information among the plurality of pre-stored cleaning algorithms. Here, the cleaning algorithm not based on image information may be a cleaning algorithm (e.g., cleaning algorithm for avoiding an obstacle) among a plurality of cleaning algorithms which are not based on image information.
As one example, if it is determined that no obstacle exists based on the first image information outputted from the image sensor unit 120, the controller 150 selects a cleaning algorithm based on image information (e.g., optimized cleaning algorithm for cleaning a place having no obstacle) among the plurality of pre-stored cleaning algorithms.
As another example, if it is determined that the number of obstacles is more than a predetermined number based on the first image information outputted from the image sensor unit 120, the controller 150 selects an optimized cleaning algorithm for avoiding an obstacle among the plurality of pre-stored cleaning algorithms (S220).
Then, the controller 150 performs a cleaning operation by controlling the running unit 170 and the cleaning unit 180 based on the selected cleaning algorithm.
While the robot cleaner 10 performs a cleaning operation, the controller 150 may make a cleaning map based on a moving path of the robot cleaner 10, and may display the made cleaning map (including information on a cleaned region and a non-cleaned region) on the display unit 160 (S230).
Then, the image sensor unit 120 captures second image information based on a control signal generated by the controller 150 when a preset time interval has passed, or when a preset specific button provided at the input unit 110 or the display unit 160 has been selected (S240).
Then, the controller 150 analyzes the second image information (including second upper image information, second front image information, etc.) outputted from the image sensor unit 120. Then, the controller 150 selects at least one cleaning algorithm among a plurality of cleaning algorithms pre-stored in the storage unit 140 based on a result of the analysis.
More concretely, if image information can be analyzed as an analysis result with respect to the second image information outputted from the image sensor unit 120, the controller 150 selects any cleaning algorithm based on image information among the plurality of pre-stored cleaning algorithms. On the other hand, if image information cannot be analyzed, the controller 150 selects any cleaning algorithm not based on image information among the plurality of pre-stored cleaning algorithms. Here, the controller 150 may select a plurality of cleaning algorithms (S250).
Also, the controller 150 compares preset first priority information corresponding to the cleaning algorithm for the current cleaning operation, with preset second priority information corresponding to the cleaning algorithm selected based on an analysis result of the second image information (S260). Then, the controller 150 controls the running unit 170 and the cleaning unit 180 based on a cleaning algorithm having a higher priority, thereby performing a cleaning operation.
When the previous cleaning operation (e.g., cleaning operation using a cleaning algorithm selected based on an analysis result of the first image information) is changed into a new cleaning operation (e.g., cleaning operation using a cleaning algorithm selected based on an analysis result of the second image information), the controller 150 may generate guidance information indicating the change of the cleaning operation to output the guidance information on the display unit 160.
As one example, when the current cleaning operation is changed from a cleaning operation including image information selected based on an analysis result of the first image information (e.g., optimized cleaning algorithm for cleaning a place having no obstacle) into a cleaning operation not based on image information selected based on an analysis result of the second image information (e.g., optimized cleaning algorithm for avoiding an obstacle), the controller 150 may generate guidance information including a message, The current cleaning operation has changed into a cleaning operation based on obstacle avoidance from a cleaning operation based on image information, and output the guidance information on the display unit 160 (S270).
The foregoing embodiments and advantages are merely exemplary and are not to be construed as limiting the present disclosure. The present teachings can be readily applied to other types of apparatuses. This description is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art. The features, structures, methods, and other characteristics of the exemplary embodiments described herein may be combined in various ways to obtain additional and/or alternative exemplary embodiments.
As the present features may be embodied in several forms without departing from the characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its scope as defined in the appended claims, and therefore all changes and modifications that fall within the metes and bounds of the claims, or equivalents of such metes and bounds are therefore intended to be embraced by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2009-0111115 | Nov 2009 | KR | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/KR2010/007940 | 11/11/2010 | WO | 00 | 5/11/2012 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2011/062396 | 5/26/2011 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6459955 | Bartsch et al. | Oct 2002 | B1 |
6496754 | Song et al. | Dec 2002 | B2 |
6697147 | Ko et al. | Feb 2004 | B2 |
6732826 | Song et al. | May 2004 | B2 |
6841963 | Song et al. | Jan 2005 | B2 |
8374721 | Halloran et al. | Feb 2013 | B2 |
20020153184 | Song | Oct 2002 | A1 |
20040016077 | Song et al. | Jan 2004 | A1 |
20040204792 | Taylor et al. | Oct 2004 | A1 |
20040207355 | Jones et al. | Oct 2004 | A1 |
20050010331 | Taylor et al. | Jan 2005 | A1 |
20060190133 | Konandreas et al. | Aug 2006 | A1 |
20070250212 | Halloran et al. | Oct 2007 | A1 |
20070285041 | Jones et al. | Dec 2007 | A1 |
20080001566 | Jones et al. | Jan 2008 | A1 |
20080015738 | Casey et al. | Jan 2008 | A1 |
20080249661 | Hong et al. | Oct 2008 | A1 |
20090038089 | Landry et al. | Feb 2009 | A1 |
20090281661 | Dooley et al. | Nov 2009 | A1 |
20100049364 | Landry et al. | Feb 2010 | A1 |
20100115716 | Landry et al. | May 2010 | A1 |
20100263142 | Jones et al. | Oct 2010 | A1 |
20110144805 | Chiappetta et al. | Jun 2011 | A1 |
20120265343 | Gilbert et al. | Oct 2012 | A1 |
Number | Date | Country |
---|---|---|
2002-078650 | Mar 2002 | JP |
2002078650 | Mar 2002 | JP |
2005211367 | Aug 2005 | JP |
2006-346178 | Jun 2008 | JP |
10-0406636 | Nov 2003 | KR |
10-2004-0062040 | Jul 2004 | KR |
Entry |
---|
JP2002078650A (Machine—English—translation). |
Translation for reference JP2005211367A. |
International Search Report and Written Opinion dated Aug. 19, 2011 issued in Application No. PCT/KR2010/007940. |
Anderson, Nils Axel et al.: “Combining a Novel Computer Vision Sensor with a Cleaning Robot to Achieve Autonomous Pig House Cleaning”; 44th IEEE Conference on Decision and Control, and the European Control Conference 2005; Seville, Spain; Dec. 12-15, 2005; pp. 8331-8336 (XP-010885139). |
Griffin, Colin, An Automated Cleaning System for Hospitals, School of Mechanical and Manufacturing Engineering [retrieved on Mar. 21, 2014]. Retrieved from the Internet <URL: http://doras.dcu.ie/14901/1/Final—ethesis.pdf> (XP-055109290). |
European Search Report dated Jul. 8, 2014, issued in Application No. 10 83 1763.7. |
Number | Date | Country | |
---|---|---|---|
20120232697 A1 | Sep 2012 | US |