Patent Grant
12174632
The present application claims priority to Korean Patent Application No. 10-2021-0103767, filed Aug. 6, 2021, the entire contents of which is incorporated herein for all purposes by this reference.
The present invention relates to a surveillance mobile robot capable of unmanned surveillance.
With the development of autonomous driving technology, attempts are being made to use robots to surveil or patrol in places or times that humans cannot patrol in person.
For day/night patrol using a mobile robot capable of autonomous driving, a system that combines a mobile robot with a surveillance camera is mainly used. As a surveillance camera, a PTZ (Pan, Tilt and Zoom) camera, an omnidirectional camera, a thermal imaging camera, etc. are used.
However, since the autonomous driving robot mainly moves using wheels, there is a limit to the area and speed it can patrol. Also, since the robot travels on the ground, there is a limit to the surveillance range using a camera.
In order to compensate for the limits of such a mobile robot, attempts are being made to utilize a drone as a micro flight device.
However, drones that are made small and lightweight for flight have a problem in that their operating time is shortened due to battery capacity. Also, there are some areas where flying of drones is prohibited, such as airports and nuclear power plants, and there are limits to surveil using drones because flying at night is prohibited for safety reasons.
The inventors of the present invention have made research efforts to solve the problem of the surveillance method using a conventional robot. Through much efforts, the present invention related to a surveillance system that can overcome the limits of a mobile robot and a drone by using the mobile robot and the drone at the same time has been completed.
It is an object of the present invention to provide a surveillance system capable of making up for the limit of a surveillance range of a mobile robot by using a drone in a surveillance system using a mobile robot.
Meanwhile, other objects not specified in the present invention will be further considered within the scope that can be easily inferred from the following detailed description and effects thereof.
A mobile security robot equipped with a micro flight device according to the present invention includes a travelling unit that enables the mobile security robot to travel on a ground; a camera that surveils surrounding; a storage that stores a micro flight device; a charger that charges a battery of the micro flight device; a communicator that communicates with the micro flight device or a control center; and a controller that includes one or more processors and a memory and controls a movement of the robot or a movement of the micro flight device.
The traveling unit is a caterpillar track.
The camera includes at least one of a PTZ (Pan-Tilt-Zoom) camera, a 360-degree camera capable of omnidirectional shooting, and a thermal imaging camera.
The charger is capable of wireless charging of the micro flight device.
The controller controls the micro flight device mounted on the storage to fly if it is determined that a location is inaccessible by the traveling unit.
A method for controlling a mobile security robot equipped with a micro flight device according to another embodiment of the present invention, includes the steps of (a) receiving patrol target location information; (b) determining whether a patrol target location is a location where the mobile security robot is able to travel; (c) determining whether it is the location where the mounted micro flight device is able to fly if it is determined as the location where the mobile security robot is not able to travel; and (d) controlling the micro flight device to patrol if it is determined as the location where the micro flight device is able to fly.
The method further includes, after the step (b), the step of further determining whether it is the location where the micro flight device is able to fly if it is determined as the location where the mobile security robot is able to travel, and controlling the mobile security robot and the micro flight device to patrol at the same time.
In the step (c), it is determined whether it is the location where the micro flight device is able to fly, by at least one of a status of a battery, available flight area and available flight time of the micro flight device.
A system for controlling a mobile security robot equipped with a micro flight device comprises a processor for performing the steps of: (a) receiving patrol target location information; (b) determining whether a patrol target location is a location where the mobile security robot is able to travel; (c) determining whether it is the location where the mounted micro flight device is able to fly if it is determined as the location where the mobile security robot is not able to travel; and (d) controlling the micro flight device to patrol if it is determined as the location where the micro flight device is able to fly.
The system, further comprises, after the step (b), the step of further determining whether it is the location where the micro flight device is able to fly if it is determined as the location where the mobile security robot is able to travel, and controlling the mobile security robot and the micro flight device to patrol at the same time.
The system, wherein in the step (c), it is determined whether it is the location where the micro flight device is able to fly, by at least one of a status of a battery, available flight area and available flight time of the micro flight device.
It is stated that the accompanying drawings are exemplified as a reference for understanding the technical spirit of the present invention, and the scope of the present invention is not limited thereby.
Hereinafter, with reference to the drawings, the configuration of the present invention guided by various embodiments of the present invention and effects resulting from the configuration will be described. In the description of the present invention, if it is determined that the subject matter of the present invention may be unnecessarily obscured as it is obvious to those skilled in the art with respect to related known functions, the detailed description thereof will be omitted.
Terms such as ‘first’ and ‘second’ may be used to describe various components, but the components should not be limited by the above tams. The above term may be used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a ‘first component’ may be referred to as a ‘second component’, and similarly, a ‘second component’ may also be referred to as a ‘first component’. Also, expressions in the singular include plural expressions unless the context clearly dictates otherwise. Unless otherwise defined, terms used in the embodiments of the present invention may be interpreted as meanings commonly known to those of ordinary skill in the art.
Hereinafter, with reference to the drawings, the configuration of the present invention guided by various embodiments of the present invention and effects resulting from the configuration will be described.
The mobile security robot 1 according to the present invention can patrol a designated area by mounting a micro flight device 2 such as a drone thereon.
The mobile security robot 1 is equipped with a moving means such as wheels or a caterpillar (crawler track) or legs (2-legged, 4-legged) to patrol a predetermined area.
However, in an area inaccessible by the mobile security robot 1, instead, the patrol is performed using the micro flight device 2. To this end, the mobile security robot 1 may include a mounting space and charging facility for the micro flight device 2.
The mobile security robot 1 may include a communicator 10, a charger 20, a storage 30, a camera 40, a traveling unit 50, and a controller 60.
The traveling unit 50 is used to move the mobile security robot 1. The travelling unit 50 may be in the form of a wheel or in the form of a caterpillar, and may be in the form of a leg for quadruped or bipedal walking.
However, there is a limit to the terrain or distance where the traveling unit 50 of the mobile security robot 1 cannot make a movement. It will be impossible for the mobile security robot 1 to access the terrain such as rivers or valleys, and in a case where there are obstacles such as stairs or walls, the mobile security robot 1 cannot travel and therefore circumstances arise where patrol cannot be carried out.
Therefore, the mobile security robot 1 according to the present invention is equipped with a micro flight device such as a drone to make up for the patrol range.
To this end, the mobile security robot 1 includes the storage 30 for mounting a micro flight device and the charger 20 for charging when the micro flight device is mounted.
The storage 30 is configured to be opened and closed and can protect the micro flight device from external shocks or dust, etc. while the micro flight device is mounted therein. In addition, the storage 30 may be mounted with two or more micro flight devices.
In the micro flight device such as a drone, the battery capacity is inevitably limited due to its weight. Therefore, the charging can be performed through the charger 20 while the micro flight device is mounted on the mobile security robot 1. Since accurate contact may be difficult due to the nature of the micro flight device, the charger 20 may support wireless charging or may use a magnetic charging method.
The camera 40 is used to collect information on the surrounding while the mobile security robot 1 is patrolling. In order to surveil a wide range by the mobile security robot 1, the camera 40 may be configured as a PTZ (Pan, Tilt and Zoom) camera, a 360-degree camera capable of omnidirectional shooting, etc. The camera 40 may also be configured as a thermal imaging (infrared) camera for nighttime, low-light photography.
The controller 60 includes one or more processors 62 and a memory 64 to control the patrol of the mobile security robot 1 and the micro flight device mounted on the mobile security robot 1.
To this end, the processor 62 performs instructions for controlling the mobile security robot 1, and stores instruction codes and data for driving the processor 62 in the memory 64. In addition, it is possible to send and receive control signals or data to and from the micro flight device or the control center through the communicator 10.
The controller 60 controls the patrol of the mobile security robot 1 and the micro flight device by determining the travelable area of the mobile security robot 1 and the flightable area of the micro flight device, respectively.
For the determination, the controller 60 receives information such as a map of a patrol target location from the user.
In (a) of
In
The area 310 indicated by a dotted line indicates an area that can be patrolled by the mobile security robot 1, and the area 330 indicated by a solid line indicates an area that can be patrolled by the micro flight device. The common area 340 indicated by a dotted line and a solid line will be an area where joint patrolling of the mobile security robot 1 and the micro flight device is possible.
Based on such information, the controller 60 may control the autonomous driving of the mobile security robot 1. If necessary, the controller 60 may receive the instruction for controlling the traveling of the mobile security robot 1 according to the surrounding environment identified by the user through the camera 40 from a control center or the like.
The information received by the controller 60 may include available flight time information, etc. independent of the map. It is because there may be a regulation such as prohibiting flight after sunset may exist for the micro flight device. In addition, location information such as airports and major facilities where flights are completely banned can also be determined.
In addition to the information received from the user, the controller 60 may determine whether patrolling is possible based on information obtained by the camera 40 and various sensors (not shown). If the flight of the micro flight device or the travelling of the mobile security robot 1 is restricted due to a construction site not shown on the map or weather changes such as rain, snow, or wind, it may be determined as a patrol impossible area.
The controller 60 may control the mobile security robot 1 to continue patrolling even while the micro flight device is in flight. In this case, the location information of the mobile security robot 1 is continuously transmitted to the micro flight device for the return of the micro flight device.
In this way, if the mobile security robot is equipped with the micro flight device and used for patrolling, it is possible to patrol the places where the mobile security robot cannot access with the micro flight device, so there is the advantage of expanding the patrol area.
A method for controlling a mobile security robot according to the present invention is performed by the controller including one or more processors and a memory.
First, the information on a patrol location is received from a user (S10).
As in the example of
The geo-fence information may be set by the user in the control center, and if information such as a no-fly area is stored in a server designated in advance, it may be utilized.
It is determined whether the mobile security robot can patrol using the received information (S20).
Whether it is possible to patrol can be determined using information such as geo-fence information or topographical features. Alternatively, it may be possible to determine whether it is possible to patrol using the information obtained from the camera or sensor mounted on the mobile security robot.
If the patrolling of the mobile security robot is possible, the patrolling of the mobile security robot may be activated to control the mobile security robot to patrol the corresponding position (S30).
If the patrolling of the mobile security robot is impossible, it may be determined whether the patrolling of the micro flight device (drone) is possible, instead (S50).
In order to determine whether the patrolling of the micro flight device is possible, it is necessary to check the status of the battery, an available flight area, and an available flight time. Since the flight time varies depending on the status of the battery, the available flight distance may be limited. Even in an operable flight location, flight may be restricted near important facilities due to legal restrictions, etc., and after sunset, factors such as restrictions on the flight of the micro flight device should be also considered. In addition, the case where flight is impossible due to weather conditions such as strong winds, storm or electromagnetic waves should be considered.
If it is determined that the patrolling by the micro flight device is possible by taking into account various factors, the patrolling of the micro flight device is activated (S60) and the patrolling is executed (S70).
Even if the patrolling of the mobile security robot is possible (S30), it can determine whether joint patrolling of the mobile security robot and the micro flight device is possible by examining whether there is an area such as the joint patrol area 340 of
If the mobile security robot and the micro flight device are used at the same time, the patrol area can be expanded and the patrol time can be shortened by patrolling the same area at the same time.
If it is an area where simultaneous patrolling is possible, it is determined whether the patrolling of the micro flight device is possible (S50), and if possible, the mobile security robot and the micro flight device are controlled to execute patrolling together (S70), and if simultaneous patrolling is not possible, only the mobile security robot is controlled to execute patrolling (S70).
According to the mobile security robot equipped with the micro flight device and the control method thereof of the present invention described above, by making up for the limits in the patrol area according to the travelling method of the mobile security robot and executing the flight patrolling by the micro flight device, it has the advantage of being able to patrol a much wider area in a shorter time, compared to the conventional patrol with only mobile security robot.
According to the present invention, by using a mobile robot and a drone at the same time, the limit of the surveillance range of the mobile robot can be overcome using the drone, and there is an effect of performing the surveillance by the mobile robot in an area where the drone cannot fly or at night time.
On the other hand, even if it is an effect not explicitly mentioned herein, it is also noted that the effects described in the following specification expected by the technical features of the present invention and their potential effects are treated as if they were described in the specification of the present invention.
The protection scope of the present invention is not limited to the description and expression of the embodiments explicitly described above. In addition, it is added once again that the protection scope of the present invention cannot be limited by obvious changes or substitutions in the technical field to which the present invention pertains.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2021-0103767 | Aug 2021 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20200341475 | Matsuda | Oct 2020 | A1 |
| 20210046650 | Deyle | Feb 2021 | A1 |
| 20220005332 | Metzler | Jan 2022 | A1 |
| 20220113744 | Hong | Apr 2022 | A1 |
| 20220197314 | Tanaka | Jun 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 111625013 | Sep 2020 | CN |
| Entry |
|---|
| Machine Translation: CN-111625013-A (Year: 2020). |
| Number | Date | Country | |
|---|---|---|---|
| 20230045483 A1 | Feb 2023 | US |
