This application is based on and claims priority to Korean Patent Application No. 10-2019-0061714, filed on May 27, 2019 in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference in its entirety.
The disclosure relates to a vehicle and a method for controlling the vehicle, and more particularly, to an autonomous vehicle capable of informing a point in time at which a passenger in the autonomous vehicle is movable while driving the autonomous vehicle, and a method for controlling the autonomous vehicle.
In general, an autonomous vehicle (also called an unmanned vehicle) refers to a vehicle that can autonomously drive to a set destination by monitoring external information and grasping road conditions without manipulation by a driver.
A control system of the autonomous vehicle recognizes a lane using a camera and performs automatic steering. The control system can detect a lane width, a transverse position of the vehicle in the lane, a distance to both lanes and a shape of the lane, and the radius of curvature of a road, based on image processing of the camera. The control system estimates the driving trajectory of the vehicle by using information on the position and the road, and changes the lane along the estimated driving trajectory.
The autonomous vehicle basically follows a map-based driving route. However, when there is a variable such as an obstacle in the driving route, the autonomous vehicle controls components of the vehicle so that the vehicle can safely drive by changing the driving route in real time. Vehicle control technology is being proposed that can completely autonomously drive on highway by using sensors, motors and artificial intelligence, without a human. The autonomous vehicle can perform a complete autonomous driving by recognizing the surrounding environment three-dimensionally using sensors and combining communication technology, artificial intelligence technology and control technology of an actuator such as motors.
This autonomous vehicle is used to transport a number of personnel such as a bus or a van. The autonomous vehicle with a large number of personnel needs to ensure the safety of passengers on board. Recently, there is an increasing need for research into devices and methods for securing the safety of the passengers aboard in response to the driving routes and driving conditions of the autonomous vehicles.
An aspect of the present disclosure is to provide an autonomous vehicle capable of ensuring the safety of the passengers by notifying the time at which the passengers of the autonomous vehicle can move while the autonomous vehicle is driving, and a method for controlling the autonomous vehicle.
Additional aspects of the present disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.
In accordance with an aspect of the present disclosure, a vehicle may include: a camera configured to acquire position information of a passenger of the vehicle by capturing the passenger; an indicator configured to indicate whether the passenger is movable within the vehicle; and a processor. The processor may determine behavioral stability of the passenger based on the acquired position information of the passenger, determine whether the passenger is movable within the vehicle based on the determined behavioral stability and driving environment of the vehicle; and control an indication type of the indicator differently depending on whether the passenger is movable.
The processor may determine the behavioral stability of the passenger as the first condition higher than a predetermined reference when it is determined that the passenger is seated in a bus based on the position information and the shape information of the passenger, and determine the behavioral stability of the passenger as a second condition lower than the predetermined reference when it is determined that the passenger is standing in the bus.
The driving environment of the vehicle may include at least one of a driving route of the vehicle, a driving speed of the vehicle, climatic conditions at the time the vehicle is driving or state information of a road on which the vehicle is driving. The vehicle further includes: a storage configured to store map information including the driving route on which the vehicle is to be driving and the state information of the road on which the vehicle is to be driving, and information on the driving route acquired in real time while the vehicle is driving; and a speed sensor configured to detect the driving speed of the vehicle.
The controller may control the indicator to be indicated in a first color when it is determined that the behavioral stability of the passenger is the first condition and that the passenger is movable within the vehicle based on the driving environment of the vehicle.
The controller may control the indicator to be indicated in a second color when it is determined that the behavioral stability of the passenger is the first condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The controller may control the indicator to be indicated in a first color when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is movable within the vehicle based on the driving environment of the vehicle.
The controller may control the indicator to be indicated in a third color when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The controller may determine whether the driving route of the vehicle can be changed based on the map information and congestion degree of the road on which the vehicle is driving when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The controller may control the vehicle to drive on the changed driving route when the driving route of the vehicle can be changed, and control the indicator to be indicated in a third color when the driving route of the vehicle cannot be changed.
The vehicle further includes a detection sensor configured to detect an object located around the vehicle. The controller is configured to determine the congestion degree of the road on which the vehicle is driving based on at least one of position information or speed information of the object acquired by the detection sensor.
In accordance with another aspect of the present disclosure, a method for controlling a vehicle, which comprises an indicator for indicating whether a passenger of the vehicle is movable within the vehicle, includes: acquiring position information of the passenger by capturing the passenger; determining behavioral stability of the passenger based on the acquired position information of the passenger; determining whether the passenger is movable within the vehicle based on the determined behavioral stability and driving environment of the vehicle; and controlling an indication type of the indicator differently depending on whether the passenger is movable.
The determining of the behavioral stability of the passenger may include determining the behavioral stability of the passenger as a first condition higher than a predetermined reference when it is determined that the passenger is seated in a bus based on the position information and shape information of the passenger, and determining the behavioral stability of the passenger as a second condition lower than the predetermined reference when it is determined that the passenger is standing in the bus.
The driving environment of the vehicle includes at least one of a driving route of the vehicle, a driving speed of the vehicle, climatic conditions at the time the vehicle is driving, or state information of a road on which the vehicle is driving. The method may further include: storing map information including the driving route on which the vehicle is to be driving and state information of the road on which the vehicle is to be driving, and information on the driving route acquired in real time while the vehicle is driving; and detecting the driving speed of the vehicle.
The controlling of the indication type of the indicator may include controlling the indicator to be indicated in a first color when it is determined that the behavioral stability of the passenger is the first condition and that the passenger is movable within the vehicle based on the driving environment of the vehicle.
The controlling of the indication type of the indicator may include controlling the indicator to be indicated in a second color when it is determined that the behavioral stability of the passenger is the first condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The controlling of the indication type of the indicator may include controlling the indicator to be indicated in a first color when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is movable within the vehicle based on the driving environment of the vehicle.
The controlling of the indication type of the indicator may include controlling the indicator to be indicated in a third color when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The method may further include determining whether the driving route of the vehicle can be changed based on the map information and congestion degree of the road on which the vehicle is driving when it is determined that the behavioral stability of the passenger is the second condition and that the passenger is not movable within the vehicle based on the driving environment of the vehicle.
The method may further include controlling the vehicle to drive on the changed driving route when the driving route of the vehicle can be changed, and controlling the indicator to be indicated in a third color when the driving route of the vehicle cannot be changed.
The method may further include detecting an object located around the vehicle; and determining the congestion degree of the road on which the vehicle is driving based on at least one of position information or speed information of the object.
These and/or other aspects of the disclosure will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
Like reference numerals refer to like elements throughout the specification. Not all elements of embodiments of the disclosure will be described, and description of what are commonly known in the art or what overlap each other in the embodiments will be omitted. The terms as used throughout the specification, such as “˜part,” “˜module,” “˜member,” “˜block,” etc., may be implemented in software and/or hardware, and a plurality of “˜parts,” “˜modules,” “˜members,” or “˜blocks” may be implemented in a single element, or a single “˜part,” “˜module,” “˜member,” or “˜block” may include a plurality of elements.
It will be understood that when an element is referred to as being “connected” to another element, it can be directly or indirectly connected to the other element, wherein the indirect connection includes “connection” via a wireless communication network.
When a part “includes” or “comprises” an element, unless there is a particular description contrary thereto, the part may further include other elements, not excluding the other elements.
Further, when it is stated that a layer is “on” another layer or substrate, the layer may be directly on another layer or substrate or a third layer may be disposed therebetween.
It will be understood that, although the terms first, second, third, etc., may be used herein to describe various elements, it should not be limited by these terms. These terms are only used to distinguish one element from another element.
As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
An identification code is used for the convenience of the description but is not intended to illustrate the order of each step. Each of the steps may be implemented in an order different from the illustrated order unless the context clearly indicates otherwise.
Hereinafter, the operation principles and embodiments of the disclosure will be described with reference to the accompanying drawings.
As illustrated in
The vehicle according to exemplary embodiments of the disclosure will be described by taking an example of an autonomous driving bus that drives itself to the destination without the operation of a vehicle driver.
The autonomous driving bus performs autonomous driving with a large number of passengers on board. In some cases, the bus 1 may be shaken or the driving stability may be lowered depending on an autonomous driving route and the driving environment. In this case, when the passengers on the bus 1 move within the bus 1 for changing the seats or getting off, accidents may occur, such as falling down or hitting a structure inside the bus.
According to the vehicle and the method for controlling the same according to embodiments of the disclosure, the behavioral stability of the passenger is determined according to position information of the passenger of the bus 1, and the passenger is provided with an indication indicating whether the passenger can move within the bus based on the driving environment of the bus 1. Therefore, the passenger may determine whether he or she can currently move within the vehicle by checking the indication.
Referring to
The controller 100 may be a computer, a processor, a central processing unit, an electronic control unit, etc., and may control the functions of the camera 70, the speed sensor 80, the storage 90, the indicator 110, and the detection sensor 200.
The detection sensor 200 may include a proximity sensor, a radar sensor, an ultrasonic sensor, an infrared sensor, or the like.
The indicator 110 may be an output device such as a computer hardware converting information into human-readable form. Examples of the indicator 110 include Visual Display Units (VDU), a Monitor, Printer, Graphic Output devices, Plotters, Speakers, etc.
The storage 90 may be embodied as a digital storage, a storage media, a storage medium, or any hardware capable of holding information either temporarily or permanently. The storage 90 may include a ROM, RAM, a magnetic tape, a magnetic disc, flash memory, an optical data storage device, etc.
Referring to
In addition, the camera 70 may acquire the form and the position information of the passenger by capturing the passenger in the interior of the bus 1. As shown in
The camera 70 may acquire the current position information of the passenger through image recognition and image analysis by capturing the passenger boarding the bus 1 in various ways, and additionally acquire image information for the boarding type of the passenger and transmit the image information to the controller 100.
In addition, the position information of the passenger acquired by the camera 70 may be stored in the storage 90, and the controller 100 may determine the behavioral stability on whether the current boarding state of the passenger is stable or unstable based on the position information of the passenger acquired by the camera 70.
In
The camera 70 may include at least one camera, and may further include an imaging sensor, a 3D spatial recognition sensor, a radar sensor, an ultrasonic sensor, and so forth in order to capture a more accurate image.
The 3D spatial recognition sensor may be a KINECT (RGB-D sensor), a structured light sensor (TOF), a stereo camera, etc., but is not limited thereto, and may include other devices capable of similar functions.
Referring to
As illustrated in
More specifically, the camera 70 may match the position of the passenger with the position of the seat of the bus 1 in the captured image, extract shape information and the position information of the passenger sitting in the seat, and transmit the shape information and the position information to the controller 100.
As shown in
In detail, the camera 70 may match the position of the passenger with the position of the internal structure of the bus 1 in the captured image, extract shape information and the position information of the standing passenger, and transmit the information to the controller 100.
The controller 100 may determine whether the passenger is in a seated state or the standing state by receiving the position information and the shape information of the passenger from the camera 70 (1010).
The controller 100 may determine the behavioral stability of the passenger as a first condition higher than a predetermined reference when it is determined that the passengers are seated in the seat of the bus 1 based on the position information and the shape information of the passenger (1020). The controller 100 may determine the behavioral stability of the passenger as a second condition lower than a predetermined reference when it is determined that the passenger is standing within the bus 1 (1070).
That is, when the passenger is seated in the seat, even if the bus 1 is shaken or suddenly accelerated or rapidly decelerated, the behavior of the passenger can be secured to a certain degree, so that the controller 100 may determine the behavioral stability as the first condition higher than the predetermined reference. Here, the predetermined reference value for determining the behavioral stability is data stored in the storage 90 and corresponds to the reference value determined based on the seating state and the seating position of the passenger.
On the other hand, if the passenger is in the standing state without being seated, the behavior of the passenger may not be stably secured and may be in an unstable state, such as the passenger may fall when the bus 1 is shaken or suddenly accelerated or rapidly decelerated. Therefore, the controller 100 may determine the behavioral stability as the second condition lower than the predetermined reference.
The controller 100 may determine the driving environment of the bus 1 based on the information acquired by the detection sensor 200 and the speed sensor 80 (1030).
The detection sensor 200 may detect an obstacle around the bus 1 while the bus 1 is driving and determine the driving environment. In addition, a curvature of the road on which the bus 1 is driving or the shape of the structure installed on the road can be detected, and information on a pavement state of the road can also be acquired.
The speed sensor 80 may detect the driving speed of the bus 1 that is being driven. That is, the driving speed can be detected using the speed at which wheels of the bus 1 rotate. The unit of the driving speed may be represented by [kph], and may be represented by the distance (e.g. km) moved per unit time (e.g. 1 hour).
The driving environment of the bus 1 that is driving may include at least one of the driving route of the bus 1, the driving speed of the bus 1, climatic conditions at the time when the bus 1 is driving, and the state information of the road on which the bus 1 is driving.
The climatic conditions at the time when the bus 1 is driving may affect the road surface condition of the road on which the bus 1 is driving, and visibility of the detection sensor 200 of the driving bus 1.
In addition, the storage 90 may store map information including the driving routes for the bus 1 to drive, and the state information of the roads for the bus 1 to drive, and the driving route information acquired in real time while the bus 1 is driving.
Therefore, the controller 100 may determine whether it is not dangerous for the passengers to move in the bus 1 based on the driving environment of the bus 1.
In detail, the controller 100 may determine whether the driving speed of the bus 1 detected by the speed sensor 80 exceeds a predetermined value, and compare an acceleration or deceleration of the bus 1 with the predetermined value to determine the current driving environment of the bus 1.
In addition, the controller 100 may determine the current driving environment of the bus 1 by comparing the curvature of the road on the driving route of the bus 1 with the predetermined value.
The controller 100 may determine whether the passenger is movable in the bus 1 based on the previously determined behavioral stability of the passengers and the driving environment of the bus 1 (1040).
That is, the controller 100 may control the indicator 110 to be displayed in the first color when it is determined that the behavioral stability of the passenger is the first condition and the passenger is movable in the bus 1 based on the driving environment of the bus 1 (1050).
In detail, where the passenger is in the seated state, and in the case when the behavioral stability of the passenger is secured without the risk such as falling down even if the passenger moves within the bus 1 for changing the seats or getting off, in consideration of the driving environment such as the driving speed of the bus 1, the acceleration and deceleration of the bus 1, and the curvature of the road on which the bus is driving, the controller 100 may control the indicator 110 provided within the bus so that a green light is turned on and inform the passengers of whether he or she is movable within the vehicle.
As shown in
The indicator 110 may be implemented differently from forms shown in
That is, as shown in
In the case where the first color is turned on by controlling the indicator 110, the behavioral stability of the passengers in the seated state can be secured and the driving environment of the bus 1 is also in the stable state. Therefore, the controller 100 may additionally control a seat belt of the bus 1 to be released, and may control the sliding seat of the bus to be rotated or moved.
The controller 100 may control the indicator 110 to be displayed in the second color when it is determined that the behavioral stability of the passengers is the first condition and the passenger cannot move in the bus 1 based on the driving environment of the bus 1 (1060).
In detail, where the passenger is in the seated state, and in the case when the behavioral stability of the passenger is not secured with the risk such as falling down if the seated passenger move within the bus 1 for changing the seats or getting off, in consideration of the driving environment such as the driving speed of the bus 1, the acceleration and deceleration of the bus 1, and the curvature of the road on which the bus is driving, the controller 100 may control the indicator 110 provided within the bus so that a red light is turned on and inform the passenger of whether he or she cannot move within the vehicle.
That is, as shown in
In the case where the second color is turned on by controlling the indicator 110, the behavioral stability of the passenger in the seated state cannot be secured and the driving environment of the bus 1 is also in the unstable state. Therefore, the controller 100 may additionally control the seat belt of the bus 1 not to be released, and may control the sliding seat of the bus not to be rotated or moved.
Referring back to
The controller 100 may determine whether the passenger is movable within the bus 1 based on the behavior stability of the passenger and the driving environment of the bus 1 (1090).
That is, the controller 100 may control the indicator 110 to be displayed in the first color when it is determined that the behavioral stability of the passenger is the second condition and the passengers can move in the bus 1 based on the driving environment of the bus 1 (1100).
In detail, where the passenger is in the standing state, and in the case when the behavioral stability of the passenger is secured without the risk such as falling down even if the standing passenger moves within the bus 1 for changing the seats or getting off, in consideration of the driving environment such as the driving speed of the bus 1, the acceleration and deceleration of the bus 1, and the curvature of the road on which the bus is driving, the controller 100 may control the indicator 110 provided within the bus so that the green light is turned on and inform the passenger of whether he or she can move within the vehicle.
That is, as shown in
In the case where the first color is turned on by controlling the indicator 110, the behavioral stability of the passenger in the standing state can be secured and the driving environment of the bus 1 is also in the stable state. Therefore, the controller 100 may additionally control the seat belt of the bus 1 to be released, and may control the sliding seat of the bus to be rotated or moved.
The controller 100 may determine whether the driving route of the bus 1 may be changed based on the driving map information of the bus 1 and the degree of congestion of the road, which are stored in the storage 90 when it is determined that the behavioral stability of the passenger is the second condition and the passenger cannot move within the bus 1 based on the driving environment of the bus 1 (1110).
In detail, where the passenger is in the standing state, and in the case when the behavioral stability of the passenger is secured without the risk such as falling down even if the standing passenger moves within the bus 1 for changing the seats or getting off, in consideration of the driving environment such as the driving speed of the bus 1, the acceleration and deceleration of the bus 1, and the curvature of the road on which the bus is driving, the controller 100 may secure the behavioral stability of the passenger by changing the driving route of the bus 1 that is driving autonomously or changing the behavior of the bus 1 that is driving.
That is, the controller 100 may determine whether the predetermined driving route of the bus 1 can be changed based on the position information of obstacles around the bus 1, the position information of another vehicle and the speed information of another vehicle acquired by the detection sensor 200.
The controller 100 may change the driving route of the bus 1 and control the bus to drive according to the changed driving route when it is determined that the behavioral stability of the passenger can be secured by changing the driving route of the bus 1.
On the other hand, the controller 100 may control the indicator 110 to be displayed in the third color when it is determined that another vehicle is driving on another driving route to be changed by the bus 1 or obstacles are located on another driving route therefor the driving route cannot be changed and the behavioral stability of the passenger cannot be secured.
Specifically, when the passenger is in the standing state and the driving route of the bus 1 cannot be changed for the stability of the passenger, the controller 100 may guide the standing passenger to sit in the seat by controlling the indicator 110 provided in the bus to turn on a yellow light.
That is, as shown in
In the case where the third color is turned on by controlling the indicator 110, the behavioral stability of the passenger in the standing state cannot be secured and the driving environment of the bus 1 is also in the unstable state. Therefore, the controller 100 may additionally control the seat belt of the bus 1 not to be released, and may control the sliding seat, which has been moved to the center passage side of the bus 1, to return to its original position.
The vehicle and the method for controlling the same according to the above-described embodiment may be applied to the bus 1 capable of autonomous driving, but may also be applied to a general car 2 capable of autonomous driving.
As described in the above-described embodiment, the camera (not shown) provided in the car 2 may acquire the position information by capturing the passenger of the car 2.
The controller of the car 2 may determine the behavioral stability of the passenger based on the position information of the passenger, and determine whether the passenger is movable within the car 2, whether the seat of the car 2 can be moved, and whether the autonomous driving state should be released and changed to a driver driving mode based on the determined behavioral stability and the driving environment of the car 2.
The controller of the car 2 may differently control display forms of the indicator 130 provided in the car 2 based on the matters determined as described above.
That is, the controller of the car 2 may provide information regarding the movability of the passenger by controlling the indicator 130 to be turned on in the predetermined color based on the behavioral stability of the passenger and the driving environment of the car 2.
The principle of controlling the indicator 130 of the passenger car 2 to be turned on with the predetermined color is the same as the principle of controlling the indicator 110 provided in the bus 1 described with reference to
According to an aspect of the disclosure as described above, by notifying the time at which the passenger who is on board during the driving of the autonomous vehicle such as the bus 1 and the general car 2 is movable, it is possible to determine the time when the passenger is movable within the vehicle and prevent safety accidents. Furthermore, according to an aspect of the disclosure, by monitoring the position of passenger within the vehicle, the autonomous driving profile can be changed to prevent accidents.
The disclosed embodiments may be implemented in the form of a recording medium storing instructions that are executable by a computer. The instructions may be stored in the form of a program code, and when executed by a processor, the instructions may generate a program module to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.
The computer-readable recording medium may include all kinds of recording media storing commands that can be interpreted by a computer. For example, the computer-readable recording medium may be ROM, RAM, a magnetic tape, a magnetic disc, flash memory, an optical data storage device, etc.
The exemplary embodiments of the disclosure have thus far been described with reference to the accompanying drawings. It will be obvious to those of ordinary skill in the art that the disclosure may be practiced in other forms than the exemplary embodiments as described above without changing the technical idea or essential features of the disclosure. The above exemplary embodiments are only by way of example, and should not be interpreted in a limited sense.
Number | Date | Country | Kind |
---|---|---|---|
10-2019-0061714 | May 2019 | KR | national |
Number | Date | Country |
---|---|---|
10-2017-0099818 | Sep 2017 | KR |
Number | Date | Country | |
---|---|---|---|
20200380278 A1 | Dec 2020 | US |