Patent Grant
11738773
This application claims under 35 U.S.C. § 119 the benefit of Korean Patent Application No. 10-2020-0081340, filed on Jul. 2, 2020 in the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference.
The present disclosure relates to a system for controlling an autonomous vehicle for reducing motion sickness, more particularly, to the control system which is capable of predicting and eliminating an occurrence of motion sickness before and during travelling of the autonomous vehicle.
An autonomous vehicle is a vehicle that can autonomously drive by recognizing surrounding conditions and vehicle conditions, without user intervention, to a predetermined destination. Accordingly, a passenger who rides in an autonomous vehicle is capable of performing various non-driving tasks, such as reading a book or using a smartphone in the vehicle. However, such behavior may cause motion sickness to passengers in the autonomous vehicle.
Motion sickness including dizziness, vomiting, and the like when a passenger rides in a vehicle is caused by the brain causing temporary confusion when there is a mismatch in input between sensory organs (visual, vestibular organs, and the like) that maintain balance or sense movement and posture.
Typically, a person's brain can remember the reactions of sensory organs, such as the eyes and ears, to the movements of the muscles in the head, and when similar movements occur later, the sensory organs make a prediction, prepare, and react in response to the similar movement with the stored information. However, in a state of riding in a vehicle, there is little or no movement of muscles that can be retrieved from existing memories, so that there may be a mismatch of sensation, resulting in motion sickness.
Motion sickness is also related to amplitude or frequency of shaking of a vehicle. Vibration of the vehicle causing motion sickness is generated by exposure to low-frequency vibration or very low or high acceleration unfamiliar to the passenger. Reportedly, the frequency causing motion sickness is around 0.2 Hz.
In the meantime, various technologies for preventing motion sickness caused to passengers in a vehicle are disclosed.
Korean Patent Application Laid-Open No. 10-2019-0126198 (Method and System for Determining and Dynamically Updating Route and Driving Style for Passenger Comfort) discloses a method, which, when a user experiences motion sickness symptoms while a vehicle travels in a first route, enables the vehicle to be operated according to a second route so as to prevent motion sickness based on a motion sickness value determined by an input of the user.
However, in Korean Patent Application Laid-Open No. 10-2019-0126198, when motion sickness occurs while a vehicle travels in a first route, a user needs to manually input the occurrence of the motion sickness and change the route, so that it is inconvenient for the user to manually manipulate the system and a response time to the occurrence of the motion sickness is long.
Korean Patent Application Laid-Open No. 10-2018-0123697 (Universal Motion Sickness Response System) includes an optical array system which visually stimulates the user's view, and a controller which controls to activate the optical array system by imitating a visual input received when the user gazes outside of a transportation means, to change an activation order of the optical array according to the movement of the transportation means and stimulate the user's view, thereby promoting the prevention of motion sickness.
Korean Patent Application Laid-Open No. 10-2018-0123697 has a problem of uniformly stimulating the passenger's vision according to the movement of the transportation means without considering the level of sensitivity of the motion sickness felt by the passenger.
The present disclosure is directed to predicting an actual occurrence of motion sickness in consideration of a degree of sensitivity of an occurrence of the motion sickness that is different depending on each passenger before and during travelling, so as to rapidly eliminate the occurrence of motion sickness.
An exemplary embodiment of the present disclosure provides a system for controlling an autonomous vehicle for reducing motion sickness, the system including: a first control unit which estimates a first vehicle motion sickness index that is determined by a travelling simulation of the vehicle performed with an analyzed target route before travelling, compares a first threshold indicating a degree of sensitivity to motion sickness according to passenger information before travelling with the first vehicle motion sickness index, and controls a boarding location of a passenger before travelling; and a second control unit which computes a passenger motion sickness index from passenger state information and vehicle state information detected during travelling, compares a second threshold indicating the degree of sensitivity to motion sickness according to passenger information during travelling with the passenger motion sickness index, and controls a behavior of the travelling vehicle so as to reduce or eliminate a generation of a motion sickness causing frequency.
The present disclosure has the following effects.
First, motion sickness is controlled twice before and during travelling of a vehicle, thereby minimizing occurrence of motion sickness.
Secondly, a passenger state is considered as well as a vehicle state which may cause motion sickness during travelling, so that the degree of sensitivity to motion sickness which is different for each passenger is reflected to a passenger motion sickness index.
Thirdly, information on a passenger is stored remotely (e.g., in the cloud), so that passenger information may be used even in a different vehicle when the passenger changes the vehicle.
It is understood that the term “vehicle” or “vehicular” or other similar term as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g. fuels derived from resources other than petroleum). As referred to herein, a hybrid vehicle is a vehicle that has two or more sources of power, for example both gasoline-powered and electric-powered vehicles.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Throughout the specification, unless explicitly described to the contrary, the word “comprise” and variations such as “comprises” or “comprising” will be understood to imply the inclusion of stated elements but not the exclusion of any other elements. In addition, the terms “unit”, “-er”, “-or”, and “module” described in the specification mean units for processing at least one function and operation, and can be implemented by hardware components or software components and combinations thereof.
Further, the control logic of the present disclosure may be embodied as non-transitory computer readable media on a computer readable medium containing executable program instructions executed by a processor, controller or the like. Examples of computer readable media include, but are not limited to, ROM, RAM, compact disc (CD)-ROMs, magnetic tapes, floppy disks, flash drives, smart cards and optical data storage devices. The computer readable medium can also be distributed in network coupled computer systems so that the computer readable media is stored and executed in a distributed fashion, e.g., by a telematics server or a Controller Area Network (CAN).
Hereinafter, exemplary embodiments of a system for controlling an autonomous vehicle for reducing motion sickness according to the present disclosure will be described in detail with reference to the drawings. Terms or words used below shall not be interpreted to be limited as general or lexical meanings, and on the principle that the inventor can appropriately define a concept of a term for describing the disclosure by the best method, the terms or the words shall be interpreted as a meaning and a concept corresponding to the technical spirit of the present disclosure.
Referring to
The motion sickness control preliminary determining unit 10 determines whether to control motion sickness before travelling in advance, and recognizes information about a passenger before travelling. The information about the passenger before travelling includes all information, such as personal information, such as the gender, age, and race of a passenger, a seat position and seat angle where a passenger will sit, and information on a posture of a passenger, based on which a passenger is recognizable, and is collected by a sensor unit 40.
The sensor unit 40 includes sensors of the vehicle, such as various sensors detecting environments inside and outside the vehicle, a surrounding CCTV, a smart device and a wearable device carried by a passenger, and a door switch button part of the vehicle, which are capable of recognizing information about a passenger and information on behavior of the vehicle. The information about the passenger collected by the sensor unit 40 is stored remotely, e.g., in a “cloud” 50. The cloud 50 is capable of performing transmission/reception with the vehicle through wireless network communication.
When there is a passenger of which passenger information is not recognized, the motion sickness control preliminary determining unit 10 classifies the passenger into an unknown person and additionally checks passenger information about the unknown person by using the sensor unit 40 or the cloud 50. The case where the passenger information about the passenger classified into the unknown person is recognized later is, for example, the case where the passenger takes off the worn hat or mask during boarding, and the case where a power supply of a smart device carried by the passenger is turned on after the turn-off. When the passenger information of the unknown person is not checked, the motion sickness control preliminary determining unit 10 may not control the motion sickness before the travelling.
After the passenger information is recognized, the motion sickness control preliminary determining unit 10 determines whether it is possible to control motion sickness before travelling. The case where it is impossible to control motion sickness before travelling is the case where it is not necessary to control motion sickness, for example, the case where a travelling mode of the vehicle is a sport mode, the case where one passenger in the autonomous vehicle switches the travelling mode from an autonomous driving mode to a driver authority mode.
The first control unit 20 is provided for the purpose of controlling motion sickness before travelling, and includes a first threshold setting unit 22, a first vehicle motion sickness index estimating unit 24, and a first comparing unit 26.
The first threshold setting unit 22 sets a first threshold indicating the level of sensitivity to the occurrence of the motion sickness of a passenger according to the passenger information before travelling. The first threshold is a value predicted to cause motion sickness to the passenger before travelling, and is stored in the cloud 50 through previous driving information of the passenger or a vehicle test.
Even though the same motion sickness causing frequency is generated in the vehicle, the degree of motion sickness occurrence prediction is different according to the passenger information before travelling. For example, in general, women are more susceptible to motion sickness than men, and Asians may be more susceptible to motion sickness than non-Asians. Further, the passenger information may also include information on whether a vehicle movement is predictable through information on a posture of the passenger. Herein, when the posture of the passenger is the posture based on which a vehicle movement cannot be predicted, the posture is more susceptible to motion sickness. Accordingly, when the degree of the motion sickness occurrence prediction is low, the first threshold may be set to be large, and when the degree of the motion sickness occurrence prediction is high, the first threshold may be set to be small.
The first threshold setting unit 22 computes thresholds drawn based on the passenger information before travelling and sets the first threshold. For example, the first threshold setting unit 22 may set the first threshold by multiplying a first-one threshold according to the gender, a first-two threshold according to the age, and a first-n threshold according to other passenger information before travelling or computing them by another method.
The first vehicle motion sickness index estimating unit 24 receives information on a route (hereinafter, referred to as a “target route”) from a departure point to a destination before travelling, through a navigation system and the like, performs a travelling simulation according to the target route by using a simulator, and estimates a first vehicle motion sickness index. However, in another exemplary embodiment of the present disclosure, the first vehicle motion sickness index estimating unit 24 may estimate a first vehicle motion sickness index based on previous travelling information on the actual movement of the target route by the vehicle. Herein, the first vehicle motion sickness index is defined as motion sickness causing energy generated by behavior of the vehicle while the simulation travelling is performed.
The first vehicle motion sickness index estimating unit 24 collects and analyzes vehicle data measured while the travelling simulation is performed. Referring to
The first vehicle motion sickness index estimating unit 24 filters at least one of the measured vehicle data items and extracts data of a frequency band which is predicted to cause motion sickness. In
The first vehicle motion sickness index estimating unit 24 performs a Fast Fourier Transform (FFT) computation by using the filtered data extracted from each vehicle data item, and calculates energy of each vehicle data item. A formula for calculating energy of each vehicle data item is as follows.
Ex=∫f
Herein, Ex means energy of each vehicle data item (Eax, Eay, Eaz, Eroll, Epitch, and Eyaw), a frequency band from f1 to f2 is a band including a motion sickness causing frequency, and x(f) means a frequency signal of each vehicle data item.
However, in another exemplary embodiment of the present disclosure, energy of each vehicle data item may be calculated by Parseval's theorem in a time domain, not a frequency domain.
The first vehicle motion sickness index estimating unit 24 obtains total energy by summing all of the energy calculated in the respective vehicle data items. The total energy computed by the foregoing process is defined as the first vehicle motion sickness index in the present specification. In another exemplary embodiment of the present disclosure, an average value of the energy calculated in the respective vehicle data items may be defined as the first vehicle motion sickness index.
In the meantime, the simulator, each vehicle data item, and the like used in the travelling simulation may be stored in a memory unit (not illustrated) provided in the vehicle or the cloud 50.
The first comparing unit 26 compares the first vehicle motion sickness index with the first threshold and generates a signal so as to control a boarding location of the passenger before travelling. When the first vehicle motion sickness index is smaller than the first threshold, the occurrence of the motion sickness is not predicted, so that it is not necessary to control the location of the passenger. In contrast, when the first vehicle motion sickness index is larger than the first threshold, the occurrence of the motion sickness is predicted, so that the first comparing unit 26 generates a guide signal so as to induce forward boarding for a passenger boarding in a reverse direction.
The second control unit 30 is for the purpose of controlling motion sickness during travelling, and includes a second threshold setting unit 32, a passenger motion sickness index calculating unit 34, and a second comparing unit 36.
The second threshold setting unit 32 sets a second threshold indicating the degree of sensitivity to the occurrence of the motion sickness of the passenger according to the passenger information during the travelling. Herein, the passenger information during the travelling may include the passenger information before the travelling. The second threshold is a value predicted to cause motion sickness to the passenger during the travelling, and may be the same as or different from the first threshold. That is, when the passenger information before the travelling does not match the passenger information during the travelling, the first threshold is different from the second threshold. For example, the posture of the passenger before the travelling is the posture based on which the movement of the vehicle is predictable, but when the passenger changes his/her posture to the posture based on which the movement of the vehicle is not predictable during the travelling, the first threshold is different from the second threshold.
In the meantime, the method of setting the second threshold is the same as the method of setting the first threshold.
The passenger motion sickness index calculating unit 34 calculates a passenger state index and a second vehicle motion sickness index, and then calculates a passenger motion sickness index indicating the degree of the occurrence of the motion sickness of the passenger.
A passenger state index is calculated based on passenger state information. The passenger state information means information about a body of the passenger changed for the travelling time up to a present time. For example, the passenger state information includes information on changes in a heart rate, body temperature, and facial expression of the passenger collected through the sensor unit 40 for the travelling time up to the present time, information about an actual vomiting symptom, and the like.
Referring to
The second vehicle motion sickness index is calculated based on vehicle state information. The vehicle state information means information on a behavior of the vehicle changed for the travelling time up to the present time. Herein, the information on the behavior of the vehicle is vehicle data actually measured by the sensor unit 40 while the vehicle travels for the travelling time up to the present time. Herein, the second vehicle motion sickness index is defined as motion sickness causing energy generated by the behavior of the vehicle for the travelling time up to the present time. The process of calculating the second vehicle motion sickness index is the same as the process of estimating the first vehicle motion sickness index, so that detailed contents thereof will be omitted.
The passenger motion sickness index calculating unit 34 calculates a passenger motion sickness index by computing the calculated passenger state index and the second vehicle motion sickness index. By drawing the passenger motion sickness index, the degree of occurrence of the motion sickness of the passenger during the travelling may be digitized in consideration both the state of the passenger and the behavior state of the vehicle.
In the meantime, the first threshold and the second threshold may be stored in the memory unit (not illustrated) provided in the vehicle or the cloud 50.
The second comparing unit 36 compares the second vehicle motion sickness index with the second threshold and generates a signal for controlling the behavior of the vehicle during the travelling. When the second vehicle motion sickness index is smaller than the second threshold, the motion sickness does not occur, so that it is not necessary to control the behavior of the vehicle. In contrast, when the second vehicle motion sickness index is larger than the second threshold, the motion sickness occurs, so that it is necessary to control the behavior of the vehicle.
In the meantime, the control of the behavior of the vehicle means adjusting the speed, a direction, and the like of the vehicle to control the vehicle to reduce or eliminate the occurrence of the frequency causing the motion sickness. However, the exemplary embodiment of the present disclosure will be described based on the adjustment of the speed of the vehicle.
In the case where it is necessary to control the behavior of the vehicle, the second comparing unit 36 calculates a vehicle route (hereinafter, referred to as an “expected route”) for X time after the present time. The second comparing unit 36 estimates a third vehicle motion sickness index at each speed of the vehicle which is travelling the expected route while changing the speed of the vehicle. The second comparing unit 36 also estimates a third vehicle motion sickness index at a current speed as a matter of course. Herein, the third vehicle motion sickness index is defined as motion sickness causing energy generated by the behavior of the vehicle for X time after the present time. Herein, the process of estimating the third vehicle motion sickness index is the same as the process of estimating the first vehicle motion sickness index, so that detailed contents thereof will be omitted.
The second comparing unit 36 controls the vehicle to travel at a speed having the smallest third vehicle motion sickness index among the third vehicle motion sickness indexes estimated in the respective speeds. Referring to
In the meantime, in another exemplary embodiment of the present disclosure in relation to the control of the behavior of the vehicle, the second comparing unit 36 may also estimate the third vehicle motion sickness index while changing a direction of the vehicle in the expected route.
Hereinafter, a process of operating the system for controlling an autonomous vehicle for reducing motion sickness according to the exemplary embodiment of the present disclosure will be described with reference to
As illustrated in
As illustrated in
As illustrated in
While this disclosure has been described in connection with the limited exemplary embodiments and drawings, the disclosure is not limited thereto, and it is obvious that various changes and modifications within the technical spirit of the present disclosure and the scope equivalent to the scope of the appended claims may be made by those skilled in the art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2020-0081340 | Jul 2020 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20170136842 | Anderson | May 2017 | A1 |
| 20190022347 | Wan | Jan 2019 | A1 |
| 20200125989 | Sucan | Apr 2020 | A1 |
| 20210031789 | Moriura | Feb 2021 | A1 |
| 20210154430 | Lev | May 2021 | A1 |
| 20210164796 | Larner | Jun 2021 | A1 |
| 20220001893 | Tartz | Jan 2022 | A1 |
| 20220135054 | Nakamura | May 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 10-2018-0123697 | Nov 2018 | KR |
| 10-2019-0126198 | Nov 2019 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20220001894 A1 | Jan 2022 | US |
