This application claims priority from Korean Patent Application No. 10-2023-0154237 filed on Nov. 9, 2023 in the Korean Intellectual Property Office, and all the benefits accruing therefrom under 35 U.S.C. 119, the contents of which in its entirety are herein incorporated by reference.
The present disclosure relates to a stopover recommendation method based on a fatigue status, and a navigation system for performing the same. More specifically, the present disclosure relates to a method for detecting a fatigue status based on vehicle information indicating a state of a vehicle or user information, classifying the detected fatigue status based on a fatigue type, and recommending a stopover appropriate for each fatigue type, and a navigation system for performing the same.
Generally, each of various mobility apparatuses employs a navigation system equipped with a GPS (Global Positioning System) to identify a current location and a current moving speed thereof or to determine a moving speed thereof. The navigation system receives a radio wave indicating a latitude, a longitude, an altitude, etc. from a plurality of artificial satellites, calculates a current location of a moving object to identify the current location of the moving object, and identifies a destination input by a user, and determines a moving route starting from the current location and arriving at the destination.
The navigation system determines the route based on various information related to driving, such as to a distance the destination, an arrival time, a cost such as an optimal distance to the destination, the shortest distance, a traffic condition, use of free or toll road, etc. The navigation system includes not only a component for receiving the destination directly from the user, but also a component that searches for the current location or the surroundings around the destination, and a component that recommends a stopover point.
The navigation system does not simply provide the shortest route for the user to reach the destination. Further, it is important to recommend an appropriate stopover for the user's rest when the user is tired. In particular, instead of recommending a general stopover when the user is tired, a detected fatigue status needs to be classified based on the fatigue type, and an individualized stopover need to be recommended according to each of different fatigue types.
A technical purpose to be achieved using embodiments of the present disclosure is to provide a method for detecting a fatigue status based on vehicle information indicating a state of a vehicle or user information, classifying the detected fatigue status based on a fatigue type, and recommending a rest-purposed stopover appropriate for each fatigue type, and a navigation system for performing the same.
The technical purposes of the present disclosure are not limited to the technical purposes mentioned above, and other technical purposes not mentioned may be clearly understood by those skilled in the art from descriptions as set forth below.
According to an aspect of the present disclosure, a stopover recommendation method may be performed by a computing device, and the method may comprise: acquiring vehicle information indicating a state of a vehicle and user information about a user; detecting a fatigue status of the user using the acquired vehicle information and user information; classifying the detected fatigue status into one of drowsiness-inducing fatigue, negative emotion fatigue, and lack-of-exercise fatigue, wherein the negative emotion fatigue includes relaxed fatigue and tense fatigue; recommending a stopover based on the fatigue classification result and the user's past destination setting history; displaying detailed information on the recommended stopover; and determining a route including the recommended stopover as a final route, in response to the user's approval with the recommended stopover.
In one embodiment, the vehicle information may include at least one of information on a location (GPS) of a vehicle, a driving speed, a total driving time duration, a window opening time or a frequency of window opening and closing, a brake pedal stepping strength, a signal indicating a departure of a preceding vehicle, information on media being played, a frequency of air conditioner control, whether ADAS (Advanced Driver Assistance Systems function) is used, and whether a seat massage function is used, wherein the user information may be extracted from usage history of the computing device and the user device of the user, wherein the user information may include at least one of the user's heart rate, a volume of voice during a call, the user's past destination setting history, whether or not the user has visited a specific location, and the user's posture.
In one embodiment, the classifying of the detected fatigue status may include: when a driving timing is evening, night, or dawn, when a total driving time duration is equal to or greater than a preset first threshold time duration, or when a window opening time duration is equal to or greater than a preset second threshold time duration, classifying the detected fatigue status as the drowsiness-inducing fatigue, wherein each of the first threshold time duration and the second threshold time duration may be determined based on a driving pattern of the user acquired from the vehicle.
In one embodiment, the classifying of the detected fatigue status may include: when the heart rate is smaller than a reference value, when a brake pedal stepping strength is smaller than an average brake pedal stepping strength of the user, when a difference between a speed limit on a road on which a vehicle is currently driving and the current driving speed is larger than a predetermined threshold value, or when the vehicle does not start despite a preceding vehicle movement-start notification signal, classifying the detected fatigue status as the relaxed fatigue of the negative emotion fatigue, wherein the brake pedal stepping strength may be stored in the vehicle every time the user drives the vehicle, wherein the average brake pedal stepping strength may be calculated from values of the brake pedal stepping strength stored in the vehicle, wherein the predetermined threshold value may be determined as an average of difference values between a driving speed stored in the navigation system or the vehicle and the speed limit on the road on which the vehicle is currently driving.
In one embodiment, the classifying of the detected fatigue status may include: when the heart rate is higher than a reference value, or when the volume of the call voice is greater than an average volume of the user's call voice, classifying the detected fatigue status as the tense fatigue of the negative emotion fatigue, wherein the average volume of the user's call voice may be calculated from the user's call record stored in the user device.
In one embodiment, the classifying of the detected fatigue status may include: when the user's posture is different from a correct posture, or when the seat massage function is activated, classifying the detected fatigue status as the lack-of-exercise fatigue.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the drowsiness-inducing fatigue, when the user's fatigue status is classified as the drowsiness-inducing fatigue, determining whether the current time is night or dawn and the driving time duration has exceeded a predetermined first threshold time duration, when the current time is night or dawn and the total driving time duration has exceeded the predetermined first threshold time duration, recommending a nearest accommodation place among searched accommodation places based on a current location as the stopover, when the current time is not night or dawn, or when the total driving time duration does not exceed the first threshold time duration, recommending a nearest drowsiness shelter or rest area searched based on the current location as the stopover, wherein the first threshold time duration may be determined based on the user's driving pattern acquired from the vehicle.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the negative emotion fatigue, when the user's fatigue status is classified as the negative emotion fatigue, searching for a destination that the user visited on a holiday, based on the user's past destination setting history; and recommending a park or a cafe among the searched destinations as the stopover.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the lack-of-exercise fatigue; when the user's fatigue status is classified as the lack-of-exercise fatigue, determining whether there is an exercise place that the user visited, based on the user's past destination setting history; and when there is the exercise place that the user visited, recommending the exercise place that the user visited as the stopover; and when there is no exercise place that the user visited, recommending a place at which the vehicle can stop and park as the stopover.
In one embodiment, wherein the detailed information on the recommended stopover may include the user's fatigue status based on which the stopover is recommended, a type of rest that may be taken in the stopover, and an expected driving time to drive along a route including the recommended stopover thereto.
According to another aspect of the present disclosure, a computing device may comprise: a processor; and a memory connected to the process and configured to store therein instructions, wherein when the instructions are executed by the processor, the instructions may cause the processor to: acquire vehicle information indicating a state of a vehicle and user information about a user; detect a fatigue status of the user using the acquired vehicle information and user information; classify the detected fatigue status into one of drowsiness-inducing fatigue, negative emotion fatigue, and lack-of-exercise fatigue, wherein the negative emotion fatigue includes relaxed fatigue and tense fatigue; recommend a stopover based on the fatigue classification result and the user's past destination setting history; display detailed information on the recommended stopover; and determine a route including the recommended stopover as a final route, in response to the user's approval with the recommended stopover.
In one embodiment, the vehicle information may include at least one of information on a location (GPS) of a vehicle, a driving speed, a total driving time duration, a window opening time or a frequency of window opening and closing, a brake pedal stepping strength, a signal indicating a departure of a preceding vehicle, information on media being played, a frequency of air conditioner control, whether ADAS (Advanced Driver Assistance Systems function) is used, and whether a seat massage function is used, wherein the user information may be extracted from usage history of the computing device and the user device of the user, wherein the user information may include at least one of the user's heart rate, a volume of voice during a call, the user's past destination setting history, whether or not the user has visited a specific location, and the user's posture.
In one embodiment, the classifying of the detected fatigue status may include: when a driving timing is evening, night, or dawn, when a total driving time duration is equal to or greater than a preset first threshold time duration, or when a window opening time duration is equal to or greater than a preset second threshold time duration, classifying the detected fatigue status as the drowsiness-inducing fatigue, wherein each of the first threshold time duration and the second threshold time duration may be determined based on a driving pattern of the user acquired from the vehicle.
In one embodiment, the classifying of the detected fatigue status may include: when the heart rate is smaller than a reference value, when a brake pedal stepping strength is smaller than an average brake pedal stepping strength of the user, when a difference between a speed limit on a road on which a vehicle is currently driving and the current driving speed is larger than a predetermined threshold value, or when the vehicle does not start despite a preceding vehicle movement-start notification signal, classifying the detected fatigue status as the relaxed fatigue of the negative emotion fatigue, wherein the brake pedal stepping strength may be stored in the vehicle every time the user drives the vehicle, wherein the average brake pedal stepping strength may be calculated from values of the brake pedal stepping strength stored in the vehicle, wherein the predetermined threshold value may be determined as an average of difference values between a driving speed stored in the navigation system or the vehicle and the speed limit on the road on which the vehicle is currently driving.
In one embodiment, the classifying of the detected fatigue status may include: when the heart rate is higher than a reference value, or when the volume of the call voice is greater than an average volume of the user's call voice, classifying the detected fatigue status as the tense fatigue of the negative emotion fatigue, wherein the average volume of the user's call voice may be calculated from the user's call record stored in the user device.
In one embodiment, the classifying of the detected fatigue status may include: when the user's posture is different from a correct posture, or when the seat massage function is activated, classifying the detected fatigue status as the lack-of-exercise fatigue.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the drowsiness-inducing fatigue, when the user's fatigue status is classified as the drowsiness-inducing fatigue, determining whether the current time is night or dawn and the driving time duration has exceeded a predetermined first threshold time duration, when the current time is night or dawn and the total driving time duration has exceeded the predetermined first threshold time duration, recommending a nearest accommodation place among searched accommodation places based on a current location as the stopover, when the current time is not night or dawn, or when the total driving time duration does not exceed the first threshold time duration, recommending a nearest drowsiness shelter or rest area searched based on the current location as the stopover, wherein the first threshold time duration may be determined based on the user's driving pattern acquired from the vehicle.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the negative emotion fatigue, when the user's fatigue status is classified as the negative emotion fatigue, searching for a destination that the user visited on a holiday, based on the user's past destination setting history; and recommending a park or a cafe among the searched destinations as the stopover.
In one embodiment, the recommending of the stopover may include: determining whether the user's fatigue status is classified as the lack-of-exercise fatigue; when the user's fatigue status is classified as the lack-of-exercise fatigue, determining whether there is an exercise place that the user visited, based on the user's past destination setting history; and when there is the exercise place that the user visited, recommending the exercise place that the user visited as the stopover; and when there is no exercise place that the user visited, recommending a place at which the vehicle can stop and park as the stopover.
In one embodiment, the detailed information on the recommended stopover may include the user's fatigue status based on which the stopover is recommended, a type of rest that may be taken in the stopover, and an expected driving time to drive along a route including the recommended stopover thereto.
The above and other aspects and features of the present disclosure will become more apparent by describing in detail illustrative embodiments thereof with reference to the attached drawings, in which:
Preferred embodiments of the present disclosure will hereinafter be described in detail with reference to the accompanying drawings. The advantages, features, and methods of achieving them of the present disclosure will become clearer with the embodiments described in detail along with the accompanying drawings. However, the present disclosure is not limited to the embodiments described below and can be implemented in various different forms. These embodiments are provided only to make the disclosure complete and fully inform those of ordinary skill in the technical field to which the present disclosure belongs, and the present disclosure is defined only by the scope of the claims.
It is noted that the same reference numerals are used for the same elements across different drawings as far as possible. Furthermore, in describing the present disclosure, detailed descriptions of known configurations or functions will be omitted when they may obscure the essence of the present disclosure.
Unless defined otherwise, all terms used herein (including technical and scientific terms) can have the meaning commonly understood by one of ordinary skill in the art to which the present disclosure belongs. Terms defined in commonly used dictionaries are not interpreted in an ideal or excessive manner unless explicitly defined otherwise. The terms used in the present specification are for the purpose of describing particular embodiments only and are not intended to limit the invention. In this specification, the singular forms include plural forms unless the context clearly indicates otherwise.
Furthermore, in describing the components of the present disclosure, terms such as first, second, A, B, (a), (b), etc., may be used. These terms are intended to distinguish the components from others, and the essence, order, or sequence of such components is not limited by these terms. If a component is stated as being “connected,” “coupled,” or “linked” to another component, the component can be directly connected or linked to the other component, but it should be understood that there may also exist other components “connected,” “coupled,” or “linked between them.
The terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For example, the information indicating the state of the vehicle 200 may include information on a location (GPS) of a vehicle, a driving speed, a total driving time duration, a window opening time or a frequency of window opening and closing, a brake pedal stepping strength, a signal indicating a departure of a preceding vehicle, information on media being played, a frequency of air conditioner control, whether ADAS (Advanced Driver Assistance Systems function) is used, whether a seat massage function is used, etc. Furthermore, the user information may include the user's heart rate, a volume of voice during a call, the user's past destination setting history, whether or not he or she has visited a specific location, etc., which may be extracted from the navigation system 100 and the user device 300. Furthermore, the user information may further include the user's posture, a frequency of changing the posture correctly, a frequency of yawning, etc., which may be extracted from a camera installed in the vehicle 200.
The navigation system 100 according to an embodiment of the present disclosure may detect the user's fatigue status based on the vehicle information and the user information. For example, the user's fatigue status may be detected when the total driving time duration has exceeded a threshold time duration, when yawning occurs frequently, when a difference between a speed limit and a current driving speed is gradually increasing (i.e., driving at an increasingly lower speed), when the vehicle does not start immediately despite a preceding vehicle movement-start notification signal, when the heart rate is low or high, when the air conditioner is frequently turned on or off, when the posture is constantly corrected, or when the ADAS function is used for an excessively long time, etc.
Furthermore, the navigation system 100 according to an embodiment of the present disclosure may classify the detected fatigue statuses based on a fatigue type. For example, the fatigue statuses may be classified into drowsiness-inducing fatigue, negative emotion fatigue, and lack-of-exercise fatigue. That is, the fatigue type may include into the drowsiness-inducing fatigue, negative emotion fatigue, and lack-of-exercise fatigue. The negative emotions may be classified into relaxed fatigue and tense fatigue. Thereafter, the navigation system 100 may recommend an appropriate stopover based on the classified type of the fatigue status. For example, when the user is in the drowsiness-inducing fatigue status, a drowsiness shelter or a rest area for a short rest may be recommended as a stopover, or in some cases, a place where the user may stay may be recommended as a stopover. When the user is in the relaxed or tense fatigue status, a cafe or park for emotional relaxation may be recommended as a stopover, or it may be more efficient that a place that the user usually visits for relaxation is recommended. When the user is in a lack-of-exercise fatigue status, and when there is a place where the user regularly visits for exercise, that place may be recommended as a stopover. Alternatively, a place where the user may stop for simple stretching, etc. may be recommended as a stopover. This will be described in more detail with reference to
The navigation system 100 may display detailed information about the stopover along with the stopover recommendation. The detailed information may include the user's fatigue status based on which the stopover is recommended, a type of rest that may be taken in the stopover, and an expected driving time to drive along a route including the recommended stopover thereto. After checking the user's fatigue status, the recommended stopover, and the related detailed information, the user of the vehicle may determine the route including the stopover as a final route. In one example, the user may determine an existing route toward the destination as the final route regardless of the stopover recommendation result.
The navigation system 100 according to some embodiments of the present disclosure may be implemented on at least one computing device. For example, all functions of the navigation system 100 may be implemented on one computing device. Alternatively, some functions of the navigation system 100 may be implemented on a first computing device, and the remaining functions thereof may be implemented on a second computing device. Alternative, a specific function of the navigation system 100 may be implemented on a plurality computing devices. For example, a stopover recommendation function of the navigation system 100 and a function of displaying information about the destination thereof may be implemented separately on different computing devices. The computing device may include any device equipped with a computing means and a communication means. An embodiment in which the navigation system 100 is implemented as a computing device is described in more detail with reference to
The user device 300 may be any personal computing device used by the user of the vehicle 200. For example, the user device 300 may include a smart phone, a smart watch, a tablet, a desktop, a laptop, etc. However, the present disclosure is not limited thereto, and the user device 300 may be embodied as any computing device equipped with a computing means and a communication means. As described above, the navigation system 100 may communicate with the user device 300 and may acquire and use usage history of the user device 300, biometric information measured from the user device 300, etc. as the user information.
Furthermore, the components illustrated in
Referring to
First, when a driving timing is evening, night, or dawn, when the total driving time duration is equal to or greater than a first threshold time duration as preset, when the window opening time duration is equal to or greater than a second threshold time duration as preset or the frequency of the window opening and closing is high, when the user yawns frequently, or when it is right after a meal (for example, when a current time is in a meal timing zone and a departure location is a restaurant), the user's fatigue status may be classified as the drowsiness-inducing fatigue status.
For example, each of the first threshold time duration and the second threshold time duration described above may be determined based on the user's driving pattern acquired from the vehicle.
Next, when the brake pedal stepping strength is smaller than an average brake pedal stepping strength of the user, when the difference between the speed limit and the current driving speed becomes larger than a predetermined threshold value (i.e., driving at a slower speed than the speed limit), when the vehicle does not start despite the preceding vehicle movement-start notification signal, when the music being played changes frequently or the sound becomes louder, when the air conditioner is frequently turned on and off, when the ADAS function is continuously used, or when the measured heart rate is lower than a reference value, the user's fatigue status may be classified as the relaxed fatigue status among the negative emotion fatigues. For example, the brake pedal stepping strength may be stored in the vehicle every time the user drives, and the above-described average brake pedal stepping strength may be calculated from the values stored in the vehicle. Furthermore, the predetermined threshold value related to the difference between the speed limit and the current driving speed as described above may be determined as an average of difference values between the driving speed and the speed limit on a specific road as stored in the navigation system 100 or the vehicle.
In particular, based on a value of the difference between the speed limit and the current driving speed, a level of the relaxed fatigue status may be further sub-classified. For example, when the difference between the current speed limit and the current driving speed is greater than a predetermined threshold value by 5 km/h, 10 km/h, and 15 km/h, the level of the relaxed fatigue status may be classified into the relaxed fatigue status of a first level, the relaxed fatigue status of a second level, and the relaxed fatigue status of a third level, respectively.
In one example, when the user takes off his outer clothing, when he/she continues to drive on a straight road with a high speed limit (i.e., a road where he/she may drive at a very high speed), when the measured heart rate is higher than the reference value, or when the volume of the call voice is greater than an average volume of the user's call voice, the user's fatigue status may be classified as the tense fatigue status among the negative emotion fatigues. For example, the average volume of the user's call voice described above may be calculated from the user's call record stored in the user device 300. Further, when the user's posture is different from a correct posture, when the seat massage function is used, or when the user frequently changes his/her sitting posture correctly, the user's fatigue status may be classified as the lack-of-exercise fatigue status.
Similarly, the fatigue type-related fatigue detection factors as shown in
Hereinafter, referring to
In operation S100, vehicle information indicating the state of the vehicle and user information may be acquired. As described with reference to
In operation S200, the user's fatigue status may be detected using the acquired vehicle information and user information. For example, the user's fatigue status may be detected when the total driving time duration has exceeded a threshold time duration, when yawning occurs frequently, when a difference between a speed limit and a current driving speed is gradually increasing (i.e., driving at an increasingly lower speed), when the vehicle does not start immediately despite a preceding vehicle movement-start notification signal, when the heart rate is low or high, when the air conditioner is frequently turned on or off, when the posture is constantly corrected, or when the ADAS function is used for an excessively long time, etc.
In operation S300, the detected fatigue status may be classified into one of the drowsiness-inducing fatigue, the negative emotion fatigue, and the lack-of-exercise fatigue. Among these fatigues, the negative emotion fatigue may be classified into the relaxed fatigue and the tense fatigue. For example, the classification of the fatigue type may be performed based on the fatigue detection factors shown in
Referring to
Referring to
Referring to
Returning to
Referring to
In other words, the computing device 500 may include various components in addition to the components as illustrated in
The processor 510 may control all operations of the components of the computing device 500. The processor 510 may be configured to include at least one of a CPU (Central Processing Unit), an MPU (Micro Processor Unit), an MCU (Micro Controller Unit), a GPU (Graphics Processing Unit), or any further type of a processor well known in the technical field of the present disclosure. Furthermore, the processor 510 may perform computations of at least one application or program for executing operations/methods according to some embodiments of the present disclosure. The computing device 500 may have one or more processors.
Next, the memory 520 may store therein various data, commands, and/or information. The memory 520 may load therein the computer program 560 from the storage 550 to execute operations/methods according to some embodiments of the present disclosure. The memory 520 may be embodied as a volatile memory such as RAM. However, the present disclosure is not limited thereto.
Next, the bus 530 may provide a communication function between the components of the computing device 500. The bus 530 may be embodied as various types of buses such as an address bus, a data bus, and a control bus.
Next, the communication interface 540 may support wired and wireless Internet communication of the computing device 500. Furthermore, the communication interface 540 may support various communication schemes other than Internet communication. To this end, the communication interface 540 may be configured to include a communication module well known in the technical field of the present disclosure.
Next, the storage 550 may non-temporarily store therein one or more computer programs 560. The storage 550 may be configured to include a non-volatile memory such as Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which the present disclosure belongs.
Next, the computer program 560 may include one or more instructions that cause the processor 510 to perform the operations/methods according to various embodiments of the present disclosure when being loaded into the memory 520. That is, the processor 510 may execute one or more loaded instructions to perform the operations/methods according to various embodiments of the present disclosure.
For example, the computer program 560 may include instructions for acquiring vehicle information indicating a state of a vehicle and user information about a user, detecting a fatigue status of the user using the acquired vehicle information and user information, classifying the detected fatigue status into one of drowsiness-inducing fatigue, negative emotion fatigue, and lack-of-exercise fatigue, wherein the negative emotion fatigue includes relaxed fatigue and tense fatigue, recommending a stopover based on the fatigue classification result and the user's past destination setting history, displaying detailed information on the recommended stopover, and determining a route including the recommended stopover as a final route, in response to the user's approval with the recommended stopover.
According to an embodiment of the present disclosure, the user's fatigue status is detected, and a stopover for rest is recommended according to the fatigue type of the detected fatigue status, thereby providing the user with a safer and more positive driving experience. This may prevent accidents that may occur due to careless driving. The system installed in the vehicle checks the user's state and provides functions to assist the driving such that the user's trust in the vehicle software may also increase.
Various embodiments and the effects thereof according to the present disclosure have been mentioned with reference to
While all components comprising the embodiments of the present disclosure have been described as being combined or operating in conjunction, it should not be understood that the present disclosure is limited to such embodiments. That is, within the scope of the objectives of the present disclosure, all such components can selectively be combined and operate in one or more configurations.
Although operations are illustrated in a specific order in the drawings, it should not be understood that the operations must be performed in that specific order or sequentially, or that all the illustrated operations are required to achieve desired results. In certain circumstances, multitasking and parallel processing may be advantageous. Furthermore, the separation of various components in the described embodiments should not be understood as necessary, and the described program components and systems can generally be integrated into a single software product or packaged into multiple software products.
While the embodiments of the present disclosure have been described with reference to the attached drawings, it will be understood by one skilled in the art that the present disclosure can be implemented in other specific forms without departing from the technical spirit or essential characteristics thereof. Therefore, the described embodiments should be considered in all respects as illustrative and not restrictive. The scope of the present disclosure is to be interpreted by the following claims, and all technical spirits within the equivalent scope are to be interpreted as included within the rights of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
10-2023-0154237 | Nov 2023 | KR | national |