The present disclosure claims priority to Japanese Patent Application No. 2022-152876, filed on Sep. 26, 2022, the contents of which application are incorporated herein by reference in their entirety.
The present disclosure relates to a technique for notifying a user of a vehicle of information. In particular, the present disclosure relates to a technique for notifying a user of a vehicle of information on a speed limit.
Patent Literature 1 discloses a sign display device for a vehicle. The sign display device detects a sign in front of a vehicle by the use of a camera. When first sign information regarding a first maximum speed in a first section and second sign information regarding a second maximum speed in a second section are detected, the sign display device displays the first sign information and the second sign information side by side.
Such a technique that recognizes a speed limit sign and notifies a user of a vehicle of a speed limit designated by the speed limit sign is useful. However, among various types of the speed limit sign, there is a time-designated speed limit sign that designates (shows) a speed limit for a specific time of day. Even if the user is notified of the speed limit designated by the time-designated speed limit sign, the user cannot know the speed limit for other than the specific time of day. For example, when a current time is outside the specific time of day, the notification of the speed limit for the specific time of day is not particularly useful. There is room for improvement in the technique for notifying the user of the vehicle of the speed limit.
A first aspect is directed to an information notification system for notifying a user of a vehicle of information. The information notification system includes: one or more processors; and one or more memory devices configured to store reference information on a legal speed limit in a region in which the vehicle is used. The one or more processors determine whether or not a first condition is satisfied. The first condition is that one or more time-designated speed limit signs recognized by a camera mounted on the vehicle designate all times of day as a whole. When the first condition is not satisfied, the one or more processors notify the user of at least the legal speed limit on a road on which the one or more time-designated speed limit signs are installed, based on the reference information.
A second aspect is directed to an information notification method for notifying a user of a vehicle of information by a computer. The information notification method includes: determining whether or not a first condition is satisfied, the first condition being that one or more time-designated speed limit signs recognized by a camera mounted on the vehicle designate all times of day as a whole; and when the first condition is not satisfied, notifying the user of at least a legal speed limit on a road on which the one or more time-designated speed limit signs are installed, based on reference information on the legal speed limit in a region in which the vehicle is used.
According to the present disclosure, when the time-designated speed limit sign recognized does not designate all times of day as a whole, the user of the vehicle is notified of at least the legal speed limit. Such the notification of the legal speed limit is useful for the user, and thus convenience for the user is improved.
Embodiments of the present disclosure will be described with reference to the accompanying drawings.
For example, the information notification system 100 notifies the user O of information regarding a speed limit of a road on which the vehicle 1 travels. The speed limit of the road on which the vehicle 1 travels is obtained from, for example, a speed limit sign S installed on the road. The information notification system 100 recognizes the speed limit sign S installed on the road on which the vehicle 1 travels, and notifies the user O of the speed limit designated by the recognized speed limit sign S.
A camera 2 mounted on the vehicle 1 is used for recognizing a speed limit sign S. The camera 2 captures a situation around the vehicle 1 to acquire an image IMG indicating the situation around the vehicle 1. The information notification system 100 acquires the image IMG captured by the camera 2 and recognizes a speed limit sign S by analyzing the image IMG. Typically, the information notification system 100 recognizes a speed limit sign S from the image IMG by using image recognition AI (Artificial Intelligence). The image recognition AI is generated in advance through a learning method such as deep learning. For example, the image recognition AI is trained to detect a variety of signs in the image IMG and to identify a type of each detected sign. As another example, the image recognition AI may be trained to be able to detect a speed limit sign S in the image IMG. In either case, it is possible to recognize a speed limit sign S by using the camera 2 and the image recognition AI.
The information notification system 100 includes a notification device for notifying the user O of information. The information notification system 100 notifies the user O of the speed limit designated by the recognized speed limit sign S through the notification device.
For example, the notification device includes a display device. The information notification system 100 displays an image itself of the recognized speed limit sign S on the display device. Alternatively, the information notification system 100 may read numbers (figures) shown on the speed limit sign S based on the image of the recognized speed limit sign S. In other words, the information notification system 100 may recognize the speed limit designated by the speed limit sign S on the basis of the image of the recognized speed limit sign S. In this case, the information notification system 100 displays the recognized speed limit on the display device. The speed limit may be represented by an icon or may be represented by characters (numbers).
As another example, the notification device may include a speaker. In this case, the information notification system 100 outputs audio information notifying the speed limit from the speaker.
The technique for notifying of the speed limit in this manner is useful for the user O of the vehicle 1.
Among various types of the speed limit sign S, there is a “time-designated speed limit sign ST” that designates (shows) a speed limit for a specific time of one day. Typically, the time-designated speed limit sign ST includes not only a main portion for designating the speed limit but also an auxiliary portion for designating a time of day to which the speed limit is applied. The image recognition AI is able to determine whether or not the speed limit sign S is the time-designated speed limit sign ST based on presence or absence of the auxiliary portion designating the time of day. The image recognition AI may recognize the time of day designated by the time-designated speed limit sign ST.
Even if the user O of the vehicle 1 is notified of the speed limit designated by the time-designated speed limit sign ST, the user O cannot know the speed limit for other than the specific time of day. For example, when a current time is outside the specific time of day, the notification of the speed limit for the specific time of day is not particularly useful. In view of above, the present embodiment provides a technique capable of further improving convenience for the user O of the vehicle 1.
More specifically, the information notification system 100 holds “reference information REF” on the legal speed limit in a region in which the vehicle 1 is used. Here, the region in which the vehicle 1 is used means a country, a state, or the like. Traffic regulations are defined for each region. The reference information REF is generated in advance on the basis of the traffic regulations defined for each region. The reference information REF may be generated to cover a plurality of regions.
For example, the reference information REF associates a design of a speed limit sign S used in the region with the legal speed limit on a road on which the speed limit sign S is installed. The design of the speed limit sign S includes numbers (figures) of the speed limit designated by the speed limit sign S. For example, such a speed limit sign S that designates a speed limit equal to or higher than 100 km/h is installed on an expressway (limited highway). The legal speed limit on the expressway in the region is defined by the traffic regulations. It is therefore possible to generate the reference information REF that associates the design of the speed limit sign S with the legal speed limit.
However, the reference information REF is not limited only to the above example. Various examples of the reference information REF will be described later.
Based on the reference information REF, the information notification system 100 acquires information on the legal speed limit on the road on which the recognized time-designated speed limit sign ST is installed. In the example shown in
As a result, the user O of the vehicle 1 can know not only the speed limit applied to the specific time of day but also the legal speed limit applied to other than the specific time of day. Such the information on the legal speed limit is useful for the user O, and thus convenience for the user O is improved. In some embodiments, for example, when a current time is outside the specific time of day, the user O can know the legal speed limit applied to the current time.
In the example shown in
Since the user O can know the speed limits for all times of day, it is not always necessary to notify the user O of the legal speed limit. Therefore, the information notification system 100 may refrain from acquiring the information on the legal speed limit based on the reference information REF. Alternatively, the information notification system 100 may refrain from notifying the user O of the legal speed limit. In either case, the processing load on the information notification system 100 is reduced. In addition, since information is not notified to the user O more than necessary, the user O is prevented from feeling annoyed.
The communication interface 110 communicates with the outside of the information notification system 100. For example, the communication interface 110 communicates with the camera 2 mounted on the vehicle 1. When the user O is a remote operator who remotely operates (remotely drives or remotely supports) the vehicle 1 and the information notification system 100 is included in a remote operator terminal, the communication interface 110 communicates with the vehicle 1.
The notification device 120 notifies the user O of the vehicle 1 of a variety of information. When the user O is a driver in the vehicle 1, the notification device 120 is mounted on the vehicle 1. When the user O is a remote operator, the notification device 120 is included in a remote operator terminal. For example, the notification device 120 includes a display device. Examples of the display device include a display, a head-up display (HUD), and the like. As another example, the notification device 120 may include a speaker.
The processor 130 executes a variety of processing. For example, the processor 130 includes a central processing unit (CPU).
The memory device 140 stores a variety of information. Examples of the memory device 140 include a volatile memory, a nonvolatile memory, a hard disk drive (HDD), a solid state drive (SSD), and the like.
A control program 200 is a computer program for controlling the information notification system 100. The variety of processing by the information notification system 100 may be implemented by the processor 130 executing the control program 200. The control program 200 is stored in the memory device 140. Alternatively, the control program 200 may be recorded on a non-transitory computer-readable recording medium.
The processor 130 acquires an image IMG captured by the camera 2 mounted on the vehicle 1 via the communication interface 110. The image IMG is stored in the memory device 140.
In addition, the processor 130 acquires navigation information NAV from the vehicle 1 via the communication interface 110. The navigation information NAV includes map information and position information of the vehicle 1. The navigation information NAV may include information on a region (country, state, or the like) in which the vehicle 1 is present. The navigation information NAV is stored in the memory device 140.
The memory device 140 further stores the reference information REF. The reference information REF is information on the legal speed limit in the region (country, state, or the like) in which the vehicle 1 is used. The reference information REF may be generated to cover a plurality of regions.
The reference information REF shown in
As still another example, the reference information REF may be map information in which the legal speed limit for each position is registered.
In Step S100, the processor 130 recognizes one or more time-designated speed limit signs ST based on the image IMG captured by the camera 2 mounted on the vehicle 1. Typically, the above-described image recognition AI is used for recognizing the time-designated speed limit sign ST. In the example shown in
In Step S110, the processor 130 determines whether or not a first condition is satisfied. The first condition is that the recognized one or more time-designated speed limit signs ST designate all times of day as a whole. In the example shown in
In Step S120, the processor 130 notifies the user O of a plurality of speed limits respectively designated by the plurality of recognized time-designated speed limit signs STs via the notification device 120 (see
In Step S130, the processor 130 identifies the legal speed limit on the road on which the recognized time-designated speed limit sign is installed. More specifically, the processor 130 identifies the legal speed limit based on the reference information REF stored in the memory device 140. If necessary, the processor 130 recognizes the region (country, state, or the like) in which the vehicle 1 is present based on the navigation information NAV, and uses the reference information REF for the region.
The processing in the case of the reference information REF shown in
The processing in the case of the reference information REF shown in
As still another example, the reference information REF may be map information in which a legal speed limit for each position is registered. In this case, the processor 130 acquires the legal speed limit at the position of the vehicle 1 based on the position information of the vehicle 1 and the reference information REF.
When the legal speed limit on the road on which the time-designated speed limit sign ST is installed is identified (Step S130; Yes), the processing proceeds to Step S140. In some situations, the legal speed limit may not be identified. In that case (Step S130; No), the processing proceeds to Step S150.
In Step S140, the information notification system 100 notifies the user O of both the speed limit designated by the recognized one or more time-designated speed limit signs ST and the legal speed limit via the notification device 120 (see
In Step S150, the information notification system 100 notifies the user O of the speed limit designated by the recognized one or more time-designated speed limit signs ST via the notification device 120.
As described above, according to the present embodiment, one or more time-designated speed limit signs ST are recognized by the camera 2 mounted on the vehicle 1. Further, it is determined whether or not the first condition that the recognized one or more time-designated speed limit signs ST designate all times of day as a whole is satisfied.
When the first condition is not satisfied, the user O of the vehicle 1 is notified of the legal speed limit. As a result, the user O of the vehicle 1 can know not only the speed limit applied to the specific time of day but also the legal speed limit applied to to other than the specific time of day. Such the information on the legal speed limit is useful for the user O, and thus convenience for the user O is improved. In some embodiments, for example, when a current time is outside the specific time of day, the user O can know the legal speed limit applied to the current time.
On the other hand, when the first condition is satisfied, the user O is notified of the plurality of speed limits respectively designated by the plurality of time-designated speed limit signs ST. In other words, the user O is notified of the speed limits for all times of day. In this case, it is not always necessary to notify the user O of the legal speed limit. Refraining from acquiring the information on the legal speed limit or refraining from notifying the user O of the legal speed limit makes it possible to reduce the processing load on the information notification system 100. In addition, since information is not notified to the user O more than necessary, the user O is prevented from feeling annoyed.
In a second embodiment, a case where the notification device 120 has a specification capable of notifying only one type of speed limit is considered. For example, due to a limited display space, the notification device 120 (display device) is capable of notifying only one type of speed limit.
In the second embodiment, the processor 130 notifies the user O of the vehicle 1 of only one of the speed limit designated by the recognized one or more time-designated speed limit signs ST and the legal speed limit. Basically, the processor 130 notifies the user O of the highest one of the speed limits being notification candidates.
As a modification example, the processor 130 may notify the user O of the vehicle 1 of one speed limit applied to the current time among the plurality of speed limits. The current time is obtained from a clock. The information on the times of day respectively designated by the plurality of time-designated speed limit signs ST-1 and ST-2 is obtained by analyzing images of the plurality of time-designated speed limit signs ST-1 and ST-2. The processor 130 selects one time-designated speed limit sign ST designating a time of day including the current time, and notifies the user O of the speed limit designated by the selected time-designated speed limit sign ST.
In Step S120′, the processor 130 notifies the user O of one of the plurality of speed limits respectively designated by the recognized plurality of time-designated speed limit signs STs (see
In Step S140′, the information notification system 100 notifies the user O of the legal speed limit without notifying of the speed limit designated by the time-designated speed limit sign ST (see
Number | Date | Country | Kind |
---|---|---|---|
2022-152876 | Sep 2022 | JP | national |