This application claims priority to Japanese Patent Application No. 2023-223079 filed on Dec. 28, 2023, incorporated herein by reference in its entirety.
The present disclosure relates to roadside devices.
Conventionally, a technique for monitoring a vehicle with a communication function is known in the art. Japanese Unexamined Patent Application Publication No. 2023-050629 (JP 2023-050629 A) discloses a notification system that notifies pedestrians or vehicles other than an autonomous vehicle that is going to pass through a predetermined traffic area of whether the pedestrians or the vehicles can proceed, or alerts the pedestrians or the vehicles, according to the behavior of the autonomous vehicle.
Improvement is desired in technique related to a roadside device that can be used to monitor a vehicle with a communication function.
In view of such circumstances, an object of the present disclosure is to improve a technique related to a roadside device that can be used to monitor a vehicle with a communication function.
A roadside device according to an embodiment of the present disclosure includes: a notification unit; and a control unit.
The control unit is configured to determine an operating state of the roadside device, and perform a notification process for notifying a notification target person according to the determined operating state.
According to the embodiment of the present disclosure, the technique related to a roadside device that can be used to monitor a vehicle with a communication function can be improved.
Features, advantages, and technical and industrial significance of exemplary embodiments of the disclosure will be described below with reference to the accompanying drawings, in which like signs denote like elements, and wherein:
Hereinafter, an embodiment of the present disclosure will be described with reference to the accompanying drawings.
Vehicles 10 include gasoline-powered vehicles, battery electric vehicle (BEV; Battery Electric Vehicle), hybrid electric vehicle (HEV; Hybrid Electric Vehicle), plug-in hybrid electric vehicle (PHEV; Plug-in Hybrid Electric Vehicle), and fuel cell electric vehicle (FCEV; Fuel Cell Electric Vehicle). The vehicle 10 is not limited thereto. Vehicle 10 may include any other vehicle capable of being ridden by a human.
The vehicle 10 may include an autonomous vehicle capable of autonomous driving, for example, the levels 1 to 5 defined in Society of Automotive Engineers (SAE). For example, the vehicle 10 is capable of autonomous driving at level 3 or 4, and the driver can override the driving operation while the driver is riding the vehicle 10 or remotely. The information processing system 1 may include any number of vehicles 10, namely may include one or more vehicles 10.
The roadside device 20 is installed, for example, in the vicinity of an intersection or a crosswalk. The roadside device 20 can detect a pedestrian who intends to cross a roadway based on an image of a camera mounted on the roadside device 20 itself. In the roadside device 20, for example, a detection area is set in advance around the own device. When the roadside device 20 detects a pedestrian who intends to cross the roadway, it notifies the pedestrian of the presence or absence of the vehicle 10 (for example, the vehicle 10 approaching the own vehicle) that has entered the detection area of the own vehicle. When the roadside device 20 detects a pedestrian attempting to cross a roadway, it notifies the driver or the driver assistant of the vehicle 10 that has entered the detection area of the own vehicle of the presence of the pedestrian. The information processing system 1 may include any number of roadside devices 20, namely may include one or more roadside devices 20.
The information processing device 30 includes any general-purpose electronic device such as a Personal Computer (PC), a tablet PC, a smart phone, and a smart watch, which is used by a notification target person to be described later. Without being limited thereto, the information processing device 30 may include one server device or a plurality of server devices that can communicate with each other, or may include other electronic devices dedicated to the information processing system 1. The information processing system 1 may include any number of information processing devices 30, namely one or more information processing devices 30.
The communication unit 11 includes one or more communication interfaces connected to the network 40. The communication interfaces correspond to mobile communication standards such as 4G (4th Generation) and 5G (5th Generation) or radio Local Area Network (LAN). The communication interface is not limited thereto. The communication interface may correspond to any other communication standard.
The sensor unit 12 includes one or more sensors used to control the vehicle 10. The sensors include position sensors, geomagnetic sensors, velocity sensors, accelerometers, gyroscopic sensors, and the like corresponding to, for example, Global Positioning System (GPS). The sensor is not limited thereto. The sensor may include any other sensor.
The storage unit 13 includes one or more memories. In the present disclosure, the “memory” is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited thereto. Each memory included in the storage unit 13 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 13 stores arbitrary information which is used for operation of the vehicle 10. For example, the storage unit 13 may store a system program, an application program, embedded software, and the like. For example, information stored in the storage unit 13 may be updated with information which is acquired from the network 40 via the communication unit 11.
The output unit 14 includes one or more output devices that output information to an occupant, including a driver or a driver assistant, in the vehicle cabin of the vehicle 10. The output device includes a display that visually outputs information in an image, a speaker that audibly outputs information in a sound, and a vibrator that vibrates and tactilely outputs information. As used herein, “display” includes, for example, Liquid Crystal Display (LCD) and organic Electro Luminescent (EL) displays, and the like. The output device may constitute a part of a car navigation device.
The control unit 15 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. A “processor” as used herein is a general-purpose processor, such as, for example, Central Processing Unit (CPU) or Graphics Processing Unit (GPU), or a special-purpose processor specialized for a particular process. The processor is not limited thereto. “Programmable circuitry” is for example, but not limited to, Field-Programmable Gate Array (FPGA). “Dedicated circuitry” is for example, but not limited to, Application-Specific Integrated Circuit (ASIC). The control unit 15 is communicably connected to the respective constituent units constituting the vehicle 10, and controls the overall operation of the vehicle 10.
The communication unit 21 includes one or more communication interfaces connected to the network 40. The communication interface corresponds to, for example, a mobile communication standard or a radio LAN standard, but is not limited thereto, and may correspond to any other communication standard.
The imaging unit 22 includes one or more cameras capable of photographing scenery around the roadside device 20. The roadside device 20 may be installed in the vicinity of the boundary between the sidewalk and the roadway so that, for example, a pedestrian moving from the sidewalk toward the roadway can be photographed by the imaging unit 22.
The notification unit 23 includes one or more notification devices that output information to notify a nearby pedestrian or the like. The notification device includes an electronic bulletin board that visually outputs information in an image, a lamp, a display, a speaker that audibly outputs information in a sound, a vibrator that vibrates and tactilely outputs information, and the like. The notification unit 23 is not limited thereto, and may include any other notification device.
The storage unit 24 includes one or more memories. Each memory included in the storage unit 24 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 24 stores arbitrary information used for the operation of the roadside device 20. For example, the storage unit 24 may store a system program, an application program, embedded software, and the like. The information stored in the storage unit 24 may be updatable with, e.g., information that is acquired from the network 40 via the communication unit 21.
The control unit 25 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The control unit 25 is communicably connected to the constituent units constituting the roadside device 20, and controls the overall operation of the roadside device 20.
The communication unit 31 includes one or more communication interfaces connected to the network 40. The communication interfaces correspond to, for example, a mobile communication standard, a wired LAN standard, or a radio LAN standard, but are not limited thereto, and may correspond to any other communication standard.
The output unit 32 includes one or more output devices that output information and provide the information to a user of the information processing device 30. The output device includes a display that visually outputs information in an image, a speaker that audibly outputs information in a sound, and a vibrator that vibrates and tactilely outputs information. The output unit 32 is not limited thereto, and may include any other output device.
The input unit 33 includes one or more input devices that detect a user input and acquire input information based on an operation of the user. The input device includes a physical key, a capacitive key, a pointing device such as a mouse, a touch screen integrally provided with a display of the output unit 32, an imaging module such as a camera, and a microphone that receives an audio input. The input unit 33 is not limited thereto, and may include any other input device.
The storage unit 34 includes one or more memories. Each memory included in the storage unit 34 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 34 stores arbitrary information used for the operation of the information processing device 30. For example, the storage unit 34 may store a system program, an application program, embedded software, and the like. The information stored in the storage unit 34 may be updatable with information received from the network 40 via the communication unit 31, for example.
The control unit 35 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The control unit 35 is communicably connected to the constituent units constituting the information processing device 30, and controls the overall operation of the information processing device 30.
In S100, the control unit 25 of the roadside device 20 determines the operating state of the roadside device 20. In the present disclosure, the operating state includes at least one of the following states: a stopped state, a restarting state, a running state, a battery state, a communication state, a state of a component, and a placement state. The “state of the component” includes either or both of a first state in which the component is in failure and a second state in which the component is likely to fall into the first state. The “component” includes, for example, a battery, a camera included in the imaging unit 22, a display, a speaker, a vibrator, and the like included in the notification unit 23. The control unit 25 of the roadside device 20 may determine the first state or the second state based on any conventional technique.
The control unit 25 of the roadside device 20 performs a notification process for notifying the notification target person according to the operating state determined in S100. In the present disclosure, the “notification target person” includes at least one of the following: a pedestrian around the roadside device 20, a driver and a driver assistant of the vehicle 10 traveling in the detection area of the roadside device 20, and an operator of the control center. In the present disclosure, the notification target person may also be a user of the information processing device 30. The “notification process” includes a process for notifying the notification target person of the operating state or prompting the notification target person to take necessary measures to the roadside device 20 according to the operating state. The “process” includes at least one of the following processes: a first output process, a second output process, a first communication process, and a second communication process. In the first output process, visual information is output from the notification unit 23 itself. The second output process outputs auditory information from the notification unit 23 itself. In the first communication process, the communication unit 21 is used to output either or both of the visual information and the auditory information from the information processing device 30 of the notification target person, and in the second communication process, the communication unit 21 is used to output either or both of the visual information and the auditory information from the vehicle 10.
In S101, for example, the control unit 25 of the roadside device 20 performs the first output process to the notification target person by the notification unit 23 in accordance with the operating state determined in S100.
In S102, for example, the control unit 25 of the roadside device 20 causes the notification unit 23 to execute the second output process for the notification target person according to the operating state determined in S100.
In S103, for example, the control unit 25 of the roadside device 20 performs the first communication process by the communication unit 21 in order to cause the notification target person to output either or both of the visual information and the auditory information from the information processing device 30 according to the operating state determined in S100.
In S104, the control unit 35 of the information processing device 30 outputs either or both of the visual information and the auditory information from the output unit 32 to the user of the information processing device 30 as the notification target person based on the information received from the roadside device 20 via the communication unit 31 in S103.
In S105, for example, the control unit 25 of the roadside device 20 performs the second communication process by the communication unit 21 in accordance with the operating state determined in S100. Thus, the control unit 25 causes the driver or the driver assistant of the vehicle 10 included in the notification target person to output either or both of the visual information and the auditory information from the vehicle 10.
In S106, the control unit 15 of the vehicle 10 outputs either or both of the visual information and the auditory information from the output unit 14 to the driver or the driver assistant as the notification target person, based on the information received from the roadside device 20 via the communication unit 11 in S105.
For example, consider a case where the operating state is a stopped state, a restarting state, or a running state. The control unit 25 of the roadside device 20 may execute the first output process by turning on or blinking the lamp 231 included in the notification unit 23 so that the pedestrian around the roadside device 20 can visually recognize the light. For example, the control unit 25 may turn on the lamp 231 when the roadside device 20 is in the running state. Similarly, the control unit 25 may perform the first output process by displaying text on the electric bulletin board 232 included in the notification unit 23 or displaying an image on a display. For example, the control unit 25 may execute a display process such as “system restart” when the roadside device 20 is in the restarting state.
In addition, the control unit 25 of the roadside device 20 may perform the second output process by outputting sound from the speaker 233 included in the notification unit 23 so as to be audible to a pedestrian around the roadside device 20. For example, the control unit 25 may execute an audio output process such as “restart the system” when the roadside device 20 is in the restarting state.
The control unit 25 of the roadside device 20 may execute the first communication process using the communication unit 21 for causing the information processing device 30 used by the notification target person to execute the same process as the first output process and the second output process using the notification unit 23 of the roadside device 20. For example, the control unit 25 may execute the first communication process in order to notify the notification target person of the operating state of the roadside device 20 by the output unit 32 of the information processing device 30.
The control unit 25 of the roadside device 20 may execute a second communication process using the communication unit 21 for causing the vehicle 10 on which the driver or the driver assistant is riding to execute a process similar to the first output process and the second output process using the notification unit 23 of the roadside device 20. For example, the control unit 25 may execute the second communication process in order to notify the driver or the driver assistant of the operating state of the roadside device 20 by the output unit 14 of the vehicle 10.
The same applies when the operating state is the battery state. The control unit 25 of the roadside device 20 may notify the notification target person of the fact that the remaining amount of the battery has fallen below the threshold value, the remaining amount of the battery at that time, and the like by the first output process, the second output process, the first communication process, the second communication process, and the like. In addition, the control unit 25 may notify the notification target person such as “Replace the battery”, and prompt the notification target person to take necessary measures to the roadside device 20 according to the operating state of the roadside device 20.
The same applies when the operating state is the communication state. The control unit 25 of the roadside device 20 may notify the notification target person of the occurrence of a communication failure or the like by the first output process, the second output process, the first communication process, the second communication process, or the like. In addition, the control unit 25 may notify the notification target person such as “Please recover the communication failure”, and prompt the notification target person to take necessary measures to the roadside device 20 according to the operating state of the roadside device 20.
The same applies to the case where the operating state is the operating state of the component. The control unit 25 of the roadside device 20 may notify the notification target person by the first output process, the second output process, the first communication process, the second communication process, and the like that the component has failed and that there is a high possibility that the component fails and the component cannot operate normally. For example, the control unit 25 may determine that the camera of the imaging unit 22 has failed when the feature point with respect to the reference image is completely different or the image is dark. In addition, the control unit 25 may notify the notification target person such as “Replace the part”, and prompt the notification target person to take necessary measures to the roadside device 20 according to the operating state of the roadside device 20.
The same applies to the case where the operating state is the placement state of the roadside device 20. The control unit 25 of the roadside device 20 may notify the notification target person by the first output process, the second output process, the first communication process, the second communication process, and the like that the arrangement of the roadside device 20 is deviated from the reference arrangement within the threshold. For example, the control unit 25 may determine a deviation of the arrangement of the roadside device 20 itself from image information or the like from the camera of the imaging unit 22. For example, the control unit 25 may determine the displacement of the roadside device 20 based on GPS from the sensor built in the roadside device 20.
In addition, the control unit 25 may notify the notification target person such as “return to the reference arrangement”, and prompt the notification target person to take necessary measures to the roadside device 20 according to the operating state of the roadside device 20. In addition, the control unit 25 may notify the notification target person such as “the disposition of the roadside device 20 is deviated beyond the threshold value, and the correction work to the reference disposition by the administrator of the roadside device 20 is necessary”. Accordingly, the control unit 25 prompts the notification target person to take necessary measures to the roadside device 20 in accordance with the operating state of the roadside device 20.
The control unit 25 of the roadside device 20 may determine the presence or absence of the pedestrian and the vehicle 10 in the vicinity of the roadside device 20 based on an image from the camera of the imaging unit 22. When determining that neither the pedestrian nor the vehicle 10 is present around the roadside device 20, the control unit 25 may not execute the notification process. The control unit 25 may execute the notification processing only when the pedestrian, the vehicle 10, and the like are detected by the image recognition based on the image from the camera of the imaging unit 22.
According to the roadside device 20 according to the embodiment as described above, the technology related to the roadside device 20 that can be used for monitoring the vehicle 10 having the communication function is improved. The roadside device 20 can determine the operating state of the roadside device 20 itself and execute appropriate notification processing according to the operating state. The roadside device 20 can also appropriately determine the specific method of the notification process and the notification target person according to the operating state of the roadside device 20. The notification target person who has received the notification based on the notification process related to the operating state of the roadside device 20 can accurately determine the operating state of the roadside device 20 or take necessary measures to the roadside device 20 according to the operating state.
Although the present disclosure has been described above based on the drawings and the embodiment, it should be noted that those skilled in the art can make various modifications and alterations thereto based on the present disclosure. It should be noted, therefore, that these modifications and alterations are within the scope of the present disclosure. For example, the functions, etc. included in the configurations, steps, or the like can be rearranged so as not to be logically inconsistent, and a plurality of configurations, steps, or the like can be combined into one or divided.
For example, a general-purpose electronic device such as a smartphone or a computer can be configured to function as the roadside device 20 according to the above-described embodiment. Specifically, a program describing processing contents for realizing each function of the roadside device 20 and the like according to an embodiment is stored in a memory of an electronic device, and the program is read and executed by a processor of the electronic device. Accordingly, the present disclosure can also be implemented as a program that can be executed by a processor.
Alternatively, the present disclosure may also be implemented as a non-transitory computer-readable medium storing a program executable by one or more processors to cause the roadside device 20 or the like according to an embodiment to execute each function. It should be understood that the above configurations are also included in the scope of the present disclosure.
For example, at least part of the processing operations performed in the roadside device 20 in the above embodiment may be performed in either or both of the vehicle 10 and the information processing device 30. At least part of the processing operations performed in each of the vehicle 10 and the information processing device 30 may be performed in the roadside device 20.
In the above-described embodiment, the roadside device 20 may be used to provide Mobility as a Service (MaaS), which is a service that uses mobility. The above process sequence illustrated in the sequence diagram illustrated in
Number | Date | Country | Kind |
---|---|---|---|
2023-223079 | Dec 2023 | JP | national |