Patent Application
20240127637
The present disclosure relates to a data processing method executed by an in-vehicle device unit and a communication system.
According to a comparative technology, an in-vehicle device is mounted on a vehicle and collects vehicle-related data from inside the vehicle and uploads the data to a predetermined server.
By a data processing method or a communication system, input data is acquired, first processing that is processing of reducing a data amount of the input data is performed, second processing of converting data obtained by the first processing into data having a preset format configured to be handled by an in-vehicle device unit is performed, third processing of converting data obtained by the second processing into normalization data configured to be handled by a cloud server is performed, and vehicle data is provided to the cloud server.
However, as a result of detailed study by the inventor, it has been found that data uploaded from the in-vehicle device to the server is estimated to be raw data of which meaning is not understand itself, and therefore a process for causing the server to understand the meaning of the raw data is required, so that a processing load of the server becomes large.
One example embodiment of the present disclosure is to reduce the processing load of the server in a technology for collecting data of a vehicle. Further, a function or performance of an in-vehicle device can be expanded with a low development load.
One example embodiment of the present disclosure is a data processing method executed by an in-vehicle device unit including an in-vehicle device mounted on a vehicle and a plurality of expansion units that is connectable to and disconnectable from the in-vehicle device.
The data processing method includes: acquiring input data from a provider device that is a provider of the input data; performing first processing that is processing of reducing a data amount of the input data; and performing second processing of converting data obtained by the first processing into data having a preset format configured to be handled by the in-vehicle device unit.
The data processing method further includes: performing third processing of converting data obtained by the second processing into normalization data configured to be handled by the cloud server; and providing vehicle data to the cloud server based on data obtained by the third processing.
According to such a method, it is possible to provide, to the server, the data converted in data that can be understood or handled after the first to third processing. Accordingly, as compared with a case where the server performs the first to third processing, it is possible to reduce the server processing load. Further, since the expansion unit is provided, it is possible to add a new function to the in-vehicle device only by connecting the expansion unit to the in-vehicle device.
Hereinafter, embodiments of the present disclosure will be described with reference to drawings.
(1-1. Relationship between Configuration of Embodiment and Configuration of Present Disclosure)
In an embodiment, a mobility IoT system 1 corresponds to a communication system of the present disclosure. Further, a data collection device 2 corresponds to an in-vehicle device unit of the present disclosure. In the embodiment, a main body 2A corresponds to an in-vehicle device of the present disclosure. Further, in the embodiment, a different (other) ECU, a radar 165, cameras 166 and 185, microphones 167 and 187, an acceleration sensor 168, a display 175, a GPS 186, a touch panel 188, a speaker 189, antennas 195A to 195C correspond to a provider device of the present disclosure.
Further, in the embodiment, an input I/F 155A corresponds to an acquisition unit of the present disclosure. In the embodiment, filtering units 20B and 156B correspond to a processing unit of the present disclosure. Further, standardization units 20C and 156C correspond to a second processing unit of the present disclosure. In the embodiment, a normalization unit 20D corresponds to a third processing unit of the present disclosure. Further, in the communication unit 13 corresponds to a provision unit of the present disclosure.
Further, among functions implemented by the data collection device 2, functions of the filtering units 20B and 156B corresponds to first processing of the present disclosure. Functions of the standardization units 20C and 156C corresponds to second processing of the present disclosure. Functions of the normalization unit 20D corresponds to third processing of the present disclosure. Functions of the structurization unit 20E corresponds to fourth processing of the present disclosure. Further, functions of determination unit 20A and 156A corresponds to a capability of the in-vehicle device of the present disclosure. Further, a communication unit 213 corresponds to a relay unit of the present disclosure.
Embodiments of the present disclosure will be described below with reference to drawings.
As shown in
The data collection device 2 is mounted on a vehicle and has a function of performing data communication with the management center 3 via a wide area wireless communication network NW.
The management center 3 is a device that manages the mobility IoT system 1. The management center 3 has a function of performing data communication with the multiple data collection devices 2 and the service provision server 4 via the wide area wireless communication network NW.
The service provision server 4 is, for example, a server installed to provide a service for managing the operation of a vehicle. The mobility IoT system 1 may include multiple service providing servers with mutually different service contents.
As shown in
As shown in
The microcomputer 11 includes a first core 21, a second core 22, a ROM 23, a RAM 24, a flash memory 25, an input/output unit 26, and a bus 27.
Various functions of the microcomputer 11 are implemented by the first core 21 and the second core 22 executing programs stored in a non-transient physical recording medium. In this example, the ROM 23 corresponds to the non-transient physical recording medium that stores a program. Further, a method corresponding to the program is performed by executing the program. Some or all of the functions executed by the first core 21 and the second core 22 may be configured in hardware using one or more ICs or the like.
The flash memory 25 is a rewritable nonvolatile memory. The flash memory 25 includes a standardization vehicle data storage 25A that stores standardized vehicle data to be described later.
The input/output unit 26 is a circuit for inputting/outputting data between the outside of the microcomputer 11 and the first core 21 and second core 22.
The bus 27 connects the first core 21, the second core 22, the ROM 23, the RAM 24, the flash memory 25, and the input/output unit 26 to each other so that data can be input and output.
The communication unit 13 performs data communication with the management center 3 via the wide area wireless communication network NW.
The storage unit 14 is a storage device for storing various data.
The vehicle I/F 12 is an input/output circuit for inputting and outputting signals between an electronic control device, a sensor, and the like mounted on the vehicle. The vehicle I/F 12 includes a power supply voltage input port, a general-purpose input/output port, a CAN communication port, an Ethernet communication port, and the like. The CAN communication port is a port for transmitting and receiving data according to the CAN communication protocol. The Ethernet communication port is a port for transmitting and receiving data based on an Ethernet communication protocol. CAN is an abbreviation for Controller Area Network. CAN is a registered trademark. Ethernet is a registered trademark.
The expansion unit 2B is connected to the CAN communication port and the Ethernet communication port as described later, and other electronic control devices mounted on the vehicle are connected via the expansion unit 2B. Accordingly, the main body 2A of the data collection device 2 can transmit and receive communication frames with other electronic control devices.
As shown in
The expansion unit 2B has a function of expanding or enhancing the functions and performance of the main body 2A. For example, the expansion unit 2B has a function that the main body 2A does not have, or a function of increasing the speed by freeing up the resources of the main body 2A by taking on a part of the processing performed in the main body 2A.
The expansion unit 2B is electrically disposed between the vehicle I/F 12 and a vehicle side instrument 2C. The vehicle I/F 12 can acquire data from the vehicle side instrument 2C via the expansion unit 2B, and in particular can collect data to be transmitted to the management center 3 via the expansion unit 2B. Further, the vehicle I/F 12 can transmit data to the vehicle side instrument 2C via the expansion unit 2B.
Specifically, as shown in
The vehicle expansion unit 150 includes the in-vehicle device side connectors 150A and 150B and the device side connectors 150C to 150H. The in-vehicle device side connectors 150A and 150B are connectors connected to the main body 2A, and the device side connectors 150C to 150H are connectors connected to the vehicle side instrument 2C. The vehicle expansion unit 150 communicates with other electronic control devices disposed in the vehicle via the device side connectors 150C to 150H, and inputs data obtained from the vehicle side instrument 2C located inside the vehicle. That is, the vehicle expansion unit 150 takes vehicle data for controlling the vehicle as input data.
Further, the vehicle expansion unit 150 has a function of transmitting and receiving data to and from the main body 2A via the in-vehicle device side connectors 150A and 150B. The in-vehicle device side connector 150A is a connector compatible with the Ethernet communication protocol, and is configured to be connectable with the vehicle I/F 12 side connector 125A. The in-vehicle device side connector 150B is a connector compatible with CAN, GPIO, and UART communication protocols, and is configured to be connectable to the vehicle I/F 12 side connector 125B.
GPIO means a general-purpose 10 port and is an abbreviation for General Purpose Input/Output. Further, UART is an abbreviation for Universal Asynchronous Receiver/Transmitter.
The device side connector 150C is a connector compatible with the UART communication protocol. The device side connector 150D is a connector compatible with the Ethernet communication protocol. The device side connector 150E is a connector compatible with the GPIO communication protocol. The device side connector 150F is a connector compatible with the CAN communication protocol. The device side connector 150G is a connector compatible with the CAN FD communication protocol. The device side connector 150H is a connector compatible with the LIN communication protocol. These device side connectors 150C to 150H may be housed in one connector case.
CAN FD is an abbreviation for CAN with Flexible Data Rate. Further, LIN is an abbreviation for Local Interconnect Network.
The sensor expansion unit 160 includes an in-vehicle device side connector 160A and device side connectors 160B to 160E. The sensor expansion unit 160 is connected to the vehicle I/F 12 via the in-vehicle device side connector 160A. The sensor expansion unit 160 is connected to a radar 165, a camera 166, a microphone 167, and an acceleration sensor 168 via the device side connectors 160B to 160E. The device side connector 160A is a connector compatible with communication protocols such as UART, Ethernet, and USB. The sensor expansion unit 160 takes sensing data for detecting an object or event as input data.
The in-vehicle device side connector 160A of the sensor expansion unit 160 is a connector compatible with UART and Ethernet communication protocols, and is configured to be connectable with the vehicle I/F 12 side connector 125C.
The sensor expansion unit 160 acquires data obtained from the radar 165, the camera 166, the microphone 167, and the acceleration sensor 168 via the device side connectors 160B to 160E, and performs predetermined processing. The processed data is then transmitted to the vehicle I/F 12 via the in-vehicle device side connectors 150A and 150B.
The display expansion unit 170 includes an in-vehicle device side connector 170A and a device side connector 170B. The display expansion unit 170 is connected to the vehicle I/F 12 via the in-vehicle device side connector 170A. The display expansion unit 170 is connected to a display 175 via the device side connector 170B. The display expansion unit 170 takes display data such as video as input data.
The in-vehicle device side connector 170A is compatible with, for example, LVDS format video data, and the device side connector 170B is compatible with, for example, HDMI format video data. HDMI is a registered trademark. The display expansion unit 170 converts the format of video data sent from the vehicle I/F 12 and outputs the data to display 175. In other words, the expansion unit 2B may have a function of converting data or a function of converting a communication protocol, like the display expansion unit 170.
The USB expansion unit 180 includes an in-vehicle device side connector 180A and device side connectors 180B to 180F. The USB expansion unit 180 is connected to the vehicle I/F 12 via the in-vehicle device side connector 180A. The USB expansion unit 180 is connected to a camera 185, a GPS antenna 186, a microphone 187, a touch panel 188, and a speaker 189 via the device side connectors 180B to 180F. The USB expansion unit 180 takes USB standard data as input data.
The in-vehicle device side connector 180A of the USB expansion unit 180 is a connector compatible with the communication protocol of the USB standard, and is configured to be connectable with a connector 125E or 125F on the vehicle I/F 12 side. In the example of
Other expansion units having a USB standard connector can be connected to the connector 125E.
The USB expansion unit 180 acquires data obtained from the camera 185, the GPS antenna 186, the microphone 187, the touch panel 188, and the speaker 189 via the device side connectors 180B to 180F, and performs predetermined processing. The processed data is then transmitted to the vehicle I/F 12 via the vehicle side device in-vehicle device side connector 180A.
The network expansion unit 190 includes the in-vehicle device side connector 190A, a Bluetooth antenna 195A, a WiFi antenna 195B, and a cellular antenna 195C. Bluetooth and WiFi are registered trademarks. The in-vehicle device side connector 190A is a connector compatible with peripheral component interconnect express (PCI Express), USB, and UART communication protocols. Multiple output lines included in the in-vehicle device side connector 190A may be provided so as to correspond to data received from each of the antennas 195A, 195B, and 195C. Further, one output line may be provided for outputting data received from each of the antennas 195A, 195B, and 195C.
The network expansion unit 190 is configured to communicate with a predetermined server or the like located outside the vehicle, and uses data obtained from a communication instrument outside the vehicle as input data. The network expansion unit 190 performs predetermined processing on input data, and transmits the processed data to the vehicle I/F 12 via the in-vehicle device side connector 190A.
The management center 3 includes a controller 31, a communication unit 32, and a storage unit 33, as shown in
The controller 31 is an electronic control device mainly composed of a microcomputer including a CPU 41, a ROM 42, a RAM 43, and the like. Various functions of the microcomputer are implemented by the CPU 41 executing programs stored in a non-transient physical recording medium. In this example, the ROM 42 corresponds to the non-transient physical storage medium in which the programs are stored. Further, a method corresponding to the program is performed by executing the program. Some or all of the functions executed by the CPU 41 may be configured in hardware using one or more ICs. Further, the number of the microcomputers constituting the controller 31 may be one or more.
The communication unit 32 performs data communication with the multiple data collection devices 2 and the service provision server 4 via the wide area wireless communication network NW.
The storage unit 33 is a storage device for storing various data.
The main body 2A of the data collection device 2 includes a first unit 101 as a functional block implemented by the first core 21 executing a program stored in the ROM 23, as shown in
The first unit 101 includes a real-time operating system (hereinafter, referred to as RTOS) 103 and a first application 104.
The first application 104 executes various kinds of processing for controlling the vehicle. The first application 104 is configured to access the standardization vehicle data storage 25A of the flash memory 25 and refer to the standardized vehicle data in order to execute various kinds of processing for controlling the vehicle.
The RTOS 103 manages the first application 104 so that real-time processing by the first application 104 can be ensured. The second unit 102 includes a general purpose operating system (hereinafter, referred to as GPOS) 105 and a second application 106.
The second application 106 executes processing related to the service provided by the service provision server 4. The second application 106 is configured to access the standardization vehicle data storage 25A of the flash memory 25 and refer to the standardized vehicle data in order to execute service-related processing.
The GPOS 105 is basic software installed in the data collection device 2 to operate various applications, and manages the second application 106.
The management center 3 includes a vehicle side unit 110 and a service side unit 120 as functional blocks implemented by the CPU 41 executing a program stored in the ROM 42, as shown in
The method of realizing these elements constituting the management center 3 is not limited to software, and some or all of the elements may be implemented by using one or multiple pieces of hardware. For example, when the above function is implemented by an electronic circuit that is hardware, the electronic circuit may be implemented by a digital circuit including a large number of logic circuits, an analog circuit, or a combination thereof.
The vehicle side unit 110 manages access to the vehicle and data received from the vehicle. The vehicle side unit 110 includes a mobility gateway (hereinafter, referred to as mobility GW) 111. The mobility GW 111 has a function of relaying a request for access to a vehicle to the vehicle, as well as a function of managing data received from the vehicle.
The mobility GW 111 includes a shadow storage unit 112 and a vehicle controller 113. The shadow storage unit 112 stores a shadow 114 that stores data for each vehicle on which the data collection device 2 is mounted. The shadow 114 shows a group of vehicle data for a certain vehicle. The vehicle controller 113 has a function of controlling a vehicle on which the data collection device 2 is mounted, based on instructions from the service provision server 4.
The service side unit 120 receives requests from the service providing server and provides vehicle data. The service side unit 120 includes a data management unit 121 and an access API 122. API is an abbreviation for Application Programming Interface.
The data management unit 121 has a function of managing a digital twin 123, which is a virtual space for providing vehicle access independent of changes in the connection state of the vehicle. The data management unit 121 manages data required for accessing vehicle data managed by the vehicle side unit 110. The access API 122 is a standard interface for the service provision server 4 to access the mobility GW 111 and the data management unit 121. The access API 122 provides the service provision server 4 with an API for accessing the vehicle and acquiring vehicle data.
Next, the processing executed by the main body 2A and the expansion unit 2B will be described. Regarding the expansion unit 2B, the vehicle expansion unit 150 will be described as a representative of the expansion unit 2B. Since the other expansion units 160 to 190 have generally similar configurations and functions, only the differences will be described.
The vehicle expansion unit 150, as shown in
The functions executed by the CPU 153 include an input I/F 155A, an output I/F 155B, a determination unit 156A, a filtering unit 156B, and a standardization unit 156C.
The vehicle expansion unit 150 includes multiple input lines 152C to 152H, multiple output lines 151A to 151F, and at least one of the connectors 150A to 190A.
The input lines 152C to 152H are provided for each communication protocol of data to be handled, and data is input thereto. In the present embodiment, even when multiple wirings are required for one communication protocol, the multiple f wirings will be referred to as one input line. The same applies to the output lines.
Here, the input lines 152C to 152H are wirings connected to the device side connectors 150C to 150H. In particular, the input line 152C is a wiring compatible with UART. Further, the input line 152D is a wiring compatible with Ethernet. Further, the input line 152E is a wiring compatible with GPIO. Further, the input line 152F is a wiring compatible with CAN. Further, the input line 152G is a wiring compatible with CAN FD. Further, the input line 152H is a wiring compatible with LIN.
The output lines 151A to 151F are configured as a power line or communication line provided for each communication protocol of output data. Data is output from the communication line. Here, the output line 151A is a wiring connected to the connector 150A. In particular, the input line 152D is a wiring compatible with Ethernet, and is connected to the vehicle I/F 12 through the connector 150A. Here, the input data on the input line 152D is output to the output line 151A without being processed by the vehicle expansion unit 150.
The output lines 151B to 151F are wirings that are connected together to the in-vehicle device side connector 150B. The output line 151B is a wiring for battery power supply. The output line 151C is a wiring for ignition power supply. The output line 151D is a communication line for communicating with CAN. The output line 151E is a communication line for communicating with GPIO. The output line 151F is a communication line for communicating with UART. The in-vehicle device side connector 150B may be provided for each of the output lines 151A to 151F. Further, any one of the output lines 151B to 151F may be unconnected.
Here, in the example shown in
Here, for example, when different types of image data such as JPEG and GIF are input to the expansion unit 2B such as the vehicle expansion unit 150, two input lines may be disposed for each protocol or data type, for example, one for JPEG and one for GIF. Even data using the same communication protocol does not need to be transmitted over one communication line. For example, the input lines may be separated for each type of data, and for example, two lines may be disposed, one USB connection line for JPEG and one USB connection line for GIF. On the other hand, when the expansion unit 2B performs image recognition on JPEG and GIF image data and forms the data into a standard format for target object information, since the data to be output is only target object information, the number of output lines can be one. In other words, the number of output lines is smaller than the number of input lines for the same type of input data. Here, the communication protocol used with this one output line is arbitrary.
Data input from one or multiple input lines using different communication protocols may be output from one output line. For example, if there are a CAN input line and a CAN FD input line, data received through the CAN FD input line may be converted into a CAN format and output from a CAN output line. In this case, CAN input data and CAN FD input data can be output from the same CAN output line, and the number of output lines is smaller than the number of input lines.
On the other hand, when MPEG image data is input to the expansion unit 2B, only one input line for MPEG can be disposed. In the expansion unit 2B, this input line can be branched into two lines. One of the output lines can be used to output the MPEG image data itself from the output line. The other one output line can be used to perform image recognition in the expansion unit 2B and output the standard format of target object information. In other words, there are more output lines than input lines for the same type of input data.
Data input from one communication protocol may be branched and output from two output lines. For example, if there is a CAN input line, one of the output lines can be used to output the CAN input data itself. The other one output line can be used to normalize input data in the expansion unit 2B and output the normalized data.
The input I/F 155A acquires data input from the input lines 152C to 152H and stores the in the memory 154. The output I/F 155B provides the vehicle I/F 12 with the data that has been instructed to be output.
Here, as shown in
The determination unit 156A of the vehicle expansion unit 150, the filtering unit 156B, and standardization unit 156C are configured to perform predetermined processing on input data and output the output data based on the input data from the output lines 151A to 151F. The output data may be processed data by the filtering unit 156B or the like, or may be the input data itself.
Since the determination unit 20A, the filtering unit 20B, and the standardization unit 20C included in the main body 2A have the same functions as the determination unit 156A, the filtering unit 156B, and the standardization unit 156C included in the vehicle expansion unit 150, the functions will be collectively described below.
When data is received from the vehicle I/F 12 or the input I/F 155A, the determination units 20A and 156A recognize the communication protocol of the data based on the communication port that has received the data, that is, the connectors 150C to 150H. Specifically, when data is received through a CAN communication port (for example, input line 152F), the determination units 20A and 156A recognize that the communication protocol of the received data is CAN. Further, when data is received through an Ethernet communication port (for example, input line 152D), the determination units 20A and 156A recognize that the communication protocol of the received data is Ethernet.
In particular, the determination unit 156A of the vehicle expansion unit 150 determines the capabilities of the main body 2A, that is, the processing that the main body 2A can execute, based on the communication protocol, the types of the connectors 150A to 190A, and the like. This is to set whether the processing should be executed by the vehicle expansion unit 150 or the main body 2A depending on whether the main body 2A has sufficient capabilities.
When it is determined that the main body 2A has the preset capability, the determination unit 156A of the vehicle expansion unit 150 transfers the received data as it is to the output I/F 155B so as to transmit the data to the main body 2A, without performing thinning, protocol conversion, and the like on the data.
More specifically, the determination unit 156A of the vehicle expansion unit 150 determines what kind of processing is to be performed on the input data based on a filtering table 8 as shown in
As shown in
Further, the 11-bit identifier used in CAN communication is called CAN ID. The CAN ID is set in advance based on the content of data included in the CAN frame, the source of the CAN frame, the destination of the CAN frame, and the like.
The data field is composed of first data, second data, third data, fourth data, fifth data, sixth data, seventh data, and eighth data, each of 8 bits (that is, 1 byte). Hereinafter, each of the first to eighth data of the data field will also be referred to as CAN data.
For example, the expansion units 2B other than the vehicle expansion unit 150 process as follows. When data is received from a UART communication protocol, in other words, from a connector having a UART communication port, the sensor expansion unit 160 performs processing by the filtering unit 156B and the standardization unit 156C, which will be described later. However, when data is received from an Ethernet communication protocol, in other words, from a connector having an Ethernet communication port, sensor expansion unit 160 does not perform processing by the filtering unit 156B and the standardization unit 156C, which will be described later. In other words, data input from the Ethernet input line is output as it is from the output line. In addition, in the sensor expansion unit 160, even when data is received from the UART communication protocol, if the type of image is a preset type, processing by the filtering unit 156B and the standardization unit 156C, which will be described later, may be omitted. In other words, the configuration may be such that a specific type of image data input from the input line of the UART is output as it is from the output line.
Further, the display expansion unit 170 and the USB expansion unit 180 do not perform processing by the filtering unit 156B and the standardization unit 156C, which will be described later, regardless of the type of data handled. In other words, data input from the input line is output as it is from the output line.
Further, the network expansion unit 190 performs processing by the filtering unit 156B and the standardization unit 156C, which will be described later, regardless of the type of data handled.
Data for which it is determined that the processing by the filtering unit 156B and the standardization unit 156C is not performed is sent to the output I/F 155B.
Even when any expansion unit 2B is configured such that input data is output as it is from the output line, the input line and the output line are not directly connected. The input line and the output line are connected via the microcomputer provided in the expansion unit 2B, and when the input data is output as it is from the output line, the microcomputer outputs the data received from the input line to the output line without processing (changing) the data.
The determination unit 20A of the main body 2A recognizes what kind of processing should be performed in the expansion unit 2B depending on the type of data. For example, the determination unit 20A sets the filtering unit 20B and the standardization unit 20C of the main body 2A to perform processing on data that has not been processed by the filtering unit 156B and the standardization unit 156C of the expansion unit 2B. In other words, in the configuration of the present embodiment, each processing by the filtering units 20B and 156B, the standardization units 20C and 156C, a normalization unit 20D, and the structurization unit 20E is performed in either the main body 2A or the expansion unit 2B.
The filtering units 20B and 156B perform filtering on input data. Here, filtering in the present embodiment refers to processing input data so that the amount of data is further reduced.
Specifically, as shown in
When data is received by using the UART communication protocol, the filtering unit of the sensor expansion unit 160 (hereinafter, also referred to as sensor expansion unit 160) performs processing set depending on the type of data. When image data and video data are received, the sensor expansion unit 160 performs image recognition based on the input data, and extracts target object information as a recognition result. Specifically, for example, edges that are the boundaries of brightness on an image are extracted from binary data of only 0 and 1, and the shape and size of the edges determine whether the object in the image is a person, object, vehicle, sign, or the like. The sensor expansion unit 160 may only perform conversion to lower the resolution of the image, for example, conversion to reduce the number of pixels per frame.
When audio data is received, the sensor expansion unit 160 performs audio recognition based on the input data and extracts text data as a recognition result. The sensor expansion unit 160 may only perform conversion to lower the audio resolution, for example, the bit rate.
When sensing data is acquired from an obstacle sensor that detects obstacles around the vehicle, the sensor expansion unit 160 extracts the recognition result of the obstacle. The sensor expansion unit 160 recognizes at least the position of the obstacle (for example, the shape of the obstacle, the type of the obstacle, and the like) from the obstacle data. For example, when the obstacle sensor is the millimeter wave radar 165, sensing data (for example, raw data such as reflected waves) can be acquired and recognize a target object (for example, the coordinates of the object can be recognized).
The filtering unit 156B of the network expansion unit 190 (hereinafter, also referred to as the network expansion unit 190) acquires device data obtained from a short distance device such as a smartphone connected via wireless communication such as Bluetooth or WiFi. The network expansion unit 190 extracts only device data obtained from a preset device (for example, the vehicle owner's smartphone) from the obtained device data. That is, when there are multiple devices that can be paired with the vehicle, the network expansion unit 190 relays only data obtained from the preset device and discards data obtained from other devices.
The network expansion unit 190 acquires cloud data obtained from a cloud server via a short distance device or a cellular line, and extracts only cloud data obtained from a preset cloud server from the obtained data. That is, when there are multiple cloud servers that can communicate with the vehicle, the network expansion unit 190 relays only data obtained from the preset cloud server, and discards data obtained from other cloud servers. The cloud server may include the management center 3. In other words, the cloud server may be a server different from the management center 3.
The standardization units 20C and 156C perform standardization, which is processing of converting the data processed by the filtering units 20B and 156B into data in a preset format. Standardization is also called formatting.
The standardization units 20C and 156C convert data into a format that can be handled by the main body 2A. In the present embodiment, the data processed by the filtering units 20B and 156B is converted into a data format conforming to a CAN frame. A data format conforming to a CAN frame is, for example, data in the same order as the CAN frame, and represents data obtained by removing the header, footer, and the like from the CAN frame.
The standardized data includes, for example, an ID indicating data type, data length information, actual data (that is, payload), and an error correction code, and each data has a common format of data, that is, a common data format. For example, target object information that is a result of recognition is stored in the payload. When the standardization unit 156C of the expansion unit 2B such as the vehicle expansion unit 150 completes standardization, the output I/F 155B sends the standardized data to the vehicle I/F 12.
The output to the output line 151D may be converted to a data format conforming to the CAN frame, the output to the output line 151E may be converted to the GPIO format, and the output to the output line 151F may be converted to a data format conforming to the UART format.
The normalization unit 20D and the structurization unit 20E, which will be described below, are functions provided in the main body 2A. The normalization unit 20D generates normalized data by normalizing the standardized data by using normalization information. Then, the normalization unit 20D uses the normalized data to perform semanticization, which is processing of converting the normalized data into data whose meaning can be understood without comparing the data with other data.
The normalization unit 20D performs processing by using normalization information and semantic information. A vehicle data conversion table 23A shown in
As shown in
“ECU” is identification information indicating the ECU that is the source of the CAN frame. For example, “ENG” indicates an engine ECU.
“Position” is information indicating the position (for example, bit position) of CAN data within the data field. “DLC” is information indicating a data length. DLC is an abbreviation for Data Length Code. In other words, data corresponding to “DLC” bits is extracted from the “position” of the data field.
“Unique label” is information indicating a control label. For example, “ETHA” indicates an intake air temperature, and “NE1” indicates an engine rotation speed. “Resolution” is information indicating a numerical value per bit. “Offset” indicates the offset amount of the numerical value of the data. “Unit” indicates the unit of the data.
Therefore, data corresponding to the “unique label” is extracted from the standard format data by using “CAN ID”, “ECU”, “position”, “DLC”, and “unique label”. Further, the extracted data is converted into data expressed in “resolution”, “offset”, and “unit”.
Further, as shown in
The structurization unit 20E performs data structuring, which is processing of associating the semantic data with each hierarchical classification in advance. At this time, the structurization unit 20E arranges the semantic data in a hierarchy and stores the data in the flash memory 25. Specifically, the structurization unit 20E stores the converted data in the corresponding region of the standardization vehicle data storage 25A provided in the flash memory 25. As a result, the standardization vehicle data storage 25A stores standardized vehicle data configured by arranging the data in a hierarchy.
The standardized vehicle data is created for each vehicle (that is, for each data collection device 2) and has multiple hierarchical structures. In the standardized vehicle data, one or more items are set for each of multiple layers. For example, as shown in
Each piece of data also includes items such as “unique label”, “ECU”, “data type”, “data size”, “data value”, and “data unit”.
As shown in
For example, the first layer item “attribute information” includes second layer items such as “vehicle identification information”, “vehicle attribute”, “transmission configuration”, “firmware version”, and the like. “Vehicle identification information” is a category name indicating information that can uniquely identify a vehicle. “Vehicle attribute” is a category name indicating the type of vehicle. “Transmission information” is a category name indicating information regarding transmission. “Firmware version” is a category name indicating information regarding vehicle firmware.
Further, the first layer item “power train” is a category name indicating power train information, and the second layer items include “accelerator pedal”, “engine”, “engine oil”, and the like.
Further, the first layer item “energy” is a category name indicating energy information, and the second layer items include “battery status”, “battery configuration”, “fuel”, and the like.
Further, “vehicle identification information”, which is an item in the second layer, includes “vehicle identification number”, “vehicle body number”, and “license plate” as items in the third layer.
Further, “vehicle attribute”, which is an item in the second layer, includes “brand name”, “model”, “year of manufacture”, and the like as items in the third layer.
Further, the second layer item “transmission configuration” includes the third layer item “transmission type”.
For example, when the control label of the converted data is “vehicle identification information”, the second core 22 stores the converted data in a predetermined storage region. The predetermined storage region is, for example, a storage region where the first layer is “attribute information”, the second layer is “vehicle identification information”, and the third layer is “vehicle identification number” in the standardization vehicle data storage 25A.
Next, a procedure for the data collection device 2 to create standardized vehicle data will be described by using the sequence diagram shown in
When the expansion unit 2B acquires data from the vehicle, as indicated by the arrow L11, the determination unit 156A of the expansion unit 2B makes various determinations, as indicated by the arrow L12. The various determinations include processing of determining whether to perform filtering based on the filtering table 8. A determination is also made here when no processing is required, such as with a CAN frame.
When the expansion unit 2B refers to the filtering table 8 and determines to perform filtering on the data, the filtering unit 156B performs the predetermined filtering set in the filtering table 8, as indicated by the arrow L13. When it is determined not to perform filtering on the data, the expansion unit 2B omits the filtering.
Subsequently, the standardization unit 156C of the expansion unit 2B converts the data into a standard format, as indicated by the arrow L14, and the output I/F 155B outputs the converted data to the main body 2A, as indicated by the arrow L15.
When the vehicle I/F 12 of the main body 2A acquires the data converted into the standard format from the expansion unit 2B, the determination unit 20A makes various determinations of the acquired data, as indicated by the arrow L21. Subsequently, the normalization unit 20D of the main body 2A performs normalization as indicated by the arrow L24. Further, the structurization unit 20E of the main body 2A structures the converted data to create structured vehicle data, as indicated by the arrow L25.
Thereafter, the main body 2A transmits the structured vehicle data to the management center 3, as indicated by the arrow L31.
By the way, as a result of the determination at the arrow L12, if it is determined that the expansion unit 2B does not process the data, the filtering at the arrow L13 and the standard format conversion at the arrow L14 are omitted. In this case, as shown in
In this case, after the main body 2A makes various determinations as indicated by the arrow L21, the filtering unit 20B performs filtering as indicated by the arrow L22. Subsequently, the standardization unit 20C performs standard format conversion as indicated by the arrow L23. Subsequently, the normalization unit 20D performs normalization indicated by the arrow L24. Subsequently, the structurization unit 20E performs data structuring as indicated by the arrow L25.
The filtering performed by the main body 2A at the arrow L22 is the same processing as the filtering performed by the expansion unit 2B at the arrow L13. Further, the standard format conversion at the arrow L23 performed by the main body 2A is the same processing as the standard format conversion at the arrow L13 performed by the expansion unit 2B. Further, when it is determined that the expansion unit 2B should perform filtering on the data, the main body 2A omits the filtering.
As indicated by the broken line in
According to a first embodiment described in detail above, the following effects are achieved. [0155] (1a) One aspect of the present disclosure is an expansion unit 2B that is configured to be detachably attached to the main body 2A that can communicate with a cloud server via a communication device. The expansion unit 2B includes at least one of the input lines 152C to 152H, at least one of the output lines 151A to 151F, and at least one of the connectors 150A to 190A. Further, the expansion unit 2B includes the determination unit 156A, the filtering unit 156B, and the standardization unit 156C as processing units.
The input lines 152C to 152H are provided for each input data communication protocol, and input data is input thereto. The output lines 151A to 151F are provided for each communication protocol of output data, and output data is output therefrom. The connectors 150A to 190A are configured to connect the output lines 151A to 151F to the main body 2A. The processing unit is configured to perform processing on input data and output output data based on the input data from output lines 151A to 151F.
According to such configuration, the expansion unit 2B can process input data and send output data to the main body 2A via the connectors 150A to 190A. Therefore, new functions can be added to the main body 2A by simply connecting the expansion unit 2B to the main body 2A by using the connectors 150A to 190A.
Further, according to such a configuration, the expansion unit can absorb differences in the functions of the hardware of each vehicle. For example, when there are vehicles including a camera only and vehicles including a camera and a millimeter wave radar, the main body 2A can be configured to receive target object information. In this case, if the expansion unit 2B processes camera signals and millimeter wave signals and outputs target object information, the main body 2A can acquire and process only target object information, regardless of whether the vehicle includes a millimeter wave radar. In other words, the main body 2A can be made less susceptible to differences in equipment between vehicles.
Further, third processing is performed to convert the data after the second processing into data whose meaning can be understood without comparing the data with other data. Further, the data after the third processing is provided to the management center 3.
According to such a method, it is possible to provide the management center 3 with data that has been converted into data whose meaning can be understood through the first processing, second processing, and third processing. Therefore, compared to the case where the management center 3 performs the first to third processing, the processing load on the management center 3 can be reduced. Further, since the expansion unit 2B is provided, new functions can be added to the main body 2A simply by connecting the expansion unit 2B to the main body 2A.
According to such a method, since the expansion unit 2B performs the first processing and the second processing, reduces the amount of data, and then provides the data to the main body 2A, it is possible to reduce the processing load on the main body 2A.
When the unprocessed data is received, the main body 2A performs the first processing, the second processing, and the third processing, and provides the data after the third processing to the management center 3. Further, when the data after the second processing is received, the main body 2A performs the third processing and provides the data after the third processing to the management center 3.
According to such a method, it is possible to select which processing the expansion unit 2B will perform depending on the capability of the main body 2A.
According to such a method, the first processing can be omitted when there is no need to reduce the amount of data or when it is better not to reduce the amount of data.
According to such a method, the first processing can be omitted depending on the communication protocol. When the expansion unit 2B uses a predetermined communication protocol, it is possible to determine that the capability of the main body 2A is high.
According to such a method, the first processing can be omitted depending on the type of connectors 150A to 190A. The expansion unit 2B can determine the capability of the main body 2A depending on the type of the connectors 150A to 190A.
According to such a method, it is possible to omit the first processing depending on the type of image. Since there may be no need to reduce the amount of data depending on the type of image, it is possible to omit the processing.
According to such a method, the data after data structuring can be provided to the management center 3.
According to such a method, the data after data structuring can be repeatedly and periodically provided to the management center 3.
According to such a configuration, since the filtering unit 156B performs the first processing, the amount of data transmitted to the main body 2A can be reduced, and the processing load on the main body 2A can be reduced.
According to such a configuration, the capture data can be converted into an object recognition result and then output to the main body 2A. Therefore, the processing by the main body 2A can be reduced compared to the case where the main body 2A performs the processing.
According to such a configuration, the audio data can be converted into an audio recognition result and then output to the main body 2A. Therefore, the processing by the main body 2A can be reduced compared to the case where the main body 2A performs the processing.
According to such a configuration, the obstacle data can be converted into an obstacle recognition result and then output to the main body 2A. Therefore, the processing by the main body 2A can be reduced compared to the case where the main body 2A performs the processing.
According to such a configuration, device data obtained from a preset short distance device can be extracted and output to the main body 2A. Therefore, the communication amount of data transmitted to the main body 2A can be suppressed.
According to such a configuration, cloud data obtained from a preset cloud server can be extracted and output to the main body 2A. Therefore, the communication amount of data transmitted to the main body 2A can be suppressed.
According to such a configuration, a preset type of CAN data can be extracted and output to the main body 2A. Therefore, the communication amount of data transmitted to the main body 2A can be suppressed.
According to such a configuration, since the second processing is performed to format the data after the first processing and then the data is transmitted to the main body 2A, it is possible to easily handle the output data by the main body 2A.
According to such a configuration, since the data is converted into a data format conforming to CAN data that can be widely handled by the main body 2A, it is possible to easily handle the data by the main body 2A.
According to such a configuration, since data including information required by the main body 2A is sent in advance, it is possible to easily handle the data by the main body 2A.
According to such a configuration, even when the number of interfaces of the main body 2A, that is, the number of the output lines 151A to 151F is small, it is possible to send output data based on many types of input data to the main body 2A.
According to such a configuration, multiple expansion units 150, 190, and the like for inputting data from outside the vehicle and data from inside the vehicle can be connected to the main body 2A.
Although the embodiment of the present disclosure is described above, the present disclosure is not limited to the embodiment described above, and various modifications can be made to implement the present disclosure.
According to such a configuration, by preparing a large number of the output lines 151A, it is possible to support a larger number of communication protocols. Therefore, even when there are only a few types of communication protocols that can be supported by the interface of the main body 2A, the expansion unit 2B can easily select a protocol with which the main body 2A can communicate.
For example, when the main body 2A is not equipped with object recognition software, the expansion unit 2B equipped with object recognition software can be attached to the main body 2A, and the expansion unit 2B can be configured to transmit recognition results to the main body 2A.
In other words, the expansion unit 2B sets whether to perform the processing on the input data by referring to a preset table, and when it is set not to perform the processing on the input data, the expansion unit 2B may transmit unprocessed data that is the input data on which the expansion unit 2B does not perform the first processing and the second processing to the main body 2A. Further, when the expansion unit 2B is set to perform the processing, the expansion unit 2B may perform the first processing and the second processing on the input data, and transmit the data after the second processing to the main body 2A.
The ECU 210 controls multiple ECUs 220 to achieve coordinated control of the entire vehicle. Further, the ECU 210 realizes a function of processing data received from other electronic control devices or outputting the data as it is to the vehicle expansion unit 250A.
The ECU 220 is provided for each domain divided by function in the vehicle, and mainly controls the multiple ECUs 230 existing within that domain. Each ECU 220 is connected to the ECU 230 under the control thereof via an individually provided lower layer network (for example, CAN). The ECU 220 has a function of centrally managing access authority of the ECU 230 under the control thereof and authenticating users. The domain includes, for example, power train, body, chassis, cockpit, and the like.
The ECU 230 connected to the ECU 220 belonging to the power train domain includes, for example, the ECU 230 that controls an engine, the ECU 230 that controls a motor, the ECU 230 that controls a battery, and the like.
The ECU 230 connected to the ECU 220 belonging to the body domain includes, for example, the ECU 230 that controls an air conditioner, the ECU 230 that controls a door, and the like.
The ECU 230 connected to the ECU 220 belonging to the chassis domain includes, for example, the ECU 230 that controls brakes, the ECU 230 that controls steering, and the like.
The ECU 230 connected to the ECU 220 belonging to the cockpit domain includes, for example, the ECU 230 that controls meter and navigation displays, the ECU 230 that controls input devices operated by a vehicle occupant, and the like.
The external communication device 240 performs data communication with a communication device outside the vehicle (for example, a cloud server) via the wide area wireless communication network NW.
The vehicle interior communication network 250 includes CAN FD and Ethernet. CAN FD connects ECU 210 to each ECU 220 and the external communication device 240 via a bus. Ethernet connects ECU 210 and each ECU 220 and the external communication device 240 individually.
The ECU 210 is an electronic control device mainly composed of a microcomputer including a CPU 210a, a ROM 210b, a RAM 210c, and the like. Various functions of the microcomputer are implemented by the CPU 210a executing programs stored in a non-transient physical recording medium. In this example, the ROM 210b corresponds to a non-transient physical recording medium that stores a program. Further, a method corresponding to the program is performed by executing the program. Some or all of the functions executed by the CPU 210a may be configured in hardware using one or more ICs. Further, the number of the microcomputers constituting the ECU 210 may be one or more.
The ECU 210 further includes the communication unit 213. The communication unit 213 is configured to relay data received from other electronic control devices (for example, ECU 220, 230, and the like) to the vehicle expansion unit 250A.
The ECU 220, the ECU 230, and the external communication device 240 are all electronic control devices mainly composed of a microcomputer provided with a CPU, ROM, RAM, and the like, similarly to the ECU 210. Further, the number of the microcomputers constituting the ECU 220 and ECU 230, and the external communication device 240 may be one or more. The ECU 220 is an ECU that controls one or more ECUs 230, and the ECU 210 is an ECU that controls one or more ECUs 220 or controls the ECUs 220 and 230 of the entire vehicle including the external communication device 240.
The data collection device 2 is connected to the ECU 210 so as to communicate data with the ECU 210. That is, the data collection device 2 receives information from the ECUs 210, 220, and 230 via the ECU 210. Further, the data collection device 2 transmits a request regarding vehicle control to the ECU 210 or to the ECUs 220 and 230 via the ECU 210.
According to such a configuration, the same effect as the above (1a) can be obtained.
Further, regarding whether normalization and data structuring should be performed in the main body 2A or the vehicle expansion unit 150, the vehicle expansion unit 150 may be provided with a table of setting values equivalent to that shown in
In the table of setting values, it is preferable that, as in
In
In the data creation processing shown in
When filtering is required, the vehicle expansion unit 150 proceeds to S140 to execute filtering processing (L13), and then proceeds to S150. When filtering is not necessary, the vehicle expansion unit 150 proceeds to S150. In S150, the vehicle expansion unit 150 determines whether normalization is necessary for vehicle data based on the expansion table. If normalization is necessary, the vehicle expansion unit 150 proceeds to S160 to execute normalization processing (L16, L24), and proceeds to S170. When normalization is not necessary, the vehicle expansion unit 150 proceeds to S170.
Subsequently, in S170, the vehicle expansion unit 150 determines whether data structuring is necessary for vehicle data based on the expansion table. If data structuring is necessary, the vehicle expansion unit 150 proceeds to S180 to execute data structuring processing (L18, L25), and then proceeds to S190. If data structuring is not necessary, the vehicle expansion unit 150 proceeds to S190.
Subsequently, in S190, the vehicle expansion unit 150 determines whether standard format conversion is necessary for the vehicle data based on the expansion table. If standard format conversion is necessary, the vehicle expansion unit 150 proceeds to S200 to execute processing related to standard format conversion (L14), and then proceeds to S210. When the standard format conversion is not necessary, the vehicle expansion unit 150 proceeds to S210.
Subsequently, the vehicle expansion unit 150 transmits data to the main body 2A in S210 (L15), and ends this processing.
The data creation processing executed by the main body 2A shown in
That is, the main body 2A is configured to transmit data to the service provision server 4 (L31) in S260.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2021-110910 | Jul 2021 | JP | national |
The present application is a continuation application of International Patent Application No. PCT/JP2022/024888 filed on Jun. 22, 2022, which designated the U.S. and claims the benefit of priority from Japanese Patent Application No. 2021-110910 filed on Jul. 2, 2021. The entire disclosures of all of the above applications are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP22/24888 | Jun 2022 | US |
| Child | 18397364 | US |
