This application claims priority to Japanese Patent Application No. 2020-187357 filed on Nov. 10, 2020, incorporated herein by reference in its entirety.
The present disclosure relates to an information processing device to be mounted on a vehicle, an information processing method, a non-transitory storage medium, and a vehicle.
Japanese Unexamined Patent Application Publication No. 2006-142994 (JP 2006-142994 A) discloses a vehicle network system to be developed in a shorter development period even in a case of development of a complicated large-scale system. In this vehicle network system, a distributed control platform structure having a plurality of layers is constructed for a network spanning a plurality of electronic control units (ECU), and cooperative control is implemented by assigning separate roles to the individual layers.
The system described in JP 2006-142994 A is dedicated to implementation of a single complex action such as a vehicle motion through cooperation among the electronic control units and vehicle devices such as actuators. Therefore, it may be difficult to avoid control interference while securing consistency among a plurality of independent and different tasks.
The present disclosure provides an information processing device, an information processing method, a non-transitory storage medium, and a vehicle that can achieve appropriate vehicle control while securing consistency among a plurality of tasks.
An information processing device to be mounted on a vehicle according to a first aspect of the present disclosure includes a processor. The processor is configured to provide an activation instruction for an application based on an operation schedule of the vehicle. The processor is configured to receive a first command as a request from the application activated in response to the activation instruction. The processor is configured to convert the received first command into a second command used to control the vehicle for fulfilling the request. The processor is configured to control a device mounted on the vehicle based on the second command.
In the information processing device according to the first aspect of the present disclosure, the processor may be configured to manage an external condition of the vehicle and an internal condition of the vehicle. The external condition of the vehicle and the internal condition of the vehicle may include at least scene information. The processor may be configured to convert the first command into the second command based on the managed external condition and the managed internal condition.
In the information processing device according to the first aspect of the present disclosure, the processor may be configured to manage a control mode for providing at least an instruction for behavior of the vehicle. The processor may be configured to convert the first command into the second command based on the managed control mode.
An information processing method according to a second aspect of the present disclosure includes providing an activation instruction for an application based on an operation schedule of a vehicle, receiving a first command as a request from the application activated in response to the activation instruction, converting the received first command into a second command used to control the vehicle for fulfilling the request, and controlling a device mounted on the vehicle based on the second command.
A non-transitory storage medium according to a third aspect of the present disclosure stores instructions that are executable by one or more processors of an information processing device to be mounted on a vehicle and that cause the one or more processors to perform the following functions. The functions include providing an activation instruction for an application based on an operation schedule of the vehicle, receiving a first command as a request from the application activated in response to the activation instruction, converting the received first command into a second command used to control the vehicle for fulfilling the request, and controlling a device mounted on the vehicle based on the second command.
The information processing device according to the first aspect of the present disclosure is mounted on a vehicle.
According to the information processing device of the present disclosure, the instruction is provided only for the activation of the necessary application based on the operation schedule of the vehicle. Thus, appropriate vehicle control can be achieved while securing consistency among a plurality of tasks.
Features, advantages, and technical and industrial significance of exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings, in which like signs denote like elements, and wherein:
An information processing device of the present disclosure provides functions of a control platform operable as a central brain configured to control overall operation and behavior of a vehicle. The functions of the control platform are provided by a vehicle integrated ECU (central ECU) alone, an external cloud alone, or a combination of the vehicle integrated ECU and the external cloud. The use of the control platform can achieve appropriate vehicle control while securing consistency among a plurality of tasks.
The service application 10 is a functional block including applications that implement services. The services are implemented by using pieces of information on the inside and outside of the vehicle and components of the vehicle. Examples of the services include real-time operations of the vehicle as an automobile or product, scheduling related to activation of applications (self applications and other applications) based on set times, collection and processing of databases, recording into recording media, and wireless transmission to the outside. The application of this embodiment is configured to request (call) an abstract command predefined in the command library 21 from the information processing device 20 via an application programming interface (API). The abstract request may include supplementary information (for example, expected service execution period, priority, or frequency). For example, a service provider can provide any service by programming the application using an API depending on purposes. The contents of the API open to business entities or the like may be changed depending on levels of software developers. Thus, the developers of the business entities or the like can easily develop an application for implementing a new function. In the development, the developers of the business entities or the like need not be aware of an electronic platform mounted in the vehicle, the structures of devices in the vehicle (actuators or sensors), and an energy (electric or heat) system of the vehicle. Various applications may be exemplified as the applications. For example, the applications are related to a cockpit user experience (UX), a remote service, Mobility-as-a-Service (MaaS), an energy management service, an over-the-air (OTA) update service, vehicle operation scheduling, energy mobility, and a transportation service (departure determination or arrival determination).
The service application 10 requests various services from the command library 21. This request is an example of “first command” of the present disclosure. The service application 10 refers to shared information open to the public at the information sharing portal 23. The service application 10 can input a trigger for an instruction to activate an application from the mobility system controller 22 to the information sharing portal 23. The service application 10 can output a request to the vehicle device 30. The service application 10 can exchange information with the plant library 40. Each application in the service application 10 is basically executed in the vehicle, but may partially be executed in the cloud.
The command library 21 is a functional block including an abstract API. This API implements control corresponding to the service request in response to the abstract service request (service API call) from the service application 10. In other words, the command library 21 is a converter configured to convert a request (first command) received from the service application 10 into a request (second command) for the integrated manager 24 or the mobility system controller 22. For example, the command library 21 includes a library of various commands for implementing the following functions in association.
(1) Function of implementing a single or complex operation command for the vehicle device 30 (such as an actuator). This operation command is a command for fulfilling a request received from the service application 10.
(2) Function of outputting (issuing) a switching trigger for a vehicle control mode. The vehicle control mode defines behavior of the vehicle (usage of the vehicle as a product).
(3) Function of activating and stopping a power supply. The power supply operates a system necessary to fulfill a request.
(4) Function of providing an instruction to adjust energy sources in response to an entered energy demand (demand merging, demand weighting, suppliability determination, and selection of sources).
(5) Function of registering shared information in the information sharing portal 23. The shared information is processed and/or generated by using various types of data.
(6) Function of storing necessary information in a storage and operating communication devices inside and outside the vehicle.
(7) Timer function for activating a specified application at a set time.
For example, the command library 21 outputs a trigger for an instruction to switch the vehicle control mode, transmits an operation schedule, and reports scheduling to the mobility system controller 22 via the information sharing portal 23. The command library 21 outputs a control request or a service request (second command) to the integrated manager 24. The command library 21 includes a receiver. The receiver receives various service requests (first commands) from the service application 10. The command library 21 can provide the information sharing portal 23 with application modification information to be open to the public. The command library 21 can refer to shared information open to the public at the information sharing portal 23. The command library 21 can output a request to the vehicle device 30. The command library 21 can exchange information with the plant library 40.
The mobility system controller 22 is a functional block configured to, for example, centrally manage a control status related to behavior of the vehicle (usage or operation), manage progress of a series of tasks based on an operation schedule, and manage schedules. For example, the mobility system controller 22 has the following management functions.
(1) Vehicle Control Mode Management Function
The mobility system controller 22 manages overall control on the vehicle by using the following elements (plurality of modes and states). The mobility system controller 22 controls components of the vehicle device 30 and behavior of the system. The mobility system controller 22 adjusts UX requests depending on situations of the vehicle (time, place, and occasion: TPO). The mobility system controller 22 is an example of “second manager”.
Main modes: determine the total usage of the vehicle depending on situations
<automobile mode/electric mode/generator mode/stop mode>
States: manage transition of vehicle states along with sequential control phases
<traveling state (standby, start, travel, end)/motion state (hold, stop, startability determination, drive, stopping necessity determination)/transportation state (standby, stop, depart, move)/electric power infrastructure cooperation state (standby, ready, charge, supply)>
Sub-modes: limit purposes and means of control under solely or a plurality of modes
<driving sub-mode (manual, semi-automatic, full-automatic)/charging sub-mode (OFF, alternating current (AC), direct current (DC), contact, non-contact, solar)/equipment power supply sub-mode (OFF, electric service, movement preparation, loading and unloading of passengers, OTA)/auxiliary-device supplementation sub-mode (OFF, high voltage, solar)/AC power supply sub-mode (OFF, inside, outside)>
(2) Schedule Management (Scheduler) Function
The mobility system controller 22 schedules a start time and an end time of a specified activity or application. The mobility system controller 22 can schedule the start and end of an application corresponding to a single service or a plurality of successive services at any time. The transportation service may be taken as an example.
(3) Operation Management Function
In the use of MaaS, the mobility system controller 22 manages progress of vehicle movement, transportation service (flows of persons and goods), stay service (preparation and use of space), and associated tasks (such as a conductor function) based on operation schedule tables. By reading an operation index and an operation schedule table for the transportation service, the mobility system controller 22 can manage progress of repetition of movement and stop in sequence. For example, the operation index contains information on coordinates of each station, a target time, and an associated task.
(4) Fail Operation (FOP) Management Function
Fail-safe and FOP are centrally managed in a personally owned vehicle (PoV) and in MaaS. For example, this function includes generation of reliability information of a main subsystem and system diagnosis as necessary.
The mobility system controller 22 outputs an instruction to permit or prohibit control and indices necessary for adjustment to the integrated manager 24. The mobility system controller 22 outputs a trigger to the information sharing portal 23. The trigger is an instruction for the service application 10 to activate an application. That is, the mobility system controller 22 is an example of “instructor”. For example, the mobility system controller 22 acquires a trigger for an instruction to switch the vehicle control mode, an operation schedule, and scheduling from the command library 21 via the information sharing portal 23. The mobility system controller 22 can provide the information sharing portal 23 with mobility system information (such as a control mode, an operation status, and a UX adjustment result) to be open to the public. The mobility system controller 22 refers to shared information open to the public at the information sharing portal 23. The mobility system controller 22 can read an operation index and an operation schedule table from a predetermined information storage. The mobility system controller 22 can further provide mobility system information (such as a driving mode and a destination) to the driving application 50, and refer to information in the driving application 50.
The information sharing portal 23 is a functional block (first manager) configured to aggregate globally open information (shared information) for reference from the functional blocks such as the service application 10, the command library 21, the mobility system controller 22, and the integrated manager 24. The shared information can be referred also from the external cloud or control domains connected by communication from the vehicle integrated ECU (central ECU). Examples of the shared information include information on a state of the vehicle, information on a surrounding condition of the vehicle, information on scenes inside and outside the vehicle, information on results of detection of user's needs, information on input values from sensors, information on a current time, and information on a current location. Each functional block can refer to the shared information of the information sharing portal 23. When referring to the shared information, each functional block does not recognize the source of generation (provision) of the shared information. The information sharing portal 23 may include a coordinator that can process information on, for example, an operation status and a stopped state of the vehicle, a traveling scene of the vehicle (time, weather, and temperature), a result of authentication of a vehicle user, and a storage capacity.
The information sharing portal 23 opens the shared information to the service application 10, the command library 21, the mobility system controller 22, the integrated manager 24, the vehicle device 30, and the driving application 50. The information sharing portal 23 can acquire application modification information openable to the public from the command library 21. For example, the information sharing portal 23 can acquire, from the mobility system controller 22, mobility system information (such as a control mode, an operation status, a UX adjustment result, and an event request), a switching trigger, and an activation trigger openable to the public. The information sharing portal 23 can acquire an adjustment result openable to the public from the integrated manager 24. The information sharing portal 23 can acquire general information (about sensors, communications, and analog signals) openable to the public from the vehicle device 30. The information sharing portal 23 may function as a gateway configured to output the general information acquired from the vehicle device 30 directly to the service application 10. The information sharing portal 23 can acquire a driving status (such as a stop determination result) openable to the public from the driving application 50. The information open to the public at the information sharing portal 23 is basically registered (stored) in the vehicle. A part of the information may be registered (stored) in the cloud.
The integrated manager 24 is a functional block configured to execute adjustment related to, for example, limitation on a physical amount and whether to receive a request from the service application 10 (service API call), and determine a final command for the vehicle device 30 to fulfill the request. The adjustment is executed based on a control status of the mobility system controller 22 and various types of shared information that can be referred to at the information sharing portal 23. For example, the integrated manager 24 includes managers for the following functions. In this embodiment, the integrated manager 24 eliminates a difference caused by variations in equipment of the vehicle (hardware difference).
(1) System Activating/Stopping Manager (Power Supply Manager) Function
The integrated manager 24 controls activation and stop of a necessary system subordinate to the vehicle in response to a service need, and outputs a command (power ON/OFF, network management (NM) trigger, or communication request).
(2) Power Manager Function
The integrated manager 24 efficiently controls consumption and supply of electric power, including charging, discharging, and voltage conversion in the vehicle. In this embodiment, the integrated manager 24 executes adjustment toward fair supply responding to all energy demands (electric power or electric energy) entered (including scheduling) in the vehicle, determines whether to permit a service, determines upper and lower limits of an electric power balance, and selects an electric power source (such as a high-voltage battery or a charger).
(3) Heat Manager Function
The integrated manager 24 efficiently controls demand and supply of heat to be exhausted from the vehicle or used for heating. In this embodiment, the integrated manager 24 adjusts heat generation requests from the service application 10 (air conditioning or component temperature control). The integrated manager 24 outputs a command to start an engine or activate a fuel cell (FC) within a range in which fuel efficiency and emission requirements are satisfied.
(4) Motion Manager Function
The integrated manager 24 adjusts requests for a motion system configured to control functions related to motions of the vehicle, such as “run”, “turn”, and “stop”. In this embodiment, the integrated manager 24 reflects requirements in the mobility system controller 22 (traveling state, motion state, and transportation operation management) and new requests in the MaaS service (such as prohibition of start and request for or prohibition of termination of vehicle holding).
An instruction to permit or prohibit control and indices necessary for adjustment are input to the integrated manager 24 from the mobility system controller 22. A control request (or a service request) is input to the integrated manager 24 from the command library 21. The integrated manager 24 may function as a gateway configured to output the control request input from the command library 21 directly to the vehicle device 30. The integrated manager 24 outputs, to the vehicle device 30, adjusted commands for controlling devices (for actuators, communications, or driver outputs). That is, the integrated manager 24 is an example of “controller”. The integrated manager 24 can provide the information sharing portal 23 with an adjustment result of each manager to be open to the public. The integrated manager 24 refers to, for adjustment, shared information open to the public at the information sharing portal 23. The integrated manager 24 can provide the driving application 50 with an answerback or an adjustment result of the motion manager, and refer to information related to a vehicle motion (such as an acceleration and a steering angle) requested by the driving application 50.
In addition to the managers described above, the integrated manager 24 may include, for example, a human machine interface (HMI) manager configured to control functions related to electric equipment control (usability) for appropriately displaying information on a navigation screen and meters of the vehicle and appropriately providing operations on the vehicle, or an upper manager configured to control functions related to electric equipment control other than that for a vehicle traveling system, such as headlights, wipers, and seats of the vehicle.
The vehicle device 30 is a functional block including devices such as sensors and actuators where control information, operation requests, data, and signals are input and output finally. Examples of the vehicle device 30 include a sensor configured to acquire information indicating a surrounding condition of the vehicle and information indicating a state of the vehicle, and a sensor configured to acquire information on driver's driving operations for the vehicle (such as operations on an accelerator, a brake, a steering wheel, and a shift lever). Examples of the vehicle device 30 also include a power supply driver configured to control a power supply for a power train or the like, Ethernet (registered trademark) connected to an advanced driver assistance system (ADAS), multimedia (MM), or the like, a controller area network (CAN) connecting the power train and a chassis, and a shift lock.
Adjusted commands (for actuators, communications, or driver outputs) are input to the vehicle device 30 from the integrated manager 24. The vehicle device 30 can provide the information sharing portal 23 with general information (about sensors, communications, and analog signals) to be open to the public. The service application 10 and the command library 21 can input requests to the vehicle device 30.
The plant library 40 is a functional block configured to provide environments such as artificial intelligence (AI) or machine learning algorithms, databases viewable from inside and outside of the vehicle, and a simulator configured to execute various simulations (such as estimation of a remaining charging period and map conversion) for use in improvement of controllability of the service application 10. The environments may partially or entirely be installed in the vehicle, or may be located in the cloud.
The plant library 40 can request necessary information from the service application 10, the command library 21, and the driving application 50 via a predetermined API. The plant library 40 can cause the service application 10, the command library 21, and the driving application 50 to acquire information indicating results of predetermined processes (such as simulations) via the predetermined API. The functions of the plant library 40 are basically installed in the vehicle, but may partially be executed in the cloud.
Among the applications installed in the vehicle, the driving application 50 is dedicated to driving of the vehicle and assistance of the driving, and is not included in the service application 10. Examples of the driving application 50 include remote driving such as autonomous parking, autonomous driving (AD), autonomous driving in MaaS (Autono-MaaS), and the advanced driver assistance system (ADAS).
The driving application 50 can refer to information open to the public at the mobility system controller 22 (such as a driving mode and a destination) via a predetermined vehicle driving API. The driving application 50 can cause the mobility system controller 22 to refer to information. The driving application 50 can provide a driving status (such as a stop determination result) to the information sharing portal 23 and acquire shared information (various types of data) open to the public at the information sharing portal 23 via the predetermined vehicle driving API. The driving application 50 can request a vehicle motion (such as an acceleration and a steering angle) toward the integrated manager 24 and receive an answerback (such as an adjustment result) from the integrated manager 24 via the predetermined vehicle driving API. The driving application 50 can exchange information with the plant library 40. Each application in the driving application 50 is basically executed in the vehicle, but may partially be executed in the cloud.
Since the vehicle control system of this embodiment includes the functional blocks described above, the vehicle control system can implement various services by simply installing applications developed without being aware of, for example, the structure of the control platform, the defined commands, the system configuration of the vehicle, and the energy system handled in the vehicle.
Specific examples of the services to be implemented in the vehicle control system of the present disclosure are described with reference to
When the operation schedule table is received, the operation scheduling application reads an existing operation schedule that has already been scheduled ([b] in
When the existing operation schedule and the new operation schedule are established without conflict, the operation scheduling application transmits the operation schedules to an energy mobility application ([c] in
The energy mobility application transmits results of the simulations executed by an operation simulator to the operation scheduling application ([d] in
The operation scheduling management executed by the operation scheduling application and the vehicle operation simulations executed by the energy mobility application may be executed in the cloud. In this configuration, only the scheduler and the information storage may be used on the vehicle side (In-Car side), and information necessary for reference may be acquired on the cloud side (Out-Car side) from the vehicle side ([h] in
The specifications of an operation scheduling library are such that the library is open-source and updatable (for example, capable of reflecting a schedule change in the operation). The controllable range may be changed depending on the level of the vehicle user.
The scheduler opens an activation trigger to the public at the information sharing portal 23. The scheduler activates applications in the service application 10 (application X and application Y) ([c-1, c-2] in
The power supply manager of the integrated manager 24 activates a corresponding power supply based on the vehicle control mode transmitted from the mobility system controller 22 and an activity need ([e] in
When the supply of electric power cannot fulfill demand for the service (activity), the request may be rejected. In this case, the power manager of the integrated manager 24 registers request rejection in the information sharing portal 23 ([h-1] in
When the associated applications (application X and application Y) need to prompt the service provider or the driver to perform an action for terminating the vehicle operation, the applications notify, through the multimedia (MM), the service provider or the driver that the action is needed ([d] in
When the information sharing portal 23 opens, to the public, information indicating that a vehicle operation termination condition is satisfied ([e-1] in
The mobility system controller 22 refers to the termination trigger open to the public at the information sharing portal 23 ([f] in
Based on the read timetable of the operation schedule, the scheduler manages progress of steps in association with the transportation state in which the operation is managed by the mobility system controller 22 ([b] in
In each step, the means and the associated task for determining the switching of the transportation state depend on a service type. Therefore, applications appropriate to the service types are selected in the service application 10 ([d] in
Based on a request and information output from the command library 21 and the mobility system controller 22, the integrated manager 24 executes appropriate adjustment in the motion manager, the upper manager, and the HMI manager, and outputs a command to the vehicle device 30 to fulfill the request ([e] in
In a case where the vehicle is operating through the autonomous driving, a destination of the operation is transmitted from the scheduler of the mobility system controller 22 to the vehicle device 30 ([f] in
In the related-art method (
In the method of the present disclosure (
As illustrated in
As described above, the information processing device according to the embodiment of the present disclosure includes in advance the library of various commands that can automatically determine various types of control by simply calling predetermined abstract commands in a control architecture that can implement activities. Examples of the various types of control include the complex actuator operation adjustment, the power supply activation for activating a necessary system, the energy supply adjustment responding to energy demand (possibility determination and energy source selection), and the mode switching for determining the overall behavior of the vehicle.
Thus, application developers can easily develop a new or additional application (service) by designing an algorithm intuitively for its purpose. In the development, the application developers need not be aware of, for example, the structure of the electronic platform in the vehicle, the defined commands, the system configuration (hardware variations), and the energy system.
In the information processing device according to this embodiment, any function can be added by referring to the information in the sharing portal, using the command library, and installing a new or additional application alone. That is, there is no need to revise related applications.
The application developers can easily develop a new or additional application.
In the information processing device according to this embodiment, it is possible to avoid an increase in the number of inspection steps to find malfunction due to unexpected behavior of the vehicle or the number of inspection steps to check control interference.
In the information processing device according to this embodiment, an instruction is provided to start a necessary application based on the operation schedule of the vehicle that is checked that details of a plurality of schedules do not conflict with each other through the simulation. Thus, appropriate vehicle control can be achieved while securing consistency among a plurality of tasks.
Although the technology of the present disclosure is described above based on the embodiment, the present disclosure can be regarded not only as the information processing device, but also as, for example, a method to be executed by the information processing device including a processor and a memory, a program for the method, a non-transitory computer-readable recording medium storing the program, or a vehicle including the information processing device.
The present disclosure is useful in an information processing device to be mounted on a vehicle or the like.
Number | Date | Country | Kind |
---|---|---|---|
2020-187357 | Nov 2020 | JP | national |