Patent Application
20230114690
As connectivity between different products increases, software developers seek to develop new applications for allowing users to customize experiences with different products. In order to develop the applications, software developers rely on data structures within the product in order to develop an application which operates reliably on the product. In some instances, application program interfaces (API) help to permit applications to exchange data with a product without specifically tailoring the application to the product. However, in some instances, understanding types of data available within the product and the format of that data helps software developers to enhance the application to improve a product user experience.
Aspects of the present disclosure are best understood from the following detailed description when read with the accompanying figures. It is noted that, in accordance with the standard practice in the industry, various features are not drawn to scale. In fact, the dimensions of the various features may be arbitrarily increased or reduced for clarity of discussion.
The following disclosure provides many different embodiments, or examples, for implementing different features of the provided subject matter. Specific examples of components, values, operations, materials, arrangements, or the like, are described below to simplify the present disclosure. These are, of course, merely examples and are not intended to be limiting. Other components, values, operations, materials, arrangements, or the like, are contemplated. For example, the formation of a first feature over or on a second feature in the description that follows may include embodiments in which the first and second features are formed in direct contact, and may also include embodiments in which additional features may be formed between the first and second features, such that the first and second features may not be in direct contact. In addition, the present disclosure may repeat reference numerals and/or letters in the various examples. This repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed.
Further, spatially relative terms, such as “beneath,” “below,” “lower,” “above,” “upper” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. The spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. The apparatus may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein may likewise be interpreted accordingly.
A user, such as a software developer, an insurance provider, a market researcher and a law enforcement, is able to use an on-demand data retrieval (ODDR) system to enter a data request into a user interface, such as a graphical user interface (GUI). The software developer is a software developer who develops applications, middleware or OS (operating systems) to be run on the vehicle, for example. Example applications includes automated-driving system applications such as an object recognition application, a road recognition application, a sensor fusion application, a localization application, path planner application, controller application, etc. The data request is analyzed and stored in a server and then transmitted to a vehicle by the server. On the server side, the data requests are stored in a storage unit in and a request queue is generated based on the stored requests. The user is able to see or request updates on a status of the data request. For example, while the data request is still within the server prior to transmission to the vehicle, the status may be indicated as “pending.” Once the server transmits the data request to the vehicle, the status may be updated to “submitted.” This allows the user to see and track the status of data requests made to the vehicle. One of ordinary skill in the art would recognize that the description refers to a vehicle for the sake of clarity; however, the description is applicable to groups of vehicles in addition to a single vehicle.
The user interface for generating the data request includes forms related to vehicle identifying information, data types being requested, start time and end time. In some embodiments, the start time and the end time are absolute times, such as Unix time, that is an elapsed time since a Unix epoch time. In some embodiments, the start time and the end time are relative times to the time that the data request is received by the vehicle. In some embodiments, the start time and the end time are relative times to a trigger event. The trigger event is the occurrence within the vehicle or in the environment surrounding the vehicle about which the user is seeking data or receipt of a data request by the vehicle. For example, a trigger event resulting from an environment surrounding the vehicle includes sudden acceleration, sudden braking, capturing an image of a target of a data request, detecting of a target of a data request or other suitable occurrences. The user information for monitoring a status of data requests includes identifying information of the data request and a status of the data request, such as pending or submitted.
In some embodiments, once the data request is received by the vehicle, the data request is processed to make the data request agnostic as to the source of the data request. In some embodiments, a data request identification (ID) is assigned to the received data request by the vehicle, for example by a request abstractor in the vehicle. In some embodiments, the data request ID is assigned to the data request prior to transmission of the data request to the vehicle. In some embodiments, a data request is generated by an application running in the vehicle and the application assigns the data request ID. In other words, the data is processed in a consistent manner regardless of a program or system that transmits the data request to the vehicle. In some embodiments, a data request is generated by a software component stored within the vehicle, and the data is processed in consistent with a data request received from an external device. This helps to sharing the same data collection software components among trigger data collection, where an application generates a data collection request to the logger, and the ODDR-based external data collection request.
In some embodiments, once the data request is received by the vehicle, the data request is processed to make the data request agnostic to the sensors within the vehicle and the server. In some embodiments, the data request is generated by an application running in the vehicle. In some embodiments, an application programming interface (API) is usable to make the data request from the application agnostic to the sensors within the vehicle or information from the server. This helps to maximize the user's ability to collect data without programming a request for specific sensor models. The data request is then transferred to a data collector and the requested data is collected in response to occurrence of the trigger event. In the situation where the trigger event had already occurred, such as a traffic accident, the data request is fulfilled based on data stored within a storage device within the vehicle. A time frame, i.e., start and end times, of the collected data is determined based on the data request. The collected data is transferred back to the server.
The collected data is then stored in the server and a notification is sent to the user regarding completion of the data request. For example, the status of the data request is updated to “complete” on the user interface.
In some instances, a budget management system or a payment system is implemented on the server side or vehicle side, such that the user is charged a fee for a data request. The fee is payable either at the submission of the request or at completion of data collection. The fee is adjustable based on the type and amount of data requested. In some embodiments, when the total amount of fee that is charged to the user reaches a maximum threshold of user's budget, the data request from the user is rejected.
This ODDR system allows users to access information collected by vehicle in an on-demand style. That is, the data is not necessarily continuously collected, but could be collected to satisfy specific desires of a user. In some embodiments, the ODDR system helps users, such as software developers, collecting data to update the design, implementation and parameter tuning of their software in an exploratory way based on collected data so that the users are able to continuously improve the software by delivering updates from the server to the vehicle via network, for example, as an Over-the-Air (OTA) update. In some embodiments, the ODDR system helps machine learning developers who develops machine learning model for the applications collecting data to train the model with the data which was not available when the model was initially developed so that the machine learning developers are able to update the models to fix weakness and issues of the model continuously. In some instances, an insurance provider would be able collect data related to a traffic accident. In some instances, law enforcement would be able to collect information related to a crime or a traffic accident.
The UI 110 is configured to receive input instructions from the user. In some embodiments, the user includes a software developer. In some embodiments, the user includes a machine learning model developer. In some embodiments, the user includes an insurance provider. In some embodiments, the user includes law enforcement. In some embodiments, the user includes market research company. The UI 110 provides options for the user to select what type of vehicle and what type of data is being requested. In some embodiments, the UI 110 is capable of generating the data request using forms related to vehicle identifying information, data types being requested, start time and end time. In some embodiments, the start time and the end time are absolute times, such as Unix time, that is an elapsed time since a Unix epoch time. In some embodiments, the start time and the end time are relative times to the time that the data request is received by the vehicle. In some embodiments, the start time and the end time are relative times to a trigger event. In some embodiments, the UI 110 also provides the user with options for selecting a trigger event and a data collection duration relative to the trigger event. In some embodiments, the UI 110 includes information related to a type of vehicle from which data is requested. In some embodiments, the UI 110 includes vehicle ID which can uniquely identify a vehicle in the world. For example, the vehicle ID includes an universally unique identifier (UUID) format. In some embodiments, the UI 110 includes data type that is able to identify the source of the data that user want to collect. For example, the data type includes sensor ID of sensor that sensor data is collected from, application ID of application that application log is collected from. In some embodiment, the format of the sensor ID and application ID includes an universally unique identifier (UUID) format. In some embodiments, the UI 110 includes drop down menus. In some embodiments, the UI 110 includes editable fields for receiving information related to a data request. In some embodiments, the UI 110 provides information regarding what data option types are available to the user. In some embodiments, the data option types available depend on the user. For example, law enforcement is able to select more data options than an insurance provider in some embodiments.
In some embodiments, the UI 110 includes a graphical user interface (GUI). In some embodiments, the UI 110 is includes a mobile terminal, such as a mobile telephone, connectable to the server 120. In some embodiments, the UI 110 includes a web interface such as RESTful API. In some embodiments, the UI 110 includes a computer connectable to the server 120. In some embodiments, the UI 110 is capable of wireless connection to the server 120. In some embodiments, the UI is connectable to the server 120 by a wired connection. The UI 110 is also able to provide the user with updates regarding a status of a data request. In some embodiments, the UI 110 provides status updates regarding a data request in response to an additional query by the user. In some embodiments, the UI 110 provides status updates regarding a data request upon receipt of updated information from the server 120 automatically without user interaction. In some embodiments, the status update causes the UI 110 to trigger an alert for the user. In some embodiments, the alert includes an audio or visual alert.
In some embodiments, the UI 110 includes a means for accepting payment of a fee from the user. In some embodiments, the UI 110 includes data entry fields to permit the user to enter payment card information. In some embodiments, the UI 110 includes a reader for detecting payment card information, such as a magnetic stripe reader, a bar code reader, a chip reader, or another suitable reader.
The server 120 includes a communication section 130 configured to communicate with the UI 110 and the vehicle 140. The communication section 130 includes a receiver 131 configured to receive data requests from the UI 110. In some embodiments, the receiver 131 includes a wireless receiver. In some embodiments, the receiver is configured to receive the data requests via a wired connection. In some embodiments, the receiver 131 is further configured to perform initial processing on the received data request. In some embodiments, the received data request includes priority level information. In some embodiments, the receiver 131 is configured to assign a priority level to the data request based on an identity of the user that submitted the data request and/or a fee paid by the user that submitted the data request. In some embodiments, the receiver 131 is configured to assign a request identification (ID) number to each received data request. In some embodiments, the server 120 is configured to limit access to certain sensors within the vehicle 140 based on an identity the user. For example, a third-party user will not be able to access sensor related to safety functions of the vehicle 140 in some embodiments.
The communication section 130 further includes a memory unit 132 configured to store data requests received by the receiver 131. In some embodiments, the memory unit 132 includes a random access memory, a solid state memory, or another type of memory. In some embodiments, the memory unit 132 is configured to store the data requests along with a status of the data request. In some embodiments, the status of the data request includes pending (prior to transmission of the data request to the vehicle 140); submitted (following transmission of the data request to the vehicle 140); and completed (following receipt of the requested data from the vehicle 140). In some embodiments, the memory unit 132 is accessible by the user. In some embodiments, updates to information in the memory unit 132 trigger notifications of a user associated with the information updated in the memory unit 132. In some embodiments, the memory unit 132 stores data requests in conjunction with time stamp data indicating a time at which the data request was received. In some embodiments, the memory unit 132 stores data requests in association with a priority level. In some embodiments, the priority level is determined based on an identity of the user. For example, in some embodiments, law enforcement has higher priority than an insurance provider, which has higher priority than a normal user, such as a software developer. In some embodiments, the priority level is determined based on a fee paid by the user. For example, in some embodiments, a user is able to pay a fee in order to increase a priority level of their request in order to obtain the requested data sooner. In some embodiments, the priority level of a data request is increased as an amount of time between initial storage of the data request and transmission of the data request to the vehicle increases.
The communication section 130 further includes a transmitter 133. The transmitter 133 is configured to transmit a status of data requests to the UI 110. In some embodiments, the status of the data requests is wirelessly transmitted to the UI 110. In some embodiments, the status of the data requests is transmitted to the UI 110 via a wired connection. In some embodiments, the transmitter 133 is configured to provide an update on a data request automatically in response to an update in the memory unit 132. In some embodiments, the transmitter 133 is configured to provide an update on a data request in response to a received update request from the user. In some embodiments, the transmitter 133 is configured to automatically transmit a request ID upon initially saving the data request in the memory unit 132. In some embodiments, the status of the data request includes a priority level of the data request. In some embodiments, the status of the data request includes an estimated time until the data request is transmitted to the vehicle 140.
The communication section 130 further includes a query queue 134 configured to store data requests in priority order for transmission to the vehicle 140. In some embodiments, the query queue 134 is integrated into the memory unit 132. In some embodiments, the query queue 134 is separate from the memory unit 132. In some embodiments, the query queue 134 is configured to retrieve data requests from the memory unit 132 based on priority level and time stamp information. In some embodiments, the query queue 134 is configured to order data requests based on priority level; and by time since initial saving in the memory unit 132 in response to data requests having a same priority level.
The communication section 130 further includes a transmitter 135 configured to transmit data requests to the vehicle 140 from the query queue 134. The transmitter 135 is configured to transmit the data requests to the vehicle 140 based on an order of the data requests in the query queue 134. In some embodiments, the data requests are transmitted to the vehicle 140 wirelessly. In some embodiments, the data request are transmitted to the vehicle 140 by a wired connection. The data requests transmitted to the vehicle 140 include trigger event information, data duration information related to how long before and after the trigger event the data should be collected, and sensor information indicating a type of sensor of the vehicle 140 should collect the data. In some embodiments, the data requests transmitted to the vehicle 140 include priority level information. In some embodiments, the transmitter 135 is configured to transmit data requests to the vehicle 140 when the vehicle 140 sends a request to server 120 to transmit the data requests to the vehicle 140. In some embodiments, the transmitter 135 is configured to transmit data requests to the vehicle 140 any time the communication section 130 has sufficient connectivity to the vehicle 140 to transmit the data request unless the communication section 130 has received information indicating that the vehicle 140 is unable to accept a new data request. In some embodiments, the transmitter 135 is configured to transmit the data requests to the vehicle 140 periodically so long as the vehicle 140 is able to receive new data requests and the transmitter 135 has sufficient connectivity to the vehicle 140. In some embodiments, the transmitter 135 is configured to transmit the data requests to the vehicle 140 in batches, such as in groups of 5 data requests, 20 data requests or some other number of data requests. In some embodiments, the transmitter 135 is configured to request confirmation of receipt of the data request from the vehicle 140. In response to failing to receive confirmation of receipt from the vehicle for a predetermined time period, the transmitter 135 is configured to re-transmit the data request. In some embodiments, the status of the data request stored in the memory unit 132 is updated to indicate submission to the vehicle 140 in response to the communication section 130 receiving confirmation of receipt of the data request from the vehicle 140.
The communication section 130 further includes a receiver 136 configured to receive notification of the occurrence of trigger events from the vehicle 140. In some embodiments, the occurrence of a trigger event is receipt of a data request. In some embodiments, the receiver 136 is configured to receive the notification of the trigger events wirelessly. In some embodiments, the receiver 136 is configured to receive the notification of the trigger events via a wired connection. In some embodiments, the receiver 136 is configured to send a signal to the memory unit 132 to update a status of a data request related to the notified trigger event.
The communication section 130 further includes a receiver 137 configured to receive data from the vehicle 140 responsive to the data requests transmitted by the transmitter 135. In some embodiments, the data is split by the vehicle 140 into data packets that is the unit of transmission from the vehicle 140 to the server 120, and the receiver 137 receives the data packet from the vehicle 140. In some embodiments, the receiver 137 is configured to receive the data wirelessly. In some embodiments, the receiver 137 is configured to receive the data via a wired connection. In some embodiments, the receiver 137 is configured to send a signal to the memory unit 132 to update a status of a data request related to the receipt of requested data. In some embodiments, the data responsive a single data request is received in a single packet from the vehicle 140. In some embodiments, the data responsive to a single data request is received in multiple packets from the vehicle 140. The receiver 137 transfers the received data to a pre-processor 122.
The server 120 further includes the pre-processor 122 configured to receive data from the receiver 137 and perform pre-processing on the data to generate collected data. In some embodiments, the pre-processing includes reforming of data from multiple packets to compile data responsive to a data request. In some embodiments, the pre-processing includes de-serializing of data to compile structured data from a byte array that is received. In some embodiments, the pre-processing includes de-compressing of data if the data is compressed by the vehicle 140 before sending. In some embodiments, the pre-processing includes error correction by Error Correction Code (ECC) such as Reed-Solomon (RS) Code, Bose—Chaudhuri—Hocquenghem (BCH) code, Low-density parity-check (LDPC) code and the like. In some embodiments, the pre-processing includes smoothing of data by removing outlier values to reduce a risk of report incorrect data to the user. In some embodiments, the pre-processing includes associating data request ID information, priority level information or other suitable information with the received data from the receiver 137. In some embodiments, the data is pre-processed so that the information is provided to the user in a format that is easy to understand and does not rely on specialized knowledge or equipment to discern the information.
The server 120 further includes a data storage 126 configured to store the collected data generated by the data pre-processor 122. In some embodiments, the data storage 126 is integrated with the memory unit 132. In some embodiments, the data storage 126 is separate from the memory unit 132. In some embodiments, the data storage 126 includes a solid state drive (SSE), a random access memory or another suitable memory. In some embodiments, the data storage 126 is accessible by the user, e.g., using the UI 110 or an accessible console 150. In some embodiments, the data storage 126 is configured to notify the user in response to data related to a data request is available. In some embodiments, the notification includes an alert to the user. In some embodiments, the alert includes an audio or visual alert. In some embodiments, the data storage 126 is configured to cause the UI 110 or the accessible console 150 to automatically display the notification of an availability of the collected data. In some embodiments, the data storage 126 is accessible by a user using the accessible console 150 without the user submitting a data request. In some embodiments, the data within the data storage 126 are searchable by the user via the accessible console 150. In some embodiments, the collected data is visualized in the console 150.
The ODDR system 100 further includes a vehicle 140. The vehicle 140 includes sensors to detect both an internal status of the vehicle 140 as well as an external environment surrounding the vehicle 140. In some embodiments, the sensors include a camera, a light distance and ranging (LiDAR) sensor, a radio distance and ranging (RADAR) sensor, a sound navigation and ranging (SONAR) sensor, an accelerometer, a steering wheel position, a speedometer, or another suitable sensor. The vehicle 140 is capable of receiving data requests, either wirelessly or via a wired connection.
In some embodiments, in response to receiving the data request, the vehicle 140 is configured to assign a data request ID to the received data request and the data request is processed to be agnostic to an originating system or program of the data request. In another embodiments, the communication section 130 instead of the vehicle 140 assigns the data request ID, and the data request ID is included in the data request that is sent from the communication section 130 to the vehicle 140. Making the data request agnostic to the originating system or program of the data request helps with expanding an ability of the vehicle 140 to receive and process a wide range of data requests from different users and systems. The vehicle 140 includes a processor for processing the data requests and determining what type of information from which sensors available in the vehicle 140 are capable of satisfying the data request. The vehicle 140 further includes a memory for storing data from the sensors. In some embodiments, the processor access the memory to determine whether any stored data is capable of satisfying the data request. The vehicle 140 is further capable of transmitting the data deemed to satisfy the data request to the server 120 either wirelessly or via a wired connection. In some embodiments, the processor is configured to attempt to satisfy received data requests in a priority order based on a received priority level of the data request. In some embodiments, the vehicle 140 is configured to transmit data to the server preferentially based on the received priority level of the data request.
In some embodiments, the memory and the processor of the vehicle 140 are configured to store and execute software applications in an electronic control unit (ECU) within the vehicle 140. In some embodiments, a data request is generated by the software application stored in the ECU. In some embodiments, the data request is generated in response to a trigger event, such as sudden acceleration, sudden braking, capturing an sensor data including specific objects or specific scenes that are predefined in the software application, “crashing” of the software application, a detected abnormality in the software application, or another suitable detected occurrence. In some embodiments, the vehicle 140 is configured to generate a notification to a maintainer, e.g., the user, of the software application in response to detecting a trigger event associated with the software application. In some embodiments, the notification is transmitted, either wirelessly or through a wired connection, directly to the user, e.g., through the UI 110. In some embodiments, the notification is transmitted, either wirelessly or through a wired connection, to the user through the server 120. In some embodiments, the notification includes an audio or visual notification. In some embodiments, the notification is configured to cause the UI 110 to automatically display the notification without user interaction.
The ODDR system 100 further includes an accessible console 150. The accessible console 150 permits the user to access the collected data stored in the data storage 126. In some embodiments, the accessible console 150 is integrated with the UI 110. In some embodiments, the accessible console 150 is separate from the UI 110. In some embodiments, the accessible console 150 includes another server separate from the server 120. In some embodiments, the accessible console 150 automatically receives collected data related to a data request from the user upon receipt of the collected data by the data storage 126. In some embodiments, the accessible console 150 permits the user to search the data storage 126 to determine whether any of the collected data stored in the data storage 126 are useful to the user without the user submitting a data request.
Using the ODDR system 100 permits users to obtain information from one or more vehicles 140 in a format that is easy to understand without relying on specialized equipment to request or read the received data. The ability to prioritize data requests in the ODDR system 100 help to ensure that law enforcement is able to obtain data relevant to public safety, while also permitting user to pay a fee to obtain data faster. This flexibility helps to improve the usefulness of the ODDR system 100 for a wide range of users.
In some embodiments, the fields 220 includes fields for users to enter the vehicle ID, the data type, the start time and the end time In some embodiments, the field 220 further includes a field for users to enter a priority level of the data request. In some embodiments, the GUI 200 further includes information related to how a user is able to increase a priority level of a data request, such as indicating a fee associated with each available priority level. In some embodiments, the GUI 200 includes fields 220 for allowing a user to enter log in information to establish an identity of the user. In some embodiments, the GUI 200 is configured to display a priority level of the user following receiving log in information. In some embodiments, the GUI 200 further includes fields 220 for receiving payment information related to fees for establishing a priority level of a data request.
The GUI 250 is configured to be displayed to the user after the user has selected the submit button 230 on GUI 200. In some embodiments, the GUI 250 is usable as the GUI 110 in the ODDR system 100 (
The GUI 350 includes information relate to a status of data requests. In some embodiments, the GUI 350 is usable as the UI 110 in the ODDR system 100 (
The server 420 is configured to receive the data request from the user 410 using a GUI interpreter 421. One of ordinary skill in the art would recognize the GUI is merely an example and that a CLI or SQL interpreter is also usable in ODDR system 400. In some embodiment, the GUI interpreter 421 includes similar functionality as the receiver 131 (
The server 420 is further configured to transmit the data request using ODDR command publisher 422. In some embodiments, the ODDR command publisher 422 includes similar functionality as query queue 134 and transmitter 135 (
The server 420 is further configured to receive data from the vehicle 430 using data receiver 423. In some embodiments, the data receiver 423 includes similar functionality as receiver 137 (
The server 420 is further configured to receive event data from the vehicle 430 using event receiver 424. In some embodiments, the event receiver 424 includes similar functionality as receiver 136 (
The server 420 is further configured to store event data and received data using a data storer 425. In some embodiments, the data storer 425 includes similar functionality as at least one of the memory unit 132 or the data store 126 (
The server 420 is further configured to notify the user 410 in response to receiving data satisfying a data request using a completion notifier 426. In some embodiments, the completion notifier 426 includes similar functionality as the data storage 126 (
The ODDR system 400 further includes vehicle 430 which is configured to receive the data request from the server 420; collect data from sensor attached to the vehicle 430 and transmit the data to server 420. The vehicle 430 is configured to receive the data request using an ODDR command receiver 431. The ODDR command receiver 431 is configured to receive the data request from the server 420 and transfer the data request to a request abstractor 434. In some embodiments, the ODDR command receiver 431 is configured to perform pre-processing on the data request, such as determining a priority level of the data request or identifying sensors in the vehicle 430 capable of capturing data related to the data request. In some embodiments, the ODDR command receiver 431 is configured to process the data request in order to facilitate communication between the server 420 and components of the vehicle 430, such as the data collector 435.
The vehicle 430 further includes applications 432 which are running on a processor in the vehicle 430. In some embodiments, the applications 432 includes automated-driving system applications such as an object recognition application, a road recognition application, a sensor fusion application, a localization application, path planner application, controller application, etc. In some embodiments, the applications 432 are configured to monitor sensor data, internal status of the applications 432, performance of the vehicle 430 and an environment surrounding the vehicle 430. The applications 432 are configured to determine whether conditions of events (trigger events) such as sudden changes in acceleration, capturing of images of objects surrounding the vehicle 430 or other suitable events are met. In response to a determination by the applications 432 that the trigger event occurred, the application 432 sends a data request to request abstractor 434 via trigger command receiver 433. In some embodiments, the applications 432 are configured to generate application logs which store internal status and internal events of the applications 432, the application logs are sent to the data collector 435 periodically, and the application logs are transmitted by the data transferer 436 when server 420 sends a data request to the vehicle 430 to collect the application logs.
The vehicle 430 further includes a trigger command receiver 433 configured to receive a data request from the applications 432. The trigger command receiver 433 is configured to transfer the data request from the application to the request abstractor. The trigger command receiver 433 is configured to process a specific communication protocol, such as inter-process communication (IPC) within the vehicle 430.
The vehicle 430 further includes the request abstractor 434. The data collector 435 is configured to receive a data request from either application 432 or the server 420. When the data request is received from the server 420, the data request is processed by ODDR command receiver 431 which is configured to process a specific communication protocol between server 420 and vehicle 430. When the data request is received from applications 432, the data request is processed by trigger command receiver 433. The request abstractor 434 is configured to abstract the data request so that the abstracted data request is independent from the communication protocol and the data requester 435 regardless of whether the data request is received from the server 420 or the applications 432. In this way the data collector 435 is made agnostic to the origin of the data request and is able to process the data request regardless the origin. In some embodiments, the request abstractor 434 is configured to analyze the data request and determine which types of trigger events the data request is targeting. In some embodiments, the request abstractor 434 adds a requestor type to the ODDR command. For example, in some embodiments, the request abstractor 434 includes information in the abstracted requestor indicating whether the ODDR command originated from outside of the vehicle or from an application within the vehicle. In some embodiments, the requestor type information includes a boolean operator indicating whether the ODDR command was received from outside of the vehicle. In some embodiments, the requestor type information includes a requestor ID. In some embodiments, receipt of the data request constitutes a trigger event. In response to receipt of the data request from ODDR command receiver 431 or trigger command receiver 433, the request abstractor 434 is also configured to transmit the abstracted data request to a data collector 435.
The vehicle 430 further includes the data collector 435 configured to retrieve data from the memory in the vehicle 430 or from an application log in one or more applications 432 in response to instructions from the request abstractor 434. The data collector 435 determines what data to collect based on the abstracted request from the request abstractor 434. In some embodiments, the instructions received by the data collector 435 include information related a time duration before and after the trigger event to collect data. In some embodiments, the instructions received by the data collector 435 include information related to a type of data, such as type of sensor, to collect in response to occurrence of the trigger event. In some embodiments, the data collector 435 is configured to transmit a notification to an event transferer 437 of the occurrence of a trigger event associated with a data request. In some embodiments, the determination of whether the trigger event has occurred is determined by receipt of a data request from the server 420 or from the applications 432. In some embodiments, the determination of whether the trigger event has occurred is determined based on data received from the sensors of the vehicle satisfying a trigger condition determined in a received data request. The data collector 435 is configured to transmit the collected data for satisfying the data request to a data transferer 436.
The data transferer 436 is configured to transmit the data from the data collector 435 to the server 420. In some embodiments, the data transferer 436 is configured to transmit the data wirelessly. In some embodiments, the data transferer 436 is configured to transmit the data via a wired connection. In some embodiments, the data transferer 436 is configured to transmit the data along with a query ID of the data request. In some embodiments, the data transferer 436 is configured to transmit information indicating whether the data being transmitted partially or completely satisfies the data request. In some embodiments, the data transferer 436 is configured to transmit priority level information associated with the data request at least partially satisfied by the data.
The event transferer 437 is configured to transmit the trigger event data from the data collector 435 to the server 420. In some embodiments, the event transferer 437 is configured to transmit the trigger event data wirelessly. In some embodiments, the event transferer 437 is configured to transmit the trigger event data via a wired connection. In some embodiments, the event transferer 437 is configured to transmit the trigger event data along with a query ID of the data request. In some embodiments, the event transferer 437 is configured to transmit priority level information associated with the data request related to the trigger event data. In some embodiments, the event transferer 537 is configured to transmit metadata associated with the trigger event in response to detection of the trigger even occurring. The metadata, such as trigger event time and data collection time range, helps the sever 420 to know that the sensor data from the data transferer 436 will be transmitted in order to help the server 420 optimize data processing. In some embodiments, the event transferer 437 is omitted and the metadata is transmitted by the data transferer 436.
Using the ODDR system 400 permits users to obtain information from one or more vehicles 430 in a format that is easy to understand without relying on specialized equipment to request or read the received data. The ability to prioritize data requests in the ODDR system 400 help to ensure that law enforcement is able to obtain data relevant to public safety, while also permitting user to pay a fee to obtain data faster. This flexibility helps to improve the usefulness of the ODDR system 400 for a wide range of users.
The ODDR command 510 includes a transfer priority parameter 511 that indicates a priority level of the data request. The ODDR command 510 further includes a log level parameter 512 that indicates what type of data, if any, should be retrieved from other applications on the vehicle. For example, in some embodiments, the ODDR command 510 retrieves data from an object recognition application. The log level parameter 512 determines what type of data to retrieve from the other application, such as error level or critical level. In some embodiments, the log level parameter 512 is omitted from the ODDR command 510 or the log level parameter 512 is left in a null state. The ODDR command 510 further includes a time range to be collected parameter 513 that indicates a time period before and/or after a trigger event to collect data. The time range is corresponding to the start time and the end time that was entered in GUI 200 by the users. The ODDR command 510 further includes a uniform resource locator (URL) endpoint parameter 514 that indicates a destination for the data collected in response to the data request. The ODDR command 510 further includes a frequency parameter 515 that indicates how often, if ever, the data should be sampled from the rime range 513. For example, when the event time is t=100 sec, the time range comprises start time=−1 sec and end time=2 sec and the frequency is 10 Hz (100 msec cycle), then the data at t=99.0 sec, 99.1 sec, 99.2 sec, . . . , 101.9 sec, 102.0 sec is collected by the ODDR command. The ODDR command 510 further includes a log ID parameter 516 that indicates types of sensors and/or applications usable to collect the data requested by the data request. In some embodiments, unique IDs (such as Universally unique identifier (UUID)) are pre-assigned to all the sensors and applications, and the unique IDs which the user want to collect data from is specified in the log ID parameter 516. The ODDR command 510 further includes a requester ID parameter 517 that indicates an identity of the user that made the data request. The ODDR command 510 further includes an event ID parameter 518 that indicates a trigger event associated with the data request. The ODDR command 510 further includes a budget ID parameter 519 that indicates how much of the resources of the vehicle, e.g., vehicle 140 (
The method 600 further includes operation 610 in which an ODDR command is transmitted to one or more vehicles, e.g., vehicle 140 (
The method 600 further includes operation 615 in which the vehicle, e.g., vehicle 140 (
The method 600 further includes operation 620 in which a request abstractor, e.g. request abstractor 434 (
The method 600 further includes operation 625 in which event information is sent to the server. In some embodiments, the event information is sent to the server by event transferer 437 (
The method 600 further includes operation 630 in which the server receives the event information from the vehicle. In some embodiments, the event information is received by the event receiver 424 (
The method 600 further includes operation 635 in which data that at least partially satisfies the data request is transmitted from the vehicle to the server. In some embodiments, the data is transmitted to the server by the data transferer 436 (
The method 600 further includes operation 640 in which the server receives the data from the vehicle. In some embodiments, the data is received by the data receiver 423 (
The method 600 further includes operation 645 in which the data is stored in a database. In some embodiments, the data is stored in data storage 126 (
The method 600 further includes operation 650 in which the user is notified of the available data. In some embodiments, the user is notified using completion notifier 426 (
In some embodiments, the method 600 includes additional operations. For example, in some embodiments, the method 600 includes prioritizing transmission of ODDR commands to the vehicle based on a priority level of a data request. In some embodiments, at least one operation is omitted from the method 600. For example, in some embodiments, the event information is not transmitted to the server. In some embodiments, an order of operations of the method 600 is changed. For example, in some embodiments, the event information is transmitted to the server (operation 625) prior to the compiling of data associated with the trigger event (operation 620).
The method 600 permits users to obtain information from one or more vehicles in a format that is easy to understand without relying on specialized equipment to request or read the received data. This flexibility helps to improve an ability of a user to develop software using real world data to improve the usefulness of the software product, in some embodiments.
In some embodiments, the processor 702 is a central processing unit (CPU), a multi-processor, a distributed processing system, an application specific integrated circuit (ASIC), and/or a suitable processing unit.
In some embodiments, the computer readable storage medium 704 is an electronic, magnetic, optical, electromagnetic, infrared, and/or a semiconductor system (or apparatus or device). For example, the computer readable storage medium 704 includes a semiconductor or solid-state memory, a magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk, and/or an optical disk. In some embodiments using optical disks, the computer readable storage medium 704 includes a compact disk-read only memory (CD-ROM), a compact disk-read/write (CD-R/W), and/or a digital video disc (DVD).
In some embodiments, the storage medium 7704 stores the computer program code 706 configured to cause system 700 to perform a portion or all of the operations as described in ODDR system 100 (
In some embodiments, the storage medium 704 stores instructions 707 for interfacing with manufacturing machines. The instructions 707 enable processor 702 to generate manufacturing instructions readable by the manufacturing machines to effectively implement method 400 during a manufacturing process.
System 700 includes I/O interface 710. I/O interface 710 is coupled to external circuitry. In some embodiments, I/O interface 710 includes a keyboard, keypad, mouse, trackball, trackpad, and/or cursor direction keys for communicating information and commands to processor 702.
System 700 also includes network interface 712 coupled to the processor 702. Network interface 712 allows system 700 to communicate with network 714, to which one or more other computer systems are connected. Network interface 712 includes wireless network interfaces such as BLUETOOTH, WIFI, WIMAX, GPRS, or WCDMA; or wired network interface such as ETHERNET, USB, or IEEE-1394. In some embodiments, a portion or all of the operations as described in ODDR system 100 (
An aspect of this description relates to a method. The method includes receiving information from a user interface (UI) for a data request. The method further includes assigning identification information to the data request. The method further includes storing the data request in association with the identification information. The method further includes transmitting the data request to a vehicle. The method further includes receiving data from a source the vehicle in response to the transmitted data request. The method further includes notifying a user of the received data. In some embodiments, the method further includes identifying the vehicle to receive the data request based on the data request. In some embodiments, the method further includes determining a priority level of the data request received from the UI. In some embodiments, the method further includes determining the priority level of the data request comprises determining the priority level of the data request based on payment information received from the UI. In some embodiments, the method further includes limiting access to a sensor in the vehicle based on a determined identity of the user. In some embodiments, the method further includes updating a status of the data request in response to transmitting the data request to the vehicle; and instructing the UI to provide a status of the data request to the user. In some embodiments, the method further includes updating a status of the data request in response to receiving sensor data from the vehicle; and instructing the UI to provide a status of the data request to the user. In some embodiments, the method further includes transmitting the received sensor data to the user along with the notification to the user. In some embodiments, the method further includes permitting the user to access the received sensor data in response to transmitting the notification to the user of the received sensor data.
An aspect of this description relates to a system. The system includes a sensor. The system further includes a non-transitory computer readable medium configured to store instructions thereon. The system further includes a processor connected to the non-transitory computer readable medium. The processor is configured to execute the instructions for receiving a data request based on information received from a user, wherein the data request comprises trigger event information. The processor is further configured to execute the instructions for determining whether a trigger event indicated by the trigger event information has occurred based on an application stored on the non-transitory computer readable medium. The processor is further configured to execute the instructions for compiling data from the sensor in response to a determination that the trigger event has occurred, wherein a time period of the complied data prior to the trigger event and after the trigger event is based on the received data request. The processor is further configured to execute the instructions for instructing a first transmitter to transmit an indication that the trigger event has occurred to a server. The processor is further configured to execute the instructions for instructing a second transmitter to transmit the complied data to the server. In some embodiments, the system further includes a vehicle, wherein the sensor is attached to the vehicle.
The foregoing outlines features of several embodiments so that those skilled in the art may better understand the aspects of the present disclosure. Those skilled in the art should appreciate that they may readily use the present disclosure as a basis for designing or modifying other processes and structures for carrying out the same purposes and/or achieving the same advantages of the embodiments introduced herein. Those skilled in the art should also realize that such equivalent constructions do not depart from the spirit and scope of the present disclosure, and that they may make various changes, substitutions, and alterations herein without departing from the spirit and scope of the present disclosure.
