Big telematics data constructing system

Abstract

Apparatus, device, methods and system relating to a vehicular telemetry environment for the real time generation and transformation of raw telematics big data into analytical telematics big data that includes raw telematics big data and supplemental data.

Description

TECHNICAL FIELD OF THE INVENTION

The present invention generally relates to a big telematics data device, method and system for application in vehicular telemetry environments. More specifically, the present invention relates to the real time construction of big telematics data for subsequent fleet management analytical analysis.

BACKGROUND OF THE INVENTION

Vehicular Telemetry systems are known in the prior art where a vehicle may be equipped with a vehicular telemetry hardware device to monitor and log a range of vehicle parameters. An example of such a device is a Geotab™ GO device. The Geotab GO device interfaces to the vehicle through an on-board diagnostics (OBD) port to gain access to the vehicle network and engine control unit. Once interfaced and operational, the Geotab GO device monitors the vehicle bus and creates of log of raw vehicle data. The Geotab GO device may be further enhanced through a Geotab I/O expander to access and monitor other variables, sensors and devices resulting in a more complex and larger log of raw data. Additionally, the Geotab GO device may further include a GPS capability for tracking and logging raw GPS data. The Geotab GO device may also include an accelerometer for monitoring and logging raw accelerometer data, The real time operation of a plurality of Geotab GO devices produces and communicates multiple complex logs of some or all of this combined raw data to a remote site for subsequent analysis.

The data is considered to be big telematics data due to the complexity of the raw data, the velocity of the raw data, the variety of the raw data, the variability of the raw data and the significant volume of raw data that is communicated to a remote site on a timely basis. For example, on 10 Dec. 2014 there were approximately 250,000 Geotab GO devices in active operation monitoring, tracking and communicating multiple complex logs of raw telematics big data to a Geotab data center. The volume of raw telematics big data in a single day exceeded 300 million records and more than 40 GB of raw telematics big data.

The past approach for transforming the big telematics raw data into a format for use with a SQL database and corresponding analytics process was to delay and copy each full day of big telematics raw data to a separate database where the big telematics raw data could be processed and decoded into a format that could provide meaningful value in an analytics process. This past approach is resource consuming and is typically run during the night when the number of active Geotab GO devices is at a minimum. In this example, the processing and decoding of the big telematics raw data required more that 12 hours for each day of big telematics raw data. The analytics process and corresponding useful information to fleet managers performing fleet management activities is at least 1.5 days old, negatively influencing any real time sensitive fleet management decisions.

SUMMARY OF THE INVENTION

The present invention is directed to aspects in a vehicular telemetry environment. The present invention provides a new capability for constructing big telematics data in real time for subsequent real time fleet management analytics.

According to a first broad aspect of the invention, there is a real time analytical telematics big data constructing device comprising a data segregator, a data amender, and a data amalgamator. The data segregator for receiving raw telematics big data and segregating the raw telematics big data into at least one preserve data and at least one alter data. The data amender for receiving the at least one alter data and at least one supplemental data to provide at least one amended data. The data amalgamator for combining the at least one preserve data with the at least one amended data, whereby the raw telematics big data is transformed into analytical telematics big data including the at least one preserve data and the at least one alter data.

According to a second broad aspect of the invention, there is a real time analytical telematics big data generating process comprising: a data segregator state, a data amender state, and a data amalgamator state. The data segregator state configured to receive raw telematics big data and segregating the raw telematics big data into at least one preserve data and at least one alter data. The data amender state for receiving the at least one alter data and at least one supplemental data to provide at least one amended data. The data amalgamator state for combining the at least one preserve data with the at least said one amended data, whereby the raw telematics big data is transformed into analytical telematics big data including the at least one preserve data and the at least one alter data.

According to a third broad aspect of the invention, there is a real time analytical telematics big data constructing system comprising at least one mobile telematics device, and at least one analytical telematics big data constructor. The at least one telematics device for providing raw telematics big data to the at least one analytical telematics big data constructor. The at least one analytical telematics big data constructor for segregating the raw telematics big data into at least one preserve data and at least one alter data. The at least one analytical telematics big data constructor for receiving at least one alter data and at least one supplemental data to provide at least one amended data. The at least one analytical telematics big data constructor for combining the at least one preserve data with the at least one amended data, whereby the raw telematics big data is transformed into analytical telematics big data including the at least one preserve data and the at least one alter data.

In an embodiment of the invention, the raw telematics big data is selected from the group of manufacturer indications for vehicle information number, debug data, manufacturer diagnostic trouble codes, latitude coordinates, longitude coordinates, accelerometer data, sensor data, near field communication data, or beacon object data.

In another embodiment of the invention, the at least one preserve data is selected from the group of manufacturer indications for vehicle information number, debug data, or accelerometer data,

In another embodiment of the invention, the at least one alter data is selected from the group of raw vehicle data or raw GPS data.

In another embodiment of the invention, the supplemental data is at least one of augment data or translate data. In another embodiment of the invention, the augment data is selected from the group of postal codes, zip codes, street names, addresses or commercial business names. In another embodiment of the invention, the translate data is selected from the group of fault descriptions, odometer value, fuel, air metering, ignition system, emissions, vehicle speed control, idle control, transmission, current speed, engine RPM, battery voltages, pedal positions, tire pressure, oil level, airbag status, seatbelt indications, emission control data, engine temperature, intake manifold pressure, braking information, fuel levels, mass air flow values, traffic data, hours of service data, driver identification data, distance data, time data, amounts of material, truck scale weight data, driver distraction data, remote worker data, school bus warning light activation or door position.

In another embodiment of the invention, the real time analytical telematics big data constructing device further includes an active big data load balancer. In another embodiment of the invention, active big data load balancer is an active buffer. In another embodiment of the invention, the active buffer is at least one active buffer for receiving alter data. In another embodiment of the invention, the active buffer is at least one active double buffer for receiving analytical telematics big data. In another embodiment of the invention, the active big data load balancer is auto scaling. In another embodiment of the invention, the auto scaling pertains to the data segregator and the raw telematics big data. In another embodiment of the invention, the auto scaling pertains to the data amender and the supplemental data. In another embodiment of the invention, the auto scaling pertains to the data amalgamator and the analytical telematics big data. In another embodiment of the invention, the active big data load balancer is an active telematics pipeline. In another embodiment of the invention, the active telematics pipeline is at least one preserve data pipeline configured to auto scale for the at least one preserve data. In another embodiment of the invention, the active telematics pipeline is at least one alter data pipeline configured to auto scale for the at least one alter data.

These and other aspects and features of non-limiting embodiments are apparent to those skilled in the art upon review of the following detailed description of the non-limiting embodiments and the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary non-limiting embodiments of the present invention are described with reference to the accompanying drawings in which:

FIG. 1 is a high level diagrammatic view of a vehicular telemetry data environment and infrastructure;

FIG. 2a is a diagrammatic view of a vehicular telemetry hardware system including an on-board portion and a resident vehicular portion;

FIG. 2b is a diagrammatic view of a vehicular telemetry hardware system communicating with at least one intelligent I/O expander;

FIG. 2c is a diagrammatic view of a vehicular telemetry hardware system with an integral Bluetooth™ module capable of communication with at least one beacon module;

FIG. 2d is a diagrammatic view of at least on intelligent I/O expander with an integral Bluetooth module capable of communication with at least one beacon module;

FIG. 2e is a diagrammatic view of an intelligent I/O expander and device capable of communication with at least one beacon module;

FIG. 3 is a diagrammatic view of a vehicular telemetry analytical environment including a network, mobile devices, servers and computing devices;

FIG. 4 is a diagrammatic view of a vehicular telemetry network illustrating raw telematics big data flow between the mobile devices and servers;

FIG. 5 is a diagrammatic view of a vehicular telemetry network illustrating analytical big telematics data flow between the servers and computing devices;

FIG. 6a is a diagrammatic representation of an embodiment of the analytical big telematics data constructor;

FIG. 6b is a diagrammatic representation of an embodiment of the analytical big telematics data constructor illustrating a plurality of preserve data type;

FIG. 6c is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a plurality of alter data and amended data types;

FIG. 7a is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender and receipt of the raw telematics big data and the supplemental data;

FIG. 7b is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a second buffer to accommodate a delay or errors in data flow through the analytical big telematics data constructor;

FIG. 7c is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a combination of the first and second buffer;

FIG. 8a is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a pair of supplemental information servers for translation data and augmentation data;

FIG. 8b is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating one supplemental information server for translation data;

FIG. 8c is a diagrammatic representation of another embodiment of the analytical big telematice data constructor further illustrating one supplemental information server for augmentation data;

FIG. 9a is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender and a pair of supplemental information servers for translation data and augmentation data;

FIG. 9b is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender and one supplemental information server for translation data;

FIG. 9c is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender and one supplemental information server for augmentation data;

FIG. 10a is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender, a second buffer to accommodate a delay or errors in data flow through the analytical big telematics data constructor and a pair of supplemental information servers for translation data and augmentation data;

FIG. 10b is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender, a second buffer to accommodate a delay or errors in data flow through the analytical big telematics data constructor and one supplemental information server for translation data;

FIG. 10c is a diagrammatic representation of another embodiment of the analytical big telematics data constructor further illustrating a first buffer to accommodate the data amender, a second buffer to accommodate a delay or errors in data flow through the analytical big telematics data constructor and one supplemental information server for augmentation data;

FIG. 11 is a diagrammatic representation of another embodiment of the invention illustrating examples of raw telematics big data, translation data, augmentation data and analytics big telematics data;

FIG. 12a is a diagrammatic state machine representation of the real time analytical big telematics data constructing logic;

FIG. 12b is a diagrammatic state machine representation of the real time analytical big telematics data constructing logic further illustrating a number of data amender sub-states;

FIG. 12c is a diagrammatic state machine representation of the real time analytical big telematics data constructing logic further illustrating an example pair of data amender sub-states for translate data and augment data;

FIG. 13a is a diagrammatic representation of the data segregator state logic and tasks for sequential processing;

FIG. 13b is an alternate diagrammatic representation of the data segregator state logic and tasks for parallel processing;

FIG. 13c is a diagrammatic representation of the data amender state logic and tasks;

FIG. 13d is a diagrammatic representation of the data amalgamator state logic and tasks for sequential processing;

FIG. 13e is a diagrammatic representation of the data amalgamator state logic and tasks for parallel processing; and

FIG. 13f is a diagrammatic representation of the data transfer state logic and tasks.

The drawings are not necessarily to scale and may be diagrammatic representations of the exemplary non-limiting embodiments of the present invention.

DETAILED DESCRIPTION

Vehicular Telemetry Environment & Infrastructure

Referring to FIG. 1 of the drawings, there is illustrated a high level overview of a vehicular telemetry environment and infrastructure. There is at least one vehicle generally indicated at 11. The vehicle 11 includes a vehicular telemetry hardware system 30 and a resident vehicular portion 42. Optionally connected to the telemetry hardware system 30 is at least one intelligent I/O expander 50 (not shown). In addition, there may be at least one Bluetooth module 45 (not shown) for communication with at least one of the vehicular telemetry hardware system 30 or the intelligent I/O expander 50.

The vehicular telemetry hardware system 30 monitors and logs a first category of raw telematics data known as vehicle data. The vehicular telemetry hardware system 30 may also log a second category of raw telematics data known as GPS coordinate data and may also log a third category of raw telematics data known as accelerometer data.

The intelligent I/O expander 50 may also monitor a fourth category of raw expander data. A fourth category of raw data may also be provided to the vehicular telemetry hardware system 30 for logging as raw telematics data.

The Bluetooth module 45 may also be in periodic communication with at least one Bluetooth beacon 21. The at least one Bluetooth beacon may be attached or affixed or associated with at least one object associated with the vehicle 11 to provide a range of indications concerning the objects. These objects include, but are not limited to packages, equipment, drivers and support personnel. The Bluetooth module 45 provides this fifth category of raw Bluetooth object data to the vehicular telemetry hardware system 30 either directly or indirectly through an intelligent I/O expander 50 for subsequent logging as raw telematics data.

Persons skilled in the art appreciate the five categories of data are illustrative and may further include other categories of data. In this context, a category of raw telematics data is a grouping or classification of a type of similar data. A category may be a complete set of raw telematics data or a subset of the raw telematics data. For example, GPS coordinate data is a group or type of similar data. Accelerometer data is another group or type of similar data. A log may include both GPS coordinate data and accelerometer data or a log may be separate data. Persons skilled in the art also appreciate the makeup, format and variety of each log of raw telematics data in each of the five categories is complex and significantly different. The amount of data in each of the five categories is also significantly different and the frequency and timing for communicating the data may vary greatly. Persons skilled in the art further appreciate the monitoring, logging and the communication of multiple logs or raw telematics data results in the creation of raw telematics big data.

The vehicular telemetry environment and infrastructure also provides communication and exchange of raw telematics data, information, commands, and messages between the at least one server 19, at least one computing device 20 (desktop computers, hand held device computers, smart phone computers, tablet computers, notebook computers, wearable devices and other computing devices), and vehicles 11. In one example, the communication 12 is to/from a satellite 13. The satellite 13 in turn communicates with a ground-based system 15 connected to a computer network 18. In another example, the communication 16 is to/from a cellular network 17 connected to the computer network 18. Further examples of communication devices include Wi-Fi devices and Bluetooth devices connected to the computer network 18.

Computing device 20 and server 19 with corresponding application software communicate over the computer network 18. In an embodiment of the invention, the MyGeotab™ fleet management application software runs on a server 19. The application software may also be based upon Cloud computing. Clients operating a computing device 20 communicate with the MyGeotab fleet management application software running on the server 19. Data, information, messages and commands may be sent and received over the communication environment and infrastructure between the vehicular telemetry hardware system 30 and the server 19.

Data and information may be sent from the vehicular telemetry hardware system 30 to the cellular network 17, to the computer network 18, and to the at least one server 19. Computing devices 20 may access the data and information on the servers 19. Alternatively, data, information, and commands may be sent from the at least one server 19, to the network 19, to the cellular network 17, and to the vehicular telemetry hardware system 30.

Data and information may also be sent from vehicular telemetry hardware system to an intelligent I/O expander 50, to an Iridium™ device, the satellite 13, the ground based station 15, the computer network 18, and to the at least one server 19. Computing devices 20 may access data and information on the servers 19. Data, information, and commands may also be sent from the at least one server 19, to the computer network 18, the ground based station 15, the satellite 13, an Iridium device, to an intelligent I/O expander 50, and to a vehicular telemetry hardware system.

Vehicular Telemetry Hardware System

Referring now to FIG. 2a of the drawings, there is illustrated a vehicular telemetry hardware system generally indicated at 30. The on-board portion generally includes: a DTE (data terminal equipment) telemetry microprocessor 31; a DCE (data communications equipment) wireless telemetry communications microprocessor 32; a GPS (global positioning system) module 33; an accelerometer 34; a non-volatile memory 35; and provision for an OBD (on board diagnostics) interface 36 for communication 43 with a vehicle network communications bus 37.

The resident vehicular portion 42 generally includes: the vehicle network communications bus 37; the ECM (electronic control module) 38; the PCM (power train control module) 40; the ECUs (electronic control units) 41; and other engine control/monitor computers and microcontrollers 39.

While the system is described as having an on-board portion 30 and a resident vehicular portion 42, it is also understood that this could be either a complete resident vehicular system or a complete on-board system.

The DTE telemetry microprocessor 31 is interconnected with the OBD interface 36 for communication with the vehicle network communications bus 37. The vehicle network communications bus 37 in turn connects for communication with the ECM 38, the engine control/monitor computers and microcontrollers 39, the PCM 40, and the ECU 41.

The DTE telemetry microprocessor 31 has the ability through the OBD interface 36 when connected to the vehicle network communications bus 37 to monitor and receive vehicle data and information from the resident vehicular system components for further processing.

As a brief non-limiting example of a first category of raw telematics vehicle data and information, the list may include but is not limited to: a VIN (vehicle identification number), current odometer reading, current speed, engine RPM, battery voltage, engine coolant temperature, engine coolant level, accelerator peddle position, brake peddle position, various manufacturer specific vehicle DTCs (diagnostic trouble codes), tire pressure, oil level, airbag status, seatbelt indication, emission control data, engine temperature, intake manifold pressure, transmission data, braking information, mass air flow indications and fuel level. It is further understood that the amount and type of raw vehicle data and information will change from manufacturer to manufacturer and evolve with the introduction of additional vehicular technology.

Continuing now with the DTE telemetry microprocessor 31, it is further interconnected for communication with the DCE wireless telemetry communications microprocessor 32. In an embodiment of the invention, an example of the DCE wireless telemetry communications microprocessor 32 is a Leon 100 commercially available from u-blox Corporation. The Leon 100 provides mobile communications capability and functionality to the vehicular telemetry hardware system 30 for sending and receiving data to/from a remote site 44. A remote site 44 could be another vehicle or a ground based station. The ground-based station may include one or more servers 19 connected through a computer network 18 (see FIG. 1). In addition, the ground-based station may include computer application software for data acquisition, analysis, and sending/receiving commands to/from the vehicular telemetry hardware system 30.

The DTE telemetry microprocessor 31 is also interconnected for communication to the GPS module 33. In an embodiment of the invention, an example of the GPS module 33 is a Neo-5 commercially available from u-blox Corporation. The Neo-5 provides GPS receiver capability and functionality to the vehicular telemetry hardware system 30. The GPS module 33 provides the latitude and longitude coordinates as a second category of raw telematics data and information.

The DTE telemetry microprocessor 31 is further interconnected with an external non-volatile memory 35. In an embodiment of the invention, an example of the memory 35 is a 32 MB non-volatile memory store commercially available from Atmel Corporation. The memory 35 of the present invention is used for logging raw data.

The DTE telemetry microprocessor 31 is further interconnected for communication with an accelerometer 34. An accelerometer (34) is a device that measures the physical acceleration experienced by an object. Single and multi-axis models of accelerometers are available to detect the magnitude and direction of the acceleration, or g-force, and the device may also be used to sense orientation, coordinate acceleration, vibration, shock, and falling. The accelerometer 34 provides this data and information as a third category of raw telematics data.

In an embodiment of the invention, an example of a multi-axis accelerometer (34) is the LIS302DL MEMS Motion Sensor commercially available from STMicroelectronics. The LIS302DL integrated circuit is an ultra compact low-power three axes linear accelerometer that includes a sensing element and an IC interface able to take the information from the sensing element and to provide the measured acceleration data to other devices, such as a DTE Telemetry Microprocessor (31), through an I2C/SPI (Inter-Integrated Circuit) (Serial Peripheral Interface) serial interface. The LIS302DL integrated circuit has a user-selectable full-scale range of +−2 g and +−8 g, programmable thresholds, and is capable of measuring accelerations with an output data rate of 100 Hz or 400 Hz.

In an embodiment of the invention, the DTE telemetry microprocessor 31 also includes an amount of internal memory for storing firmware that executes in part, methods to operate and control the overall vehicular telemetry hardware system 30. In addition, the microprocessor 31 and firmware log data, format messages, receive messages, and convert or reformat messages. In an embodiment of the invention, an example of a DTE telemetry microprocessor 31 is a PIC24H microcontroller commercially available from Microchip Corporation.

Referring now to FIG. 2b of the drawings, there is illustrated a vehicular hardware telemetry system generally indicated at 30 further communicating with at least one intelligent I/O expander 50. In this embodiment, the vehicular telemetry hardware system 30 includes a messaging interface 53. The messaging interface 53 is connected to the DTE telemetry microprocessor 31. In addition, a messaging interface 53 in an intelligent I/O expander 50 may be connected by the private bus 55. The private bus 55 permits messages to be sent and received between the vehicular telemetry hardware system 30 and the intelligent I/O expander, or a plurality of I/O expanders (not shown). The intelligent I/O expander hardware system 50 also includes a microprocessor 51 and memory 52. Alternatively, the intelligent I/O expander hardware system 50 includes a microcontroller 51. A microcontroller includes a CPU, RAM, ROM and peripherals. Persons skilled in the art appreciate the term processor contemplates either a microprocessor and memory or a microcontroller in all embodiments of the disclosed hardware (vehicle telemetry hardware system 30, intelligent I/O expander hardware system 50, Bluetooth module 45 (FIG. 2c) and Bluetooth beacon 21 (FIG. 2c)). The microprocessor 51 is also connected to the messaging interface 53 and the configurable multi-device interface 54. In an embodiment of the invention, a microcontroller 51 is an LPC1756 32 bit ARM Cortec-M3 device with up to 512 KB of program memory and 64 KB SRAM. The LPC1756 also includes four UARTs, two CAN 2.08 channels, a 12-bit analog to digital converter, and a 10 bit digital to analog converter. In an alternative embodiment, the intelligent I/O expander hardware system 50 may include text to speech hardware and associated firmware (not illustrated) for audio output of a message to an operator of a vehicle 11.

The microprocessor 51 and memory 52 cooperate to monitor at least one device 60 (a device 62 and interface 61) communicating 56 with the intelligent I/O expander 50 over the configurable multi device interface 54. Data and information from the device 60 may be provided over the messaging interface 53 to the vehicular telemetry hardware system 30 where the data and information is retained in the log of raw telematics data. Data and information from a device 60 associated with an intelligent I/O expander provides the 4^th category of raw expander data and may include, but not limited to, traffic data, hours of service data, near field communication data such as driver identification, vehicle sensor data (distance, time, amount of material (solid, liquid), truck scale weight data, driver distraction data, remote worker data, school bus warning lights, and doors open/closed.

Referring now to FIGS. 2C, 2D and 2e, there are three alternative embodiments relating to the Bluetooth module 45 and Bluetooth beacon 21 for monitoring and receiving the 5th category of raw beacon data. The Bluetooth module 45 includes a microprocessor 142, memory 144 and radio module 146. The microprocessor 142, memory 144 and associated firmware provide monitoring of Bluetooth beacon data and information and subsequent communication of the Bluetooth beacon data, either directly or indirectly through an intelligent I/O expander 50, to a vehicular telemetry hardware system 30.

In an embodiment, the Bluetooth module 45 is integral with the vehicular telemetry hardware system 30. Data and information is communicated 130 directly from the Bluetooth beacon 21 to the vehicular telemetry hardware system 30. In an alternate embodiment, the Bluetooth module integral 45 is with the intelligent I/O expander. Data and information is communicated 130 directly to the intelligent I/O expander 50 and then through the messaging interface 53 to the vehicular telemetry hardware system 30. In another alternate embodiment, the Bluetooth module 45 includes an interface 148 for communication 56 to the configurable multi-device interface 54 of the intelligent I/O expander 50. Data and information is communicated 130 directly to the Bluetooth module 45, then communicated 56 to the intelligent I/O expander and finally communicated over the private bus 55 to the vehicular telemetry hardware system 30.

Data and information from a Bluetooth beacon 21 provides the 5th category of raw telematics data and may include data and information concerning an, object associated with a Bluetooth beacon 21. This data and information includes, but is not limited to, object acceleration data, object temperature data, battery level data, object pressure data, object luminance data and user defined object sensor data. This 5th category of data may be used to indicate damage to an article or a hazardous condition to an article.

Vehicular Telemetry Analytical Environment

Referring now to FIGS. 3, 4 and 5, the vehicular telemetry analytical environment is further described. The map 150 illustrates a number of vehicles 11 (A through K) operating in real time. For example, Geotab presently has over 400,000 Geotab GO devices operating in 70 countries communicating multiple complex logs of raw telematics data to the server 19. Each of the vehicles 11 has at least a vehicular telemetry hardware system 30 installed and operational in the vehicle 11. Alternatively, some or all of the vehicles 11 may further include an intelligent I/O expander 50 communicating with a vehicular telemetry hardware system 30. The intelligent I/O expander 50 may further include devices 60 communicating with the intelligent I/O expander 50 and vehicular telemetry hardware system 30. Alternatively, a Bluetooth module 45 may be included with one of the vehicular telemetry hardware system 30, the device 60, or the intelligent I/O expander 50. When a Bluetooth module 45 is included, then Bluetooth beacons 21 may further communicate data with the Bluetooth module 45. Collectively, these alternative embodiments and different configurations of hardware generate in real time the raw telematics big data. The vehicular telemetry hardware system 30 is able to communicate the raw telematics big data over the network 18 to other servers 19 and computing devices 20. Communication of the raw telematics big data may occur at pre-defined intervals. Communication may also be triggered because of an event such as an accident. Communication may be periodic or aperiodic. Communication may also be further requested by a command sent from a server 19 or a computing device 20. Each vehicle 11 will provide a log of category 1 raw data through the vehicular telemetry hardware system 30. Then, dependent upon the specific configuration previously described, each vehicle 11 may further also include in a log, at least one of category 2, category 3, category 4 and category 5 raw telematics data through the vehicular telemetry hardware system 30.

A number of special purpose servers 19 are also part of the vehicular telemetry analytical environment and communicate over the network 18. The servers 19 may be one server, more than one server, distributed, Cloud based or portioned into specific types of functionality such as a supplemental information server 152, external third party servers, a store and forward server 154 and an analytics server devices 156. Computing 20 may also communicate with the servers 19 over the network 18.

In an embodiment of the invention, the logs of raw telematics data are communicated from a plurality of vehicles in real time and received by a server 154 with a store and forward capability as raw telematics big data (RTbD). In an embodiment of the invention, an analytical telematics big data constructor 155 is disposed with the server 154. The analytical telematics big data constructor 155 receives the raw telematics big data (RTbD) either directly or indirectly from the server 154. The analytical telematics big data constructor 155 has access to supplemental data (SD) located either directly or indirectly on a supplemental information server 152. Alternatively, the supplemental data (SD) may be disposed with the server 154. The analytical telematics big data constructor 155 transforms the raw telematics big data (RTD) into analytical telematics big data (AtbD) for use with a server 156 having big data analytical capability 156. An example of such capability is the Google™ BigQuery technology. Then, computing devices 20 may access the analytical telematics big data (AtbD) in real time to perform fleet management queries and reporting. The server 156 with analytic capability may be a single analytics server or a plurality of analytic servers 156a, 156b, and 156c.

Analytical Telematics Big Data Constructor

Referring now to FIG. 6a, an embodiment of the analytical telematics big data constructor 155 is described. Persons skilled in the art appreciate the telematics that analytical big data constructor 155 may be a stand-alone device with a microprocessor, memory, firmware or software with communications capability. Alternatively, the analytical telematics big data constructor 155 may be integral with a special purpose server, for example a store and forward server 154. Alternatively, the analytical telematics big data constructor 155 may be associated or integral with a vehicle telemetry hardware system 30. Alternatively, the functionality of the analytical telematics big data constructor 155 may be a Cloud based resource. Alternatively, there may be one or more analytical telematics big data constructors 155 for transforming in real time the raw telematics big data (RTbD) into analytical telematics big data (ATbD).

The analytical telematics big data constructor 155 receives in real time the raw telematics big data (RTbD) into a data segregator. The raw telematics big data (RTbD) is a mixed log of raw telematics data and includes category 1 raw vehicle data and at least one of category 2, category 3, category 4 or category 5 raw telematics data. Persons skilled in the art appreciate there may be more or less than five categories of raw telematics data. The data segregator processes each log of raw telematics data and identifies or separates the data into preserve data and alter data in real time. This is performed on a category-by-category basis, or alternatively, on a sub-category basis. The preserve data is provided in the raw format to a data amalgamator. The alter data is provided to a data amender. The data amender obtains supplemental data (SD) to supplement and amend the alter data with additional information. The supplemental data (SD) may be resident with the analytical telematics big data constructor 155 or external, for example located on at least one supplemental information server 152, or located on at least one store and forward server 154 or in the Cloud and may further be distributed. The data amender then provides the alter data and the supplemental data to the data amalgamator. The data amalgamator reassembles or formats the preserve data, alter data and supplemental data (SD) to construct the analytical telematics big data (ATbD) in real time. The analytical telematics big data (ATbD) may then be communicated in real time, or streamed in real time, or stored in real time for subsequent real time fleet management analytics. In an embodiment of the invention, the analytical telematics big data (ATbD) is communicated and streamed in real time to an analytics server 156 having access to the Google BigQuery technology.

Referring now to FIG. 66, another embodiment of the analytical telematics big data constructor 155 is described. In this embodiment, the data segregator processes the raw telematics big data (RTbD) into a plurality of distinct data (1, 2, 3, n) types or groups based upon the categories. The plurality of preserve data is then provided to the data amalgamator for assembly with the amended data for assembly into the analytical telematics big data (ATbD).

Referring now to FIG. 6c, another embodiment of the analytical telematics big data constructor 155 is described. In this embodiment the data segregator processes the raw telematics big data (RTbD) into preserve data (category 1) and a plurality of distinct alter data (A, B, C, n) types or groups based upon the categories (2, 3, 4 and 5). For example, one category may be engine data that is in a machine format. This machine format may be translated into a human readable format. Another example may be another category of GPS data in a machine format of latitude and different machine format may be longitude coordinates. This augmented with human readable information. The alter data types are provided to the data amender and the data amender obtains a plurality of corresponding supplemental data (D) types (A, B, C, n). The data amender then amends the alter data types with the corresponding supplemental data types. The preserve data and the plurality of amended data is provided to the data amalgamator for assembly into the analytical telematics big data (ATbD).

Persons skilled in the art appreciate that there may be one preserve data, one alter data, at least one preserve data, at least one alter data in different combinations between the data segregator and data amalgamator.

Analytical Telematics Big Data Constructor and Active Buffers

Another embodiment of the invention including at least one active buffer or blocking queue is described with reference to FIGS. 7a, 7b, and 7c. A first active buffer (see FIG. 7a) may be disposed with the analytical telematics big data constructor 155. The first active buffer may temporally retain at least one alter data. In an embodiment of the invention, the first active buffer is disposed intermediate the data segregator and data amalgamator. The first active buffer assists the analytical telematics big data constructor 155. For example, the processing of the raw telematics big data (RtbD) in the data segregator may be at a more constant rate in contrast to the processing of the alter data and supplemental data in the data amender. When a difference in processing rates occurs, or differences in timing, the first active buffer may smooth intermittent heavy data loads and minimize any impact of peak demand on availability and responsiveness of the analytical telematics big data constructor 155 and external services and supplemental data acquisition.

Alternatively, a second active double buffer or double blocking queue (see FIG. 7b) may also be disposed with the analytical telematics big data constructor 155. The second active double buffer may temporally retain the analytical telematics big data (ATbD). This may occur when a communication or streaming request fails due to either network issues or exceptions with the analytics server 156. The analytical telematics big data (ATbD) is held in the second active double buffer such that the data is available and communicated successfully to the analytics server 156 in a real time order and sequence. In an embodiment of the invention, the second active double buffer is disposed after the data amalgamator.

Alternatively, another embodiment with active buffers is illustrated in FIG. 7c and includes both the first active buffer and the second active double buffer.

Supplemental Data, Translation Data & Augmentation Data

Another set of embodiments of the invention is illustrated with example classifications or groups of supplemental data as shown with reference to FIGS. 8a, 8b and 8c. The data segregator processes the raw telematics big data (RTbD) into three types of streams of data. The first type of data is preserve data that is passed directly to the data amalgamator. A second type of data is alter translate data and the third type of data is the alter augment data. The data amender for this embodiment may be at least one data amender.

The alter translate data requires translation data. The data amender obtains supplemental data (SD) in the form of translation data (TD) to amend the alter translate data. The translation data (TD) may be resident with the analytical telematics big data constructor 155 or external, for example located on at least one translation server 153.

The alter augment data requires augmentation data (AD). The data amender obtains supplement data (SD) in the form of augmentation data to amend the alter augment data. The augmentation data (AD) may be resident with the analytical telematics big data constructor 155 or external, for example located on at least one augmentation server 157. The data amalgamator reassembles or formats the preserve data, amended translate data and amended augment data to construct the analytical telematics bigdata (ATbD). The analytical telematics bid data (ATbD) may then be communicated or streamed in real time or stored in real time for subsequent real time fleet management analytics.

The embodiment in FIG. 8b is similar to the embodiment in FIG. 8a, but the analytical telematics big data constructor 155 only provides translation data and preserve data in the transformation to analytical telematics big data (ATbD). The embodiment in FIG. 8c is also similar to the embodiment in FIG. 8a, but the analytical telematics big data constructor 155 only provides augmentation and preserve data in the transformation to analytical telematics big data (ATbD). The alternative embodiments of FIG. 8b and FIG. 8c are examples of analytical telematics big data constructors 155 dedicated to particular streams and categories of raw telematics big data (RTbD). Persons skilled in the art appreciate the analytical telematics big data constructor may process preserve data, alter data, or a combination of preserve data and alter data.

Another set of embodiments of the invention includes example categories of supplemental data and active buffers. This is described with reference to FIGS. 9a, 9b and 9c. The data segregator processes the raw telematics big data (RTbD) into three types of data. The first type of data is preserve data that is passed directly to the data amalgamator. A second type of data is alter translate data and the third type of data is the alter augment data. At least one active buffer is provided to the analytical telematics big data generator 155 to buffer one of or both of the alter translate data and the alter augment data. The data amender obtains supplemental in the form of translation data (TD) to amend the alter translate data and the supplemental data (SD) in the form of augmentation data (AD) to amend the alter augment data. The data amalgamator reassembles or formats the preserve data, amended translate data and the amended augment data to construct the analytical telematics big data (ATbD) that may then be communicated or streamed in real time or stored in real time for subsequent real time fleet management analytics.

The embodiment in FIG. 9b is similar to the embodiment in FIG. 9a, but the analytical telematics big data constructor 155 only provides translation data and preserve data in the transformation to analytical telematics big data (ATbD). The embodiment in FIG. 9c is also similar to the embodiment in FIG. 9a, but the analytical telematics big data constructor 155 provides augmentation and preserve data in the transformation to analytical telematics big data (ATbD). These alternative embodiments of FIG. 9b and FIG. 9c are also examples of analytical telematics big data constructors 155 dedicated to particular streams and categories of raw telematics big data (RTbD).

The embodiments illustrated in FIGS. 10a, 10b and 10c are similar to the embodiments in FIGS. 9a, 9b and 9c and further include both the first active buffer and second active double buffer. The first active buffer is disposed in the analytical telematics big data constructor 155 intermediate the data segregator and data amalgamator. The second active double buffer is disposed after the data amalgamator.

Analytical Telematics Big Data Constructor & Example Data Flow

FIG. 11 illustrates an embodiment of the invention with example data flow through the analytical telematics big data constructor 155. In this example, the raw telematics big data (RTbD) includes category 1 data in two subcategories. The first subcategory includes debug data and vehicle identification number (VIN) data. The second subcategory includes engine specific data. Category 2 data includes GPS data and category 3 data includes accelerometer data.

The raw telematics big data (RTbD) including category 1 (and subcategories), 2, and 3 is provided to the data segregator. The data segregator identifies preserve data from the raw telematics big data (RTbD). The preserve data includes the portions of category 1 data (debug data and vehicle identification number (VIN) data) and the category 3 accelerometer data. This preserve data is provided directly to the data amalgamator.

The data segregator also identifies alter translate data and includes a portion of the category 1 data (engine specific data). The translation data (TD) required includes at least one of fault code data, standard fault code data, non-standard fault code data, error descriptions, warning descriptions and diagnostic information. The data amender then provides the alter translate data and translation data (TD) in the form of amended engine data.

The data segregator also identifies alter augment data and includes the category 2 data (GPS data). The argumentation data (AD) required includes at least one of postal code or zip code data, street address data, or contact data. The data amender then provides the alter augment data and augmentation data in the form of amended GPS data.

The data amalgamator then assembles or formats and provides the analytical telematics big data (ATbD) in real time. The analytical telematics big data (ATbD) includes debug data, vehicle identification number (VIN) data, accelerometer data, engine data, at lease one of fault code data, standard fault code data, non-standard fault code data, error descriptions, warning descriptions, diagnostic information, GPS data and at least one of postal code data, zip code data, street address data, or contact data.

Categories of Data, Example Data & Supplemental Data

Table 1 provides an example list of categories of raw telematics data, example data for each category and an indication for any supplemental data required by each category. Category 1 is illustrated as a pair of sub-categories 1a and 1b but may also be organized into two separate categories. Table 1 is an example where the raw telematics data includes different groups or types of similar data in the form of data subsets.

TABLE 1
Example Raw, Augment and Translate Data.
Category	Category	Supplemental Data
Number	Type	Example Data	Example Augment Data	Example Translate Data
1a	Raw Vehicle	Manufacturer	Not required.	Not required.
	Data	indications for
		VIN, or debug
		data.
1b		Engine status data	Not required.	Fault descriptions,
		or engine fault		odometer value, fuel and
		data. Fault data		air metering, ignition
		may be GO device		system, emissions,
		specific data and		vehicle speed control,
		vehicle specific		idle control,
		data.		transmission, current
				speed, engine RPM,
				battery voltages, pedal
				positions, tire pressure,
				oil level, airbag status,
				seatbelt indications,
				emission control data,
				engine temperature,
				intake manifold pressure,
				braking information, fuel
				levels, or mass air flow
				values.
2	Raw GPS Data	Latitude and	Postal codes, zip codes,	Not required.
		longitude	street names, addresses, or
		coordinates	commercial businesses.
3	Raw	One or two or three	Not required.	Not required.
	Accelerometer	dimensional values
	Data.	for g-force in at
		least one axis or
		direction.
4	Raw Expander	Sensor or	Not required.	Traffic data, hours of
	Data.	manufacturer		service data, driver
		specific data,		identification data,
		sensor data, near		distance data, time data,
		field communication		amounts of material
		data.		(solid, liquid), truck
				scale weight data, driver
				distraction data, remote
				worker data, school bus
				warning light activation,
				or door open/closed.
5	Raw Beacon	One or two-	Not required.	Object damage or
	Object Data	dimensional values		hazardous conditions
		for g-force in at		have occurred.
		least one axis or
		direction, temperatures,
		battery level
		value, pressure,
		luminance and user
		defined sensor data.

Persons skilled in the art appreciate other categories, or sub-categories of raw telematics big data (RTbD) and other categories or sub-categories of supplement data (SD) may be included and transformed into analytical telematics big data (ATbD) by the analytical telematics big data constructor 155 of the present invention.

State Machine Representation

Referring now to FIGS. 12a, 12b, and 12c, a state machine representation of the logic associated with the analytical big telematics constructor 55 is described. There are four states to the logic that operate concurrently and in parallel. There may further be multiple instances of each state. The initial state is the data segregator state. The logic of the data segregator state is to filter, identify and separate the raw telematics big data (RTbD) into preserve data and alter data. The data segregator state waits for receipt of a log or portion of raw telematics big data (RTbD). Upon receipt, the data segregator processes the raw telematics big data (RTbD) into either at least one preserve data path or at least one alter data path. The raw telematics big data (RTbD) in the at least one preserve data path is optionally provided to a first active buffer or directly to the data amalgamator state. The raw telematics big data (RTbD) in the alter data path is optionally provided to a first active buffer or directly to the data amender state. Then, the data segregator state waits for receipt of the next log or portion of raw telematics big data (RTbD).

In an example embodiment of the invention, category 1a and 3 are preserve data and are provided to the data amalgamator state. Category 1b, 2, 4 and 5 are alter data and are provided to the data amender state.

The logic of the data amender state is to identify each category of alter data and associate a category of supplemental data with each category of alter data and provide amended data (alter data and supplemental data) to the data amalgamator state. The data amender state waits for receipt of a portion of raw telematics big data (RTbD) that is identified as alter data. Then, the data amender state obtains supplemental data for the alter data. This occurs for each category of alter data and associated supplemental data. Finally, the data amender state provides the amended data (each alter and each supplemental data) to the data amalgamator state.

In an embodiment of the invention, the data amender state has two sub-states, the translate data state and the augment data state. The translate data state obtains translate data for particular categories of alter data that require a translation. The augment data state obtains augment data for particular categories of alter data that require augmentation. Persons skilled in the art appreciate other sub-states may be added to the data amender state.

In an example embodiment of the invention Category 2 requires augment data and category 1b, 4 and 5 require translate data. Example augment data and translate data are previously illustrated in Table 1.

The logic of the data amalgamator state is to assemble, or format, or integrate the preserve data, alter data and supplemental data into the analytical telematics big data (ATbD). The data amalgamator state receives the preserve data from the data segregator and the amended data from the data amender state. The preserve data is processed d into the format for the analytical telematics big data (ATbD). The analytical big telematics data (ATbD) in the preserve data path is optionally provided to a second active double buffer or directly to the data amalgamator state.

The logic of the data transfer state is to communicate or store or stream the analytical big telematics data (ATbD) to an analytics server 156 or a Cloud computing based resource. The data transfer state receives the analytical big telematics data (ATbD) either directly from the data amalgamator state or indirectly from the second active double buffer. The analytical big telematics data (ATbD) is then provided to the analytics server 156 or the Cloud computing based resource.

Process Logic & Tasks

The process logic and tasks of the present invention are described with reference to FIGS. 13a, 13b, 13c, 13d, 13e and 13f. The data segregator state logic and tasks begins by obtaining in real time a log of raw telematics big data (RTbD). The log of raw telematics big data (RTbD) is segregated into at least one preserve data category and at least one alter data category. In an embodiment of the invention, there is more than one preserve data category, and no alter category etc. The preserve data is made available to the data amalgamator. The at lease one alter data is made available to the data amender. The process logic and tasks may auto scale as required for the log of raw telematics big data RTbD). The data segregator state logic and tasks may be either sequential processing or parallel processing or a combination of sequential and parallel processing.

The process logic and tasks for the data amender state logic and tasks begins by obtaining the at least one alter data from the data segregator. For each of the at least one alter data, the corresponding supplemental data is obtained. Each of the at least one alter data is amended with the corresponding supplemental data to form at least one amended data. The at least one amended data is made available to the data amender. The process logic and tasks may auto scale as required for either the alter data and/or the supplemental data.

The process logic and tasks for the data amalgamator state logic and tasks begin by obtaining the at least one preserve data from the data segregator and the at least one amended data from the data amender. The at least one preserve data and the at least one amended data is amalgamated to form the analytical telematics big data. The process logic and tasks may auto scale as required either for the at least one preserve data and/or the at least one amended data. The data amalgamator state logic and tasks may be either sequential processing or parallel processing or a combination of sequential and parallel processing.

The process logic and tasks for the data transfer state logic and tasks begin by obtaining the analytical telematics big data (ATbD) from the data amalgamator. The analytical telematics big data (ATbD) is communicated or streamed to an analytical server or Cloud based resource. The process logic and tasks may auto scale as required for the analytical telematics big data ATbD).

Load Balancing

Another broad feature of the present invention is described with reference to FIGS. 3, 6b, 7c, 12b, 13a, 13b, 13c, 13d, 13e and 13f. As illustrated on the map 150, many different vehicles 11 can be operational at any given time throughout the world in many different time zones all monitoring, logging and communicating raw telematics data to a analytical telematics big data constructor 155 in real time. The categories and type of raw telematics data (see Table 1.) may also vary greatly dependent upon the specific configurations of each vehicle 11 (vehicular telemetry hardware system 30, intelligent I/O expanders 50, devices 60, Bluetooth modules 45 and Bluetooth Beacons 21 associated with a plurality of objects). This results in a unique big data velocity, timing, variety and amount of raw telematics data that collectively forms the raw telematics big data (RTbD) entering the data segregator of the analytical telematics big data constructor 155. This is collectively referred to as raw telematics big data (TbD) load.

There are also many different types of supplemental data (SD) required by the data amender available from many different locations and remote sources. The supplemental data (D) is also dependent upon the portion or mix of raw telematics big data (RTbD). This results in another unique big data velocity, timing, variety and amount of supplemental data (SD) (see Table 1 augment data and translate data) required by the data amender. This is collectively referred to as supplemental data load.

Communicating or streaming the analytical telematics big data (ATbD) to an analytics server 156 or a Cloud based resource is also dependent upon the analytics server 156 or Cloud based resources ability to receive the analytical. telematics big data (ATbD). This results in another big data unique velocity, timing, variety and availability to communicate or stream the analytical telematics big data (ATbD). This is collectively referred to as analytical telematics big data (ATbD) load.

The end result is a plurality of potential imbalances for the load, velocity, timing variety and amount of raw telematics big data (RTbD), supplemental data (SD) and analytical telematics big data (ATbD). Therefore, the analytical telematics big data constructor 155, finite state machine, process and tasks of the present invention must be able to deal in real time with this imbalance in real time.

In an embodiment of the invention, this imbalance is resolved by the unique arrangement of the pipelines, filters and tasks associated with the analytical telematics big data constructor 155. This unique arrangement permits load balancing and scaling when imbalances occur in the system. For example, the pipelines, filters and tasks may be dynamically increased or decreased (concurrent instances) based upon the real time load. The data is standardized into specific formats for each of the finite states, logic, resources, processes and tasks. This includes the raw telematics big data (RTbD) format, the supplemental data (SD) format, the preserve data format, the alter data format, the augment data (AD) format, translation data (TD) format and the analytical telematics big data (ATbD) format. In addition, a unique pipeline structure is provided for the analytical telematics bid data constructor 155 to balance the load in system. The raw telematics big data enters the analytical telematics big data constructor through a first pipeline to the data segregator. The data segregator then passes data through at least two pipelines as preserve data and alter data. The alter data pipeline may further include additional pipelines (A, B, C, n). The alter data pipelines feed into the data amender with the corresponding supplemental data (SD) pipelines. The amended data pipelines and the preserve data feed into the data amalgamator and finally, the analytical telematics bid data. (ATbD) feeds into the communication or streaming pipeline. This architecture of telematics specific pipelines permits running parallel and multiple instances of the data segregator state, the data amender state, the data amalgamator state and the data streaming state enabling the system to spread the load and improve the throughput of the analytical telematics bid data constructor 155. This also assists with balancing the system in situations where the data, for example raw telematics bid data RTbD) and the supplemental data (SD) are not in the same geographical location.

In another embodiment of the invention, this imbalance is resolved by the application of the first active buffer and/or the second active buffer either alone or in combination. The first active buffer handles the imbalance between the raw telematics big data (RTbD) and the supplemental data (SD). The second active buffer handles the potential imbalance when communicating or streaming the analytical telematics big data (ATbD) to an analytics server 56 or a Cloud based resource. The buffers may scale up or down dependent upon the needs of the analytical telematics big data constructor 155.

In another embodiment of the invention, this imbalance is resolved by the layout of the finite state machine, the logic, the resources, the process and the tasks of the process through a unique and specific telematics computing resource consolidation.

The data segregator state, logic, process and tasks automatically deal with scalability of the raw telematics big data (RTbD) and associated processing tasks to filter the data into preserve data and alter data. This includes both scaling up or down dependent upon the corresponding load required by the raw telematics big data (RTbD) and the amount of processing required to segregate portions of the data into preserve data or alter data. Additional instances of the data segregator state, logic, process and tasks may be automatically started or stopped according to the load, demand or communication requirements.

The data amender state, logic, process and tasks automatically deal with the scalability with the supplemental data (SD). This includes both scaling up or down dependent upon the corresponding load required by the supplement data (SD) and the amount of processing required to amend each alter data. Additional instances of the data amender state, logic, process and tasks may be automatically started or stopped according to the load, demand or communication requirements.

The data amalgamator state, logic process and tasks automatically deal with the scalability with the preserve data, amended data and ability to communicate or stream the analytical telematics big data (ATbD) to an analytics server 156 or Cloud based computing resource. Additional instances of the data amalgamator state, logic, process and tasks may be automatically started or stopped according to the load, demand or communication requirements.

The analytical telematics big data constructor 155 enables real time insight based upon the real time analytical telematics big data. For example, the data may be applied to monitor the number of Geotab GO devices currently connecting to the server 19 and compare that to the number of GO devices that is expected to be connected at any given time during the day; or be able to use the real time analytical telematics big data to monitor the GO devices that are connecting to their server 19 from each cellular or satellite network provider. Using this data, managers are able to determine if a particular network carrier is having issues for proactive notification with customers that may be affected by the carrier's outage.

SUMMARY

In summary, the analytical telematics big data constructor 55 is capable of auto scaling based upon the unique requirements of the data and communication requirements or delays in communication. In an embodiment of the invention auto scaling includes telematics auto scaling with respect to raw telematics big data (RTbD). In another embodiment of the invention, auto scaling includes supplemental scaling with respect to supplemental data (SD). In another embodiment of the invention, auto scaling includes augmentation scaling with respect to augmentation data. In another embodiment of the invention, auto scaling includes translation scaling with respect to translation data. In another embodiment of the invention, auto scaling includes at least one of telematics scaling, supplemental scaling, augmentation scaling and/or translation scaling.

Embodiments of the present invention, including the device, system and process, individually and/or collectively provide one or more technical effects. Substantially reducing the wait time for analytical telematics big data (ATbD). Ability to provide deeper business insight and analysis in real time based upon the faster availability of the analytical real time telematics big data. Improving the fleet management response time based upon access in real time to analytical real time telematics big data (ATbD). The real time transformation of raw telematics big data (RTbD) into analytical telematics big data (ATbD). Faster access to analytical telematics big data (ATbD) a shorter cycle time to fleet management information. Access to a diverse set of multi-petabytes of data in a single cloud data source to support fleet management analytics. Raw telematics big data (RTbD) transformed and stored or streamed in real time as an analytical telematics big data (ATbD) source. Scalable real time telematics big data available in real time to process a preserve data type concurrently with at least one alter data type and supplemental information data (SD) type. Real time telematics big data that may incorporates translation data and alter data in the transformation to analytical telematics big data (ATbD). Real time telematics big data that may further incorporate augmentation data and alter data in the transformation to analytical telematics big data (ATbD). In an example embodiment of the invention, the capability to handle a big data velocity in the range from 20,000 rows per second to approximately 60,000 rows per second. In an example embodiment of the invention, dealing with uncontrollable network communication issues and avoiding missing data. A device, system and process capable of pre-processing raw telematics big data (RTbD) logs in real time according to the specific needs and requirements for specific data types contained in the logs. Device, system and process capable of streaming analytical telematics big data (ATbD) into an analytic server such as Google BigQuery. An ability to scale big data as volume, velocity and variety grows.

While the present invention has been described with respect to the non-limiting embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. Persons skilled in the art understand that the disclosed invention is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims. Thus, the present invention should not be limited by any of the described embodiments.

Claims

1. An apparatus comprising: at least one processor; andat least one storage medium having encoded thereon executable instructions that, when executed by the at least one processor, cause the at least one processor to carry out a method of processing a stream of telematics data, the stream of the telematics data comprising data units of telematics data of multiple categories, the method comprising: generating at least one edited stream of data from the stream of the telematics data, wherein generating the at least one edited stream of data comprises: for at least one first data unit of at least some data units of the stream of the telematics data: identifying a change to be made to the data unit based at least in part on a category of the data unit;generating an edited data unit at least in part by making the change to the data unit; andoutputting the edited data unit in the at least one edited stream of data; andgenerating a processed stream of data by combining data units of the at least one edited stream of data with at least one second data unit of the stream of the telematics data, the at least one second data unit not included in the at least one first data unit.

2. The apparatus of claim 1, wherein identifying the change to be made to the data unit comprises determining, based at least in part on the category of the data unit, whether the data unit is to be edited to supplement data of the data unit with supplemental data or whether the data of the data unit is to be replaced with alternative data.

3. The apparatus of claim 2, wherein determining, based at least in part on the category of the data unit, whether the data unit is to be edited to supplement data of the data unit with supplemental data or whether the data of the data unit is to be replaced with alternative data comprises determining whether the data of the data unit is to be replaced with alternative data, wherein determining whether the data of the data unit is to be replaced with alternative data comprises: determining whether data of the data unit is to be translated from a first form to a second form;generating the edited data unit at least in part by making the change comprises, in response to determining that the data of the data unit is to be translated from the first form to the second form, determining alternative data of the second form based at least in part on data of the data unit in the first form; andoutputting the edited data unit comprises outputting a data unit comprising the alternative data of the second form.

4. The apparatus of claim 2, wherein generating the edited data unit at least in part by making the change comprises, in response to determining that the data unit is to be edited to supplement data of the data unit with supplemental data: determining the supplemental data based at least in part on the category of the data unit and/or on data of the data unit; andgenerating the edited data unit by adding to the data unit the supplemental data.

5. The apparatus of claim 3, wherein outputting the data unit comprising the alternative data of the second form comprises outputting the data unit comprising the alternative data in the second form and not comprising the data in the first form.

6. The apparatus of claim 3, wherein the alternative data of the second form has a same meaning as the data in the first form.

7. The apparatus of claim 3, wherein: the first form is a machine-readable form;the second form is a human-readable form; anddetermining the alternative data of the second form based on the data of the data unit in the first form comprises determining human-readable data from machine-readable data.

8. The apparatus of claim 3, wherein identifying the change to be made to the data unit comprises determining a translation to be performed based on the category of the data unit; andgenerating the edited data unit comprises performing the translation on the data of the data unit in the first form to generate the alternative data of the second form.

9. The apparatus of claim 1, wherein the method further comprises: segregating the data units of the stream into at least one first stream of data to which at least one change is to be made and at least one second stream of data to which no changes are to be made, the at least one first stream of data comprising the at least one first data unit of the stream and the at least one second stream comprises the at least one second data unit of the stream.

10. The apparatus of claim 9, wherein segregating the data units of the stream of the telematics data comprises, in response to determining that a data unit of the stream is to be segregated into the at least one second stream of data, outputting the data unit to at least one first active buffer.

11. The apparatus of claim 10, wherein the method further comprises: operating the at least one first active buffer to smooth a communication rate in provision of data units from the segregating to the generating of the at least one edited stream of data.

12. The apparatus of claim 10, wherein the method further comprises: outputting the processed stream of telematics data to at least one second active buffer; andretaining each data unit of the processed stream of telematics data in the at least one second active buffer for a period of time.

13. The apparatus of claim 1, wherein the method further comprises: outputting the processed stream of telematics data to at least one active buffer; andretaining each data unit of the processed stream of telematics data in the at least one active buffer for a period of time.

14. The apparatus of claim 1, wherein: processing the stream of telematics data comprises processing the stream of telematics data in real time; andgenerating the processed stream of telematics data comprises generating the processed stream of telematics data in real time with respect to receipt of the stream of telematics data.

15. The apparatus of claim 1, wherein processing the stream of the telematics data comprises processing the stream of the telematics data generated by and/or received from a motor vehicle.

16. A system comprising: the apparatus of claim 15; anda plurality of motor vehicles.

17. The system of claim 16, wherein processing the stream of the telematics data comprises performing the processing for each of a plurality of streams of the telematics data, wherein each of the plurality of streams of the telematics data is generated by and/or received by the apparatus from one of the plurality of motor vehicles and comprises telematics data generated by and/or received by the apparatus from the one motor vehicle.

18. A method of processing a stream of telematics data, the stream of the telematics data comprising data units of telematics data of multiple categories, the method comprising: generating at least one edited stream of data from the stream of the telematics data, wherein generating the at least one edited stream of data comprises: for at least one first data unit of at least some data units of the stream of the telematics data: identifying a change to be made to the data unit based at least in part on a category of the data unit;generating an edited data unit at least in part by making the change to the data unit; andoutputting the edited data unit in the at least one edited stream of data; andgenerating a processed stream of data by combining data units of the at least one edited stream of data with at least one second data unit of the stream of the telematics data, the at least one second data unit not included in the at least one first data unit.

19. At least one non-transitory computer-readable storage medium having encoded thereon executable instructions that, when executed by at least one processor, cause the at least one processor to carry out a method of processing a stream of telematics data, the stream of the telematics data comprising data units of telematics data of multiple categories, the method comprising: generating at least one edited stream of data from the stream of the telematics data, wherein generating the at least one edited stream of data comprises: for at least one first data unit of at least some data units of the stream of the telematics data: identifying a change to be made to the data unit based at least in part on a category of the data unit;generating an edited data unit at least in part by making the change to the data unit; andoutputting the edited data unit in the at least one edited stream of data; andgenerating a processed stream of data by combining data units of the at least one edited stream of data with at least one second data unit of the stream of the telematics data, the at least one second data unit not included in the at least one first data unit.