Current systems for visualizing the position of an object typically display the raw global positioning system (GPS) data of the object on a map. This GPS data is updated and then redisplayed to show the object's new position. In many situations, however, the raw GPS data does not provide an accurate depiction of the actual position and motion of the object.
Embodiments described herein provide for a system that delivers real-time (or close to real-time) position and motion information of a transit object to a client application. The system can receive raw global positioning system (GPS) data from a transit device (e.g., a computing device) of a transit object (e.g., a vehicle, a bicycle, a train, etc.) as the transit object moves in position, and can use the data to determine a most likely path of travel of the transit object on an underlying transit system.
In some embodiments, a transit object's operator or driver can use a computing device (e.g., also referred to as a transit device) that can communicate GPS data corresponding its real-time position at a given instance in time to a system. In many cases, such GPS data may not be accurate due to GPS error and/or signal problems. Inaccurate location information of a transit object may be problematic, for example, to an end-user that is using the client application for requesting services.
By fitting the raw GPS data to an underlying transit system, the system can provide a more accurate depiction of the trajectory or movement of a transit object to an end user. A computing device (e.g., also referred to as an observer device) that runs a client application can receive position information of the most likely path of travel of the transit object and present a visualization of the trajectory of the transit object that accurately reflects the actual movement of the transit object to a user.
According to an embodiment, the system can periodically receive raw GPS data from one or more transit devices over a network. Because the position of a transit device corresponds to the position of the corresponding transit object, the GPS data of the transit device can identify the position of the transit object at an instance in time (e.g., a latitude, a longitude, an altitude, etc.). As the transit object moves in real-time, GPS data can be periodically provided to the system at different instances in time thereby providing updated position information indicating the movement of the transit object.
In some embodiments, for each received GPS point, the system can identify one or more candidate points of a transit system (e.g., roads, walkways, railways, shipping routes, flight paths, etc.) that can correspond to a possible position of the transit object for that GPS point. For example, a candidate point identified for a received GPS point can have a latitude and a longitude that is very close (e.g., within a certain distance) to that GPS point. The system can then use or apply one or more transit models in order to determine, for each transit object, the most likely path of travel on the transit system.
A transit device can be a computing device that runs an application configured to communicate with the system. Similarly, an observer device can run a client application also configured to communicate with the system and to present a visualization of the trajectory of the transit object. As described herein, a “transit device” and an “observer device” refer to computing devices that can correspond to desktop computers, cellular devices or smartphones, personal digital assistants (PDAs), laptop computers, tablet devices, television (IP Television), etc., that can provide network connectivity and processing resources for enabling a user to communicate with the system over a network. A transit device can also correspond to taxi meters, other metering devices of a transit object, or custom hardware, etc. Also as used herein, a “transit object” refers to an object that can be in motion, such as, for example, a vehicle (e.g., a sedan, an SUV, a limousine), a motorcycle, a bicycle, a train, a light-rail vehicle, an airplane, a helicopter, a ship, or a person (e.g., an individual walking, jogging, skateboarding).
Still further, the system, for example, can enable services (such as a transportation service, a delivery service, an entertainment service) to be arranged between individuals using a computing device (or observer device) and available service providers that provide services via a transit object. As an example, a user can request a service, such as a transportation or delivery service (e.g., food delivery, messenger service, food truck service, or product shipping) or an entertainment service (e.g., mariachi band, string quartet) using the system, and a service provider, such as a driver, food provider, band, etc. can communicate with the system and/or the user to arrange for the service. As described herein, a “user,” an “end-user,” a “requester,” or a “customer” are invariably used to refer to individuals that are requesting or ordering a service using an application on his or her computing device. Also as described herein, a “provider,” a “service provider,” a “supplier,” or a “vendor” are invariably used to refer to individuals or entities that can provide the service.
In some embodiments, once the system determines the most likely path of travel of a transit object on a transit system, the system can extrapolate additional position points along the most likely path of travel. A set of extrapolated points can then be wirelessly transmitted over a network to a client application stored and operated on an end-user's computing device (e.g., an observer device). The client application can use the set of extrapolated points and present a visualization of the trajectory of the transit object that accurately reflects the actual movement of the transit object to the user.
One or more embodiments described herein provide that methods, techniques, and actions performed by a computing device are performed programmatically, or as a computer-implemented method. Programmatically, as used herein, means through the use of code or computer-executable instructions. These instructions can be stored in one or more memory resources of the computing device. A programmatically performed step may or may not be automatic.
One or more embodiments described herein can be implemented using programmatic modules, engines, or components. A programmatic module, engine, or component can include a program, a sub-routine, a portion of a program, or a software component or a hardware component capable of performing one or more stated tasks or functions. As used herein, a module or component can exist on a hardware component independently of other modules or components. Alternatively, a module or component can be a shared element or process of other modules, programs or machines.
Some embodiments described herein can generally require the use of computing devices, including processing and memory resources. For example, one or more embodiments described herein may be implemented, in whole or in part, on computing devices such as servers, desktop computers, cellular or smartphones, personal digital assistants (e.g., PDAs), laptop computers, printers, digital picture frames, network equipments (e.g., routers) and tablet devices. Memory, processing, and network resources may all be used in connection with the establishment, use, or performance of any embodiment described herein (including with the performance of any method or with the implementation of any system).
Furthermore, one or more embodiments described herein may be implemented through the use of instructions that are executable by one or more processors. These instructions may be carried on a computer-readable medium. Machines shown or described with figures below provide examples of processing resources and computer-readable mediums on which instructions for implementing embodiments of the invention can be carried and/or executed. In particular, the numerous machines shown with embodiments of the invention include processor(s) and various forms of memory for holding data and instructions. Examples of computer-readable mediums include permanent memory storage devices, such as hard drives on personal computers or servers. Other examples of computer storage mediums include portable storage units, such as CD or DVD units, flash memory (such as carried on smartphones, multifunctional devices or tablets), and magnetic memory. Computers, terminals, network enabled devices (e.g., mobile devices, such as cell phones) are all examples of machines and devices that utilize processors, memory, and instructions stored on computer-readable mediums. Additionally, embodiments may be implemented in the form of computer-programs, or a computer usable carrier medium capable of carrying such a program.
System Description
System 100 can dynamically provide position information for any type of object that can be in motion (e.g., a vehicle, a bicycle, a boat, a train, etc.) for any corresponding transit system (e.g., roads, walkways, railways, shipping routes, flight paths, etc.). In one example, system 100 can track bicycle messengers. Because bicycle messengers can ride on certain roads as well as through parks or open fields (but not on freeways or in rivers), the underlying corresponding transit system for bicycle messengers can include some roadways and other paths that vehicles cannot drive on (e.g., the corresponding transit system includes only possible avenues of travel).
In another example, system 100 can track the movement of trains on particular railways and railroads, i.e., a train's corresponding transit system and/or can track the movement of airplanes in flight patterns and paths, i.e., an airplane's corresponding transit system. The airplane transit system can also take into account no flight zones, for example, or typical paths between airports. System 100 can also track the movement of vehicles. In general, a vehicle can travel on most roadways and freeways, but only on certain bridges, for example, or only on selective streets through certain parks having streets. Although system 100 is not limited to vehicles and roadways, for simplicity purposes of this application, system 100 is described mainly with respect to vehicles that can travel on roadways, i.e., a vehicle's respective transit system.
System 100 includes a tracking service 110, a transit models database 140, a transit device interface 190, and an observer device interface 195. In some implementations, the tracking service 110 can also include a path of travel (POT) determination 120, a transit model determination 130, a position extrapolation 150, and a data store 160. The components of system 100 can combine to dynamically provide position information of one or more transit objects to one or more observer devices 180. For example, the components of system 100 can be implemented on network side resources, such as on one or more servers. System 100 can also be implemented through other computer systems in alternative architectures (e.g., peer-to-peer networks, etc.).
As an alternative or addition, some or all of the components of system 100 can be implemented on client machines or devices, such as through applications that operate on the transit devices 170 and/or observer devices 180. For example, a client application operating on a transit device and/or an observer device can execute to perform one or more of the processes described by the various components of system 100. System 100 can communicate over a network, via a network interface (e.g., wirelessly or using a wireline), to communicate with the one or more transit devices 170 and the one or more observer devices 180.
Each of the transit device interface 190 and the observer device interface 195 manages communications between system 100 and the corresponding devices over a network. In some implementations, each of the transit devices 170 can download, store, and operate an application that can interface with the transit device interface 190 in order to provide information to and/or receive information from system 100 via a cellular or Wi-Fi network. Similarly, each of the observer devices 180 can download, store, and operate an application (e.g., a different application than the application used by a customer, or the same application) that can interface with the observer device interface 195 in order to provide information to and/or receive information from system 100.
For example, the applications can include or use an application programming interface (API), such as an externally facing API, to communicate data with the respective device interfaces 190, 195. The externally facing API can provide access to system 100 via secure access channels over the network through any number of methods, such as web-based forms, programmatic access via restful APIs, Simple Object Access Protocol (SOAP), remote procedure call (RPC), scripting access, etc., while also providing secure access methods including key-based access to ensure system 100 remains secure and only authorized users, service providers, and/or third parties can gain access to system 100.
The tracking service 110 can receive, via the transit device interface 190, GPS data 171 from one or more transit devices 170. A transit device 170 can be a computing device that is located with a transit object (e.g., a vehicle, such as a sedan, a taxi cab, an SUV, etc.) so that its position corresponds to the position of the transit object. As the transit object moves, e.g., is driven along one or more roads, its actual position changes and is measured/identified by one or more sensors of the transit device 170 (e.g., a GPS component and a magnetometer). The GPS data 171 that is provided by the transit device 170 can correspond to position or GPS information of the transit device 170 determined at different instances in time (e.g., GPS snapshots).
For example, at time t=T1, the transit device 170 can be at a particular location or GPS point, identified by a latitude and a longitude (e.g., Lat1, Long1). The transit device 170 can provide the GPS data 171 that includes a latitude and longitude at time t=T1, as well as the time stamp of the GPS reading (e.g., the time stamp would be t=T1) and a GPS error amount to the POT determination 120. In some implementations, the GPS data 171 can also include a GPS bearing (or magnetometer bearing), or other information, such as nearby Wi-Fi networks, cellular network strength, etc. If the transit object is moving, at time t=T2, the transit device can be at a different location or GPS point, identified by a different latitude and longitude, Lat2 and Long2, respectively. This GPS data 171 is also provided to the tracking service 110 along with the time stamp (t=T2) and the GPS error amount at this particular GPS measurement. In this manner, the transit device 170 can periodically take GPS measurements of the current status or position of the transit object (e.g., every three seconds, every four seconds, etc.), and provide these measurements to the tracking service 110. In another example, the transit device 170 can provide GPS data 171 whenever new or updated GPS measurements are taken or are available.
In some implementations, as the transit object moves and provides updated GPS data 171 at different instances in time, the POT determination 120 can maintain a running history of GPS data for each transit object (e.g., for each transit device 170). For example, for each transit object, the GPS data 171 for that transit object can be continually added to a list or table of previously received GPS data. The POT determination 120 can include a data store or a buffer to store the GPS data 171 received from the transit devices 170. Using the GPS data 171 at different instances in time, the POT determination 120 attempts to identify which roadways or highways (when tracking vehicles, for example) the vehicle is actually moving on.
As the POT determination 120 receives the GPS data 171 at different instances in time (e.g., receives GPS snapshots), the POT determination 120 identifies one or more candidate points of a transit system that can correspond to a given GPS point. A candidate point is a point (having a latitude and a longitude reading) corresponding to a location on an underlying transit system. For example, a vehicle transit system, a candidate point can be a point that corresponds to a location on a street or at an intersection between streets. In order to identify one or more candidate points, the underlying transit system must be identified (based on what type of transit object the tracking service 110 is tracking).
In one implementation, the POT determination 120 queries 121 a transit model determination 130 for one or more appropriate transit models or spatial databases. The POT determination 120 can use the transit models and/or spatial databases to identify one or more candidate points and to determine the most likely path of travel for a particular transit object. The query 121 can identify the type of transit object (e.g., a bicycle, a vehicle, an airplane, etc.) that the tracking service 110 is to track. Based on the type of transit object, the transit model determination 130 can select, from a transmit models database 140, one or more selected transit models and/or spatial databases 123 that can be used by the POT determination 120.
For example, the transit models database 140 can store a variety of transit system spatial databases. Transit system spatial databases are queryable databases identifying different points (e.g., having a latitude and a longitude, and/or an altitude) along paths of transit which a given transit object can use, and information of how the different points connect with other points. Some transit system spatial databases can also include points identifying locations of interests or landmarks.
With respect to vehicles, a vehicle transit system spatial database can include points corresponding to locations on roadways, highways, freeways, etc., and other information related to roadways, such as intersections, one way streets, how the different roads and streets connect to each other, etc. Similarly, with respect to airplanes, an airplane transit system spatial database can include points corresponding to locations along flight paths and what points are boundaries for no flight zones, while for trains, a train transit system spatial database can include points corresponding to locations on railroads and railways, and where/how the railroads connect. Additional spatial databases can be created and/or added to the transit models database 140 as a result of real life updates and changes.
The POT determination 120 references a transit system spatial database in order to identify one or more candidate points corresponding to locations on the transit system. As a result, for a particular GPS point for a transit object, a candidate point can be a probable actual (or real-life) position of the transit device 170. This can be the best approximated position for the transit object that matches an actual position on the underlying transit system. The POT determination 120 identifies one or more candidate points because in many cases, a GPS measurement may not be perfectly accurate. This can be a result of bad GPS components of a computing device or a result of bad signals or interference when the GPS reading was taken. Because the GPS data 171 may not be accurate, the measured (and transmitted) latitude and longitude of a transit device 170 may not necessarily correspond to the actual position of the transit device 170. For example, due to the inconsistencies of a GPS measurement, a given GPS point for a vehicle can identify Lat1, Long1 (which corresponds to a building near a street) as the position of the transit device 170 at a time t=T1, but in reality, the transit device 170 can be positioned at Lat2, Long2 (which corresponds to a location on a street) at time t=T1. Using the position Lat2, Long2 would be more accurate in determining the most likely path of travel of the transit device 170 (especially if Lat1, Long 1 identified the vehicle to be on a different road than a road that the vehicle was actually traveling on).
Based on a selected spatial database or model 123, the POT determination 120 can identify, for each (or for some) of the GPS points received at different instances in time (e.g., GPS snapshots), one or more candidate points of the selected transit system. For example, if the tracking service 110 is tracking vehicles, the selected spatial database 123 can correspond to the vehicle transit system spatial database, which includes points corresponding to locations on roadways. By referencing the vehicle transit system spatial database, for a given GPS point (e.g., having a latitude and a longitude, a time stamp, a bearing, and an GPS error amount), the POT determination 120 identifies one or more candidate points (e.g., points corresponding to locations on roadways) that are nearby or close to the measured (and received) GPS point. The candidate point(s) can be identified by searching for points that are within a predetermined distance from the given GPS point at an instance. Depending on implementation, the predetermined distance can be configured or set by an administrator of system 100 or other users, or can correspond to a GPS error amount for a given GPS point that is provided by the respective GPS component of transit device.
As the transit object moves and provides updated GPS data 171 at different instances in time to the POT determination 120, the POT determination 120 continues to identify candidate point(s) for each GPS point at each instance in time (or as an alternative, not every GPS point, but for only selected GPS points). The POT determination 120 can then determine the most likely path of travel based on the identified candidate point(s) on the transit system. In one example, the POT determination 120 can query 121 the transit model determination 130 (at the same time it queried for the spatial database or at a different time) to select other transit models to determine the most likely path of travel. These transit models can use the identified one or more candidate points to make this determination. For example, other transit models stored in the database 140 include routing engines, physics engines, a hidden Markov model solver, or other models that can be used, individually or in combination, to determine the best or most likely paths of travel of one or more transit objects.
For example, a routing engine, a physics engine, and/or a hidden Markov model solver (or other models) can provide a mechanism that the POT determination 120 can use to select, from all (or many of) the possible paths of travel, a path of travel as being the most likely path of travel for a transit object. Based on the identified candidate points at each instance in time (corresponding to the each received GPS point), a routing engine and/or the physics engine, for example, can use the time stamps of the GPS points to generate timing distance and travel paths between two points in the transit system. Using this information, the routing engine and/or the physics engine can determine how long it would have (or should have) taken a typical vehicle driving at a particular speed on the road (e.g., based on the speed limit) to get from one GPS point to another GPS point (or one candidate point for a GPS point to another candidate point for a subsequent GPS point). This can provide a better indication as to which path of travel is the most likely travel path of the vehicle (as compared to other travel paths). In another example, a hidden Markov model solver (or other Markov models) can also be used by the POT determination 120 to determine the most likely path of travel of the transit object.
Because the identified candidate points correspond to only possible positions of the transit device 170, the POT determination 120 considers only possible avenues of travel for the particular type of transit object (e.g., roads for vehicles, roads and walkways for bicycles, railroads for trains) in determining the most likely path of travel. In the case of tracking vehicles, the most likely path of travel can include, for example, Road 1 to Road 2 to Road 3, etc., while continuing to stay on these roads (e.g., cannot jump between roads). In this manner, the GPS data 171 of the transit objects can be matched to the underlying transit system and the most likely path of travel can be determined for each of the transit objects.
In some implementations, the determined most likely path of travel 125 can continue to be stored in a data store 160 as the POT determination 120 continues to process the GPS data 171 (e.g., as the GPS data is continually or periodically received from the transit devices 170). The POT determination 120 can continue to identify one or more candidate points and determine a most likely path of travel until the transit device 170 stops providing the GPS data 171 (e.g., shuts off or closes/logs out of the application) or until other triggers are received. For example, if the transit device 170 is performing a service (e.g., is unavailable) or is out of commission, the transit device 170 can stop providing the GPS data 171 to the tracking service 110.
The position extrapolation 150 can generate position data of a transit object based on the determined most likely path of travel 125. As an addition or an alternative, the position extrapolation 150 can retrieve the stored most likely path of travel 151 from the data store 160. Using the most likely path of travel 151 determined by the POT determination 120, the position extrapolation 150 can extrapolate additional position points along the most likely path of travel.
For example, if a GPS point or candidate point at time t=T1 is determined to be a point along the most likely path of travel, and four seconds later at time t=T2, another GPS point or candidate point is determined to be a point along the most likely path of travel, additional extrapolated data points can be generated along the most likely path of travel in between the points at t=T1 and t=T2. For each of the extrapolated points, a corresponding extrapolated time stamp can also be generated. Optionally, the bearing or heading can also be included with each extrapolated data point. By generating extrapolated points, additional points that are closer together in time (e.g., one second, a half of a second, or a third of a second, etc., as compared to four seconds) can be provided to the observer device 180 (via the observer device interface 195) so that a visualization of the movement of the transit device can be displayed more smoothly to a user.
The extrapolated data 155 is provided to the observer device(s) 180 via the observer device interface 195. An application running on the observer device 180 (and communicating with system 100) can use the extrapolated data 155 to display (e.g., as part of a map) the location and trajectory of transit objects in real-time (or as close to real-time). In the example of vehicles, because the extrapolated data 155 (which can also include the selected GPS point or candidate point) corresponds to actual locations on roads, highways, and freeways, a graphic (e.g., an image of a vehicle) that represents the transit object can be animated to move on the appropriate roads on the map. This is done by matching the positions identified in the extrapolated data 155 to the underlying map displayed on the user's observer device 180. In this manner, a smooth visualization of the trajectory of the transit object that accurately reflects the actual movement of the transit object can be presented to a user.
The position extrapolation 150 can also receive timing information 181 (via the observer device interface 195) from one or more observer devices 180 in order to adjust or control the timing of the delivery of extrapolated data 155 and/or control the amount of extrapolated data to be provided to individual observer devices 180. The observer devices 180 can typically operate off different clocks. For example, observer device 180-1 can be off by ten seconds from observer device 180-2. Similarly, transit devices 170 can also operate off different clocks. Despite the fact that the clocks of the devices are not in sync, system 100 provides for a synchronization-free visualization service so that the transit devices 170 and the observer devices 180 do not have to be in sync in order for position information to be accurately provided to the observer devices 180.
The position extrapolation 150 can provide a window of extrapolated points 155 (e.g., a set of extrapolated points 155) that span a particular duration of time (e.g., ten seconds) for a transit object. This window of extrapolated points 155 can have a start time and an end time (which corresponds to a start point and an end point along the determined most likely path of travel). A set of extrapolated points 155 (e.g., that spans a duration of ten seconds, or fifteen seconds, etc.) can be beneficial in situations where the observer device 180 loses a signal or cannot receive subsequent sets of extrapolated points 155 from the tracking service 110. The application running on the observer device 180 can continue to display visualization of the transit object for a time until a signal is re-established and additional extrapolated data 155 is received. The position extrapolation 150 can continue to periodically check/receive the timing information 181 of the individual observer devices 180 to adjust or control the timing of the delivery of extrapolated data 155 and/or control the amount of extrapolated data to be provided to individual observer devices 180. Additionally, based on the timing information 181 of an observer device 180, the position extrapolation 150 can also determine a delay (e.g., determine how far back in the past to use and provide position points of a transit object) and provide a window of extrapolated points 155 of a transit object to the particular observer device 180 to account for clock discrepancies.
In some implementations, when the position extrapolation 150 transmits an additional window of extrapolated data 155 to the observer device 180, this additional window can overlap (e.g., some of the subsequently transmitted extrapolated points can share points previously transmitted) the previously transmitted window. In such a case, the application running on the observer device 180 can replace or modify the redundant data (e.g., has two data points at the same time t=T5) with the more recently received extrapolated data, and add/append the other more recently received extrapolated data 155 to the previously received extrapolated data 155. In this manner, although segments of data can be received at discrete times, the visualization of the transit object can be seamless on the observer device 180.
The tracking service 110 (via the position extrapolation 150) can also maintain a database (e.g., using the data store 160 or other data stores) of user accounts, and can monitor the current location of the transit devices 170 and the observer devices 180. In some examples, only extrapolated data 155 of transit objects that are within a certain area or predetermined distance from an observer device 180 will be transmitted to the observer device 180 (e.g., within a particular distance, such as 15 mile radius or 20 minutes distance from the observer device 180, or within a city limit or metropolitan area that the observer device 180 is currently located in, etc.).
The tracking service 110 also provides a fail-safe in situations where one or more components of the tracking service 110 and/or system 100 fail. For example, the tracking service 110 can continue to receive raw GPS data 171 from the transit device(s) 170 and directly provide the raw GPS data to the observer device(s) 180 without processing (e.g., without fitting the GPS data to an underlying transit system) the GPS data. The applications running on the observer devices 180 can use the raw GPS data to still provide an estimated position of the transit object at the different instances in time. Similarly, if for example, some transit devices are operating off an older application that does not provide GPS error and/or cannot be mapped to a transit system, the raw GPS points can still be provided to system 100, which is then (without being processed) transmitted to the observer device(s) 180. In this manner, the tracking service 110 is horizontally scalable by enabling different components of system 100 to operate on any of different devices and/or operate even when one or more other components fail.
In some variations, some of the components that are described in system 100 can be provided as being individual components or as being part of the same component. For example, the transit model determination 130 can be provided as a part of the POT determination 120 or the position extrapolation 150 can be provided as a part of the POT determination 120. Logic can be implemented with various applications (e.g., software) and/or with hardware of a computer system that implements system 100.
Methodology
The tracking system periodically receives GPS information from one or more transit devices (step 210). The GPS information provided by a transit device can include a latitude and longitude of the transit device, a time stamp, a bearing, and a GPS error amount at a given instances in time. The GPS component of a transit device can determine the GPS error for each measured GPS data (e.g., at each given instance in time). In this manner, as the transit device (and the corresponding transit object) moves and changes position, the transit device can continue to provide the GPS information to the tracking system to indicate new and/or updated positions.
For example, referring to
Using the GPS information, the tracking system can identify, for each of the GPS points at a given instance, one or more candidate points of a transit system (step 220). The candidate points can be identified by referencing one or more transit system spatial databases and determining which points are nearby or close to the measured (and received) GPS point. In this manner, the inaccuracies of the GPS measurements can be accounted for in determining the most likely path of travel. The candidate point(s) can be identified by searching for points (each having a latitude and a longitude) that are within a predetermined distance or within a GPS error amount from the given GPS point at an instance (sub-step 222). The GPS error amount can also vary from point to point as a result of the varying signal quality and/or different interferences at different locations, and can be represented as an ellipse (e.g., where the latitude error and the longitude error can be different) or as a circle (e.g., where the latitude error and the longitude error are equal). As an alternative or an addition, the GPS error amounts can be normalized for each GPS point (see GPS error amount Δ3, which has been normalized to be represented as a circle) in order to perform a search of candidate points within a radius (e.g., a normalized GPS error amount).
Referring again to the example in
Based on the identified candidate points (and the corresponding time stamps), the tracking system can determine the most likely path of travel of the transit object on the transit system (step 230). For example, the tracking system can apply or use one or more transit models, such as routing engines, physics engines, a hidden Markov model solver, or other models, individually or in combination, to determine the best or most likely paths of travel of the transit object. Referring to
Other paths of travel can be possible based on the candidate points selected. For example, the transit device could have traveled from Lat2,Long2 to Lat4,Long4. However, the transit models can take into account the travel times based on the time stamps provided with each GPS point at a given instance in time, in order to better determine the more likely path of travel between Lat1,Long1 to Lat4,Long4 or Lat2,Long2 to Lat4,Long4. For example, the travel time from Lat2,Long2 to Lat4,Long4 would be much longer than the alternative. Similarly, Lat5,Long5 on C Street is also a point along a possible path of travel. Again, using the transit models, such as a hidden Markov model solver, the tracking system can determine that the candidate point Lat5,Long5 is unlikely (based on probabilities, timing, etc.) as compared to Lat4,Long4.
The tracking system can extrapolate additional position points along the most likely path of travel (e.g., in addition to the GPS point or candidate point determined to be on the most likely path of travel) (step 410). For example, referring to
The extrapolated data is transmitted to one or more observer devices (step 420). An application running on the observer device can use the extrapolated data to display (e.g., as part of a map) the location and trajectory of transit objects in real-time (or as close to real-time). In the example of vehicles as shown in
In one example, the tracking system can also determine or receive timing information from one or more observer devices. Based on the timing information, the tracking system can adjust or control the timing of the delivery of extrapolated data and/or control the amount of extrapolated data to be provided to individual observer devices (sub-step 422). Based on the timing information of an observer device, the tracking system can also determine a delay (e.g., determine how far back in the past to use and provide position points of a transit object) and provide a set of extrapolated points of a transit object to the particular observer device to account for clock discrepancies between the system and the observer device.
User Interface Example
In some implementations, the tracking system can communicate with a fleet of vehicles that can be arranged to provide services for requesters. The GPS data can be received for the fleet of vehicles (e.g., multiple transit objects) and processed by the tracking system. The tracking system can then provide position information (e.g., extrapolated data) of selected transit objects to the respective observer devices based on the geographic location of the observer devices and the transit objects. In this manner, a user of an observer device can see the location and movements of the transit objects in his or her area (and not of objects that he or she does not care about in other areas that are too far to service him or her) to make a more informed decision in requesting a service.
The user interface 500 can provide a real-time (or close to real-time) visualization of the position and trajectory of one or more transit objects (e.g., in this example, transport service providers) that accurately reflect the actual position and movement of the transit object to a user. Using the extrapolated position data (as discussed with respect to
According to an implementation, the graphic images can also vary depending on the transit object. The graphic images can match the type of vehicle, for example, to provide an accurate depiction of the vehicle being a sedan, an SUV, a limousine, etc. Similarly, for other transit objects (e.g., bicycles, trains, airplanes, boats, etc.) on an underlying transit system, respective graphic images can also be presented. In addition, the graphic images can also face (e.g., point) in the correct direction to match the bearing and trajectory of the actual transit object. In the example provided in
Hardware Diagrams
In one implementation, computer system 600 includes processing resources 610, main memory 620, ROM 630, storage device 640, and communication interface 650. Computer system 600 includes at least one processor 610 for processing information and a main memory 620, such as a random access memory (RAM) or other dynamic storage device, for storing information and instructions to be executed by the processor 610. Main memory 620 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 610. Computer system 600 may also include a read only memory (ROM) 630 or other static storage device for storing static information and instructions for processor 610. A storage device 640, such as a magnetic disk or optical disk, is provided for storing information and instructions.
The communication interface 650 can enable the computer system 600 to communicate with one or more networks 680 (e.g., cellular network) through use of the network link (wireless or wireline). Using the network link, the computer system 600 can communicate with one or more computing devices, and one or more servers. In some variations, the computer system 600 can be configured to receive sensor data (e.g., such as GPS data) from one or more transit devices (e.g., belonging to service providers) via the network link. The sensor data 652 can be processed by the processor 610 and can be stored in, for example, the storage device 640. The processor 610 can process the sensor data 652 of a transit device in order to determine a most likely path of travel of a transit object corresponding to the transit device. Extrapolated position information 654 can be transmitted to one or more observer devices over the network 680 to enable an application running on the observer device to use the position information 654 to present a visualization of the actual movement of the transit object.
Computer system 600 can also include a display device 660, such as a cathode ray tube (CRT), an LCD monitor, or a television set, for example, for displaying graphics and information to a user. An input mechanism 670, such as a keyboard that includes alphanumeric keys and other keys, can be coupled to computer system 600 for communicating information and command selections to processor 610. Other non-limiting, illustrative examples of input mechanisms 670 include a mouse, a trackball, touch-sensitive screen, or cursor direction keys for communicating direction information and command selections to processor 610 and for controlling cursor movement on display 660.
Examples described herein are related to the use of computer system 600 for implementing the techniques described herein. According to one embodiment, those techniques are performed by computer system 600 in response to processor 610 executing one or more sequences of one or more instructions contained in main memory 620. Such instructions may be read into main memory 620 from another machine-readable medium, such as storage device 640. Execution of the sequences of instructions contained in main memory 620 causes processor 610 to perform the process steps described herein. In alternative implementations, hard-wired circuitry may be used in place of or in combination with software instructions to implement examples described herein. Thus, the examples described are not limited to any specific combination of hardware circuitry and software.
The processor 710 is configured with software and/or other logic to perform one or more processes, steps and other functions described with implementations, such as described by
From the viewpoint of a service provider, a service provider operating a transit device (such as a computing device 700) can operate a service application so that sensor data, such as location/position data 765, can be determined from the GPS component 770. This location/position data 765 can then be wirelessly transmitted to the system via the communication sub-systems 740. From the viewpoint of an end-user, a user can operate the service application in order to receive position information 745 of one or more transit objects from the system (via the communication sub-systems 740).
The processor 710 can provide content to the display 730 by executing instructions and/or applications that are stored in the memory resources 720. In some examples, one or more user interfaces 715 can be provided by the processor 710, such as a user interface for the service application, based at least in part on the received position information 745 of the one or more transit objects. While
It is contemplated for embodiments described herein to extend to individual elements and concepts described herein, independently of other concepts, ideas or system, as well as for embodiments to include combinations of elements recited anywhere in this application. Although embodiments are described in detail herein with reference to the accompanying drawings, it is to be understood that the invention is not limited to those precise embodiments. As such, many modifications and variations will be apparent to practitioners skilled in this art. Accordingly, it is intended that the scope of the invention be defined by the following claims and their equivalents. Furthermore, it is contemplated that a particular feature described either individually or as part of an embodiment can be combined with other individually described features, or parts of other embodiments, even if the other features and embodiments make no mentioned of the particular feature. Thus, the absence of describing combinations should not preclude the inventor from claiming rights to such combinations.
This application is a continuation of U.S. patent application Ser. No. 16/247,958, filed Jan. 15, 2019, which is a continuation of U.S. patent application Ser. No. 15/596,944, filed May 16, 2017, now U.S. Pat. No. 10,180,330, which is a continuation of U.S. patent application Ser. No. 13/672,643, filed on Nov. 8, 2012, now U.S. Pat. No. 9,671,233. Each is incorporated by reference herein in its entirety. This application is also related to U.S. Pat. No. 9,230,292, filed Nov. 8, 2012, entitled “Providing On-Demand Services Through Use Of Portable Computing Devices;” incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
3953720 | Kelch | Apr 1976 | A |
5828979 | Polivka | Oct 1998 | A |
5862244 | Kleiner et al. | Jan 1999 | A |
5930474 | Dunworth et al. | Jul 1999 | A |
6002981 | Kreft | Dec 1999 | A |
6179252 | Roop | Jan 2001 | B1 |
6184802 | Lamb | Feb 2001 | B1 |
6236933 | Lang | May 2001 | B1 |
6243657 | Tuck | Jun 2001 | B1 |
6356838 | Paul | Mar 2002 | B1 |
6401034 | Kaplan | Jun 2002 | B1 |
6417856 | Tamura et al. | Jul 2002 | B1 |
6421587 | Diana | Jul 2002 | B2 |
6456207 | Yen | Sep 2002 | B1 |
6484094 | Wako | Nov 2002 | B1 |
6516056 | Justice et al. | Feb 2003 | B1 |
6519463 | Tendler | Feb 2003 | B2 |
6631322 | Arthur | Oct 2003 | B1 |
6697730 | Dickerson | Feb 2004 | B2 |
6756913 | Aved | Jun 2004 | B1 |
7009501 | Oleh | Mar 2006 | B2 |
7064681 | Horstemeyer | Jun 2006 | B2 |
7089110 | Pechatnikov et al. | Aug 2006 | B2 |
7113110 | Horstemeyer | Sep 2006 | B2 |
7119716 | Horstemever | Oct 2006 | B2 |
7143241 | Hull | Nov 2006 | B2 |
7191057 | Adamczyk | Mar 2007 | B2 |
7315780 | Suaahara et al. | Jan 2008 | B2 |
7319414 | Horstemeyer | Jan 2008 | B2 |
7394386 | Nowlan | Jul 2008 | B2 |
7412042 | Henry | Aug 2008 | B2 |
7421334 | Dahlgren | Sep 2008 | B2 |
7434177 | Ordinq et al. | Oct 2008 | B1 |
7479899 | Horstemeyer | Jan 2009 | B2 |
7479900 | Horstemever | Jan 2009 | B2 |
7479901 | Horstemeyer | Jan 2009 | B2 |
7482952 | Horstemever | Jan 2009 | B2 |
7487467 | Kawahara et al. | Feb 2009 | B1 |
7504966 | Horstemeyer | Mar 2009 | B2 |
7525427 | Mauriello | Apr 2009 | B2 |
7528742 | Horstemeyer | May 2009 | B2 |
7538691 | Horstemever | May 2009 | B2 |
7552063 | McEachern | Jun 2009 | B1 |
7561069 | Horstemever | Jul 2009 | B2 |
7590490 | Clark | Sep 2009 | B2 |
7692655 | Ni | Apr 2010 | B2 |
7698450 | Monroe | Apr 2010 | B2 |
7714705 | Rennie | May 2010 | B2 |
7720581 | Yaqub | May 2010 | B2 |
7733371 | Monroe | Jun 2010 | B1 |
7876239 | Horstemeyer | Jan 2011 | B2 |
7957871 | Echeruo | Jun 2011 | B1 |
7957891 | Okuyama | Jun 2011 | B2 |
8050688 | Jacob | Nov 2011 | B2 |
8068037 | Horstemeyer | Nov 2011 | B2 |
8099085 | Lowry | Jan 2012 | B2 |
8188745 | Overby | May 2012 | B2 |
8232899 | Horstemeyer | Jul 2012 | B2 |
8242935 | Horstemeyer | Aug 2012 | B2 |
8271316 | Blackshaw et al. | Sep 2012 | B2 |
8284076 | Horstemever | Oct 2012 | B1 |
8362927 | Horstemeyer | Jan 2013 | B2 |
8368562 | Horstemeyer | Feb 2013 | B2 |
8374627 | Howard et al. | Feb 2013 | B2 |
8473203 | Shin | Jun 2013 | B2 |
8531317 | Horstemever | Sep 2013 | B2 |
8564459 | Horstemeyer | Oct 2013 | B2 |
8688532 | Khunger | Apr 2014 | B2 |
9230292 | Amin et al. | Jan 2016 | B2 |
9295011 | Fix | Mar 2016 | B1 |
9534912 | Lord | Jan 2017 | B2 |
9671233 | Holden | Jun 2017 | B2 |
10180330 | Holden | Jan 2019 | B2 |
10909612 | Smith | Feb 2021 | B2 |
20020034292 | Tuoriniemi et al. | Mar 2002 | A1 |
20020077905 | Arndt et al. | Jun 2002 | A1 |
20020095326 | Katz | Jul 2002 | A1 |
20020138338 | Trauth et al. | Sep 2002 | A1 |
20020194129 | Furuya et al. | Dec 2002 | A1 |
20030040944 | Hileman | Feb 2003 | A1 |
20030043206 | Duarte | Mar 2003 | A1 |
20030087648 | Mezhvinsky et al. | May 2003 | A1 |
20030137435 | Haddad et al. | Jul 2003 | A1 |
20040054428 | Sheha et al. | Mar 2004 | A1 |
20040093280 | YamaQuchi | May 2004 | A1 |
20040100479 | Nakano et al. | May 2004 | A1 |
20040106399 | Ki | Jun 2004 | A1 |
20040112959 | Jun | Jun 2004 | A1 |
20040155907 | Yamaguchi et al. | Aug 2004 | A1 |
20040185842 | Spaur et al. | Sep 2004 | A1 |
20040219933 | Faith | Nov 2004 | A1 |
20040243430 | Horstemeyer | Dec 2004 | A1 |
20040254717 | Sugahara et al. | Dec 2004 | A1 |
20040254811 | Horstemeyer | Dec 2004 | A1 |
20050091596 | Anthonv et al. | Apr 2005 | A1 |
20050143095 | Jacob | Jun 2005 | A1 |
20050149382 | Fenner et al. | Jul 2005 | A1 |
20050278114 | Ahmad | Dec 2005 | A1 |
20060034201 | Umeda et al. | Feb 2006 | A1 |
20060048076 | Vronay et al. | Mar 2006 | A1 |
20060059023 | Mashinsky | Mar 2006 | A1 |
20060094447 | Zellner | May 2006 | A1 |
20060135134 | Mezhvinsky et al. | Jun 2006 | A1 |
20060136254 | Greenstein | Jun 2006 | A1 |
20060149681 | Meisner | Jul 2006 | A1 |
20060161346 | Murakami et al. | Jul 2006 | A1 |
20060200306 | Adamcvzk | Sep 2006 | A1 |
20060217885 | Crady et al. | Sep 2006 | A1 |
20060229778 | Obradovich et al. | Oct 2006 | A1 |
20060268100 | Karukka et al. | Nov 2006 | A1 |
20060271867 | Wang et al. | Nov 2006 | A1 |
20070073477 | Krumm et al. | Mar 2007 | A1 |
20070176796 | Bliss et al. | Aug 2007 | A1 |
20070198276 | Hinrichs et al. | Aug 2007 | A1 |
20080076451 | Sheha et al. | Mar 2008 | A1 |
20080114629 | Pavlov | May 2008 | A1 |
20080172173 | Chana et al. | Jul 2008 | A1 |
20080178116 | Kim | Jul 2008 | A1 |
20080189207 | Wurster | Aug 2008 | A1 |
20080195428 | O'Sullivan | Aug 2008 | A1 |
20080288880 | Reponen et al. | Nov 2008 | A1 |
20080307512 | Tandon | Dec 2008 | A1 |
20090030885 | DePasquale et al. | Jan 2009 | A1 |
20090049119 | Marcinkiewicz et al. | Feb 2009 | A1 |
20090083111 | Carr | Mar 2009 | A1 |
20090099971 | Salemme et al. | Apr 2009 | A1 |
20090106124 | Yang | Apr 2009 | A1 |
20090138199 | Bonanni | May 2009 | A1 |
20090156241 | Staffaroni et al. | Jun 2009 | A1 |
20090157566 | Grush | Jun 2009 | A1 |
20090171576 | Kim et al. | Jul 2009 | A1 |
20090172599 | Nezu | Jul 2009 | A1 |
20090176508 | Lubeck et al. | Jul 2009 | A1 |
20090177384 | Walder | Jul 2009 | A1 |
20090177385 | Matas et al. | Jul 2009 | A1 |
20090177502 | Doinoff et al. | Jul 2009 | A1 |
20090192851 | Bishop | Jul 2009 | A1 |
20090204920 | Beverley et al. | Aug 2009 | A1 |
20090216600 | Hill | Aug 2009 | A1 |
20090222284 | McEachern | Sep 2009 | A1 |
20090234523 | Nandedkar et al. | Sep 2009 | A1 |
20090254270 | Yu | Oct 2009 | A1 |
20090282353 | Halbherr et al. | Nov 2009 | A1 |
20090313077 | Wheeler | Dec 2009 | A1 |
20090326991 | Wei et al. | Dec 2009 | A1 |
20100035596 | Nachman et al. | Feb 2010 | A1 |
20100042549 | Adamczyk et al. | Feb 2010 | A1 |
20100070334 | Monteverde | Mar 2010 | A1 |
20100076878 | Burr et al. | Mar 2010 | A1 |
20100076988 | Kenedy et al. | Mar 2010 | A1 |
20100088026 | Manolescu | Apr 2010 | A1 |
20100109948 | Razoumov et al. | May 2010 | A1 |
20100114475 | Shin | May 2010 | A1 |
20100115455 | Kim | May 2010 | A1 |
20100121689 | Wallace et al. | May 2010 | A1 |
20100141261 | Overby | Jun 2010 | A1 |
20100153292 | Zheng et al. | Jun 2010 | A1 |
20100198453 | Doroausker et al. | Aug 2010 | A1 |
20100228415 | Paul | Sep 2010 | A1 |
20100235085 | Kikuchi | Sep 2010 | A1 |
20100289632 | Seder | Nov 2010 | A1 |
20110010300 | Audet | Jan 2011 | A1 |
20110052110 | Kim | Mar 2011 | A1 |
20110060480 | Mattia et al. | Mar 2011 | A1 |
20110060600 | Fox et al. | Mar 2011 | A1 |
20110069017 | Victor | Mar 2011 | A1 |
20110099040 | Felt et al. | Apr 2011 | A1 |
20110137696 | Meyer et al. | Jun 2011 | A1 |
20110153192 | Lin | Jun 2011 | A1 |
20110197131 | Duffin et al. | Aug 2011 | A1 |
20110208732 | Melton et al. | Aug 2011 | A1 |
20110218992 | Waldman et al. | Sep 2011 | A1 |
20110221765 | Nason et al. | Sep 2011 | A1 |
20110307282 | Camp et al. | Dec 2011 | A1 |
20110313880 | Paul et al. | Dec 2011 | A1 |
20120084676 | de Paz | Apr 2012 | A1 |
20120130627 | Islam et al. | May 2012 | A1 |
20120163662 | Lee | Jun 2012 | A1 |
20120179764 | Erdal | Jul 2012 | A1 |
20120203599 | Choi et al. | Aug 2012 | A1 |
20120225671 | Lubeck et al. | Sep 2012 | A1 |
20120232800 | Overby | Sep 2012 | A1 |
20120232943 | Myr | Sep 2012 | A1 |
20120239452 | Trivedi et al. | Sep 2012 | A1 |
20120323642 | Camp et al. | Dec 2012 | A1 |
20120327009 | Fleizach | Dec 2012 | A1 |
20130024249 | Zohar et al. | Jan 2013 | A1 |
20130041720 | Spires | Feb 2013 | A1 |
20130132140 | Amin et al. | May 2013 | A1 |
20130132246 | Amin et al. | May 2013 | A1 |
20130132887 | Amin et al. | May 2013 | A1 |
20130162627 | Gabara | Jun 2013 | A1 |
20130185123 | Krivopaltsev et al. | Jul 2013 | A1 |
20130185124 | Aaron et al. | Jul 2013 | A1 |
20130191141 | Chun et al. | Jul 2013 | A1 |
20130204676 | Hindi et al. | Aug 2013 | A1 |
20130219429 | Hirsch | Aug 2013 | A1 |
20130268406 | Radhakrishnan et al. | Oct 2013 | A1 |
20130290040 | Perry et al. | Oct 2013 | A1 |
20140026065 | Wang | Jan 2014 | A1 |
20140047346 | Karamchedu | Feb 2014 | A1 |
20140051465 | Ruys et al. | Feb 2014 | A1 |
20140067491 | James et al. | Mar 2014 | A1 |
20140129135 | Holden et al. | May 2014 | A1 |
20140129302 | Amin et al. | May 2014 | A1 |
20140136414 | Abhyanker | May 2014 | A1 |
20140172727 | Abhyanker et al. | Jun 2014 | A1 |
20140180732 | Rotchin et al. | Jun 2014 | A1 |
20140180733 | Rotchin et al. | Jun 2014 | A1 |
20150012341 | Amin | Jan 2015 | A1 |
20150046080 | Wesselius et al. | Feb 2015 | A1 |
20150365796 | Toni | Dec 2015 | A1 |
20170164315 | Smith | Jun 2017 | A1 |
20170164318 | Smith | Jun 2017 | A1 |
20170180938 | Smith | Jun 2017 | A1 |
Number | Date | Country |
---|---|---|
1800783 | Jul 2006 | CN |
101136140 | Mar 2008 | CN |
2003-318613 | Nov 2000 | JP |
2002-024659 | Jan 2002 | JP |
2011-075345 | Apr 2011 | JP |
10-2005-0015772 | Feb 2005 | KR |
WO 9944186 | Sep 1999 | WO |
WO 0216457 | Feb 2008 | WO |
WO 2008145986 | Dec 2008 | WO |
Entry |
---|
“Uber iPhone app update 1.0.48”, Jun. 27, 2011, http://blog.uber.com/2011 /06/27/uber-iphone-app-update-1-0-48/. |
Alfred Round et al. “Futher Ride: Adapting New Technologies to Paratransit in the United States”, Working Paper, UCTC No. 306, University of California Transportation Center, 51 pages. |
Australian First Examination Report, Australian Application No. 2013341619, dated Apr. 11, 2018, 4 pages. |
EESR dated May 31, 2016 in EP 13853974.7 (UP-019EP). |
European Examination Report, European Application No. 13853974.7, dated Dec. 11, 2017, 6 pages. |
European Patent Office, Summons to Attend Oral Proceedings, EP Patent Application No. 13853974.7, Jan. 3, 2020, eight pages. |
Examination Report for Australian Application No. 2010325793, dated Jun. 21, 2013, 5 pages. |
Final Office Action dated Feb. 26, 2014 for related U.S. Appl. No. 13/672,658. |
Final office Action dated Jul. 10, 2013, for related U.S. Appl. No. 12/961,493, 44 pages. |
Final Office Action dated Jun. 12, 2014, for related U.S. Appl. No. 12/928,253 19 pages. |
Final Office Action for U.S. Appl. No. 12/928,254 dated Apr. 24, 2013, 15 pages. |
Final Office Action for U.S. Appl. No. 13/596,497 dated May 16, 2013, 13 pages. |
Goh, et al. Online map-matching based on Hidden Markov model for real-time traffic sensing applications, 2012, www.mit.edu/-jailleUgeneral/map matching itsc2012-final.pdf. |
Hu, K. et al., “Taxi-Viewer: Around the Corner Taxis Are!,” 201 O Symposia and Workshops on Ubiquitous, Automatic and Trusted Computing, Oct. 26, 2010, pp. 498-500. |
International Search Report and Written Opinion, International Application No. PCT/US2010/059152, dated Mar. 28, 2011, pp. 1-11. |
International Search Report and Written Opinion, International Application No. PCT/US2013/68025, dated Apr. 15, 2014, pp. 12. |
Krum, et al. Map Matching with Travel Time Constraints, 2006 SAE International. |
Non-Final Office Action dated Aug. 16, 2012, for related U.S. Appl. No. 12/928,254, filed Dec. 6, 2010. |
Non-Final Office Action dated Dec. 3, 2013 for related U.S. Appl. No. 13/672,661. |
Non-Final Office Action dated Nov. 19, 2013, for related U.S. Appl. No. 12/928,253. |
Non-Final Office Action dated Oct. 15, 2012, for related U.S. Appl. No. 13/596,497, filed Aug. 28, 2012. |
Non-Final Office Action dated Oct. 5, 2012, for related U.S. Appl. No. 12/961,493, filed Dec. 6, 2010. |
Non-Final Office Action dated Sep. 10, 2012, for related U.S. Appl. No. 12/928,253, filed Dec. 6, 2010. |
Non-Final Office Action for U.S. Appl. No. 13/672,658 dated Jun. 12, 2013, 25 pages. |
Office Action (Restriction Requirement) dated Jun. 6, 2012, for related U.S. Appl. No. 12/928,254, filed Dec. 6, 2010. |
Office Action dated May 6, 2016 in CN 2013800581997 (UP-019CN). |
PCT International Search Report and Written Opinion, PCT Application No. PCT/US13/66529, dated Jan. 17, 2014, 12 pages. |
Search Report dated Apr. 25, 2016 in CN 2013800581997 (UP-019CN). |
Search Report dated Oct. 1, 2013, for related EP Application No. 10835261.8. |
Shigematsu et al. “AVM System”, Fujistu Ten Technical Journal No. 33, 27:34, (2009). |
United States Office Action, U.S. Appl. No. 13/672,643, dated Aug. 20, 2015, 19 pages. |
United States Office Action, U.S. Appl. No. 13/672,643, dated Jun. 27, 2014, 67 pages. |
United States Office Action, U.S. Appl. No. 13/672,643, dated Mar. 3, 2016, 22 pages. |
United States Office Action, U.S. Appl. No. 13/672,643, dated Nov. 26, 2014, 127 pages. |
United States Office Action, U.S. Appl. No. 13/672,643, dated Oct. 25, 2016, 29 pages. |
United States Office Action, U.S. Appl. No. 15/596,944, dated Nov. 22, 2017, 26 pages. |
United States Office Action, U.S. Appl. No. 16/247,958, dated Jan. 2, 2020, 28 pages. |
Number | Date | Country | |
---|---|---|---|
20210025720 A1 | Jan 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16247958 | Jan 2019 | US |
Child | 17066037 | US | |
Parent | 15596944 | May 2017 | US |
Child | 16247958 | US | |
Parent | 13672643 | Nov 2012 | US |
Child | 15596944 | US |