Systems and methods for combinatorial resource optimization

Information

  • Patent Grant
  • 11922343
  • Patent Number
    11,922,343
  • Date Filed
    Friday, January 20, 2023
    a year ago
  • Date Issued
    Tuesday, March 5, 2024
    a month ago
Abstract
Horizontally-scalable systems and methods for scheduling and optimizing deliveries are described herein. At least one scheduler is configured to receive a request to schedule a delivery for an origination location. The request includes a desired time slot. The request is compared to a persistent delivery snapshot for the origination location to determine availability of the desired time slot. An interim delivery snapshot including the requested delivery is generated when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. At least one optimizer is configured to receive the interim delivery snapshot and generate an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot.
Description
TECHNICAL FIELD

This application relates generally to combinatorial resource optimization, and more particularly, relates to optimizing delivery routes in a goods delivery system.


BACKGROUND

At least some known systems and industries provide delivery services to their customers. For example, some industries provide the delivery of goods, such as grocery items, to their customers, which has increasingly become a method by which consumers obtain their grocery needs. For grocery delivery services, the use of delivery vehicle resources can be optimized in order to achieve an efficient and profitable grocery delivery service. One particular optimization solution or system is resource optimization and vehicle routing (ROVR), which is designed to optimize grocery delivery routes based on a number of factors in order to make efficient use of delivery vehicle resources.


However, current solutions, including ROVR cannot scale to handle large order sizes (e.g., 2000 or more orders per day). As the number of delivery orders increases, the combinatorial space to be explored (i.e., the complexity of the optimization problem) increases exponentially. For example, doubling the number of orders may result in an exponential increase in the number of alternative delivery routes that are explored and/or considered. In addition, computational resources become bottlenecked, as the time required to optimize delivery routes increases once the number of orders becomes larger. For example, a single optimization can take longer than three minutes, which may significantly affect an optimization system's ability to allocate computation resources to other stores among a collection of hundreds of stores.


SUMMARY

In various embodiments, a system including a computing device is disclosed. The computing device is configured to define at least one scheduler and at least one optimizer. The at least one scheduler is configured to receive a request to schedule a delivery for an origination location. The request includes a desired time slot. The request is compared to a persistent delivery snapshot for the origination location to determine availability of the desired time slot. An interim delivery snapshot including the requested delivery is generated when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. The at least one optimizer is configured to receive the interim delivery snapshot and generate an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot


In various embodiments, a method is disclosed. The method includes the step of defining a plurality of schedulers and a plurality of optimizers. A request to schedule a delivery for predetermined first origination location is received at a selected one of the plurality of schedulers. The request includes a desired time slot. The selected one of the plurality of schedulers compares the request to a persistent delivery snapshot for the first origination location to determine availability of the desired time slot and generates an interim delivery snapshot including the requested delivery when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. A selected one of the plurality of optimizers receives the interim delivery snapshot and generates an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot.


In various embodiments, a non-transitory computer readable medium having instructions stored thereon is disclosed. The instructions, when executed by a processor cause a device to perform operations including defining a plurality of schedulers and a plurality of optimizers. A selected one of the plurality of schedulers receives a request to schedule a delivery for predetermined first origination location. The request includes a desired time slot. The selected one of the plurality of schedulers compares the request to a persistent delivery snapshot for the first origination location to determine availability of the desired time slot and generates an interim delivery snapshot including the requested delivery when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. A selected one of the plurality of optimizers receives the interim delivery snapshot and generates an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1A illustrates an exemplary system in accordance with some embodiments of the present disclosure.



FIG. 1B illustrates an exemplary computing device that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 1C illustrates an exemplary memory for storing instructions for executing steps of a method that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 2 illustrates an exemplary diagram of vehicle availability that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 3A illustrates an exemplary diagram of a route map for one or more delivery vehicles prior to assigning a delivery route or option that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 3B illustrates an exemplary diagram of the route map for one or more delivery vehicles after assigning the delivery route that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 4A illustrates an exemplary diagram of a plurality of delivery routes prior to optimization that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 4B illustrates an exemplary diagram of the plurality of delivery routes during optimization that may be used with the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 5 illustrates a flow diagram of a method for optimizing a plurality of vehicle resources during delivery of goods using the system shown in FIG. 1A, in accordance with some embodiments of the present disclosure.



FIG. 6 illustrates an exemplary diagram of a horizontally-saleable system configured to provide routing capability and resource optimization, in accordance with some embodiments of the present disclosure.



FIG. 7 illustrates an exemplary flow diagram of a method of periodic optimization, in accordance with some embodiments of the present disclosure.



FIG. 8 illustrates an exemplary diagram of an optimization layer of the system of FIGS. 1A-1C, in accordance with some embodiments of the present disclosure.





DETAILED DESCRIPTION

As discussed above, existing solutions or systems for resource optimization cannot scale to handle large numbers of orders and do not enable sufficient flexibility with computational resources. The embodiments described herein facilitate the efficient optimization of resources in large-scale delivery systems. The embodiments described herein include, for example, the estimation of a number of available time windows for a delivery, and the presenting of available time windows to a user. The embodiments also include the determination of delivery routes for one or more vehicles and the subsequent optimization of the determined delivery routes. Although the embodiments described herein illustrate delivery resource optimization systems and methods used for the delivery of grocery goods or items, the embodiments discussed herein are not limited to such systems and methods and one of ordinary skill in the art will appreciate that the current disclosure may be used in connection with any type of system or method that addresses various different types of combinatorial optimization problems.



FIG. 1A illustrates a system 100 in accordance with exemplary embodiments of the present disclosure. System 100 may be utilized, for example, in optimizing the use of a plurality of vehicles (not shown) in delivering groceries to users. System 100 may include a server 105, one or more user terminals, such as terminals 120, 125, and 130, and a vehicle server 128, that are each coupled to server 105. System 100 may further include vehicles 128a-128c which are each communicatively coupled to vehicle server 128 and may receive delivery order assignments and delivery routes from server 105 via the vehicle server 128. It should be noted that, as used herein, the term “couple” is not limited to a direct mechanical, communicative, and/or an electrical connection between components, but may also include an indirect mechanical, communicative, and/or electrical connection between two or more components or a coupling that is operative through intermediate elements or spaces.


Server 105, user terminals 120, 125, and 130, and vehicle server 128 can each be a computing device that can be, for example, a desktop computer, laptop, mobile device, tablet, thin client, or other device having a communications interface (not shown) that can communicate with other components of system 100, as explained in more detail below with respect to FIG. 1B.


In some embodiments, server 105 is associated with a retail store, for example a grocery store. Server 105 may include information about the retail items that are available from the retail store. For example, server 105 can maintain a database (such as database 160 shown in FIG. 1B) that includes details on the various retail items available from the retail store, the quantity of each item available from the retail store, the price of each item, and (if applicable) an amount of time before a particular retail item will perish after leaving the store (e.g. milk or fresh fruits). As will be discussed in further detail with respect to FIG. 2, server 105 may also maintain a database of vehicle availability which it may use to determine available time slots from the plurality of vehicles for presentation to a user (e.g. via user terminals 120, 125, and 130).


In some embodiments, vehicle server 128 enables communication between server 105 and each of the vehicles 128a-128c. As server 105 determines delivery order assignments and delivery routes (as discussed in more detail below), server 105 may communicate these assignments and routes to vehicle server 128, which may in turn communicate the assignments and routes to the corresponding vehicle. Vehicle server 128 may transmit information regarding a plurality of time slots for each of the vehicles in the plurality of vehicles to server 105. For example, vehicle server 128 may transmit information regarding the number of time slots a vehicle has per delivery route, the length of each time slot, and other pertinent information regarding the plurality of time slots for each vehicle 128a-128c. In some embodiments, the functions of the vehicle server 128 may be performed by server 105. In some embodiments, information regarding the plurality of time slots for each vehicle 128a-128c may be maintained by the vehicle server 128, the server 105, and/or any other suitable system. Assignments and routes may be calculated by the server 105 and provided to the vehicles 128a-128c once a final assignment and route is determined.


In some embodiments, each user terminal 120, 125, and 130, can be accessed by a user to enable the user to communicate with server 105. Each user terminal 120, 125, and 130 may be capable of connecting to and communicating with server 105 via network 135 (for example, via the internet). The user can use terminals 120, 125, and 130 for accessing information from server 105, such as the retail items that are available for purchase and available delivery time slots, as discussed in more detail herein.


During operation, as explained in more detail below with respect to FIGS. 1A, 2, 3A, 3B, 4A, 4B, and 5-8, system 100 can be used to facilitate the efficient delivery of goods, such as grocery and/or other retail items. For example, server 105 may receive delivery orders from user terminals 120-130 via network 135. Such orders may be received from a variety of locations. As discussed above, although discussed in terms of retail delivery, the embodiments described herein may be utilized to solve any combinatorial optimization problem. Upon receiving a delivery order from any of user terminals 120-130, server 105 may assign the delivery order to an appropriate vehicle among the plurality of vehicles 128a-128c and determine an appropriate delivery route for that vehicle based on one or more delivery parameters. Server 105 may transmit the assignment and route information to the appropriate delivery vehicle via vehicle server 128.



FIG. 1B is a block diagram of an exemplary computing device 110, which may be used to implement one or more of server 105, user terminals 120, 125, and 130, and/or vehicle server 128 (shown in FIG. 1A). In some embodiments, computing device 110 includes a hardware unit 126 and software 127. Software 127 can run on hardware unit 126 such that various applications or programs can be executed on hardware unit 126 by way of software 127. In some embodiments, the functions of software 127 can be implemented directly in hardware unit 126, e.g., as a system-on-a-chip, firmware, field-programmable gate array (“FPGA”), etc. In some embodiments, hardware unit 126 includes one or more processors, such as processor 131. In some embodiments, processor 131 is an execution unit, or “core,” on a microprocessor chip. In some embodiments, processor 131 may include a processing unit, such as, without limitation, an integrated circuit (“IC”), an ASIC, a microcomputer, a programmable logic controller (“PLC”), and/or any other programmable circuit. Alternatively, processor 131 may include multiple processing units (e.g., in a multi-core configuration). The above examples are exemplary only, and, thus, are not intended to limit in any way the definition and/or meaning of the term “processor.”


Hardware unit 126 also includes a system memory 132 that is coupled to processor 131 via a system bus 234. Memory 132 can be a general volatile RAM. For example, hardware unit 126 can include a 32 bit microcomputer with 2 Mbit ROM and 64 Kbit RAM, and/or a few GB of RAM. Memory 132 can also be a ROM, a network interface (NIC), and/or other device(s).


In some embodiments, computing device 110 can also include at least one media output component or display interface 136 for use in presenting information to a user. Display interface 136 can be any component capable of conveying information to a user and may include, without limitation, a display device (not shown) (e.g., a liquid crystal display (“LCD”), an organic light emitting diode (“OLED”) display, or an audio output device (e.g., a speaker or headphones)). In some embodiments, computing device 110 can output at least one desktop, such as desktop 140. Desktop 140 can be an interactive user environment provided by an operating system and/or applications running within computing device 110, and can include at least one screen or display image, such as display image 142. Desktop 140 can also accept input from a user in the form of device inputs, such as keyboard and mouse inputs. In some embodiments, desktop 140 can also accept simulated inputs, such as simulated keyboard and mouse inputs. In addition to user input and/or output, desktop 140 can send and receive device data, such as input and/or output for a FLASH memory device local to the user, or to a local printer.


In some embodiments, display image 142 can be presented to a user on computer displays of a remote terminal (not shown). For example, computing device 110 can be connected to one or more remote terminals (not shown) or servers (not shown) via a network (not shown), wherein the network can be the Internet, a local area network (“LAN”), a wide area network (“WAN”), a personal area network (“PAN”), or any combination thereof, and the network can transmit information between computing device 110 and the remote terminals or the servers, such that remote end users can access the information from computing device 110.


In some embodiments, computing device 110 includes an input or a user interface 150 for receiving input from a user. User interface 150 may include, for example, a keyboard, a pointing device, a mouse, a stylus, a touch sensitive panel (e.g., a touch pad or a touch screen), a gyroscope, an accelerometer, a position detector, and/or an audio input device. A single component, such as a touch screen, may function as both an output device of the media output component and the input interface. In some embodiments, mobile devices, such as tablets, can be used.


Computing device 110, in some embodiments, can include a database 160 within memory 132, such that various information can be stored within database 160. Alternatively, in some embodiments, database 160 can be included within a remote server (not shown) with file sharing capabilities, such that database 160 can be accessed by computing device 110 and/or remote end users. In some embodiments, a plurality of computer-executable instructions can be stored in memory 132, such as one or more computer-readable storage media 170 (only one being shown in FIG. 1). Computer storage medium 170 includes non-transitory media and may include volatile and nonvolatile, removable and non-removable mediums implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. The instructions may be executed by processor 131 to perform various functions described herein, e.g., steps of the method shown in FIG. 5.



FIG. 1C illustrates an example of computer-executable instructions that can be stored in memory 132 as software (SW) modules. Memory 132 may include the following SW modules: (1) an availability window estimator SW module 132a that is configured to determine a number of available time slots for delivery of groceries; (2); a map engine SW module 132b that is configured to assign delivery orders to vehicles and determine the sequence in which a particular vehicles orders will be delivered (delivery route); (3) an optimization SW module 132c that is configured to optimize the delivery route for each vehicle having at least one delivery order assigned to it.


Memory 132 may further store map data 132d of the geographic area serviced by one or more store fronts as well as a vehicle availability database 132e that stores a snapshot of the current capacity of each vehicle in the plurality of vehicles and the time slots each vehicle has available.


Referring back to FIG. 1A, in some embodiments, server 105 may determine and present a number of available delivery time slots to a user. More specifically, server 105 may generate a synthetic order and compare the synthetic order to a snapshot of the plurality of vehicles (as described below with respect to FIG. 2) retrieved from, for example, vehicle availability database 132e (shown in FIG. 1C). Server 105 may identify the time slots having at least one of the plurality of vehicles available for delivery during that time slot and communicate those time slots to the user via user terminals 120-130. For example, vehicle server 128 may transmit information regarding the number of time slots each vehicle has, and the length of each time slot. Server 105 may determine which vehicles among the plurality of vehicles has sufficient capacity to accommodate the synthetic order. Upon determining which vehicles have sufficient capacity, server 105 may insert the synthetic order into each time slot in each of the vehicles having sufficient capacity. For each time slot the synthetic order is inserted into, server 105 may determine whether the insertion is feasible. In other words, server 105 may determine if all of the vehicle's other delivery orders can be met (e.g. delivered on time) if the synthetic order is inserted into that time slot and remove those time slots that would result in the vehicle being unable to fulfill one or more of its previously scheduled deliveries. Alternatively, in some embodiments, the server 105 may receive a request for a delivery from a user terminal 120-130 including a desired time slot. The server 105 may attempt to update the snapshot to include the delivery received from the user terminal 120-130 at the desired time slot.



FIG. 2 illustrates a snapshot 200 of the time slot availability of a plurality of vehicles 205, 210, 215, and 220. The plurality of vehicles 205, 210, 215, and 220 are each associated with a predetermined origination point for the deliveries, such as, for example, a retail store or location, a warehouse, a delivery hub, etc. Although embodiments including four vehicles 205, 210, 215, and 220 are illustrated, it will be appreciated that each predetermined origination point can have any number of vehicles associated therewith. Snapshot 200 may be updated by the server 105 to include received deliveries. Alternatively, in some embodiments, the server 105 may generate an interim snapshot that is provided to an optimizer and/or an optimization queue for optimization, as discussed in greater detail below. Each vehicle 205, 210, 215, and 220 may have 4 available time slots (ranging from 1 PM to 9 PM). It should be noted that time slots of any appropriate length and/or time may be used. As shown in FIG. 2, vehicle 205 has time slots 205a-205d while vehicle 210 has time slots 210a-210d etc. In the example of FIG. 2, vehicle 210 may not have any capacity, thus server 105 may refrain from assigning any further delivery orders to it. In addition, none of the vehicles 205-225 may have availability in the 1 PM-3 PM time slot, while only vehicle 225 has availability in the 5 PM-7 PM time slot, corresponding to time slot 225c. Thus, in the example of FIG. 2, server 105 may present three time slots (3 PM-5 PM, 5 PM-7 PM, and 7 PM-9 PM) to a customer wishing to place a delivery order.


Referring back to FIG. 1A, upon receiving a delivery order indicating a delivery address and a selected time slot, server 105 (such as a scheduler implemented by the server 105 as discussed below in conjunction with FIGS. 6-8) may determine a delivery route for one or more vehicles 205, 210, 215, and 220 in the plurality of vehicles. More specifically, server 105 may assign a received delivery order is to a selected one of the plurality of vehicles 205, 210, 215, and 220, re-assign one or more to orders a different vehicle 205, 210, 215, and 220 in order to optimize vehicle resources, and/or sequence each vehicle's 205, 210, 215, and 220 assigned delivery orders to minimize cost. In some embodiments, server 105 is configured to assign the received delivery order to, and determine a delivery route for, a vehicle 205, 210, 215, and 220 from the plurality of vehicles 205, 210, 215, and 220 based on the selected time slot of the received order, map data 132d, and/or an overall cost that is a function of a number of delivery parameters. In some embodiments, server 105 may re-assign delivery orders to, and determine delivery routes for, other vehicles in the plurality of vehicles 205, 210, 215, and 220 based on the selected time slot of the received order, map data 132d, and/or an overall cost that is a function of a number of delivery parameters. Examples of such delivery parameters may include, but are not limited to, number of vehicles from the plurality needed to deliver all orders, total number of miles driven by the vehicles during delivery, total driving time of the vehicles during delivery, total amount of idle time of the vehicles during delivery, and degree of lateness in delivering an order (if any) among others. Server 105 may utilize a meta-heuristic algorithm, such as simulated annealing, in order to determine which vehicle the received delivery order is to be assigned to, as well as the sequence in which that vehicle's delivery orders are to be delivered. In addition, server 105 may utilize the meta-heuristic algorithm to determine whether certain delivery orders need to be re-assigned to a different vehicle in order to optimize vehicle resources, and the sequence in which each vehicle's assigned delivery orders will be delivered (delivery route). In some embodiments, server 105 may assign a particular weight to each delivery parameter when assigning delivery orders and determining delivery routes for the one or more vehicles. For example, server 105 may assign total mileage the largest weight, and thus may assign delivery orders to and determine delivery routes for the one or more vehicles from the plurality of vehicles based primarily on reducing the total miles driven by the one or more vehicles, as this will have the largest impact on the overall cost. In this way, server 105 may determine one or more delivery routes.



FIG. 3A illustrates a delivery route map 300 for a first and second delivery vehicle in accordance with some embodiments of the present disclosure. Delivery route 305 may indicate the delivery route of the first vehicle, while delivery route 310 may indicate the delivery route of the second vehicle. Delivery order 315 may indicate the delivery address of a delivery order that is yet to be assigned to a particular vehicle. As an initial matter, server 105 may determine that assigning delivery order 315 to the first delivery vehicle for delivery in the same time slot as delivery number 2 will not prevent the first delivery vehicle from completing any of its subsequent deliveries on time. Server 105 may make a similar determination with respect to assigning delivery order 315 to the second delivery vehicle for delivery in the time slot for its delivery number 2. In addition, server 105 may determine that the delivery address of delivery order 315 is in close proximity to the delivery address of delivery number two for the first delivery vehicle and is also relatively far from any of the delivery addresses in the second vehicles delivery route 310. Thus, server 105 may determine that the total number of miles required to be driven will be minimized if delivery order 315 is assigned to the first delivery vehicle for delivery after delivery number 2. Server 105 may also determine that the number of miles driven can be further reduced if the first delivery vehicle delivers delivery order 315 after its current delivery number two (as delivery number two is on the way). Therefore, server 105 may assign delivery order 315 to the first delivery vehicle, and sequence it for delivery right after delivery number 2. FIG. 3B illustrates the new delivery route for the first delivery vehicle.


In some embodiments, server 105 may further optimize each vehicle's delivery route. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may randomly select a delivery order from among the plurality of delivery routes, and iteratively insert the randomly selected delivery order into one or more randomly selected time slots from the plurality of delivery routes. Server 105 may then determine the cost effect of each insertion. In some embodiments, server 105 may insert the randomly selected delivery order into every time slot from the plurality of delivery routes and calculate the cost effect of every insertion. In still other embodiments, server 105 may determine which routes among the plurality of delivery routes have available time slots that overlap with the time slot of the randomly selected delivery order. Server 105 may only insert the randomly selected delivery order into those routes having an available time slot that overlaps with the time slot of the randomly selected delivery order. Server 105 may insert the randomly selected delivery order into the time slot resulting in the largest reduction in overall cost. In some embodiments, server 105 may perform multiple iterations of the above described process to further optimize each vehicle's delivery route.



FIG. 4A illustrates delivery routes for three vehicles. Server 105 may randomly select delivery order 405 corresponding to delivery number 3 in vehicle one's delivery route. Server 105 may then randomly select the time slot of delivery order 410 corresponding to delivery number 3 in vehicle two's delivery route and insert delivery order 405 into the time slot containing delivery order 410. FIG. 4B illustrates the updated delivery routes after the insertion by server 105. Server 105 may calculate the cost effect of inserting delivery order 405 into delivery order 410's slot as illustrated in FIG. 4B. More specifically, server 105 may determine the cost effect based on an increase or decrease (if any) in the total number of miles driven by each vehicle during delivery, total driving time for each vehicle during delivery, total amount of idle time for each vehicle during delivery, number of trucks needed to deliver all orders, and degree of lateness (if any) based on inserting delivery order 405 into delivery order 410's time slot. As discussed above, in some embodiments, certain factors (e.g. total mileage, degree of lateness) may have been assigned a greater weight, and therefore even relatively small increases in those factors may result in a significantly larger overall cost. Server 105 may iteratively insert delivery order 405 into one or more random time slots and calculate the cost effect of each such insertion. Server 105 may reassign delivery order 405 to the time slot resulting in the largest reduction in overall cost. If no time slot would result in a reduction of overall cost, server 105 may refrain from reassigning delivery order 405.


Referring back to FIG. 1, in some embodiments, server 105 may assign degree of lateness a relatively heavy weight, as a late delivery can result in severe consequences (e.g. easily perishable goods going bad). However, a certain degree of lateness may be tolerable if a significant improvement in one or more other parameters is achieved by an insertion. For example, if an improvement in the overall cost due to a relatively large reduction in total mileage driven by all vehicles is achieved, and the degree of lateness will not result in goods of a delivery order perishing, then server 105 may allow the insertion (if the cost effect is superior to the cost effect of other insertions).


In some embodiments, server 105 may generate an updated snapshot of time slot availability for the plurality of vehicles and store the updated snapshot in vehicle availability database 132e for presentation to online users and/or transmission to the vehicles 128-128c. The updated snapshot may be based on the optimized delivery routes determined for the one or more vehicles in the plurality of vehicles.


As described above, server 105 may assign delivery orders and optimize delivery routes whenever a new delivery order is received from a user terminal 120-135. In some embodiments, server 105 may continuously optimize the delivery routes of each vehicle at pre-defined intervals until a pre-defined time period before the delivery route is to commence. In other embodiments, server 105 may optimize delivery routes in response to receiving a new delivery order until a pre-defined time period before the delivery route is to commence.


In some embodiments, server 105 may transmit the optimized delivery routes to the corresponding vehicles among the plurality of vehicles 128a-c via vehicle server 128, which may act as a relay to provide the optimized delivery routes to the corresponding vehicles.



FIG. 5 illustrates a flow diagram of a method 500 for optimizing delivery vehicle resources in accordance with some exemplary embodiments of the present disclosure. Method 500 may be performed by, server 105 described with respect to FIG. 1, for example.


At 505, server 105 may determine a number of available delivery time slots and present them to a user. More specifically, server 105 may generate a synthetic order and compare the synthetic order to a snapshot of the time slot availability of the plurality of vehicles (as described above with respect to FIG. 2) retrieved from vehicle availability database 132e (shown in FIG. 1C). Server 105 may maintain the snapshot based on information received from vehicle server 128 regarding the plurality of time slots each vehicle in the plurality of vehicles has. For example, vehicle server 128 may transmit information regarding the number of time slots each vehicle has, and the length of each time slot. Server 105 may determine which vehicles among the plurality of vehicles has sufficient capacity to accommodate the synthetic order. Upon determining which vehicles have sufficient capacity, server 105 may insert the synthetic order into each time slot in each of the vehicles having sufficient capacity. For each time slot the synthetic order is inserted into, server 105 may determine whether the insertion is feasible. In other words, server 105 may determine if all of the vehicle's other delivery orders can be met (e.g. delivered on time) if the synthetic order is inserted into that time slot and remove those time slots that would result in the vehicle being unable to fulfill one or more of its previously scheduled deliveries. At this point, server 105 may identify the time slots having at least one of the plurality of vehicles available for delivery during that time slot as acceptable delivery time slots and present them to the user via user terminals 120-130.


At 510 server 105 may determine whether a delivery order has been received. If server 105 determines that a delivery order has been received, at 515, server 105 may determine which vehicle the received delivery order is to be assigned to, and whether certain delivery orders need to be re-assigned to a different vehicle in order to optimize vehicle resources. At 520, server 105 may determine the sequence in which the assigned vehicle's delivery orders will be delivered. Server 105 may assign delivery orders to, and determine a delivery route for the vehicle based on the selected time slot of the received order, map data 132d, and an overall cost that is a function of a number of delivery parameters. In some embodiments, server 105 may also re-assign delivery orders to and determine delivery routes for other vehicles in the plurality of vehicles based on the selected time slot of the received order, map data 132d, and an overall cost that is a function of a number of delivery parameters. Examples of such delivery parameters may include number of vehicles from the plurality needed to deliver all orders, total number of miles driven by the vehicles during delivery, total driving time of the vehicles during delivery, total amount of idle time of the vehicles during delivery, and degree of lateness in delivering an order (if any) among others. Server 105 may utilize a meta-heuristic algorithm, such as simulated annealing, in order to determine which vehicle the received delivery order is to be assigned to, as well as the sequence in which that vehicle's delivery orders are to be delivered. In addition, server 105 may utilize the meta heuristic algorithm to determine whether certain delivery orders need to be re-assigned to a different vehicle in order to optimize vehicle resources, and the sequence in which each vehicle's assigned delivery orders will be delivered (delivery route). In some embodiments, server 105 may assign a particular weight to each delivery parameter when assigning delivery orders and determining delivery routes for the one or more vehicles. For example, server 105 may assign total mileage the largest weight, and thus may assign delivery orders to and determine delivery routes for the one or more vehicles from the plurality of vehicles based primarily on reducing the total miles driven by the one or more vehicles, as this will have the largest impact on the overall cost. In this way, server 105 may determine one or more delivery routes.


At 525, server 105 may further optimize each vehicle's delivery route. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may randomly select a delivery order from among the plurality of delivery routes, and iteratively insert the randomly selected delivery order into one or more randomly selected time slots from the plurality of delivery routes. Server 105 may then determine the cost effect of each insertion. In some embodiments, server 105 may insert the randomly selected delivery order into every time slot from the plurality of delivery routes and calculate the cost effect of every insertion. In still other embodiments, server 105 may determine which routes among the plurality of delivery routes have available time slots that overlap with the time slot of the randomly selected delivery order Server 105 may only insert the randomly selected delivery order into those routes having an available time slot that overlaps with the time slot of the randomly selected delivery order. Server 105 may insert the randomly selected delivery order into the time slot resulting in the largest reduction in overall cost. In some embodiments, server 105 may perform multiple iterations of the above described process.


In some embodiments, server 105 may generate an updated snapshot of time slot availability for the plurality of vehicles and store the updated snapshot in vehicle availability database 132e for presentation to online users. The updated snapshot may be based on the optimized delivery routes determined for the one or more vehicles in the plurality of vehicles.


As described above, server 105 may assign delivery orders and optimize delivery routes whenever a new delivery order is received from a user terminal 120-135. In some embodiments, server 105 may continuously optimize the delivery routes of each vehicle at pre-defined intervals until a pre-defined time period before the delivery route is to commence. In other embodiments, server 105 may optimize delivery routes in response to receiving a new delivery order until a pre-defined time period before the delivery route is to commence.


In some embodiments, server 105 may transmit the optimized delivery routes to the corresponding vehicles among the plurality of vehicles 128a-c via vehicle server 128, which may act as a relay to provide the optimized delivery routes to the corresponding vehicles.


In some embodiments, server 105 is configured to provide a horizontally-scalable system to provide expansion to additional origination locations and increased throughput. FIG. 6 illustrates an exemplary optimization and routing block 600 configured to be implemented on a system, such as server 105. In some embodiments, the optimization and routing block 600 is configured to be implemented on a virtual machine or server. The optimization and routing block 600 can include a scheduler 605, an optimizer 610, a geospatial engine 615, a database 132e, and an administration block 620.


In some embodiments, a scheduler 605 is configured to receive delivery requests from user terminals 120-130, view available delivery slots, assign deliveries, and/or generate interim delivery snapshots to an optimizer 610. For example, in some embodiments, the scheduler 605 is configured to receive a request from a user to schedule a delivery. In some embodiments, the request from the user includes a desired time slot. The scheduler 605 obtains a persistent delivery snapshot for a plurality of vehicles 128a-128c associated with a predetermined origination location for the scheduled delivery. The persistent delivery snapshot may be an optimized delivery snapshot generated by an optimizer 610, as discussed in greater detail below. The persistent delivery snapshot can be loaded from a database 132e, provided directly from an optimizer 610, and/or otherwise obtained by the scheduler 605. The scheduler 605 reviews the available delivery slots. If the scheduler 605 determines that the desired time slot is available in the persistent delivery snapshot, the scheduler 605 inserts the requested delivery into the time slot to generate an interim delivery snapshot. If the scheduler 605 determines that the desired time slot is not available in the persistent delivery snapshot, the scheduler 605 sends a response to the user that the desired delivery time slot is not available.


After verifying that a selected time slot is available, the scheduler 605 is configured to insert the requested delivery in the persistent delivery snapshot to generate an interim delivery snapshot. The scheduler 605 inserts the requested delivery at one of the available open slots corresponding to the selected time slot. For example, in some embodiments, the scheduler 605 is configured to perform a cost function analysis to determine a delivery slot with the least cost for insertion of the requested delivery, as discussed above with respect to FIGS. 3A-3B.


In some embodiments, the scheduler 605 applies a dynamic programming approach to find a slot among multiple delivery snapshots and updates an existing delivery snapshot with the requested delivery. For example, in some embodiments, the scheduler 605 receives a request to schedule a delivery in a specific time slot, such as a 3 PM-5 PM time slot. The scheduler 605 obtains a persistent delivery snapshot for a first origination location and determines that the 3 PM-5 PM delivery window is not available. The scheduler 605 may obtain one or more additional delivery snapshots from the database 132e for the current origination location and/or may obtain persistent delivery snapshots for other origination locations that are located in proximity to the current origination location associated with the scheduler 605. For example, in some embodiments, the scheduler 605 obtains one or more alternative delivery snapshots from the database 132e and determines if the desired delivery time slot can be accommodated in any of the alternative delivery snapshots. If an alternative delivery snapshot can accommodate the requested delivery, the scheduler 605 can book the delivery in the desired time slot and generate an interim delivery snapshot from the alternative delivery snapshot.


The optimization and routing block 600 includes an optimizer (e.g., vehicle routing problem (VRP) optimizer) 610 configured to apply one or more routing optimization processes, such as discussed above with respect to FIGS. 2-5. For example, in some embodiments, the optimizer 610 is configured to receive an interim delivery snapshot from the scheduler 605 and apply a simulated annealing process, a 1-0 replacement process, and/or any other suitable optimization process to the interim delivery snapshot. As discussed above, an optimizer 610 can be configured to asses a plurality of factors each having a predetermined weighting during an optimization process. In various embodiments, the optimizer 610 can include a stateless optimizer or stateful optimizer.


In some embodiments, the optimizer 610 includes a stateless optimizer configured to receive a single order request and return an inline solution to scheduler 605. The stateless optimizer applies an optimization process, such as the simulated annealing process discussed above, to an interim delivery snapshot received from a scheduler 605 to generate an updated persistent delivery snapshot. In some embodiments, the optimizer 610 applies an optimization process for a predetermined number of cycles and/or a predetermined duration (as bound by a configurable upper limit). In some embodiments, the predetermined number of cycles corresponds to a predetermined optimization period.


In some embodiments, the optimizer 610 includes a stateful optimizer configured to receive an interim delivery snapshot and generate an updated persistent delivery snapshot. The updated persistent delivery snapshot is associated with a unique identifier (such as a job ID, etc.). The stateful optimizer can generate a call (such as a callback to the scheduler 605) and/or can store the updated persistent delivery snapshot in a database, such as database 132e. The updated persistent delivery snapshot is stored in the database. When the scheduler 605 (and/or an additional scheduler, as discussed below) requests a delivery snapshot for the predetermined origination location by providing the unique identifier, the stored (e.g., updated) persistent delivery snapshot is provided to the scheduler 605 as the current persistent delivery snapshot for the origination location.


In some embodiments, the optimizer 610 is configured to perform incremental optimization of one or more stored persistent delivery snapshots. The optimizer 610 can be configured to perform incremental optimization at a first predetermined interval, such as, for example, every five minutes, ten minutes, fifteen minutes, twenty minutes, etc. When initiating an incremental optimization process, the optimizer 610 obtains the persistent delivery snapshot (for example, from the database 132e and/or from an optimization queue as discussed below) and applies a predetermined optimization process for a predetermined number of cycles to generate an updated persistent delivery snapshot. The updated persistent delivery snapshot is stored in the database 132e and replaces the existing persistent delivery snapshot for the associated origination location. When a scheduler 605 receives a request to schedule a delivery, the scheduler 610 loads the persistent delivery snapshot from the database 132e and receives the most-recently optimized persistent delivery snapshot. In some embodiments, the persistent delivery snapshot is provided to one or delivery vehicles 128a-128c at a predetermined time, after which the persistent delivery snapshot cannot be further updated or edited by the scheduler 605 and/or the optimizer 610. The optimizer 610 may repeat the incremental optimization process at the predetermined interval on the same and/or a different persistent delivery snapshot stored in the database 132e.


In some embodiments, the optimizer 610 is configured to perform batch optimization at a second predetermined interval, such as, for example, every half hour, every hour, every two hours, etc. When initiating a batch optimization process, the optimizer 610 loads a current persistent delivery snapshot from the database 132e (and/or from an optimization queue) and performs an extended optimization process. For example, in some embodiments, the optimizer 610 applies a simulated annealing process to an existing persistent delivery snapshot over a predetermined number of cycles corresponding to a predetermined time period, such as, for example, one hour, two hours, etc. to provide a greater comparison of the potential solution space and identify optimal solutions. In some embodiments, a batch optimization process may generate a new persistent delivery snapshot without using the existing persistent delivery snapshot as a starting point (i.e., using only existing deliveries).


In some embodiments, the optimizer 610 is configured to apply a reconciliation strategy during batch and/or incremental optimization, as illustrated in FIG. 7. During an optimization process, additional events (or delta events) may occur that would impact the persistent delivery snapshot. For example, delta events can include, but are not limited to, cancellation of existing orders, updates to existing orders, and addition of new orders. As shown in FIG. 7, in some embodiments, at time to, a trigger for incremental optimization is received by a optimizer 610. As discussed below, the trigger can include any suitable trigger, such as a Backend as a Service (BaaS) trigger, an internal/external clock, and/or any other suitable trigger. The optimizer 610 initiates an incremental optimization for a persistent delivery snapshot. The incremental optimization has a predetermined run time, such as, for example, fifteen minutes. At time t1, a delta event, such as an order cancellation, order modification, and/or order addition can be received at the scheduler 605. The scheduler 605 may generate a request to the optimizer 610 (and/or an optimization queue) to optimize an interim delivery snapshot based on the persistent delivery snapshot being optimized by the optimizer 610.


At time t2, the optimizer 610 completes the incremental optimization and, as discussed above, generates an updated persistent delivery snapshot. At time t3, prior to saving the updated persistent delivery snapshot in the database 132e, the optimizer 610 checks for delta events, such as the delta event that occurred at time t1. If the optimizer 610 identifies one or more delta events, the optimizer 610 modifies the updated persistent delivery snapshot based on the delta event(s). For example, in some embodiments, the optimizer 610 incorporates the delta event(s) into the updated persistent delivery snapshot directly and/or loads the interim delivery solution from the optimization queue and discards the updated persistent delivery snapshot. After modifying the updated persistent delivery snapshot, the optimizer 610 performs an additional optimization process on the modified persistent delivery snapshot. The additional optimization process may include a cycle time that is less than, equal to, or greater than the cycle time of the incremental optimization process. After performing the additional optimization process, the optimizer 610 checks for additional delta events that occurred during the additional optimization process. If additional delta events are present, the optimizer 610 may perform a second additional optimization process. In some embodiments, the optimizer 610 includes a predetermined limit on the number of additional optimization processes that can be performed. For example, if the optimizer 610 performs three additional optimization processes and encounters additional delta events after the third optimization process, the optimizer 610 stops trying to generate an incremental update for the persistent delivery snapshot. If no additional delta events are identified, the optimizer stores the updated persistent delivery snapshot at time t4.


In some embodiments, the optimization and routing block 600 includes a geospatial engine 615 configured to provide mapping data to the scheduler 605 and/or the optimizer 610. The geospatial engine 615 can include any suitable mapping engine configured to support distance and time matrix queries. In some embodiments, the geospatial engine 615 is configured to augment distance and time queries to account for modified forms of travel, such as foot travel vs. vehicle travel, on-road vs. off-road travel, etc. In some embodiments, the geospatial engine 615 is configured to pre-process map information using a predetermined process, such as a contraction hierarchy, to increase response time to queries.


In some embodiments, a server 105 can include a horizontally-scalable implementation of multiple optimization and routing blocks 600 and/or portions of multiple optimization and routing blocks 600. FIG. 8 illustrates a server environment 700 including a plurality of virtual machines 705a-705c each including an implantation of an optimization and routing block 600. The optimization and routing blocks 600 are illustrated with components in a scheduling layer 720a and an optimization layer 720b, although it will be appreciated that components can be located in any layer and/or across layers. For example, as shown in FIG. 8, each of the virtual machines 705a-705c can include a scheduler 605a-605c, an optimizer 610a-610c, and a geospatial engine 615a-615c. Although the schedulers 605a-605c and the optimizers 610a-610c are illustrated in separate layers 720a, 720b, it will be appreciated that the each of the virtual machines 705a-705c can include a single implementation of a optimization and routing block 600 containing each of scheduler 605a-605c, an optimizer 610a-610c, and a geospatial engine 615a-615c.


In some embodiments, the server environment 700 includes a scheduling layer 720a including a plurality of virtual machines 705a-705c each including a scheduler 605a-605c and a geospatial engine 615a-615c. The schedulers 605a-605c are similar to the scheduler 605 discussed above and the geospatial engines 615a-615c are similar to the geospatial engine 615 discussed above, and similar description is not repeated herein. Each of the schedulers 605a-605c is associated with and configured to receive requests to schedule a delivery for a predetermined origination location, such as a store, a warehouse, etc. The schedulers 605a-605c receive requests for deliveries from users associated with and/or located near the predetermined origination location and attempt to schedule the deliveries within an existing persistent delivery snapshot for the associated predetermined origination location, for example, from database 132e.


In some embodiments, each of the schedulers 605a-605c is configured to generate one or more calls or requests. For example, each of the schedulers 605a-605c may be configured to perform a view slot call, a book slot call, an update/cancel slot call, and/or an optimization call. For example, as discussed above with respect to FIG. 6, each of the schedulers 605a-605c are configured to view one or more available slots within a persistent delivery snapshot associated with a predetermined origination location and insert a requested delivery into an available slot (e.g., book a slot). In addition, each of the schedulers 605a-605c are configured to modify and/or remove previously scheduled deliveries. For example, in some embodiments, the schedulers 605a-605c are configured to modify a delivery time of a previously scheduled delivery, remove a previously scheduled delivery, and/or add additional deliveries.


In some embodiments, each of the schedulers 605a-605c is configured to generate an optimization call after generating in interim delivery snapshot. For example, in some embodiments, when a scheduler 605a-605c assigns a requested delivery to an available slot within a persistent delivery snapshot, the interim delivery snapshot may not contain an optimal route and/or optimal order for all deliveries and/or vehicles. The schedulers 605a-605c generate a call to an optimization layer 720b. The generated call provides the interim delivery snapshot to the optimization layer 720b, which includes a plurality of optimizers 610a-610c configured to implement an optimization process to optimize the interim delivery snapshot.


In some embodiments, each of the schedulers 605a-605c is configured to provide the interim delivery snapshot to an optimization queue 725. The optimization queue 725 is in communication with the optimization layer. When an optimizer 610a-610c is idle, the optimization queue 725 provides a pending interim delivery snapshot to the idle optimizer 610a-610c. The optimizer 610a-610c performs an optimization process to generate an updated persistent delivery snapshot. The optimizer 610a-610c may be implemented by the same virtual machine 705a-705c associated with the scheduler 605a-605c that generated the interim delivery snapshot and/or may be any available virtual machine 705a-705c selected from the available virtual machines 705a-705c.


In some embodiments, each of the virtual machines 705a-705c includes a geospatial engine 615a-615c and an optimizer 610a-610c. The geospatial engine 615a-615c may be the same geospatial engine 615a-615c used by the schedulers 605a-605c implemented by the respective virtual machine 705a-705c and/or may be an independent and/or dedicated geospatial engine 615a-615c. The optimizers 610a-610c and the geospatial engines 615a-615c are similar to the optimizer 610 and the geospatial engine 615 described above, and similar description is not repeated herein.


In some embodiments, each of the optimizers 610a-610c is configured receive an interim delivery snapshot and/or a persistent delivery snapshot and generate an updated persistent delivery snapshot. For example, in some embodiments, a scheduler 605a-605c generates an interim delivery snapshot which is provided to the optimization queue 725. When an optimizer 610a-610c is idle, the optimizer 610a-610c loads an interim delivery snapshot from the optimization queue and performs an optimization process to generate an updated persistent delivery snapshot. If no interim delivery snapshots are available in the optimization queue 725, the optimizers 610a-610c may be configured to perform an incremental and/or batch optimization. For example, persistent delivery snapshots for one or more stores are stored in a database 132e. When an optimizers 610a-610c initiates an incremental and/or batch optimization, the optimizer 610a-610c loads a persistent delivery snapshot from the database 132e and performs the incremental and/or batch optimization process to generate an updated persistent delivery snapshot that is stored in the database 132e.


In some embodiments, each of the scheduling layer 720a and the optimization layer 720b are horizontally scalable. For example, in some embodiments, if additional origination locations (such as additional stores, warehouses, etc.) are added, the scheduling layer 720a can add N additional schedulers 605c, where N is equal to the number of additional origination locations being added. Similarly, if additional origination locations are added and/or a large number of unprocessed optimization requests are located in the optimization queue 725, the optimization layer 720b can add N additional optimizers 610c, where N is the number of additional origination locations and/or the number of unprocessed optimization requests in the optimization queue 725.


In some embodiments, each of the virtual machines 705a-705c are associated with a selected one of the origination locations. For example, in some embodiments, a first scheduler 605a may be configured to receive all requests to schedule a delivery for a first origination location, a second scheduler 605b may be configured to receive all requests to schedule a delivery for a second origination location, and a third scheduler 605c may be configured to receive all requests to schedule a delivery for a third origination location. Similarly, in some embodiments, a first optimizer may be configured to handle optimization requests (including interim delivery snapshots, incremental optimization, and/or batch optimization) for delivery snapshots associated with the first origination location, a second optimizer may be configured to handle optimization requests for delivery snapshots associated with the second origination location, and a third optimizer may be configured to handle optimization requests for delivery snapshots associated with the third origination location.


The various embodiments described herein may employ various computer-implemented operations involving data stored in computer systems. For example, these operations may require physical manipulation of physical quantities usually, though not necessarily, these quantities may take the form of electrical or magnetic signals, where they or representations of them are capable of being stored, transferred, combined, compared, or otherwise manipulated. Further, such manipulations are often referred to in terms, such as producing, identifying, determining, or comparing. Any operations described herein that form part of one or more embodiments of the invention may be useful machine operations. In addition, one or more embodiments of the invention also relate to a device or an apparatus for performing these operations. The apparatus may be specially constructed for specific required purposes, or it may be a general purpose computer selectively activated or configured by a computer program stored in the computer. In particular, various general purpose machines may be used with computer programs written in accordance with the teachings herein, or it may be more convenient to construct a more specialized apparatus to perform the required operations.


The various embodiments described herein may be practiced with other computer system configurations including hand-held devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like.


One or more embodiments of the present invention may be implemented as one or more computer programs or as one or more computer program modules embodied in one or more computer readable media. The term computer readable medium refers to any data storage device that can store data which can thereafter be input to a computer system. The computer readable media may be based on any existing or subsequently developed technology for embodying computer programs in a manner that enables them to be read by a computer. Examples of a computer readable medium include a hard drive, network attached storage (NAS), read-only memory, random-access memory (e.g., a flash memory device), a CD (Compact Discs)—CD-ROM, a CD-R, or a CD-RW, a DVD (Digital Versatile Disc), a magnetic tape, and other optical and non-optical data storage devices. The computer readable medium can also be distributed over a network coupled computer system so that the computer readable code is stored and executed in a distributed fashion.


Although one or more embodiments of the present invention have been described in some detail for clarity of understanding, it will be apparent that certain changes and modifications may be made within the scope of the claims. Accordingly, the described embodiments are to be considered as illustrative and not restrictive, and the scope of the claims is not to be limited to details given herein, but may be modified within the scope and equivalents of the claims. In the claims, elements and/or steps do not imply any particular order of operation, unless explicitly stated in the claims.


Plural instances may be provided for components, operations or structures described herein as a single instance. Finally, boundaries between various components, operations and data stores are somewhat arbitrary, and particular operations are illustrated in the context of specific illustrative configurations. Other allocations of functionality are envisioned and may fall within the scope of the invention(s). In general, structures and functionality presented as separate components in exemplary configurations may be implemented as a combined structure or component. Similarly, structures and functionality presented as a single component may be implemented as separate components. These and other variations, modifications, additions, and improvements may fall within the scope of the appended claims(s).

Claims
  • 1. A system, comprising: a communications interface configured to communicate, over one or more networks, with a vehicle server, the vehicle server being configured to communicate with a delivery computing device of each of a plurality of vehicles;a database storing a plurality of persistent delivery snapshots of the plurality of vehicles;a memory resource storing instructions; anda processor operatively coupled to the communications interface, the database and memory resource, the processor being configured to execute the instructions to: receive a request to schedule a delivery for an origination location;generate an interim delivery snapshot including the delivery at an available time slot of a persistent delivery snapshot of the plurality of persistent delivery snapshots;determine an overall cost associated with the interim delivery snapshot, based on a plurality of delivery parameters associated with a completion of all delivery orders by a set of vehicles identified in the interim delivery snapshot, wherein the plurality of delivery parameters includes at least: a total mileage driven by all assigned vehicles during delivery, a degree of lateness during delivery, anda total vehicle number of the all assigned vehicles, the total mileage is associated with a first weight,the degree of lateness is associated with a second weight that is smaller than the first weight, andthe total vehicle number is associated with a third weight that is smaller than the second weight;compute a plurality of candidate overall costs using a meta-heuristic algorithm based on: the interim delivery snapshot, the plurality of delivery parameters, and the weights associated with the plurality of delivery parameters, wherein each of the plurality of candidate overall costs is associated with a set of candidate delivery routes of the set of vehicles, wherein each of the plurality of candidate overall costs is computed iteratively after re-assigning at least one delivery order from one vehicle to another vehicle among the set of vehicles;compare the determined overall cost with the plurality of candidate overall costs to determine a minimum overall cost based on the plurality of delivery parameters comprising the total mileage driven by all assigned vehicles during delivery, the degree of lateness during delivery, the total vehicle number of the all assigned vehicles, after the re-assigning, and the associated weights of the plurality of delivery parameters;based on the minimum overall cost, determine, for each of the set of vehicles, an optimized delivery route, the optimized delivery route being associated with one or more optimized delivery orders of all the delivery orders identified in the interim delivery snapshot that are assigned to a corresponding vehicle of the set of vehicles corresponding to the minimum overall cost;based at least on the determined optimized delivery route for each of the set of vehicles and the interim delivery snapshot, generate an updated persistent delivery snapshot; andfor each of the set of vehicles, transmit, over the one or more networks, via the vehicle server and to a corresponding delivery computing device, the optimized delivery route.
  • 2. The system of claim 1, wherein the processor is further configured to execute the instructions to: store the updated persistent delivery snapshot in the database.
  • 3. The system of claim 2, wherein the processor is further configured to execute the instructions to: provide the interim delivery snapshot to an optimization queue, wherein the interim delivery snapshot is received from the optimization queue before computing the plurality of candidate overall costs.
  • 4. The system of claim 3, wherein the processor is further configured to execute the instructions to: apply an incremental optimization process to the updated persistent delivery snapshot.
  • 5. The system of claim 3, wherein the processor is further configured to execute the instructions to: apply a batch optimization process to the updated persistent delivery snapshot.
  • 6. The system of claim 1, wherein the processor is further configured to execute the instructions to: receive at least one delta event; andmodify the updated persistent delivery snapshot based on the at least one delta event.
  • 7. The system of claim 1, wherein the processor is further configured to execute the instructions to implement a set of geospatial operations, the set of geospatial operations including: receiving distance and time matrix queries; andgenerating mapping data.
  • 8. The system of claim 7, wherein the set of geospatial operations provides distance and time queries for off-road travel.
  • 9. A method, implemented on a processor operatively coupled to a database and a memory resource, comprising: receiving a request to schedule a delivery for an origination location, wherein: the processor is operatively coupled to a communications interface,the communications interface is configured to communicate, over one or more networks, with a vehicle server, the vehicle server being configured to communicate with a delivery computing device of each of a plurality of vehicles,the database stores a plurality of persistent delivery snapshots of the plurality of vehicles;generating an interim delivery snapshot including the delivery at an available time slot of a persistent delivery snapshot of the plurality of persistent delivery snapshots;determining an overall cost associated with the interim delivery snapshot, based on a plurality of delivery parameters associated with a completion of all delivery orders by a set of vehicles identified in the interim delivery snapshot, wherein the plurality of delivery parameters includes at least: a total mileage driven by all assigned vehicles during delivery, a degree of lateness during delivery, and a total vehicle number of the all assigned vehicles,the total mileage is associated with a first weight,the degree of lateness is associated with a second weight that is smaller than the first weight, andthe total vehicle number is associated with a third weight that is smaller than the second weight;computing a plurality of candidate overall costs using a meta-heuristic algorithm based on: the interim delivery snapshot, the plurality of delivery parameters, and the weights associated with the plurality of delivery parameters, wherein each of the plurality of candidate overall costs is associated with a set of candidate delivery routes of the set of vehicles, wherein each of the plurality of candidate overall costs is computed iteratively after re-assigning at least one delivery order from one vehicle to another vehicle among the set of vehicles;comparing the determined overall cost with the plurality of candidate overall costs to determine a minimum overall cost based on the plurality of delivery parameters comprising the total mileage driven by all assigned vehicles during delivery, the degree of lateness during delivery, the total vehicle number of the all assigned vehicles, after the re-assigning, and the associated weights of the plurality of delivery parameters;based on the minimum overall cost, determining, for each of the set of vehicles, an optimized delivery route, the optimized delivery route being associated with one or more optimized delivery orders of all the delivery orders identified in the interim delivery snapshot that are assigned to a corresponding vehicle of the set of vehicles corresponding to the minimum overall cost;based at least on the determined optimized delivery route for each of the set of vehicles and the interim delivery snapshot, generate an updated persistent delivery snapshot; andfor each of the set of vehicles, transmitting, over the one or more networks, via the vehicle server and to a corresponding delivery computing device, the optimized delivery route.
  • 10. The method of claim 9, further comprising: storing the updated persistent delivery snapshot in the database.
  • 11. The method of claim 10, further comprising: providing the interim delivery snapshot to an optimization queue, wherein the interim delivery snapshot is received from the optimization queue before computing the plurality of candidate overall costs.
  • 12. The method of claim 11, further comprising applying an incremental optimization process to the updated persistent delivery snapshot.
  • 13. The method of claim 11, further comprising applying a batch optimization process to the updated persistent delivery snapshot.
  • 14. The method of claim 9, further comprising: receiving at least one delta event; andmodifying the updated persistent delivery snapshot based on the at least one delta event.
  • 15. The method of claim 9, further comprising implementing a set of geospatial operations, the set of geospatial operations including receiving distance and time matrix queries and generating mapping data.
  • 16. A non-transitory computer readable medium having instructions stored thereon, wherein the instructions, when executed by a processor, cause a device to perform operations comprising: receiving a request to schedule a delivery for an origination location, wherein: the processor is operatively coupled to a communications interface and a database,the communications interface is configured to communicate, over one or more networks, with a vehicle server, the vehicle server being configured to communicate with a delivery computing device of each of a plurality of vehicles,the database stores a plurality of persistent delivery snapshots of the plurality of vehicles;generating an interim delivery snapshot including the delivery at an available time slot of a persistent delivery snapshot of the plurality of persistent delivery snapshots;determining an overall cost associated with the interim delivery snapshot, based on a plurality of delivery parameters associated with a completion of all delivery orders by a set of vehicles identified in the interim delivery snapshot, wherein the plurality of delivery parameters includes at least: a total mileage driven by all assigned vehicles during delivery, a degree of lateness during delivery, and a total vehicle number of the all assigned vehicles,the total mileage is associated with a first weight,the degree of lateness is associated with a second weight that is smaller than the first weight, andthe total vehicle number is associated with a third weight that is smaller than the second weight;computing a plurality of candidate overall costs using a meta-heuristic algorithm based on: the interim delivery snapshot, the plurality of delivery parameters, and the weights associated with the plurality of delivery parameters, wherein each of the plurality of candidate overall costs is associated with a set of candidate delivery routes of the set of vehicles, wherein each of the plurality of candidate overall costs is computed iteratively after re-assigning at least one delivery order from one vehicle to another vehicle among the set of vehicles;comparing the determined overall cost with the plurality of candidate overall costs to determine a minimum overall cost based on the plurality of delivery parameters comprising the total mileage driven by all assigned vehicles during delivery, the degree of lateness during delivery, the total vehicle number of the all assigned vehicles, after the re-assigning, and the associated weights of the plurality of delivery parameters;based on the minimum overall cost, determining, for each of the set of vehicles, an optimized delivery route, the optimized delivery route being associated with one or more optimized delivery orders of all the delivery orders identified in the interim delivery snapshot that are assigned to a corresponding vehicle of the set of vehicles corresponding to the minimum overall cost;based at least on the determined optimized delivery route for each of the set of vehicles and the interim delivery snapshot, generate an updated persistent delivery snapshot; andfor each of the set of vehicles, transmitting, over the one or more networks, via the vehicle server and to a corresponding delivery computing device, the optimized delivery route.
  • 17. The non-transitory computer readable medium of claim 16, wherein the instructions, when executed by the processor, further cause the device to perform operations comprising: receiving at least one delta event; andmodifying the updated persistent delivery snapshot based on the at least one delta event.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 16/007,913, filed Jun. 13, 2018, and entitled “SYSTEMS AND METHODS FOR COMBINATORIAL RESOURCE OPTIMIZATION,” which is a continuation-in-part of U.S. patent application Ser. No. 15/876,007, filed Jan. 19, 2018, now U.S. Pat. No. 11,475,395, and entitled “SYSTEMS AND METHODS FOR COMBINATORIAL RESOURCE OPTIMIZATION,” which are incorporated herein in their entireties.

US Referenced Citations (251)
Number Name Date Kind
5444444 Ross Aug 1995 A
5922040 Prabhakaran Jul 1999 A
6240362 Gaspard, II May 2001 B1
6701299 Kraisser et al. Mar 2004 B2
6754634 Ho Jun 2004 B1
6963861 Boucher et al. Nov 2005 B1
7222081 Sone May 2007 B1
7251612 Parker et al. Jul 2007 B1
7430517 Barton Sep 2008 B1
7437305 Kantarjiev Oct 2008 B1
7775431 Skaaksrud et al. Aug 2010 B2
8015023 Lee et al. Sep 2011 B1
8126903 Lehmann et al. Feb 2012 B2
8160972 Tannenbaum Apr 2012 B1
8224707 Smith et al. Jul 2012 B1
8429019 Yeatts et al. Apr 2013 B1
8438088 Cunniff et al. May 2013 B2
8521656 Zimberoff et al. Aug 2013 B2
9037406 Mason May 2015 B2
9256852 Myllymaki Feb 2016 B1
9494937 Siegel et al. Nov 2016 B2
9619775 Saito Apr 2017 B1
9626639 Gibbon et al. Apr 2017 B2
9691091 Jones et al. Jun 2017 B2
9857188 O'Hare et al. Jan 2018 B1
10157362 Johansson et al. Dec 2018 B1
10163070 Phillips et al. Dec 2018 B1
10204528 Truong et al. Feb 2019 B2
10227178 High et al. Mar 2019 B2
10233021 Brady et al. Mar 2019 B1
10245993 Brady et al. Apr 2019 B1
10248731 Brouwer, II et al. Apr 2019 B1
10255577 Steves et al. Apr 2019 B1
10304027 Haque May 2019 B1
10514690 Siegel et al. Dec 2019 B1
10627244 Lauka et al. Apr 2020 B1
10839695 Kuncl et al. Nov 2020 B2
10846633 Magazinik et al. Nov 2020 B2
11157866 Bostick Oct 2021 B2
11615368 Fu Mar 2023 B2
20010047285 Borders et al. Nov 2001 A1
20010056395 Khan Dec 2001 A1
20020007299 Florence Jan 2002 A1
20020052688 Yofu May 2002 A1
20020073049 Dutta Jun 2002 A1
20020107820 Huxter Aug 2002 A1
20020147654 Kraisser Oct 2002 A1
20020152174 Woods et al. Oct 2002 A1
20020188517 Banerjee et al. Dec 2002 A1
20030040944 Hileman Feb 2003 A1
20030078873 Cohen Apr 2003 A1
20030084125 Nagda et al. May 2003 A1
20030200111 Damji Oct 2003 A1
20030236679 Galves et al. Dec 2003 A1
20040015393 Fong et al. Jan 2004 A1
20040030572 Campbell et al. Feb 2004 A1
20040030604 Young Feb 2004 A1
20040034571 Wood et al. Feb 2004 A1
20040093302 Baker et al. May 2004 A1
20040107110 Gottlieb Jun 2004 A1
20040199285 Berichon et al. Oct 2004 A1
20050006470 Mrozik et al. Jan 2005 A1
20050209913 Wied et al. Sep 2005 A1
20050216364 Jurisic et al. Sep 2005 A1
20050228705 Irwin Oct 2005 A1
20050251330 Waterhouse et al. Nov 2005 A1
20050278063 Hersh et al. Dec 2005 A1
20060026030 Jacobs Feb 2006 A1
20060085318 Cohoon Apr 2006 A1
20060155595 Johannsen Jul 2006 A1
20060161335 Beinhaker Jul 2006 A1
20060235739 Levis et al. Oct 2006 A1
20060238334 Mangan et al. Oct 2006 A1
20060276960 Adamczyk et al. Dec 2006 A1
20070015518 Winter et al. Jan 2007 A1
20070038506 Noble et al. Feb 2007 A1
20070038673 Broussard et al. Feb 2007 A1
20070050279 Huang et al. Mar 2007 A1
20070083410 Hanna Apr 2007 A1
20070112647 Borders et al. May 2007 A1
20070185778 Weng Aug 2007 A1
20070257774 Stumpert et al. Nov 2007 A1
20080027737 Watkins Jan 2008 A1
20080082257 Lee Apr 2008 A1
20080109246 Russell May 2008 A1
20080235147 Jensen Sep 2008 A1
20080288368 Marks et al. Nov 2008 A1
20090005963 Jarvinen Jan 2009 A1
20090037095 Jani et al. Feb 2009 A1
20090058646 Waterhouse et al. Mar 2009 A1
20090070236 Cohen et al. Mar 2009 A1
20090099972 Angert et al. Apr 2009 A1
20090201201 Foster Aug 2009 A1
20090254405 Hollis Oct 2009 A1
20090296990 Holland et al. Dec 2009 A1
20100057341 Bradburn et al. Mar 2010 A1
20100222908 Gombert et al. Sep 2010 A1
20100234990 Zini et al. Sep 2010 A1
20100235210 Nadrotowicz, Jr. Sep 2010 A1
20100332284 Hilbush et al. Dec 2010 A1
20110054979 Cova et al. Mar 2011 A1
20110055046 Bowen et al. Mar 2011 A1
20110099040 Felt et al. Apr 2011 A1
20110112761 Hurley et al. May 2011 A1
20110119159 Chou et al. May 2011 A1
20110161964 Piazza et al. Jun 2011 A1
20110192893 Waugh et al. Aug 2011 A1
20110258134 Mendez Oct 2011 A1
20120078743 Betancourt Mar 2012 A1
20120173448 Rademaker Jul 2012 A1
20120174002 Martin et al. Jul 2012 A1
20120253892 Davidson Oct 2012 A1
20130024390 Zlobinsky Jan 2013 A1
20130117193 Ni May 2013 A1
20130144763 Skyberg et al. Jun 2013 A1
20130198042 Seifen Aug 2013 A1
20130238462 Lutnick Sep 2013 A1
20130246301 Radhakrishnan et al. Sep 2013 A1
20130268454 Mateer Oct 2013 A1
20130325553 Nadiadi et al. Dec 2013 A1
20130325741 Smalling et al. Dec 2013 A1
20130338855 Mason et al. Dec 2013 A1
20140012772 Pretorius Jan 2014 A1
20140023264 Branch et al. Jan 2014 A1
20140032440 Chandrashekar et al. Jan 2014 A1
20140040043 Barron et al. Feb 2014 A1
20140046585 Marris, IV et al. Feb 2014 A1
20140075572 Mehring et al. Mar 2014 A1
20140081445 Villamar Mar 2014 A1
20140095350 Carr et al. Apr 2014 A1
20140149269 Kantarjiev et al. May 2014 A1
20140164167 Taylor Jun 2014 A1
20140172739 Anderson et al. Jun 2014 A1
20140180914 Abhyanker Jun 2014 A1
20140188750 Seiler Jul 2014 A1
20140195421 Lozito Jul 2014 A1
20140214715 Crocker Jul 2014 A1
20140244110 Tharaldson et al. Aug 2014 A1
20140258167 Rohmann et al. Sep 2014 A1
20140277900 Abhyanker Sep 2014 A1
20140279646 Bodenhamer et al. Sep 2014 A1
20140317005 Balwani Oct 2014 A1
20140330739 Falcone Nov 2014 A1
20140330741 Bialynicka-Birula et al. Nov 2014 A1
20150039362 Haque Feb 2015 A1
20150046362 Muetzel et al. Feb 2015 A1
20150081360 Sun et al. Mar 2015 A1
20150081581 Gishen Mar 2015 A1
20150088620 Wittek Mar 2015 A1
20150100514 Parris Apr 2015 A1
20150120600 Luwang Apr 2015 A1
20150142591 High et al. May 2015 A1
20150149298 Tapley May 2015 A1
20150178678 Carr et al. Jun 2015 A1
20150178778 Lee et al. Jun 2015 A1
20150186869 Winters et al. Jul 2015 A1
20150202770 Patron et al. Jul 2015 A1
20150206267 Khanna et al. Jul 2015 A1
20150219467 Ingerman et al. Aug 2015 A1
20150294261 Adell Oct 2015 A1
20150294262 Nelson et al. Oct 2015 A1
20150310388 Jamthe Oct 2015 A1
20150348282 Gibbon et al. Dec 2015 A1
20160012392 Paden et al. Jan 2016 A1
20160019501 Olechko et al. Jan 2016 A1
20160037481 Won et al. Feb 2016 A1
20160042319 Mauch Feb 2016 A1
20160042321 Held Feb 2016 A1
20160048804 Paul et al. Feb 2016 A1
20160063435 Shah et al. Mar 2016 A1
20160071056 Ellison Mar 2016 A1
20160104112 Gorlin Apr 2016 A1
20160125356 Kellogg May 2016 A1
20160148303 Carr et al. May 2016 A1
20160171439 Ladden et al. Jun 2016 A1
20160210591 Lafrance Jul 2016 A1
20160224935 Burnett Aug 2016 A1
20160232487 Yonker Aug 2016 A1
20160239788 Hanks Aug 2016 A1
20160300185 Zamer et al. Oct 2016 A1
20160328669 Droege Nov 2016 A1
20160364678 Cao Dec 2016 A1
20160379167 Raman Dec 2016 A1
20170011180 Andrews et al. Jan 2017 A1
20170011340 Gabbai Jan 2017 A1
20170059337 Barker et al. Mar 2017 A1
20170076058 Stong Mar 2017 A1
20170083862 Loubriel Mar 2017 A1
20170090484 Obaidi Mar 2017 A1
20170091709 Mishra et al. Mar 2017 A1
20170091856 Canberk et al. Mar 2017 A1
20170127215 Khan May 2017 A1
20170138749 Pan et al. May 2017 A1
20170154347 Bateman Jun 2017 A1
20170178057 Al Rifai Jun 2017 A1
20170178070 Wang Jun 2017 A1
20170193404 Yoo et al. Jul 2017 A1
20170193574 Marueli Jul 2017 A1
20170200115 High Jul 2017 A1
20170213062 Jones et al. Jul 2017 A1
20170228683 Hu et al. Aug 2017 A1
20170262790 Khasis Sep 2017 A1
20170300905 Withrow et al. Oct 2017 A1
20170323250 Lindbo et al. Nov 2017 A1
20170365030 Shoham et al. Dec 2017 A1
20180018868 Ren et al. Jan 2018 A1
20180060814 Seaman et al. Mar 2018 A1
20180096287 Senger Apr 2018 A1
20180107967 Bulcao et al. Apr 2018 A1
20180107979 Westover et al. Apr 2018 A1
20180130017 Gupte May 2018 A1
20180158020 Khasis Jun 2018 A1
20180283890 Zhao et al. Oct 2018 A1
20180285806 Scofield et al. Oct 2018 A1
20180299895 Knotts et al. Oct 2018 A1
20180315319 Spector et al. Nov 2018 A1
20180350214 Roth et al. Dec 2018 A1
20180351671 Sadeghi et al. Dec 2018 A1
20180356823 Cooper Dec 2018 A1
20180365643 Zhu et al. Dec 2018 A1
20190066047 O'Brien et al. Feb 2019 A1
20190101401 Balva Apr 2019 A1
20190114588 Radetzki et al. Apr 2019 A1
20190156253 Malyack et al. May 2019 A1
20190156283 Abebe et al. May 2019 A1
20190164126 Chopra et al. May 2019 A1
20190180229 Phillips et al. Jun 2019 A1
20190197475 Bianconcini et al. Jun 2019 A1
20190205857 Bell et al. Jul 2019 A1
20190220785 Tanno Jul 2019 A1
20190220816 Frye Jul 2019 A1
20190266557 Berk et al. Aug 2019 A1
20190266690 Mandeno et al. Aug 2019 A1
20190285426 Mitchell et al. Sep 2019 A1
20190333130 Jha et al. Oct 2019 A1
20190385121 Waliany et al. Dec 2019 A1
20200097900 Kibbey et al. Mar 2020 A1
20200097908 Glasfurd et al. Mar 2020 A1
20200104962 Aich et al. Apr 2020 A1
20200116508 Dashti et al. Apr 2020 A1
20200117683 Ji et al. Apr 2020 A1
20200118071 Venkatesan et al. Apr 2020 A1
20200134014 Tiwari et al. Apr 2020 A1
20200134557 Pevzner et al. Apr 2020 A1
20200160148 Garg et al. May 2020 A1
20200210960 Soryal et al. Jul 2020 A1
20200249040 Yamaguchi Aug 2020 A1
20200265383 Zhang Aug 2020 A1
20210150467 Sakai et al. May 2021 A1
20210293550 Migita Sep 2021 A1
20220067657 Neumann Mar 2022 A1
Foreign Referenced Citations (6)
Number Date Country
111144822 May 2020 CN
2002183264 Jun 2002 JP
2007017192 Jan 2007 JP
0169488 Sep 2001 WO
WO-0169488 Sep 2001 WO
2017062492 Apr 2017 WO
Non-Patent Literature Citations (12)
Entry
“Time Slot Management in Attended Home Delivery,” by Niels Agatz, Ann Campbell, Mortiz Fleischmann, and Martin Savelsbergh, Apr. 15, 2008 (Year: 2008).
“Solving multi depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” by Supachai Pathumnakul, 1996 (Year: 1996).
Supachai Pathumnakul, “Solving multi-depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” A thesis submitted to the graduate faculty in partial fulfillment requirements for the degree of Master of Science, Iowa State University, (1996), 96 pages.
N. Agatz et al., “Time Slot Management in Attended Home Delivery,” Apr. 15, 2008, 32 pages.
“Coincide,” Merriam-Webster, Nov. 2, 2016.
D. E. Akyol, et al., “Determining time windows in urban freight transport: A city cooperative approach,” Transportation Research Part E, 118, Jul. 12, 2018, pp. 34-50.
G. P. Rajappa, “Solving Combinatorial Optimization Problems Using Genetic Algorithms and Ant Colony Optimization,” University of Tennessee, Tennessee Research and Creative Exchange, Doctoral Dissertations, Aug. 2012, 105 pages.
S. Pathumnakul, “Solving multi depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” Iowa State University, Retrospective Theses and Dissertations, 1996, 96 pages.
M. Mahajan “Backward and Forward Scheduling,” http://www.erpgreat.com/sap-sd/backward-and-forward-scheduling-in-sap-sd.htm, Jun. 30, 2018, 2 pages.
J. Xu, “Client-Side Data Caching in Mobile Computing Environments,” Hong Kong University of Science and Technology, Thesis, UMI No. 3058186, Jun. 2002, 176 pages.
Supachai Pathumnakul, “Solving multi-depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” A thesis submitted to the graduate faulty in partial fulfillment requirements for the degree of Master of Science, Iowa State University, (1996), 96 pages.
R. Carbonneau et al., “Application of machine learning techniques for supply chain demand forecasting,” European Journal of Operational Research, 184 (2008), pp. 1140-1154.
Related Publications (1)
Number Date Country
20230169415 A1 Jun 2023 US
Continuations (1)
Number Date Country
Parent 16007913 Jun 2018 US
Child 18099591 US
Continuation in Parts (1)
Number Date Country
Parent 15876007 Jan 2018 US
Child 16007913 US