This application relates generally to combinatorial resource optimization, and more particularly, relates to optimizing delivery routes in a goods delivery system.
At least some known systems and industries provide delivery services to their customers. For example, some industries provide the delivery of goods, such as grocery items, to their customers, which has increasingly become a method by which consumers obtain their grocery needs. For grocery delivery services, the use of delivery vehicle resources can be optimized in order to achieve an efficient and profitable grocery delivery service. One particular optimization solution or system is resource optimization and vehicle routing (ROVR), which is designed to optimize grocery delivery routes based on a number of factors in order to make efficient use of delivery vehicle resources.
However, current solutions, including ROVR cannot scale to handle large order sizes (e.g., 2000 or more orders per day). As the number of delivery orders increases, the combinatorial space to be explored (i.e., the complexity of the optimization problem) increases exponentially. For example, doubling the number of orders may result in an exponential increase in the number of alternative delivery routes that are explored and/or considered. In addition, computational resources become bottlenecked, as the time required to optimize delivery routes increases once the number of orders becomes larger. For example, a single optimization can take longer than three minutes, which may significantly affect an optimization system's ability to allocate computation resources to other stores among a collection of hundreds of stores.
In various embodiments, a system including a computing device is disclosed. The computing device is configured to define at least one scheduler and at least one optimizer. The at least one scheduler is configured to receive a request to schedule a delivery for an origination location. The request includes a desired time slot. The request is compared to a persistent delivery snapshot for the origination location to determine availability of the desired time slot. An interim delivery snapshot including the requested delivery is generated when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. The at least one optimizer is configured to receive the interim delivery snapshot and generate an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot
In various embodiments, a method is disclosed. The method includes the step of defining a plurality of schedulers and a plurality of optimizers. A request to schedule a delivery for predetermined first origination location is received at a selected one of the plurality of schedulers. The request includes a desired time slot. The selected one of the plurality of schedulers compares the request to a persistent delivery snapshot for the first origination location to determine availability of the desired time slot and generates an interim delivery snapshot including the requested delivery when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. A selected one of the plurality of optimizers receives the interim delivery snapshot and generates an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot.
In various embodiments, a non-transitory computer readable medium having instructions stored thereon is disclosed. The instructions, when executed by a processor cause a device to perform operations including defining a plurality of schedulers and a plurality of optimizers. A selected one of the plurality of schedulers receives a request to schedule a delivery for predetermined first origination location. The request includes a desired time slot. The selected one of the plurality of schedulers compares the request to a persistent delivery snapshot for the first origination location to determine availability of the desired time slot and generates an interim delivery snapshot including the requested delivery when the persistent delivery snapshot has an available time slot corresponding to the desired time slot. A selected one of the plurality of optimizers receives the interim delivery snapshot and generates an updated persistent delivery snapshot by applying an optimization process to the interim delivery snapshot.
As discussed above, existing solutions or systems for resource optimization cannot scale to handle large numbers of orders and do not enable sufficient flexibility with computational resources. The embodiments described herein facilitate the efficient optimization of resources in large-scale delivery systems. The embodiments described herein include, for example, the estimation of a number of available time windows for a delivery, and the presenting of available time windows to a user. The embodiments also include the determination of delivery routes for one or more vehicles and the subsequent optimization of the determined delivery routes. Although the embodiments described herein illustrate delivery resource optimization systems and methods used for the delivery of grocery goods or items, the embodiments discussed herein are not limited to such systems and methods and one of ordinary skill in the art will appreciate that the current disclosure may be used in connection with any type of system or method that addresses various different types of combinatorial optimization problems.
Server 105, user terminals 120, 125, and 130, and vehicle server 128 can each be a computing device that can be, for example, a desktop computer, laptop, mobile device, tablet, thin client, or other device having a communications interface (not shown) that can communicate with other components of system 100, as explained in more detail below with respect to
In some embodiments, server 105 is associated with a retail store, for example a grocery store. Server 105 may include information about the retail items that are available from the retail store. For example, server 105 can maintain a database (such as database 160 shown in
In some embodiments, vehicle server 128 enables communication between server 105 and each of the vehicles 128a-128c. As server 105 determines delivery order assignments and delivery routes (as discussed in more detail below), server 105 may communicate these assignments and routes to vehicle server 128, which may in turn communicate the assignments and routes to the corresponding vehicle. Vehicle server 128 may transmit information regarding a plurality of time slots for each of the vehicles in the plurality of vehicles to server 105. For example, vehicle server 128 may transmit information regarding the number of time slots a vehicle has per delivery route, the length of each time slot, and other pertinent information regarding the plurality of time slots for each vehicle 128a-128c. In some embodiments, the functions of the vehicle server 128 may be performed by server 105. In some embodiments, information regarding the plurality of time slots for each vehicle 128a-128c may be maintained by the vehicle server 128, the server 105, and/or any other suitable system. Assignments and routes may be calculated by the server 105 and provided to the vehicles 128a-128c once a final assignment and route is determined.
In some embodiments, each user terminal 120, 125, and 130, can be accessed by a user to enable the user to communicate with server 105. Each user terminal 120, 125, and 130 may be capable of connecting to and communicating with server 105 via network 135 (for example, via the internet). The user can use terminals 120, 125, and 130 for accessing information from server 105, such as the retail items that are available for purchase and available delivery time slots, as discussed in more detail herein.
During operation, as explained in more detail below with respect to
Hardware unit 126 also includes a system memory 132 that is coupled to processor 131 via a system bus 234. Memory 132 can be a general volatile RAM. For example, hardware unit 126 can include a 32 bit microcomputer with 2 Mbit ROM and 64 Kbit RAM, and/or a few GB of RAM. Memory 132 can also be a ROM, a network interface (NIC), and/or other device(s).
In some embodiments, computing device 110 can also include at least one media output component or display interface 136 for use in presenting information to a user. Display interface 136 can be any component capable of conveying information to a user and may include, without limitation, a display device (not shown) (e.g., a liquid crystal display (“LCD”), an organic light emitting diode (“OLED”) display, or an audio output device (e.g., a speaker or headphones)). In some embodiments, computing device 110 can output at least one desktop, such as desktop 140. Desktop 140 can be an interactive user environment provided by an operating system and/or applications running within computing device 110, and can include at least one screen or display image, such as display image 142. Desktop 140 can also accept input from a user in the form of device inputs, such as keyboard and mouse inputs. In some embodiments, desktop 140 can also accept simulated inputs, such as simulated keyboard and mouse inputs. In addition to user input and/or output, desktop 140 can send and receive device data, such as input and/or output for a FLASH memory device local to the user, or to a local printer.
In some embodiments, display image 142 can be presented to a user on computer displays of a remote terminal (not shown). For example, computing device 110 can be connected to one or more remote terminals (not shown) or servers (not shown) via a network (not shown), wherein the network can be the Internet, a local area network (“LAN”), a wide area network (“WAN”), a personal area network (“PAN”), or any combination thereof, and the network can transmit information between computing device 110 and the remote terminals or the servers, such that remote end users can access the information from computing device 110.
In some embodiments, computing device 110 includes an input or a user interface 150 for receiving input from a user. User interface 150 may include, for example, a keyboard, a pointing device, a mouse, a stylus, a touch sensitive panel (e.g., a touch pad or a touch screen), a gyroscope, an accelerometer, a position detector, and/or an audio input device. A single component, such as a touch screen, may function as both an output device of the media output component and the input interface. In some embodiments, mobile devices, such as tablets, can be used.
Computing device 110, in some embodiments, can include a database 160 within memory 132, such that various information can be stored within database 160. Alternatively, in some embodiments, database 160 can be included within a remote server (not shown) with file sharing capabilities, such that database 160 can be accessed by computing device 110 and/or remote end users. In some embodiments, a plurality of computer-executable instructions can be stored in memory 132, such as one or more computer-readable storage media 170 (only one being shown in
Memory 132 may further store map data 132d of the geographic area serviced by one or more store fronts as well as a vehicle availability database 132e that stores a snapshot of the current capacity of each vehicle in the plurality of vehicles and the time slots each vehicle has available.
Referring back to
Referring back to
In some embodiments, server 105 may further optimize each vehicle's delivery route. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may randomly select a delivery order from among the plurality of delivery routes, and iteratively insert the randomly selected delivery order into one or more randomly selected time slots from the plurality of delivery routes. Server 105 may then determine the cost effect of each insertion. In some embodiments, server 105 may insert the randomly selected delivery order into every time slot from the plurality of delivery routes and calculate the cost effect of every insertion. In still other embodiments, server 105 may determine which routes among the plurality of delivery routes have available time slots that overlap with the time slot of the randomly selected delivery order. Server 105 may only insert the randomly selected delivery order into those routes having an available time slot that overlaps with the time slot of the randomly selected delivery order. Server 105 may insert the randomly selected delivery order into the time slot resulting in the largest reduction in overall cost. In some embodiments, server 105 may perform multiple iterations of the above described process to further optimize each vehicle's delivery route.
Referring back to
In some embodiments, server 105 may generate an updated snapshot of time slot availability for the plurality of vehicles and store the updated snapshot in vehicle availability database 132e for presentation to online users and/or transmission to the vehicles 128-128c. The updated snapshot may be based on the optimized delivery routes determined for the one or more vehicles in the plurality of vehicles.
As described above, server 105 may assign delivery orders and optimize delivery routes whenever a new delivery order is received from a user terminal 120-135. In some embodiments, server 105 may continuously optimize the delivery routes of each vehicle at pre-defined intervals until a pre-defined time period before the delivery route is to commence. In other embodiments, server 105 may optimize delivery routes in response to receiving a new delivery order until a pre-defined time period before the delivery route is to commence.
In some embodiments, server 105 may transmit the optimized delivery routes to the corresponding vehicles among the plurality of vehicles 128a-c via vehicle server 128, which may act as a relay to provide the optimized delivery routes to the corresponding vehicles.
At 505, server 105 may determine a number of available delivery time slots and present them to a user. More specifically, server 105 may generate a synthetic order and compare the synthetic order to a snapshot of the time slot availability of the plurality of vehicles (as described above with respect to
At 510 server 105 may determine whether a delivery order has been received. If server 105 determines that a delivery order has been received, at 515, server 105 may determine which vehicle the received delivery order is to be assigned to, and whether certain delivery orders need to be re-assigned to a different vehicle in order to optimize vehicle resources. At 520, server 105 may determine the sequence in which the assigned vehicle's delivery orders will be delivered. Server 105 may assign delivery orders to, and determine a delivery route for the vehicle based on the selected time slot of the received order, map data 132d, and an overall cost that is a function of a number of delivery parameters. In some embodiments, server 105 may also re-assign delivery orders to and determine delivery routes for other vehicles in the plurality of vehicles based on the selected time slot of the received order, map data 132d, and an overall cost that is a function of a number of delivery parameters. Examples of such delivery parameters may include number of vehicles from the plurality needed to deliver all orders, total number of miles driven by the vehicles during delivery, total driving time of the vehicles during delivery, total amount of idle time of the vehicles during delivery, and degree of lateness in delivering an order (if any) among others. Server 105 may utilize a meta-heuristic algorithm, such as simulated annealing, in order to determine which vehicle the received delivery order is to be assigned to, as well as the sequence in which that vehicle's delivery orders are to be delivered. In addition, server 105 may utilize the meta heuristic algorithm to determine whether certain delivery orders need to be re-assigned to a different vehicle in order to optimize vehicle resources, and the sequence in which each vehicle's assigned delivery orders will be delivered (delivery route). In some embodiments, server 105 may assign a particular weight to each delivery parameter when assigning delivery orders and determining delivery routes for the one or more vehicles. For example, server 105 may assign total mileage the largest weight, and thus may assign delivery orders to and determine delivery routes for the one or more vehicles from the plurality of vehicles based primarily on reducing the total miles driven by the one or more vehicles, as this will have the largest impact on the overall cost. In this way, server 105 may determine one or more delivery routes.
At 525, server 105 may further optimize each vehicle's delivery route. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may utilize any suitable local search algorithm, such as 1-0 exchange in order to calculate an optimized delivery route for each vehicle. Server 105 may randomly select a delivery order from among the plurality of delivery routes, and iteratively insert the randomly selected delivery order into one or more randomly selected time slots from the plurality of delivery routes. Server 105 may then determine the cost effect of each insertion. In some embodiments, server 105 may insert the randomly selected delivery order into every time slot from the plurality of delivery routes and calculate the cost effect of every insertion. In still other embodiments, server 105 may determine which routes among the plurality of delivery routes have available time slots that overlap with the time slot of the randomly selected delivery order Server 105 may only insert the randomly selected delivery order into those routes having an available time slot that overlaps with the time slot of the randomly selected delivery order. Server 105 may insert the randomly selected delivery order into the time slot resulting in the largest reduction in overall cost. In some embodiments, server 105 may perform multiple iterations of the above described process.
In some embodiments, server 105 may generate an updated snapshot of time slot availability for the plurality of vehicles and store the updated snapshot in vehicle availability database 132e for presentation to online users. The updated snapshot may be based on the optimized delivery routes determined for the one or more vehicles in the plurality of vehicles.
As described above, server 105 may assign delivery orders and optimize delivery routes whenever a new delivery order is received from a user terminal 120-135. In some embodiments, server 105 may continuously optimize the delivery routes of each vehicle at pre-defined intervals until a pre-defined time period before the delivery route is to commence. In other embodiments, server 105 may optimize delivery routes in response to receiving a new delivery order until a pre-defined time period before the delivery route is to commence.
In some embodiments, server 105 may transmit the optimized delivery routes to the corresponding vehicles among the plurality of vehicles 128a-c via vehicle server 128, which may act as a relay to provide the optimized delivery routes to the corresponding vehicles.
In some embodiments, server 105 is configured to provide a horizontally-scalable system to provide expansion to additional origination locations and increased throughput.
In some embodiments, a scheduler 605 is configured to receive delivery requests from user terminals 120-130, view available delivery slots, assign deliveries, and/or generate interim delivery snapshots to an optimizer 610. For example, in some embodiments, the scheduler 605 is configured to receive a request from a user to schedule a delivery. In some embodiments, the request from the user includes a desired time slot. The scheduler 605 obtains a persistent delivery snapshot for a plurality of vehicles 128a-128c associated with a predetermined origination location for the scheduled delivery. The persistent delivery snapshot may be an optimized delivery snapshot generated by an optimizer 610, as discussed in greater detail below. The persistent delivery snapshot can be loaded from a database 132e, provided directly from an optimizer 610, and/or otherwise obtained by the scheduler 605. The scheduler 605 reviews the available delivery slots. If the scheduler 605 determines that the desired time slot is available in the persistent delivery snapshot, the scheduler 605 inserts the requested delivery into the time slot to generate an interim delivery snapshot. If the scheduler 605 determines that the desired time slot is not available in the persistent delivery snapshot, the scheduler 605 sends a response to the user that the desired delivery time slot is not available.
After verifying that a selected time slot is available, the scheduler 605 is configured to insert the requested delivery in the persistent delivery snapshot to generate an interim delivery snapshot. The scheduler 605 inserts the requested delivery at one of the available open slots corresponding to the selected time slot. For example, in some embodiments, the scheduler 605 is configured to perform a cost function analysis to determine a delivery slot with the least cost for insertion of the requested delivery, as discussed above with respect to
In some embodiments, the scheduler 605 applies a dynamic programming approach to find a slot among multiple delivery snapshots and updates an existing delivery snapshot with the requested delivery. For example, in some embodiments, the scheduler 605 receives a request to schedule a delivery in a specific time slot, such as a 3 PM-5 PM time slot. The scheduler 605 obtains a persistent delivery snapshot for a first origination location and determines that the 3 PM-5 PM delivery window is not available. The scheduler 605 may obtain one or more additional delivery snapshots from the database 132e for the current origination location and/or may obtain persistent delivery snapshots for other origination locations that are located in proximity to the current origination location associated with the scheduler 605. For example, in some embodiments, the scheduler 605 obtains one or more alternative delivery snapshots from the database 132e and determines if the desired delivery time slot can be accommodated in any of the alternative delivery snapshots. If an alternative delivery snapshot can accommodate the requested delivery, the scheduler 605 can book the delivery in the desired time slot and generate an interim delivery snapshot from the alternative delivery snapshot.
The optimization and routing block 600 includes an optimizer (e.g., vehicle routing problem (VRP) optimizer) 610 configured to apply one or more routing optimization processes, such as discussed above with respect to
In some embodiments, the optimizer 610 includes a stateless optimizer configured to receive a single order request and return an inline solution to scheduler 605. The stateless optimizer applies an optimization process, such as the simulated annealing process discussed above, to an interim delivery snapshot received from a scheduler 605 to generate an updated persistent delivery snapshot. In some embodiments, the optimizer 610 applies an optimization process for a predetermined number of cycles and/or a predetermined duration (as bound by a configurable upper limit). In some embodiments, the predetermined number of cycles corresponds to a predetermined optimization period.
In some embodiments, the optimizer 610 includes a stateful optimizer configured to receive an interim delivery snapshot and generate an updated persistent delivery snapshot. The updated persistent delivery snapshot is associated with a unique identifier (such as a job ID, etc.). The stateful optimizer can generate a call (such as a callback to the scheduler 605) and/or can store the updated persistent delivery snapshot in a database, such as database 132e. The updated persistent delivery snapshot is stored in the database. When the scheduler 605 (and/or an additional scheduler, as discussed below) requests a delivery snapshot for the predetermined origination location by providing the unique identifier, the stored (e.g., updated) persistent delivery snapshot is provided to the scheduler 605 as the current persistent delivery snapshot for the origination location.
In some embodiments, the optimizer 610 is configured to perform incremental optimization of one or more stored persistent delivery snapshots. The optimizer 610 can be configured to perform incremental optimization at a first predetermined interval, such as, for example, every five minutes, ten minutes, fifteen minutes, twenty minutes, etc. When initiating an incremental optimization process, the optimizer 610 obtains the persistent delivery snapshot (for example, from the database 132e and/or from an optimization queue as discussed below) and applies a predetermined optimization process for a predetermined number of cycles to generate an updated persistent delivery snapshot. The updated persistent delivery snapshot is stored in the database 132e and replaces the existing persistent delivery snapshot for the associated origination location. When a scheduler 605 receives a request to schedule a delivery, the scheduler 610 loads the persistent delivery snapshot from the database 132e and receives the most-recently optimized persistent delivery snapshot. In some embodiments, the persistent delivery snapshot is provided to one or delivery vehicles 128a-128c at a predetermined time, after which the persistent delivery snapshot cannot be further updated or edited by the scheduler 605 and/or the optimizer 610. The optimizer 610 may repeat the incremental optimization process at the predetermined interval on the same and/or a different persistent delivery snapshot stored in the database 132e.
In some embodiments, the optimizer 610 is configured to perform batch optimization at a second predetermined interval, such as, for example, every half hour, every hour, every two hours, etc. When initiating a batch optimization process, the optimizer 610 loads a current persistent delivery snapshot from the database 132e (and/or from an optimization queue) and performs an extended optimization process. For example, in some embodiments, the optimizer 610 applies a simulated annealing process to an existing persistent delivery snapshot over a predetermined number of cycles corresponding to a predetermined time period, such as, for example, one hour, two hours, etc. to provide a greater comparison of the potential solution space and identify optimal solutions. In some embodiments, a batch optimization process may generate a new persistent delivery snapshot without using the existing persistent delivery snapshot as a starting point (i.e., using only existing deliveries).
In some embodiments, the optimizer 610 is configured to apply a reconciliation strategy during batch and/or incremental optimization, as illustrated in
At time t2, the optimizer 610 completes the incremental optimization and, as discussed above, generates an updated persistent delivery snapshot. At time t3, prior to saving the updated persistent delivery snapshot in the database 132e, the optimizer 610 checks for delta events, such as the delta event that occurred at time t1. If the optimizer 610 identifies one or more delta events, the optimizer 610 modifies the updated persistent delivery snapshot based on the delta event(s). For example, in some embodiments, the optimizer 610 incorporates the delta event(s) into the updated persistent delivery snapshot directly and/or loads the interim delivery solution from the optimization queue and discards the updated persistent delivery snapshot. After modifying the updated persistent delivery snapshot, the optimizer 610 performs an additional optimization process on the modified persistent delivery snapshot. The additional optimization process may include a cycle time that is less than, equal to, or greater than the cycle time of the incremental optimization process. After performing the additional optimization process, the optimizer 610 checks for additional delta events that occurred during the additional optimization process. If additional delta events are present, the optimizer 610 may perform a second additional optimization process. In some embodiments, the optimizer 610 includes a predetermined limit on the number of additional optimization processes that can be performed. For example, if the optimizer 610 performs three additional optimization processes and encounters additional delta events after the third optimization process, the optimizer 610 stops trying to generate an incremental update for the persistent delivery snapshot. If no additional delta events are identified, the optimizer stores the updated persistent delivery snapshot at time t4.
In some embodiments, the optimization and routing block 600 includes a geospatial engine 615 configured to provide mapping data to the scheduler 605 and/or the optimizer 610. The geospatial engine 615 can include any suitable mapping engine configured to support distance and time matrix queries. In some embodiments, the geospatial engine 615 is configured to augment distance and time queries to account for modified forms of travel, such as foot travel vs. vehicle travel, on-road vs. off-road travel, etc. In some embodiments, the geospatial engine 615 is configured to pre-process map information using a predetermined process, such as a contraction hierarchy, to increase response time to queries.
In some embodiments, a server 105 can include a horizontally-scalable implementation of multiple optimization and routing blocks 600 and/or portions of multiple optimization and routing blocks 600.
In some embodiments, the server environment 700 includes a scheduling layer 720a including a plurality of virtual machines 705a-705c each including a scheduler 605a-605c and a geospatial engine 615a-615c. The schedulers 605a-605c are similar to the scheduler 605 discussed above and the geospatial engines 615a-615c are similar to the geospatial engine 615 discussed above, and similar description is not repeated herein. Each of the schedulers 605a-605c is associated with and configured to receive requests to schedule a delivery for a predetermined origination location, such as a store, a warehouse, etc. The schedulers 605a-605c receive requests for deliveries from users associated with and/or located near the predetermined origination location and attempt to schedule the deliveries within an existing persistent delivery snapshot for the associated predetermined origination location, for example, from database 132e.
In some embodiments, each of the schedulers 605a-605c is configured to generate one or more calls or requests. For example, each of the schedulers 605a-605c may be configured to perform a view slot call, a book slot call, an update/cancel slot call, and/or an optimization call. For example, as discussed above with respect to
In some embodiments, each of the schedulers 605a-605c is configured to generate an optimization call after generating in interim delivery snapshot. For example, in some embodiments, when a scheduler 605a-605c assigns a requested delivery to an available slot within a persistent delivery snapshot, the interim delivery snapshot may not contain an optimal route and/or optimal order for all deliveries and/or vehicles. The schedulers 605a-605c generate a call to an optimization layer 720b. The generated call provides the interim delivery snapshot to the optimization layer 720b, which includes a plurality of optimizers 610a-610c configured to implement an optimization process to optimize the interim delivery snapshot.
In some embodiments, each of the schedulers 605a-605c is configured to provide the interim delivery snapshot to an optimization queue 725. The optimization queue 725 is in communication with the optimization layer. When an optimizer 610a-610c is idle, the optimization queue 725 provides a pending interim delivery snapshot to the idle optimizer 610a-610c. The optimizer 610a-610c performs an optimization process to generate an updated persistent delivery snapshot. The optimizer 610a-610c may be implemented by the same virtual machine 705a-705c associated with the scheduler 605a-605c that generated the interim delivery snapshot and/or may be any available virtual machine 705a-705c selected from the available virtual machines 705a-705c.
In some embodiments, each of the virtual machines 705a-705c includes a geospatial engine 615a-615c and an optimizer 610a-610c. The geospatial engine 615a-615c may be the same geospatial engine 615a-615c used by the schedulers 605a-605c implemented by the respective virtual machine 705a-705c and/or may be an independent and/or dedicated geospatial engine 615a-615c. The optimizers 610a-610c and the geospatial engines 615a-615c are similar to the optimizer 610 and the geospatial engine 615 described above, and similar description is not repeated herein.
In some embodiments, each of the optimizers 610a-610c is configured receive an interim delivery snapshot and/or a persistent delivery snapshot and generate an updated persistent delivery snapshot. For example, in some embodiments, a scheduler 605a-605c generates an interim delivery snapshot which is provided to the optimization queue 725. When an optimizer 610a-610c is idle, the optimizer 610a-610c loads an interim delivery snapshot from the optimization queue and performs an optimization process to generate an updated persistent delivery snapshot. If no interim delivery snapshots are available in the optimization queue 725, the optimizers 610a-610c may be configured to perform an incremental and/or batch optimization. For example, persistent delivery snapshots for one or more stores are stored in a database 132e. When an optimizers 610a-610c initiates an incremental and/or batch optimization, the optimizer 610a-610c loads a persistent delivery snapshot from the database 132e and performs the incremental and/or batch optimization process to generate an updated persistent delivery snapshot that is stored in the database 132e.
In some embodiments, each of the scheduling layer 720a and the optimization layer 720b are horizontally scalable. For example, in some embodiments, if additional origination locations (such as additional stores, warehouses, etc.) are added, the scheduling layer 720a can add N additional schedulers 605c, where N is equal to the number of additional origination locations being added. Similarly, if additional origination locations are added and/or a large number of unprocessed optimization requests are located in the optimization queue 725, the optimization layer 720b can add N additional optimizers 610c, where N is the number of additional origination locations and/or the number of unprocessed optimization requests in the optimization queue 725.
In some embodiments, each of the virtual machines 705a-705c are associated with a selected one of the origination locations. For example, in some embodiments, a first scheduler 605a may be configured to receive all requests to schedule a delivery for a first origination location, a second scheduler 605b may be configured to receive all requests to schedule a delivery for a second origination location, and a third scheduler 605c may be configured to receive all requests to schedule a delivery for a third origination location. Similarly, in some embodiments, a first optimizer may be configured to handle optimization requests (including interim delivery snapshots, incremental optimization, and/or batch optimization) for delivery snapshots associated with the first origination location, a second optimizer may be configured to handle optimization requests for delivery snapshots associated with the second origination location, and a third optimizer may be configured to handle optimization requests for delivery snapshots associated with the third origination location.
The various embodiments described herein may employ various computer-implemented operations involving data stored in computer systems. For example, these operations may require physical manipulation of physical quantities usually, though not necessarily, these quantities may take the form of electrical or magnetic signals, where they or representations of them are capable of being stored, transferred, combined, compared, or otherwise manipulated. Further, such manipulations are often referred to in terms, such as producing, identifying, determining, or comparing. Any operations described herein that form part of one or more embodiments of the invention may be useful machine operations. In addition, one or more embodiments of the invention also relate to a device or an apparatus for performing these operations. The apparatus may be specially constructed for specific required purposes, or it may be a general purpose computer selectively activated or configured by a computer program stored in the computer. In particular, various general purpose machines may be used with computer programs written in accordance with the teachings herein, or it may be more convenient to construct a more specialized apparatus to perform the required operations.
The various embodiments described herein may be practiced with other computer system configurations including hand-held devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like.
One or more embodiments of the present invention may be implemented as one or more computer programs or as one or more computer program modules embodied in one or more computer readable media. The term computer readable medium refers to any data storage device that can store data which can thereafter be input to a computer system. The computer readable media may be based on any existing or subsequently developed technology for embodying computer programs in a manner that enables them to be read by a computer. Examples of a computer readable medium include a hard drive, network attached storage (NAS), read-only memory, random-access memory (e.g., a flash memory device), a CD (Compact Discs)—CD-ROM, a CD-R, or a CD-RW, a DVD (Digital Versatile Disc), a magnetic tape, and other optical and non-optical data storage devices. The computer readable medium can also be distributed over a network coupled computer system so that the computer readable code is stored and executed in a distributed fashion.
Although one or more embodiments of the present invention have been described in some detail for clarity of understanding, it will be apparent that certain changes and modifications may be made within the scope of the claims. Accordingly, the described embodiments are to be considered as illustrative and not restrictive, and the scope of the claims is not to be limited to details given herein, but may be modified within the scope and equivalents of the claims. In the claims, elements and/or steps do not imply any particular order of operation, unless explicitly stated in the claims.
Plural instances may be provided for components, operations or structures described herein as a single instance. Finally, boundaries between various components, operations and data stores are somewhat arbitrary, and particular operations are illustrated in the context of specific illustrative configurations. Other allocations of functionality are envisioned and may fall within the scope of the invention(s). In general, structures and functionality presented as separate components in exemplary configurations may be implemented as a combined structure or component. Similarly, structures and functionality presented as a single component may be implemented as separate components. These and other variations, modifications, additions, and improvements may fall within the scope of the appended claims(s).
This application is a continuation of U.S. patent application Ser. No. 16/007,913, filed Jun. 13, 2018, and entitled “SYSTEMS AND METHODS FOR COMBINATORIAL RESOURCE OPTIMIZATION,” which is a continuation-in-part of U.S. patent application Ser. No. 15/876,007, filed Jan. 19, 2018, now U.S. Pat. No. 11,475,395, and entitled “SYSTEMS AND METHODS FOR COMBINATORIAL RESOURCE OPTIMIZATION,” which are incorporated herein in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
5444444 | Ross | Aug 1995 | A |
5922040 | Prabhakaran | Jul 1999 | A |
6240362 | Gaspard, II | May 2001 | B1 |
6701299 | Kraisser et al. | Mar 2004 | B2 |
6754634 | Ho | Jun 2004 | B1 |
6963861 | Boucher et al. | Nov 2005 | B1 |
7222081 | Sone | May 2007 | B1 |
7251612 | Parker et al. | Jul 2007 | B1 |
7430517 | Barton | Sep 2008 | B1 |
7437305 | Kantarjiev | Oct 2008 | B1 |
7775431 | Skaaksrud et al. | Aug 2010 | B2 |
8015023 | Lee et al. | Sep 2011 | B1 |
8126903 | Lehmann et al. | Feb 2012 | B2 |
8160972 | Tannenbaum | Apr 2012 | B1 |
8224707 | Smith et al. | Jul 2012 | B1 |
8429019 | Yeatts et al. | Apr 2013 | B1 |
8438088 | Cunniff et al. | May 2013 | B2 |
8521656 | Zimberoff et al. | Aug 2013 | B2 |
9037406 | Mason | May 2015 | B2 |
9256852 | Myllymaki | Feb 2016 | B1 |
9494937 | Siegel et al. | Nov 2016 | B2 |
9619775 | Saito | Apr 2017 | B1 |
9626639 | Gibbon et al. | Apr 2017 | B2 |
9691091 | Jones et al. | Jun 2017 | B2 |
9857188 | O'Hare et al. | Jan 2018 | B1 |
10157362 | Johansson et al. | Dec 2018 | B1 |
10163070 | Phillips et al. | Dec 2018 | B1 |
10204528 | Truong et al. | Feb 2019 | B2 |
10227178 | High et al. | Mar 2019 | B2 |
10233021 | Brady et al. | Mar 2019 | B1 |
10245993 | Brady et al. | Apr 2019 | B1 |
10248731 | Brouwer, II et al. | Apr 2019 | B1 |
10255577 | Steves et al. | Apr 2019 | B1 |
10304027 | Haque | May 2019 | B1 |
10514690 | Siegel et al. | Dec 2019 | B1 |
10627244 | Lauka et al. | Apr 2020 | B1 |
10839695 | Kuncl et al. | Nov 2020 | B2 |
10846633 | Magazinik et al. | Nov 2020 | B2 |
11157866 | Bostick | Oct 2021 | B2 |
11615368 | Fu | Mar 2023 | B2 |
20010047285 | Borders et al. | Nov 2001 | A1 |
20010056395 | Khan | Dec 2001 | A1 |
20020007299 | Florence | Jan 2002 | A1 |
20020052688 | Yofu | May 2002 | A1 |
20020073049 | Dutta | Jun 2002 | A1 |
20020107820 | Huxter | Aug 2002 | A1 |
20020147654 | Kraisser | Oct 2002 | A1 |
20020152174 | Woods et al. | Oct 2002 | A1 |
20020188517 | Banerjee et al. | Dec 2002 | A1 |
20030040944 | Hileman | Feb 2003 | A1 |
20030078873 | Cohen | Apr 2003 | A1 |
20030084125 | Nagda et al. | May 2003 | A1 |
20030200111 | Damji | Oct 2003 | A1 |
20030236679 | Galves et al. | Dec 2003 | A1 |
20040015393 | Fong et al. | Jan 2004 | A1 |
20040030572 | Campbell et al. | Feb 2004 | A1 |
20040030604 | Young | Feb 2004 | A1 |
20040034571 | Wood et al. | Feb 2004 | A1 |
20040093302 | Baker et al. | May 2004 | A1 |
20040107110 | Gottlieb | Jun 2004 | A1 |
20040199285 | Berichon et al. | Oct 2004 | A1 |
20050006470 | Mrozik et al. | Jan 2005 | A1 |
20050209913 | Wied et al. | Sep 2005 | A1 |
20050216364 | Jurisic et al. | Sep 2005 | A1 |
20050228705 | Irwin | Oct 2005 | A1 |
20050251330 | Waterhouse et al. | Nov 2005 | A1 |
20050278063 | Hersh et al. | Dec 2005 | A1 |
20060026030 | Jacobs | Feb 2006 | A1 |
20060085318 | Cohoon | Apr 2006 | A1 |
20060155595 | Johannsen | Jul 2006 | A1 |
20060161335 | Beinhaker | Jul 2006 | A1 |
20060235739 | Levis et al. | Oct 2006 | A1 |
20060238334 | Mangan et al. | Oct 2006 | A1 |
20060276960 | Adamczyk et al. | Dec 2006 | A1 |
20070015518 | Winter et al. | Jan 2007 | A1 |
20070038506 | Noble et al. | Feb 2007 | A1 |
20070038673 | Broussard et al. | Feb 2007 | A1 |
20070050279 | Huang et al. | Mar 2007 | A1 |
20070083410 | Hanna | Apr 2007 | A1 |
20070112647 | Borders et al. | May 2007 | A1 |
20070185778 | Weng | Aug 2007 | A1 |
20070257774 | Stumpert et al. | Nov 2007 | A1 |
20080027737 | Watkins | Jan 2008 | A1 |
20080082257 | Lee | Apr 2008 | A1 |
20080109246 | Russell | May 2008 | A1 |
20080235147 | Jensen | Sep 2008 | A1 |
20080288368 | Marks et al. | Nov 2008 | A1 |
20090005963 | Jarvinen | Jan 2009 | A1 |
20090037095 | Jani et al. | Feb 2009 | A1 |
20090058646 | Waterhouse et al. | Mar 2009 | A1 |
20090070236 | Cohen et al. | Mar 2009 | A1 |
20090099972 | Angert et al. | Apr 2009 | A1 |
20090201201 | Foster | Aug 2009 | A1 |
20090254405 | Hollis | Oct 2009 | A1 |
20090296990 | Holland et al. | Dec 2009 | A1 |
20100057341 | Bradburn et al. | Mar 2010 | A1 |
20100222908 | Gombert et al. | Sep 2010 | A1 |
20100234990 | Zini et al. | Sep 2010 | A1 |
20100235210 | Nadrotowicz, Jr. | Sep 2010 | A1 |
20100332284 | Hilbush et al. | Dec 2010 | A1 |
20110054979 | Cova et al. | Mar 2011 | A1 |
20110055046 | Bowen et al. | Mar 2011 | A1 |
20110099040 | Felt et al. | Apr 2011 | A1 |
20110112761 | Hurley et al. | May 2011 | A1 |
20110119159 | Chou et al. | May 2011 | A1 |
20110161964 | Piazza et al. | Jun 2011 | A1 |
20110192893 | Waugh et al. | Aug 2011 | A1 |
20110258134 | Mendez | Oct 2011 | A1 |
20120078743 | Betancourt | Mar 2012 | A1 |
20120173448 | Rademaker | Jul 2012 | A1 |
20120174002 | Martin et al. | Jul 2012 | A1 |
20120253892 | Davidson | Oct 2012 | A1 |
20130024390 | Zlobinsky | Jan 2013 | A1 |
20130117193 | Ni | May 2013 | A1 |
20130144763 | Skyberg et al. | Jun 2013 | A1 |
20130198042 | Seifen | Aug 2013 | A1 |
20130238462 | Lutnick | Sep 2013 | A1 |
20130246301 | Radhakrishnan et al. | Sep 2013 | A1 |
20130268454 | Mateer | Oct 2013 | A1 |
20130325553 | Nadiadi et al. | Dec 2013 | A1 |
20130325741 | Smalling et al. | Dec 2013 | A1 |
20130338855 | Mason et al. | Dec 2013 | A1 |
20140012772 | Pretorius | Jan 2014 | A1 |
20140023264 | Branch et al. | Jan 2014 | A1 |
20140032440 | Chandrashekar et al. | Jan 2014 | A1 |
20140040043 | Barron et al. | Feb 2014 | A1 |
20140046585 | Marris, IV et al. | Feb 2014 | A1 |
20140075572 | Mehring et al. | Mar 2014 | A1 |
20140081445 | Villamar | Mar 2014 | A1 |
20140095350 | Carr et al. | Apr 2014 | A1 |
20140149269 | Kantarjiev et al. | May 2014 | A1 |
20140164167 | Taylor | Jun 2014 | A1 |
20140172739 | Anderson et al. | Jun 2014 | A1 |
20140180914 | Abhyanker | Jun 2014 | A1 |
20140188750 | Seiler | Jul 2014 | A1 |
20140195421 | Lozito | Jul 2014 | A1 |
20140214715 | Crocker | Jul 2014 | A1 |
20140244110 | Tharaldson et al. | Aug 2014 | A1 |
20140258167 | Rohmann et al. | Sep 2014 | A1 |
20140277900 | Abhyanker | Sep 2014 | A1 |
20140279646 | Bodenhamer et al. | Sep 2014 | A1 |
20140317005 | Balwani | Oct 2014 | A1 |
20140330739 | Falcone | Nov 2014 | A1 |
20140330741 | Bialynicka-Birula et al. | Nov 2014 | A1 |
20150039362 | Haque | Feb 2015 | A1 |
20150046362 | Muetzel et al. | Feb 2015 | A1 |
20150081360 | Sun et al. | Mar 2015 | A1 |
20150081581 | Gishen | Mar 2015 | A1 |
20150088620 | Wittek | Mar 2015 | A1 |
20150100514 | Parris | Apr 2015 | A1 |
20150120600 | Luwang | Apr 2015 | A1 |
20150142591 | High et al. | May 2015 | A1 |
20150149298 | Tapley | May 2015 | A1 |
20150178678 | Carr et al. | Jun 2015 | A1 |
20150178778 | Lee et al. | Jun 2015 | A1 |
20150186869 | Winters et al. | Jul 2015 | A1 |
20150202770 | Patron et al. | Jul 2015 | A1 |
20150206267 | Khanna et al. | Jul 2015 | A1 |
20150219467 | Ingerman et al. | Aug 2015 | A1 |
20150294261 | Adell | Oct 2015 | A1 |
20150294262 | Nelson et al. | Oct 2015 | A1 |
20150310388 | Jamthe | Oct 2015 | A1 |
20150348282 | Gibbon et al. | Dec 2015 | A1 |
20160012392 | Paden et al. | Jan 2016 | A1 |
20160019501 | Olechko et al. | Jan 2016 | A1 |
20160037481 | Won et al. | Feb 2016 | A1 |
20160042319 | Mauch | Feb 2016 | A1 |
20160042321 | Held | Feb 2016 | A1 |
20160048804 | Paul et al. | Feb 2016 | A1 |
20160063435 | Shah et al. | Mar 2016 | A1 |
20160071056 | Ellison | Mar 2016 | A1 |
20160104112 | Gorlin | Apr 2016 | A1 |
20160125356 | Kellogg | May 2016 | A1 |
20160148303 | Carr et al. | May 2016 | A1 |
20160171439 | Ladden et al. | Jun 2016 | A1 |
20160210591 | Lafrance | Jul 2016 | A1 |
20160224935 | Burnett | Aug 2016 | A1 |
20160232487 | Yonker | Aug 2016 | A1 |
20160239788 | Hanks | Aug 2016 | A1 |
20160300185 | Zamer et al. | Oct 2016 | A1 |
20160328669 | Droege | Nov 2016 | A1 |
20160364678 | Cao | Dec 2016 | A1 |
20160379167 | Raman | Dec 2016 | A1 |
20170011180 | Andrews et al. | Jan 2017 | A1 |
20170011340 | Gabbai | Jan 2017 | A1 |
20170059337 | Barker et al. | Mar 2017 | A1 |
20170076058 | Stong | Mar 2017 | A1 |
20170083862 | Loubriel | Mar 2017 | A1 |
20170090484 | Obaidi | Mar 2017 | A1 |
20170091709 | Mishra et al. | Mar 2017 | A1 |
20170091856 | Canberk et al. | Mar 2017 | A1 |
20170127215 | Khan | May 2017 | A1 |
20170138749 | Pan et al. | May 2017 | A1 |
20170154347 | Bateman | Jun 2017 | A1 |
20170178057 | Al Rifai | Jun 2017 | A1 |
20170178070 | Wang | Jun 2017 | A1 |
20170193404 | Yoo et al. | Jul 2017 | A1 |
20170193574 | Marueli | Jul 2017 | A1 |
20170200115 | High | Jul 2017 | A1 |
20170213062 | Jones et al. | Jul 2017 | A1 |
20170228683 | Hu et al. | Aug 2017 | A1 |
20170262790 | Khasis | Sep 2017 | A1 |
20170300905 | Withrow et al. | Oct 2017 | A1 |
20170323250 | Lindbo et al. | Nov 2017 | A1 |
20170365030 | Shoham et al. | Dec 2017 | A1 |
20180018868 | Ren et al. | Jan 2018 | A1 |
20180060814 | Seaman et al. | Mar 2018 | A1 |
20180096287 | Senger | Apr 2018 | A1 |
20180107967 | Bulcao et al. | Apr 2018 | A1 |
20180107979 | Westover et al. | Apr 2018 | A1 |
20180130017 | Gupte | May 2018 | A1 |
20180158020 | Khasis | Jun 2018 | A1 |
20180283890 | Zhao et al. | Oct 2018 | A1 |
20180285806 | Scofield et al. | Oct 2018 | A1 |
20180299895 | Knotts et al. | Oct 2018 | A1 |
20180315319 | Spector et al. | Nov 2018 | A1 |
20180350214 | Roth et al. | Dec 2018 | A1 |
20180351671 | Sadeghi et al. | Dec 2018 | A1 |
20180356823 | Cooper | Dec 2018 | A1 |
20180365643 | Zhu et al. | Dec 2018 | A1 |
20190066047 | O'Brien et al. | Feb 2019 | A1 |
20190101401 | Balva | Apr 2019 | A1 |
20190114588 | Radetzki et al. | Apr 2019 | A1 |
20190156253 | Malyack et al. | May 2019 | A1 |
20190156283 | Abebe et al. | May 2019 | A1 |
20190164126 | Chopra et al. | May 2019 | A1 |
20190180229 | Phillips et al. | Jun 2019 | A1 |
20190197475 | Bianconcini et al. | Jun 2019 | A1 |
20190205857 | Bell et al. | Jul 2019 | A1 |
20190220785 | Tanno | Jul 2019 | A1 |
20190220816 | Frye | Jul 2019 | A1 |
20190266557 | Berk et al. | Aug 2019 | A1 |
20190266690 | Mandeno et al. | Aug 2019 | A1 |
20190285426 | Mitchell et al. | Sep 2019 | A1 |
20190333130 | Jha et al. | Oct 2019 | A1 |
20190385121 | Waliany et al. | Dec 2019 | A1 |
20200097900 | Kibbey et al. | Mar 2020 | A1 |
20200097908 | Glasfurd et al. | Mar 2020 | A1 |
20200104962 | Aich et al. | Apr 2020 | A1 |
20200116508 | Dashti et al. | Apr 2020 | A1 |
20200117683 | Ji et al. | Apr 2020 | A1 |
20200118071 | Venkatesan et al. | Apr 2020 | A1 |
20200134014 | Tiwari et al. | Apr 2020 | A1 |
20200134557 | Pevzner et al. | Apr 2020 | A1 |
20200160148 | Garg et al. | May 2020 | A1 |
20200210960 | Soryal et al. | Jul 2020 | A1 |
20200249040 | Yamaguchi | Aug 2020 | A1 |
20200265383 | Zhang | Aug 2020 | A1 |
20210150467 | Sakai et al. | May 2021 | A1 |
20210293550 | Migita | Sep 2021 | A1 |
20220067657 | Neumann | Mar 2022 | A1 |
Number | Date | Country |
---|---|---|
111144822 | May 2020 | CN |
2002183264 | Jun 2002 | JP |
2007017192 | Jan 2007 | JP |
0169488 | Sep 2001 | WO |
WO-0169488 | Sep 2001 | WO |
2017062492 | Apr 2017 | WO |
Entry |
---|
“Time Slot Management in Attended Home Delivery,” by Niels Agatz, Ann Campbell, Mortiz Fleischmann, and Martin Savelsbergh, Apr. 15, 2008 (Year: 2008). |
“Solving multi depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” by Supachai Pathumnakul, 1996 (Year: 1996). |
Supachai Pathumnakul, “Solving multi-depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” A thesis submitted to the graduate faculty in partial fulfillment requirements for the degree of Master of Science, Iowa State University, (1996), 96 pages. |
N. Agatz et al., “Time Slot Management in Attended Home Delivery,” Apr. 15, 2008, 32 pages. |
“Coincide,” Merriam-Webster, Nov. 2, 2016. |
D. E. Akyol, et al., “Determining time windows in urban freight transport: A city cooperative approach,” Transportation Research Part E, 118, Jul. 12, 2018, pp. 34-50. |
G. P. Rajappa, “Solving Combinatorial Optimization Problems Using Genetic Algorithms and Ant Colony Optimization,” University of Tennessee, Tennessee Research and Creative Exchange, Doctoral Dissertations, Aug. 2012, 105 pages. |
S. Pathumnakul, “Solving multi depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” Iowa State University, Retrospective Theses and Dissertations, 1996, 96 pages. |
M. Mahajan “Backward and Forward Scheduling,” http://www.erpgreat.com/sap-sd/backward-and-forward-scheduling-in-sap-sd.htm, Jun. 30, 2018, 2 pages. |
J. Xu, “Client-Side Data Caching in Mobile Computing Environments,” Hong Kong University of Science and Technology, Thesis, UMI No. 3058186, Jun. 2002, 176 pages. |
Supachai Pathumnakul, “Solving multi-depot vehicle routing problem for Iowa recycled paper by Tabu Search heuristic,” A thesis submitted to the graduate faulty in partial fulfillment requirements for the degree of Master of Science, Iowa State University, (1996), 96 pages. |
R. Carbonneau et al., “Application of machine learning techniques for supply chain demand forecasting,” European Journal of Operational Research, 184 (2008), pp. 1140-1154. |
Number | Date | Country | |
---|---|---|---|
20230169415 A1 | Jun 2023 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16007913 | Jun 2018 | US |
Child | 18099591 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15876007 | Jan 2018 | US |
Child | 16007913 | US |