The present disclosure relates generally to monitoring cargo and, more specifically, a system for scanning cargo during loading onto a vehicle to determine a three-dimensional shape of the cargo.
Cargo can be shipped in a variety of configurations depending on the context. Cargo can be packaged in containers and stacked on pallets or within the interior space of shipping container. Some cargo is shipped separately without being packaged in a container, such as large industrial equipment that is not applicable for packaging in a container. The different cargo has different shapes and sizes.
An objective in shipping cargo is to have a high efficiency. The efficiency is the amount of cargo that can be shipped on a vehicle. A vehicle with a higher efficiency is more profitable than a vehicle with a lower efficiency.
One issue that affects efficiency is the amount of cargo that is loaded onto a container. The cargo should be loaded onto the container to maximize the usage of the available space and minimize gaps and other spaces. The efficiency of a loaded container can be difficult to determine as the container may not be evaluated prior to loading onto the vehicle.
Another issue that affects the efficiency is the loading of the cargo onto the vehicle. The vehicle has a limited amount of available space to hold cargo. Examples include a cargo hold of an aircraft, and the interior of over-the-road trailer. The cargo should be loaded to fill the available space and reduce the amount of unused space. Efficiently loading the vehicle can be problematic due to the various shapes and sizes of the cargo that is loaded onto the vehicle. Further, the space on the vehicle can have various shapes and sizes. In one example, a cargo hold in an aircraft can have one or more curved walls that conform to the overall cylindrical shape of the fuselage of the aircraft.
One aspect is directed to a system to monitor loading a cargo unit onto a vehicle. The system comprises one or more sensors mounted to the vehicle and configured to scan the cargo unit. A communication network is mounted in the vehicle and configured to transmit signals from the one or more sensors. A control unit comprises processing circuitry configured to determine a three-dimensional shape of the cargo unit based on the signals from the sensors.
In another aspect, the one or more sensors comprise a first sensor and a second sensor that are each mounted to the vehicle and spaced apart with the first sensor and the second sensor comprising different fields of view to simultaneously scan different sections of the cargo unit.
In another aspect, at least one of the sensors are mounted at a door of the vehicle and at least one of the sensors is mounted within an interior of the vehicle and away from the door.
In another aspect, the control unit is configured to determine an efficiency of the cargo unit based on the three-dimensional shape relative to an outer envelope of the cargo unit.
In another aspect, the control unit is configured to prevent loading the cargo unit onto the vehicle when the efficiency is below a predetermined amount.
In another aspect, the control unit is further configured to: receive first ones of the signals from a first scan of the cargo unit taken at a first time; determine a first three-dimensional shape of the cargo unit based on the first ones of the signals; receive second ones of the signals from a second scan of the cargo unit taken at a second time; determine a second three-dimensional shape of the cargo unit based on the second ones of the signals; compare the first three-dimensional shape and the second three-dimensional shape; and determine that the cargo unit has been damaged when the first three-dimensional shape is different than the second three-dimensional shape.
In another aspect, the control unit is further configured to determine an amount of empty space in a cargo hold of the vehicle based on the three-dimensional shape of the cargo unit.
In another aspect, the control unit is further configured to determine where to locate the cargo unit within a cargo hold of the vehicle based on the three-dimensional shape of the cargo unit.
In another aspect, the one or more sensors are LiDAR sensors.
One aspect is directed to a non-transitory computer readable medium comprising instructions stored thereon that, when executed by processing circuitry of a control unit, configures the control unit to: receive signals from sensors that are mounted to a vehicle and configured to scan a cargo unit; determine a three-dimensional shape of the cargo unit based on the signals from the sensors; and determine a location for the cargo unit in a cargo hold of the vehicle based on the three-dimensional shape.
In another aspect, the control unit is further configured to: determine an amount of unused space in the cargo hold after the cargo unit is loaded; and determine an efficiency of the cargo hold based on the unused space.
One aspect is directed to a method of monitoring cargo that is loaded onto a vehicle. The method comprises: scanning a cargo unit that is being loaded onto the vehicle; and determining a three-dimensional shape of the cargo unit based on the scanning.
In another aspect, the method further comprises scanning the cargo unit while the cargo unit is moving through a door of the vehicle and into the vehicle.
In another aspect, scanning the cargo unit that is being loaded onto the vehicle further comprises scanning the cargo unit from a first direction with a first sensor and scanning the cargo unit from a second direction with a second sensor and determining the three-dimensional shape based on the scans from the first sensor and the second sensor.
In another aspect, the method further comprises: determining an outer envelope of the cargo unit; determining a difference between the outer envelope and the three-dimensional shape; and determining an efficiency of the cargo unit based on the difference.
In another aspect, the method further comprises unloading the cargo unit from the vehicle prior to transport when the efficiency is below a predetermined level.
In another aspect, the method further comprises determining a position and a size of gaps in the cargo unit with the gaps formed between an outer surface of the cargo unit and the outer envelope.
In another aspect, the method further comprises determining where to position the cargo unit in a cargo hold of the vehicle based on the three-dimensional shape.
In another aspect, the method further comprises determining whether the cargo unit can fit into the cargo hold based on the three-dimensional shape of the cargo unit.
In another aspect, the three-dimensional shape of the cargo unit is a first three-dimensional shape with the method further comprising: determining a second three-dimensional shape of the cargo unit when the cargo unit is being unloaded from the vehicle; determining that the second three-dimensional shape is different than the first three-dimensional shape; and determining that the cargo unit was damaged based on the difference.
The features, functions and advantages that have been discussed can be achieved independently in various aspects or may be combined in yet other aspects, further details of which can be seen with reference to the following description and the drawings.
The present application is directed to systems and methods for monitoring cargo that is loaded onto a vehicle. One or more sensors are positioned and configured to scan the cargo unit. Signals from the sensors are transmitted through a communication network to a control unit. The control unit determines a three-dimensional shape of the cargo unit based on the signals from the sensors. The control unit can also determine other aspects about the loading and unloading process to increase the efficiency.
The cargo hold 110 holds cargo that is formed by one or more cargo units 120. The cargo units 120 can include a container 121 that support smaller packages 122.
A capture system 40 determines aspects about the cargo units 120 that are loaded onto the vehicle 100. As illustrated in
In one example, the sensors 30 include cameras that capture a visual image of the cargo units 120. The sensors 30 can capture still images or video images of the cargo units 120. Other examples of sensors 30 that sense the cargo units 120 include but are not limited to thermal imaging devices, ultrasonic sensors, radar, sonar, LiDAR, and 3D scanning.
The sensors 30 are positioned to detect a size of the cargo units 120. The sensors 30 are positioned at the one or more doors 105 that lead into the cargo hold 110 as illustrated in
In one example, a single sensor 30 is configured to detect the dimensions of the cargo units 120. In another example, two or more sensors 30 together detect the dimensions with the sensors 30.
One or more sensors 30 can be portable to be positioned away from the vehicle 100. In one example, the sensors 30 are hand-held units that are carried by ground personnel that work with the cargo prior to loading onto the vehicle.
Sensors 39 can obtain information from the cargo units 120 to identify the cargo units 120. The sensors 39 can include different sensing technologies, including but not limited to BLUETOOTH and bar code readers (e.g., tradition, QR). In one example, the sensors 39 detect signals from an RFID tag that is attached to the containers 121 or packages 122. When the RFID tag passes through the field of the sensor 39, the sensor 39 senses signals from the RFID tag. The signals include identification information for the cargo, such as a unique serial number or other customized information associated with the cargo. The information is transmitted to the control unit 50 which uses the information to identify the cargo.
The control unit 50 determines the dimensional aspects of the cargo units 120. As illustrated in
The control unit 50 includes communication circuitry 53 that provides for communication functionality with the sensors 30. The communication circuitry 53 can provide for one-way communications from the sensors 30 or two-way communications that are both to and from the sensors 30. The communication circuitry 53 can also provide for communications with a remote monitoring node 150 that monitors the status of the cargo. The control unit 50 also communicates with other systems on the vehicle 100, such as a vehicle control system 49 that controls the operation of one or more larger functions of the vehicle 100. In one example in which the vehicle 100 is an aircraft, the vehicle control system 49 is a flight control system that controls the operations of the aircraft during flight.
In one example as illustrated in
A user interface 54 provides for a user to control one or more aspects of the capture system 40. The user interface 54 can include one or more input devices 56 such as but not limited to a keypad, touchpad, roller ball, and joystick. The user interface 54 can also include one or more displays 55 for displaying information to the traveler 140 and one or more input devices 56 for the user to enter commands to the control circuitry 51.
The capture system 40 scans the cargo units 120 during the loading process onto the vehicle 100. The scanning can occur at various times, including but not limited to as the cargo units 120 move through the door 105 and into the cargo hold 110, when the cargo units 120 are in the cargo hold 110, and when the cargo units 120 are on the ground prior to being loaded into the vehicle 100. The capture system 40 can scan the cargo units 120 a single time, or multiple times.
The sensor 30 scans the cargo unit 120 (block 302). In one example, this includes the sensor 30 taking a single scan, such as capturing a single image of the cargo unit 120 or performing a single RF scan of the cargo unit 120. In another example, the sensor 30 takes multiple scans of the cargo unit 120. This can include taking multiple images of the cargo unit 120 as it passes through the door 105 or moving the sensor 30 to different positions relative to the cargo unit 120 and capturing the different images. The cargo unit 120 can be scanned by a single sensor 30 or from multiple sensors 30. The scans can occur simultaneously (e.g., multiple sensors 30 scan cargo unit 120 simultaneously from different directions) or over time (e.g., a sensor 30 scans the cargo unit 120 multiple times as it moves past the sensor 30 during loading). The scans from the sensors 30 are sent to the control unit 50 which determines the three-dimensional aspects of the cargo unit 120 (block 304). In one example, the sensors 30 are 3D scanners that scan the cargo unit 120 and provide data to the control unit 50 that calculate the size and shape.
The control unit 50 determines the dimensional aspects of the cargo units 120. As illustrated in
The control unit 50 determines a package efficiency of the cargo unit 120. The efficiency is calculated as the density of the cargo unit 120 within an outer envelope that is defined by the height, width, and length.
The cargo units 120 can have an expected efficiency that is stored with information about the cargo unit 120. In one example, this efficiency is provided by a shipping company that is shipping the cargo. The capture system 40 can reject a cargo unit 120 that has an efficiency below a predetermined amount. The rejected cargo unit 120 is removed from the vehicle 100 or otherwise not loaded. Personnel loading the vehicle 100 can add additional cargo thus increasing the efficiency and then loading the updated cargo unit 120.
If the efficiency is not acceptable, the cargo unit 120 is not loaded onto the vehicle 100. Additional cargo can be added to the cargo unit 120 to increase the efficiency (block 316). In an example in which this occurs during the loading process, the cargo unit 120 is not loaded onto the vehicle 100 until the additional cargo is added. If the cargo unit is already loaded onto the vehicle 100, the cargo unit 120 can be unloaded and the additional cargo added. In one example, the unloading occurs during a second leg of a transportation trip. For example, the cargo unit 120 is loaded onto the vehicle 100 and flown to a first connection airport. The cargo unit 120 is then removed from the vehicle 100 and additional cargo is added. The higher efficiency cargo unit 120 is then reloaded onto the vehicle 100 and transported to the final destination.
The control unit 50 can determine the efficiency of the cargo hold 110. As illustrated in
Sensors 30 within the cargo hold 110 can sense the position of the cargo units 120 and the empty space within the cargo hold 110. The control unit 50 receives the signals and determines an efficiency of the cargo hold 110. In one example, the control unit 50 determines a shape and size of the empty space within the cargo hold 110. The control unit 50 is able to scan the cargo units 120 that are to be loaded to determine if the cargo units 120 will fit. The control unit 50 can also determine where to position the cargo unit 120 to increase the efficiency of the cargo hold 110.
A cargo unit 120 that has not yet been loaded is scanned (block 333). The control unit 50 determines the dimensions of the scanned cargo unit 120 and determines whether the cargo unit 120 can fit into the cargo hold 110 (block 334). If the control unit 50 determines that the cargo unit 120 can fit, the cargo unit 120 is loaded into the cargo unit 120 (block 336). In one example, the control unit 50 can provide an indication of where the cargo unit 120 fits to best increase the efficiency. For example, the control unit 50 determines the smallest volume area of empty space in the cargo hold 110 that can receive the cargo unit 120. This positioning provides for loading the most cargo into the cargo hold 110 and with the least amount of remaining empty space.
If the control unit 50 determines that the cargo unit 120 does not fit into the cargo hold 110, the cargo unit 120 is not loaded (block 338). Personnel receiving this indication can move the cargo unit 120 out of the way to not block additional loading.
The scanning process can also be used by the control unit 50 to determine if there is damage to the cargo units 120. The control unit 50 determines if the shape of the cargo unit 120 is different than an expected shape and/or whether the shape has changed since an earlier scan.
In one example, the damage determination occurs prior to the cargo unit 120 being loaded onto the vehicle 100.
The control unit 50 determines whether the shapes are the same (block 346). If the shapes are the same, the control unit 50 determines that there is no damage (block 347). If the shapes are different, the control unit 348 determines that there is damage to the cargo unit 120 (block 348). The control unit 50 can determine the position of the damage on the cargo unit 120 and the extent of the damage. The position of the damage is based on the comparison of the two scans and the location of the differences in the scans. The amount of damage can be based on the extent of the differences in the shapes between the previous shape and the scanned shape. The greater the amount of difference, the greater the amount of damage.
In another example, the control unit 50 determines if the cargo unit 120 is damaged while on the vehicle 100. The cargo unit 120 is first scanned when loaded onto the vehicle 100. The cargo unit 120 is then scanned again when unloaded from the vehicle 100. In one example, the scans occur at the same location and by the same one or more sensors 30. For example, the scans occur when the cargo unit 120 is moving through the door 105 during both loading and unloading. The control unit 50 compares the two scans and determines whether they are the same. If the scans are the same, then the cargo unit 120 has not been damaged during the transportation. If the control unit 50 determines that the scans are different, the control unit 50 determines that the cargo unit 120 has been damaged. In one example, the control unit 50 determines the position and extent of the change between the two scans to determine the extent of the damage.
The control unit 50 can further determine the weight of the cargo unit 120. This can include but is not limited to a known weight of the object provided by the manufacturer, or the weight determined by a scale when the cargo unit 120 is constructed. In another example, the cargo unit 120 estimates the weight of the cargo unit 120 based on the scan. The weight can be based on the shape and size, as well as the type of cargo that is included in the cargo unit 120 which can be stored in a record associated with the cargo unit 120. Based on the determined weight, the control unit 50 can provide instructions to locate the cargo unit 120 in the cargo hold 110. This positioning provides for weight balancing of the vehicle 100.
The control unit 50 can also determine a position for the cargo unit 120 on the vehicle 100 to provide for load balancing. The position at which the cargo unit 120 is located in the cargo hold 110 is sensed by one or more sensors 30. The control unit 50 uses the weight and size of the cargo unit 120, and the dimensions of the cargo unit 120.
The control unit 50 can also determine an overall accuracy of the vehicle loading relative to a load plan.
The map can include various criteria of the cargo units 120 based on information from the sensors 30. Criteria includes but is not limited to dimension, weight, and hazard determinations. size, prior to the cargo unit 120 being blocked by other cargo units 120. The control unit 50 can also monitor an amount of variance between the load plan and the actual loading. If the variance exceeds a predetermined amount, the control unit 50 can notify personnel of the issue.
A record 82 of the cargo can be maintained during the transportation process at one or more of the control unit 50 and the remote monitoring node 150. The record 82 can apply to the individual cargo units 120, a container 121, and/or cargo package 122. The record 82 can include information about the cargo, such as but not limited to shape, size, weight, contents. The record 82 can also include any particular shipping instructions, such as an operational range of one or more environmental conditions (e.g., storage between 50° F.-80° F.).
The system 40 can be used on a variety of vehicles 100. Vehicles 100 include but are not limited to aircraft, watercraft, and freight trailers for trains and trucks. In one example, the system 40 is used in a passenger aircraft that includes a cabin area for transporting passengers and a separate cargo hold 110.
By the term “substantially” with reference to amounts or measurement values, it is meant that the recited characteristic, parameter, or value need not be achieved exactly. Rather, deviations or variations, including, for example, tolerances, measurement error, measurement accuracy limitations, and other factors known to those skilled in the art, may occur in amounts that do not preclude the effect that the characteristic was intended to provide.
The present invention may, of course, be carried out in other ways than those specifically set forth herein without departing from essential characteristics of the invention. The present embodiments are to be considered in all respects as illustrative and not restrictive, and all changes coming within the meaning and equivalency range of the appended claims are intended to be embraced therein.