Patent Application
20190049234
This disclosure generally relates to the field of automated package handling.
Package handling efficiency is increased by automating aspects of the process. Two processes that are time consuming are the determination of the package dimensions and/or determining dimensional weight. Package dimensions are important to optimize the loading process. In addition, knowing the remaining space is also useful.
The concept of dimensional weight has commonly been adopted by the transportation industry in most parts of the world as a standard way of determining charges for the shipment of packaged goods. Determining the dimensional weight of an object involves measuring the cubic space occupied by the object, or dimensioning. Dimensional weight is widely used because shipping costs calculated based on weight of the goods alone would render it unprofitable for carriers when the shipped goods have low density, e.g., small weight but occupy a large space. By using dimensional weight in calculating shipping costs, on the other hand, carriers can charge based on either the actual weight or the dimensional weight of the shipped goods, usually depending on whichever is greater. Moreover, by dimensioning objects, such as parcels, packages, and pallets, carriers, warehouses, shipping retailers, postal companies, or the like may optimally utilize their storage space and charge for the service accordingly.
Dimensional weight involves the volumetric weight of an object, and, more specifically, the cubic space the object occupies. Typically, the dimensional weight of an object is calculated as the multiplicative product of the object's length, width, and height divided by a constant. For example, in the United States, the dimensional weight of an object is calculated by domestic air carriers as (length×width×height)/166, with all dimensions in inches. A parcel weighing 25 pounds and having volumetric dimensions of 20×15×15 inches would have, using the above formula, a dimensional weight of 27.1 pounds. In this example, the shipping charge would be determined based on the dimensional weight of 27.1 pounds, because it is greater than the actual weight of 25 pounds.
To expedite the dimensioning process and to facilitate accurate dimensioning, companies have invested in various automatic dimensioning systems. One type of dimensioning system, such as a volume dimensioning application, performs volumetric dimensioning of objects by first capturing an image of the objects and then finding those objects in the image. For instance, an image capturing device may be utilized to capture an image of a number of parcels waiting to be dimensioned. Afterwards, a computing device may select one of the parcels from the parcels in the image to calculate the dimensional weight for. To do so, the computing device may need to estimate the boundary of the selected parcel to determine its approximate length, width, and height for the calculation. However, it can be very difficult at times to discern a particular object or objects in an image due to insufficient lighting or the presence of numerous objects in the same image. Although such a volume dimensioning application may be designed as a standalone, automatic application, issues such as those mentioned above may cause inaccuracy in the dimensioning process and ultimately result in delay and extra operational costs.
A method of operating a dimensioning system to determine dimensional information for objects may be summarized as including acquiring a number of images; computationally identifying objects in at least one of the acquired images; computationally initially selecting one object represented in the at least one of the acquired images as a candidate for processing; providing an indication to a user indicative of the initially selected object; receiving at least one user input indicative of an object selected for processing; and computationally determining dimensional data for the object indicated by the received user input.
Receiving at least one user input indicative of an object selected for processing may include receiving a user selection that confirms the initially selected one object as the object for processing. Computationally determining dimensional data for the object indicated by the received user input may include determining a dimensional weight based on an estimated perimeter of the initially selected one object as represented in the acquired image. Receiving at least one user input indicative of an object selected for processing may include receiving a user selection that indicates an object other than the initially selected one object as the object for processing. Computationally determining dimensional data for the object indicated by the received user input may include determining a dimensional weight based on an estimated perimeter of the object indicated by the received user selection as the object is represented in the acquired image. The method may further include providing an indication to the user indicative of a currently selected object, the indication visually distinguishing the currently selected object in a display of the acquired image from any other object represented in the display of the acquired image. Receiving at least one user input indicative of an object selected for processing may include receiving a user selection that indicates at least a portion of a new perimeter for the object for processing. Computationally determining dimensional data for the object indicated by the received user input may include computationally determining dimensional data based on the new perimeter of the object represented in the acquired image. Providing an indication to a user indicative of the initially selected object may include displaying the acquired image and visually distinguishing the initially selected object in the display of the acquired image from any other objects represented in the display of the acquired image. Visually distinguishing the initially selected object in the display of the acquired image from any other objects represented in the display of the acquired image may include displaying a border about at least a portion of the initially selected object in the display of the acquired image. Receiving at least one user input indicative of an object selected for processing may include receiving at least one signal representing a position in the image that indicates a position of at least a portion of a new perimeter for the object for processing. Visually distinguishing the initially selected object in the display of the acquired image from any other objects represented in the display of the acquired image may include displaying a draggable border about at least a portion of the initially selected object in the display of the acquired image. Receiving at least one user input indicative of an object selected for processing may include receiving at least one signal representing a dragging of the draggable border to a new position that indicates at least a portion of a new perimeter for the object for processing. Computationally determining dimensional data for the object indicated by the received user input may include computationally determining a dimension of at least one of a box, a package, a parcel, a pallet or a document represented in the acquired image.
A method of operating a dimensioning system to determine dimensional information for objects may be summarized as including acquiring a number of images; computationally identifying objects or spaces in at least one of the acquired images; determining dimensional data for at least one object or space; and receiving at least one user input indicative of an object or space selected for processing.
The method may further include computationally determining dimensional data for the object or space selected by the received user input. The method may further include computationally revising the determined dimensional data for the at least one object or space in response to the received user input. Receiving at least one user input may include receiving at least one user input in the form of at least one of a keyboard entry, a computer mouse entry, a touch-screen device entry, a voice command, an audible command, and a bar code reading. Receiving at least one user input indicative of an object or space selected for processing may include receiving a user selection that confirms the initially selected one object or space as the object for processing. Computationally determining dimensional data for the object or space selected by the received user input may include determining a dimensional weight based on an estimated perimeter of the initially selected one object as represented in the acquired image. Computationally determining dimensional data for the object or space selected by the received user input may include determining a dimensional data based on an estimated perimeter of the initially selected one space as represented in the acquired image. Receiving at least one user input indicative of an object or space selected for processing may include receiving a user selection that indicates an object or space other than the initially selected one object or space as the object or space for processing. Computationally determining dimensional data for the object or space selected by the received user input may include determining a dimensional weight based on an estimated perimeter of the object selected by the received user selection as the object is represented in the acquired image. Computationally determining dimensional data for the object or space selected by the received user input may include determining a dimensional data based on an estimated perimeter of the space selected by the received user selection as the space is represented in the acquired image. The method may further include providing an indication to the user indicative of a currently selected object or space, the indication visually distinguishing the currently selected object or space in a display of the acquired image from any other object or space represented in the display of the acquired image. Receiving at least one user input indicative of an object or space selected for processing may include receiving a user selection that indicates at least a portion of a new perimeter for the object or space for processing. Computationally determining dimensional data for the object or space selected by the received user input may include computationally determining dimensional data based on the new perimeter of the object or space represented in the acquired image in response to the received user input.
A dimensioning system to determine dimensional information for objects may be summarized as including an imager configured to acquire images; a user input/output system configured to display images and to receive user input; and a processor configured to identify objects in the acquired images, initially select one of the identified objects for processing, cause the acquired images to be displayed via the user input/output system along with an indication indicative of the initially selected one object, and computationally determine dimensional data for an object indicated by at least one user input received via the user input/output system.
The processor may be configured to determine a dimensional weight based on an estimated perimeter of the initially selected one object as represented in the acquired image in response to at least one user input confirming the initially selected one object as the object to be processed. The processor may be configured to computationally determine a dimensional weight based on a new perimeter of the initially selected one object represented in the acquired image in response to at least one user input indicative of the new perimeter. The processor may be configured to determine a dimensional weight based on an estimated perimeter of an object represented in the acquired image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed. The processor may be configured to determine a dimensional weight based on a user identified perimeter of an object represented in the acquired image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed and identifying at least a portion of the user identified perimeter. The processor may be configured to cause acquired images to be displayed via the user input/output system along with an indication indicative of the initially selected one object by displaying a draggable border about at least a portion of the initially selected object in the display of the acquired image. The processor may be further configured to cause acquired images to be displayed via the user input/output system along with an indication indicative of a user selected object by displaying a draggable border about at least a portion of a user selected object in the display of the acquired image. The user input/output system may include a touch-sensitive display. The processor may be further configured to cause the user input/output system to display dimensional data for one or more objects in the acquired images.
A dimensioning system to determine dimensional information for confined empty spaces may be summarized as including an imager to acquire images; a user input/output system to display images and to receive user input; and a processor configured to identify spaces in the acquired images, initially select one of the identified spaces for processing, cause the acquired images to be displayed via the user input/output system along with an indication indicative of selection of the initially selected space, and computationally determine dimensional data for a space indicated by at least one user input received via the user input/output system.
The processor may be configured to computationally determine the dimension data based on an estimated perimeter of the initially selected space as represented in the acquired image in response to at least one user input confirming the initially selected space as the space to be processed. The processor may be configured to computationally determine the dimensional data based on a new perimeter of the initially selected space represented in the acquired image in response to at least one user input indicative of the new perimeter. The processor may be configured to computationally determine the dimensional data based on an estimated perimeter of a space represented in the acquired image other than the initially selected space in response to at least one user input selecting the other space as the space to be processed. The processor may be configured to computationally determine the dimensional data based on a user identified perimeter of a space represented in the acquired image other than the initially selected space in response to at least one user input selecting the other space as the space to be processed and identifying at least a portion of the user identified perimeter. The processor may be configured to cause acquired images to be displayed via the user input/output system along with an indication indicative of the initially selected space by displaying a draggable border about at least a portion of the initially selected space in the display of the acquired image. The processor may be further configured to cause acquired images to be displayed via the user input/output system along with an indication indicative of a user selected space by displaying a draggable border about at least a portion of a user selected space in the display of the acquired image. The user input/output system may include a touch-sensitive display. The processor may be further configured to cause the user input/output system to display dimensional data related to one or more objects.
A computer-readable medium storing therein instructions to cause a computer to execute a process related to determining dimensional information for objects may be summarized as including displaying an image; identifying objects represented in the displayed image; initially selecting one object of the objects represented in the displayed image for processing; causing the displayed image and an indication indicative of the initially selected one object to be displayed; receiving user input; and determining dimensional data for an object indicated by at least one user input.
Determining dimensional data for an object indicated by at least one user input may include determining a dimensional weight based on an estimated perimeter of the initially selected one object as represented in the displayed image in response to at least one user input confirming the initially selected one object as the object to be processed. Determining dimensional data for an object indicated by at least one user input may include determining a dimensional weight based on a new perimeter of the initially selected one object represented in the displayed image in response to at least one user input indicative of the new perimeter. Determining dimensional data for an object indicated by at least one user input may include determining a dimensional weight based on an estimated perimeter of an object represented in the displayed image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed. Determining dimensional data for an object indicated by the at least one user input may include determining a dimensional weight based on a user identified perimeter of an object represented in the displayed image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed and identifying at least a portion of the user identified perimeter. Causing the displayed image and an indication indicative of the initially selected one object to be displayed may include causing the displayed image to be displayed and causing a draggable border about at least a portion of the initially selected one object to be displayed in the displayed image. Causing the displayed image and an indication indicative of the initially selected one object to be displayed may include causing the displayed image to be displayed and causing a draggable border about at least a portion of a user selected object to be displayed in the displayed image.
A computer-readable medium storing therein instructions to cause a computing system to execute a process related to determining dimensional information for objects may be summarized as including displaying an image; identifying objects or spaces represented in the displayed image; providing an indication to a user; receiving user input; and determining dimensional data for an object or space in response to the user input.
Providing an indication to a user may include indicating a problem related to an object or space of the objects or spaces in the displayed image to the user. Indicating a problem related to an object or space of the objects or spaces in the displayed image to the user may include indicating a problem in determining dimensional data for an object or space of the objects or spaces in the displayed image to the user. Receiving user input may include receiving the user input in the form of at least one of a keyboard entry, a computer mouse entry, a touch-screen device entry, a voice command, an audible command, and a bar code reading.
The process may further include displaying a second image after receiving the user input; identifying objects or spaces represented in the second image; and receiving a second user input. Determining dimensional data for an object or space in response to the user input may include determining dimensional data for an object or space identified in the second image in response to the second user input. The process may further include determining dimensional data for one of the identified objects or spaces in the displayed image prior to receiving the user input. The process may further include displaying a dimensional data for an object or space.
A processor-implemented method of selecting an object from at least one object in an image to process information about the selected object may be summarized as including providing an image of the at least one object; selecting a first object of the at least one object in the image; updating the image to indicate the selection of the first object; receiving an input related to the selection of the first object; updating the image to indicate the input; and computationally determining dimensional data related to one of the at least one object using the input.
Updating the image to indicate the selection of the first object may include updating the image to indicate an estimated perimeter around the first object. Receiving an input related to the selection of the first object may include receiving the input selecting a second object of the at least one object that is different than the first object. Receiving an input related to the selection of the first object may include receiving the input to modify an aspect related to the indication of the selection of the first object. Receiving the input to modify an aspect related to the indication of the selection of the first object may include receiving the input to modify an estimated perimeter of the first object. Receiving an input related to the selection of the first object may include receiving the input as a user selection on a portion of a touch-screen device to select a second object of the at least one object. Receiving an input related to the selection of the first object may include receiving the input as a boundary drawn on a touch-screen device around an image of a second object of the at least one object to select the second object. Receiving an input related to the selection of the first object may include detecting a number of contacts at a number of positions on a touch-screen device, the contacts indicative of a number of corners of the first object. Receiving an input related to the selection of the first object may include receiving at least one user input indicative of a new position of a corner of the first object in the image displayed on a touch-screen device. Receiving an input related to the selection of the first object may include receiving at least one user input indicative of a perimeter of one of the at least one object on a touch-screen device indicative of a selection of the one of the at least one object. Determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a computationally determined estimated perimeter of the one of the at least one object. Determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a user identified perimeter of the one of the at least one object.
A processor-implemented method of selecting an object from at least one object in an image to process information about the selected object may be summarized as including displaying the image of the at least one object; selecting a first object of the at least one object in the image; updating the image to indicate the selection of the first object; receiving an input related to the selection of the first object; and updating the image to indicate the input.
Updating the image to indicate the selection of the first object may include updating the image to indicate an estimated perimeter around the first object. Receiving an input related to the selection of the first object may include receiving the input selecting a second object of the at least one object that is different than the first object. Receiving an input related to the selection of the first object may include receiving the input to modify an aspect related to the indication of the selection of the first object. Receiving the input to modify an aspect related to the indication of the selection of the first object may include receiving the input to modify an estimated perimeter of the first object. Receiving an input related to the selection of the first object may include receiving the input as a user selection on a portion of a touch-screen device to select a second object of the at least one object. Receiving an input related to the selection of the first object may include receiving the input as a boundary drawn on a touch-screen device around an image of a second object of the at least one object to select the second object. Receiving an input related to the selection of the first object may include detecting a number of contacts at a number of positions on a touch-screen device, the contacts indicative of a number of corners of the first object. Receiving an input related to the selection of the first object may include receiving at least one user input indicative of a new position of a corner of the first object in the image displayed on a touch-screen device. Receiving an input related to the selection of the first object may include receiving at least one user input indicative of a perimeter of one of the at least one object on a touch-screen device indicative of a selection of the one of the at least one object. Receiving an input may include receiving an audible command from a user. Receiving an input may include receiving a verbal command from a user. The method of claim may further include computationally determining dimensional data related to one of the at least one object using the input. Determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a computationally determined estimated perimeter of the one of the at least one object. Determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a user identified perimeter of the one of the at least one object.
In the drawings, identical reference numbers identify similar elements or acts. The sizes and relative positions of elements in the drawings are not necessarily drawn to scale. For example, the shapes of various elements and angles are not drawn to scale, and some of these elements are arbitrarily enlarged and positioned to improve drawing legibility. Further, the particular shapes of the elements as drawn, are not intended to convey any information regarding the actual shape of the particular elements, and have been solely selected for ease of recognition in the drawings.
In the following description, certain specific details are set forth in order to provide a thorough understanding of various disclosed embodiments. However, one skilled in the relevant art will recognize that embodiments may be practiced without one or more of these specific details, or with other methods, components, materials, etc. In other instances, well-known structures associated with computing systems, imagers (e.g., cameras), and/or transport mechanisms (e.g., conveyors) have not been shown or described in detail to avoid unnecessarily obscuring descriptions of the embodiments.
Unless the context requires otherwise, throughout the specification and claims which follow, the word “comprise” and variations thereof, such as, “comprises” and “comprising” are to be construed in an open, inclusive sense that is as “including, but not limited to.”
Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
The headings and Abstract of the Disclosure provided herein are for convenience only and do not interpret the scope or meaning of the embodiments.
In some embodiments, the computing system 12 may be, for example, a desktop computer, a notebook computer, a handheld computer, a PDA, a workstation, a mainframe computer, or a processor in any type of the aforementioned computers or devices. The user input device 14 may be, for example, a keyboard, a computer mouse, a touch-screen device, a voice recognition device, a bar code reader, or any combination thereof. The user output device 16 may be, for example, a standalone monitor (e.g., a liquid-crystal display monitor or a cathode-ray tube monitor), a display screen, an auditory device, or a touch-screen device. In one embodiment, the user input device 14 and the user output device 16 may each be a part of a touch-screen device, which, as known in the art, is a display device that can detect the presence and location of a touch within a display area of the display device. For example, a touch-screen device including both the user input device 14 and the user output device 16 may have a screen that is operable to display an image and detect a contact to the screen by a user's finger, hand, or a writing tool such as a stylus. The data storage device 18 is preferably operable to store digital data that includes textual and numerical data, digitized images, and data input by a user of the dimensioning system 10, etc. The data storage device 18 may comprise a memory device such as, for example, a hard drive (whether as an integral part of the dimensioning system 10 or as a standalone device), a recording medium, or an integrated-circuit memory device (e.g., memory chip). The imager 15 may be, for example, a charge-coupled device (CCD), a complementary metal-oxide-semiconductor (CMOS) active-pixel sensor, or any similar image sensing or capture device that converts an optical image to a signal representative of the image.
In operation, the dimensioning system 10 of
A user of the dimensioning system 10 viewing the displayed image of the one or more objects may provide user input through the user input device 14. If the user agrees that it is the selected object on which further computation is to be performed, the user input may simply be one form of validation, such as, for example, a click of a computer mouse, a touch on a “Yes” button or user selectable icon on the user input device 14 in the form of a touch-screen device, pressing and releasing of a key on a keyboard, a check mark entered in an input field displayed on the user input device 14 in the form of a touch-screen device, or an audible or verbal command such as “Object 3,” for example. If the user agrees with the selection but wishes to make some modification to the selection (e.g., to correct the estimated perimeter of the selected object before dimensional weight is calculated based on the estimated perimeter), the user input may include both a validation and a modification, or simply a modification. For example, the perimeter estimated by the computing system 12 may be entirely or partially incorrect due to insufficient lighting in the image or too many or overlapping objects in the image making it difficult to discern the perimeter of the selected object. In such case, the user may modify all or a portion of the perimeter of the selected object as estimated by the computing system 12 and show in the image on the output device 16. If, however, the user disagrees with the selection by the computing system 12 and wishes to select a different object among the objects represented in the displayed image, the user input may include a selection of a different object in the image. For instance, when an object A of two objects represented in the displayed image is selected by the computing system 12 and the user wishes to select an object B instead, the user may enter his/her selection of object B by one of various ways. In another situation, there may be an inadequate image for certain packages, such as when a package is viewed straight on, only two of the tree dimensions are visible. Accordingly, in one embodiment, the computing system 12 may request that the user perform a task, such as issuing the command “Please move right or left and re-image Object 3,” for example.
The method by which the user enters his/her input may include, but is not limited to, one of the following: selecting or indicating at least a portion of the representation of object B in the displayed image; drawing or otherwise indicating a boundary around the representation of object B in the displayed image displayed on a touch-screen device; drawing a mark on or otherwise marking object B in the displayed image; and/or pointing out or otherwise indicating or selecting the corners or other specific features of object B in the displayed image. The user may take such action by, for example, manipulating a cursor or pointer icon displayed in the image using a pointer device (e.g., computer mouse, trackball, joystick, and rocker switch or arrow keys), or by using audible or verbal commands. The user may take such action by touching one or more portions of a touch sensitive screen on which the image is displayed, for example, to select portions of the objects B or user selectable icons.
Whether the user input validates or modifies the selection of the computing system 12, or selects a new object in the image, the user output device 16 may display the user input along with the representation of the at least one object in the image. For example, the user may validate the selection of a first object of the objects represented in the image yet at the same time modify the estimated perimeter of the representation of the first object by tracing or otherwise indicating the actual perimeter (i.e., indicated perimeter) of the representation of the first object on the display of the user output device 16. For instance, the user may select a portion of the perimeter of object and drag the selected portion using a pointer device (e.g., mouse, trackball, joystick, etc), a finger or a stylus (e.g., touch screen). In such case, the user output device 16 may show the traced line on the display as drawn by the user. If the user selects a second object of the objects represented in the image (e.g., by drawing a cross or a check mark on the second object), the user output device 16 may then represent the cross or check mark on the display. This provides an interaction between the dimensioning system 10 and the user in that the user provides user input as a part of the overall process of determining a dimensional value of the selected object (e.g., volume dimensioning), and the dimensioning system 10 provides an indication or feedback to the user of the user's input and performs computation based on the user input.
After the user provides input to the dimensioning system 10 through the user input device 14, the computing system 12 performs computation related to the selected object based on the user input. In the case of volume dimensioning where the dimensional weight of an object is computed, the computing system 12 computes the dimensional weight of the selected object based on an estimated or indicated perimeter of the selected object. More specifically, in one embodiment, the computing system 12 is able to estimate a length, width, and height of the selected object, for example, by using the estimated or indicated perimeter of the selected object. Once the dimensional weight of the selected object has been determined, the charge for shipment of the selected object may then be determined.
Thus, by allowing the user to validate the object selection by the computing system 12, or by allowing the user to select an object for the computing system 20 to perform volume dimensioning on, or both, issues related to inaccuracy caused by selection of a wrong object or an erroneous estimation of the object's perimeter (and thus dimensions) by the computing system 12 due to insufficient lighting or presence of numerous objects in the image or other issues may be avoided. The user interaction serves as a check in the dimensioning process, ensuring that the correct object is selected and that computation is based on dimensions derived from a correct perimeter of the selected object.
In one embodiment, the processing component 22 is operable to determine from an image captured by the imager 25 an approximate perimeter of a first object of at least one object in the image. The processing component 22 may cause the display component 26 to display the captured image and an indicator that indicates the approximate perimeter of the first object. Upon receiving at least one input from the user via the user input component 24, the processing component 22 determines a dimensional value of one of the objects in the displayed image based on the user input. For example, the processing component 22 may perform computation for volume dimensioning on the first object if the user input validates or modifies the approximate perimeter of the first object. If the user input modifies the approximate perimeter of the first object, the computation will be based on the modified perimeter. Otherwise, in the case of the user input indicates validation, the computation will be based on the approximate perimeter determined by the processing component 22. Alternatively, if the user selects a second object different than the first object from objects represented in the displayed image, the processing component 22 may perform volume dimensioning on the second object to determine the dimensional weight of the second object.
In one embodiment, the at least one user input received may include a user selection that confirms the initially selected one object as the object for processing. In another embodiment, the at least one user input received may include a user selection that indicates an object other than the initially selected one object as the object for processing. For example, when the user desires to determine dimensional data for an object that is different than the object initially selected by an automatic process executed in a computing system, the user manually selects the user-selected object before the computing system proceeds further. When the user input confirms the initially selected one object as the object for processing, in one embodiment, a dimensional weight of the initially selected one object is determined based on an estimated perimeter of the initially selected one object as represented in the acquired image. Alternatively, when the user input selects a different object, a dimensional weight of the user-selected object is determined based on an estimated perimeter of the user-selected object as represented in the acquired image. Further, when the user input selects a different object, process 30a may additionally include (not shown) providing an indication to the user indicative of a currently selected object to visually distinguish the currently selected object in a display of the acquired image from any other object represented in the display of the acquired image.
In one embodiment, the at least one user input received indicates at least a portion of a new perimeter for the object for processing. In such case, in one embodiment, the dimensional data is computationally determined based on the new perimeter, as indicated by the user input, of the object represented in the acquired image. For instance, when an estimated perimeter of the selected object, as represented in the acquired image on a display, is partially or entirely incorrect (e.g., due to insufficient lighting or the presence of numerous objects when the image is acquired), the user may modify the estimated perimeter so that dimensional data for the selected object is computed not based on incorrect information (e.g., incorrect estimated perimeter) but based on modified information.
In one embodiment, the user is notified of the initial selection of the initially selected one object by a display of the acquired image, where the initially selected one object is visually distinguished in the display of the acquired image from any other objects represented in the display of the acquired image. In one embodiment, the initially selected one object is visually distinguished from any other objects represented in the display of the acquired image with a display of a border about at least a portion of the initially selected object in the display of the acquired image. In such a case, in an embodiment, the at least one user input received may include at least one signal representing a position in the image that indicates a position of at least a portion of a new perimeter for the object for processing. In an alternative embodiment, the initially selected one object is visually distinguished from any other objects represented in the display of the acquired image with a display of a draggable border about at least a portion of the initially selected object in the display of the acquired image. For example, the at least one user input received may include at least one signal representing a dragging of the draggable border to a new position that indicates at least a portion of a new perimeter for the object for processing.
It should be appreciated by one skilled in the art that the process 30a may be implemented in one integrated device or in multiple standalone devices. For example, the process 30a may be implemented in any of the computing system 10a, 10b, and 10c of
The process 30b may further computationally determine dimensional data for the object or space selected by the received user input at 35b. For example, in one embodiment, this may be due to the user input selecting an object or space that is different from the object or space for which a dimensional data has been determined. The process 30b may further computationally revise the determined dimensional data for the at least one object or space in response to the received user input at 36b. For example, in one embodiment, the user may agree with the selection of the object or space but disagree with the certain aspect of the selection (e.g., the border of the selected object or space which is used to determine the volume of the object or space). In such case, the user input may be a modification to that aspect of the selection of the object or space, such as, for example, a change in the selected object's or space's border.
The user input may come in different forms. For example, the user input may be a keyboard entry on a keyboard, a click or “click and drag” using a computer mouse, entry through a touch-sensitive screen by the user's finger or a stylus or similar tool, a voice command including at least one command word, an audible command such as a clap or some recognizable sound, or entry by a bar code reader.
As with the process 30a, the process 30b may be implemented in one integrated device or in multiple standalone devices. For example, the process 30b may be implemented in any of the computing system 10a, 10b, and 10c of
In one embodiment, the image is updated to indicate an estimated perimeter around the first object when updating the image to indicate the selection of the first object. In one embodiment, the input (e.g., a user input manually entered by a user) selects a second object different than the first object. In another embodiment, the input modifies an aspect related to the indication of the selection of the first object. For example, in an embodiment, one aspect related to the indication of the selection of the first object may be an estimated perimeter of the first object as shown in the image, and accordingly the input may modify the estimated perimeter of the first object.
In some embodiments, the input may be a mark or a line drawn on, for example, a touch-screen device by a user to either validate the selection of the first object or to select a second object different than the first object. The input may also be a user input to point out corners of the first object in the image on, for example, a touch-screen device. When an estimated perimeter of the first object is also indicated in the image, the input may be a user input to correct a corner position of the estimated perimeter by moving a corner point of the first object in the image on, say, a touch-screen device. The estimated perimeter of the first object may be a draggable perimeter displayed on a display device and modifiable by a user dragging at least a portion of the estimated perimeter (e.g., in a click-and-drag or point-and-drag fashion) to change the estimated perimeter into a modified boundary that more closely resembles the real perimeter of the first object. Alternatively, the input may be a boundary line drawn by the user to indicate the selection of an object approximately surrounded by the line drawn by the user. As indicated previously, the input may be done by using the user's finger, a stylus or similar tool, by using a keyboard, or by using a computer mouse.
Accordingly, in one embodiment, the input received may be a user selection on a portion of a touch-screen device to select a second object of the at least one object. In another embodiment, the input received may be a boundary drawn on a touch-screen device around an image of a second object of the at least one object to select the second object that is different than the first object. In one embodiment, receiving an input may include detecting a number of contacts at a number of positions on a touch-screen device where the contacts indicate a number of corners of the first object. In a different embodiment, the received input may include at least one user input indicative of a new position of a corner of the first object in the image displayed on a touch-screen device. Alternatively, the received input may include at least one user input indicative of a perimeter of one of the at least one object on a touch-screen device indicative of a selection of the selected object.
In one embodiment, determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a computationally determined estimated perimeter of the one of the at least one object. For instance, when the user input confirms the initial selection of the first object by a computing system, the computing system will determine the dimensional weight of the first object based on the estimated perimeter as determined by the computing system. In an alternative embodiment, determining dimensional data related to one of the at least one object using the input may include determining a dimensional weight of the one of the at least one object based on a user identified perimeter of the one of the at least one object. For example, when the user input modifies an estimated perimeter of the first object as determined by the computing system, the computing system determines the dimensional weight of the first object based on the modified perimeter. If the user input instead selects a second object that is not the first object, the computing system may determine the dimensional weight of the user-selected second object based on an estimated perimeter of the second object as determined by the computing system or based on a user-identified perimeter of the second object.
It should be appreciated by one skilled in the art that the process 40a may be implemented in one integrated device or in multiple standalone devices. For example, the process 40a may be implemented in any of the computing system 10a, 10b, and 10c of
As with the process 40a, the process 40b may be implemented in one integrated device or in multiple standalone devices. For example, the process 40b may be implemented in any of the computing system 10a, 10b, and 10c of
In one embodiment, determining dimensional data for the object indicated by at least one user input may include determining a dimensional weight based on an estimated perimeter of the initially selected one object as represented in the acquired image in response to at least one user input confirming the initially selected one object as the object to be processed. For example, when a user confirms the estimated perimeter of initially selected object A, the dimensional weight of object A is determined based on the estimated perimeter. Alternatively, determining dimensional data for the object indicated by at least one user input may include determining a dimensional weight based on a new perimeter of the initially selected one object represented in the acquired image in response to at least one user input indicative of the new perimeter. For example, when a user modifies an estimated perimeter of initially selected object A to form a new perimeter, the dimensional weight of object A is determined based on the new perimeter.
In one embodiment, determining dimensional data for the object indicated by at least one user input may include determining a dimensional weight based on an estimated perimeter of an object represented in the acquired image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed. For example, when the user selects object B, which is different than object A as initially selected by the computer-executable program, the dimensional weight of object B may be determined based on an estimated perimeter of object B as determined by the program. In another embodiment, determining dimensional data for the object indicated by at least one user input may include determining a dimensional weight based on a user identified perimeter of an object represented in the acquired image other than the initially selected one object in response to at least one user input selecting the other object as the object to be processed and identifying at least a portion of the user identified perimeter. For instance, when the user selects object B and identifies a user-identified perimeter of object B, the dimensional weight of object B may be determined based on the user-identified perimeter. The user-identified perimeter may also be displayed as a feedback to the user on a display of the acquired image to acknowledge the user input.
In one embodiment, causing the acquired image and an indication indicative of the initially selected one object to be displayed may include causing the acquired image to be displayed and causing a draggable border about at least a portion of the initially selected one object to be displayed in a display of the acquired image. In another embodiment, causing the acquired image and an indication indicative of the initially selected one object to be displayed may include causing the acquired image to be displayed and causing a draggable border about at least a portion of a user selected object to be displayed in a display of the acquired image. In either case, with the draggable border displayed, a user may drag the draggable border to make modifications to correct error in the displayed border.
In one embodiment, the process 50b may further determine dimensional data for one of the identified objects or spaces in the displayed image prior to receiving the user input at 56b. In another embodiment, the process 50b may further display a dimensional data for an object or space. For example, a dimensional data, such as length, width, height, area, or volume, of the automatically selected object or space may be displayed before and/or after the user input is received. In yet another embodiment, at 57b, the process 50b may display a second image after receiving the user input. Objects or spaces represented in the second image are identified at 58b. Another user input is received at 59b.
Thus, systems and methods to allow user interaction in volume dimensioning an object are disclosed herein and should greatly improve upon the inaccuracy problem described above. For instance, when a dimensioning application selects an incorrect object for dimensioning or when the estimated perimeter of the selected object is erroneous, a user can intervene by selecting the correct object for dimensioning or by modifying the estimated perimeter. This user interaction provides a way for the user to validate or modify selections made by the application, and thereby avoid inaccuracies that might arise if the process is fully automated.
The above description of illustrated embodiments, including what is described in the Abstract, is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Although specific embodiments of and examples are described herein for illustrative purposes, various equivalent modifications can be made without departing from the spirit and scope of the disclosure, as will be recognized by those skilled in the relevant art. The teachings provided herein of the various embodiments can be applied to other context, not necessarily the exemplary context of volume dimensioning generally described above. It will be understood by those skilled in the art that, although the embodiments described above and shown in the figures are generally directed to the context of volume dimensioning, applications for determining other values related to objects, such as parcels and packages, may also benefit from the concepts described herein. Further, although the embodiments described above and shown in the figures are directed to volume dimensioning using a portable electronic device, the concepts and the embodiments described herein are equally applicable to non-portable devices or to a system having multiple standalone devices coupled to one.
These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 09368001.5 | Jan 2009 | EP | regional |
The present application claims the benefit of U.S. patent application Ser. No. 12/685,816 for Semi-Automatic Dimensioning with Imager on a Portable Device filed Jan. 12, 2010 (and published Aug. 12, 2010 as U.S. Patent Application Publication No. 2010/0202702), now U.S. Pat. No. 8,908,995, which claims the benefit of U.S. patent application Ser. No. 61/149,912 for Semi-Automatic Dimensioning with Imager on a Portable Device filed Feb. 4, 2009. Each of the foregoing patent applications, patent publication, and patent is hereby incorporated by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61149912 | Feb 2009 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14561367 | Dec 2014 | US |
| Child | 16153260 | US | |
| Parent | 12685816 | Jan 2010 | US |
| Child | 14561367 | US |
