Patent Application
20180033214
The present invention relates generally to imaging. More particularly, example embodiments of the present invention relate to evaluating image data.
Generally speaking, logistical processes increase efficiency and reduce cost of commerce in relation to storing inventory and transporting cargo. For example, storage space is finite and transport media, such as trailers, have specified capacities. Logistic processing apportions cargoes and inventories efficiently over the available spaces, which can facilitate storage and expedite transport.
To apportion a cargo or inventory, dimensions of each of the constituent packages, boxes, crates and other items (“items”) are measured. The measured dimensions are processed in relation to the available storage or transport space. Based on the processing, a position within the storage/transport space is computed that optimizes placement of each inventory/cargo item relative to each of the other items.
The measuring of the dimensions of the cargo/inventory items may be automated by a dimensioning apparatus (“dimensioner”), which may be operable optically. Optically based dimensioners are typically operable for capturing image data using photographic and/or videographic techniques. Image data captured in relation to surfaces of the cargo/inventory items are used for computing the measurements.
Dimensioners capture the image data over two or more measurably sufficient (“good”) surfaces of the cargo/inventory items to produce measurements with levels of accuracy sufficient for commercial application. Use of three good surfaces may improve measurement accuracy for commerce. In some situations, however, dimensioners may sometimes capture substantially inaccurate (“false”) image data.
Computations based on the false captured image data produce inaccurate measurements of the dimensions of the items, which can cause faulty cargo/inventory apportioning. Excessive false image value production levels are thus unacceptable with dimensioners certified for commercial use, e.g., under the National Type Evaluation Program (NTEP) of the (U.S.) National Council on Weights and Measures.
On the contrary, NTEP certified dimensioners rely on consistently reliable measurement accuracy and thus, in the image values on which the measurements are based. Dimensioners may be deployed in industrial settings, e.g., in which they capture the image data from cargo/inventory items as the items are moved on high speed conveyors. Such usage however may sometimes degrade the accuracy of image based measurements.
For example, images captured by the dimensioner from an item that is beyond an optical range limit may lack sufficient structured light information for accurate measurement. Even with sufficient structured light information, accuracy may be affected by an orientation of an item relative to the dimensioner. For example, a dimensioner oriented straight-on to one face of an item may measure its depth inaccurately.
Therefore, a need exists for evaluating image data, captured from items examined by dimensioners, in relation to suitability of the data for computing accurate dimension measurements therewith. A need also exists for recognizing false values in the image data captured by the dimensioners and rejecting use of the false values in computing dimension measurements. Further, a need exists for recommending and/or implementing corrections in relation to the false image data, in order to produce accurate dimension measurements.
Accordingly, in one aspect, the present invention embraces evaluating image data, captured from items examined by dimensioners, in relation to suitability of the data for computing accurate dimension measurements therewith. In an example embodiment, dimensioners are thus operable for recognizing false values in the image data captured therewith dimensioners and rejecting the false values for dimension measurement computations. Further, the dimensioners are operable for correcting the captured image data and computing accurate dimension measurements based on the corrected values.
Images of items are evaluated. A first image of the item, having a view of two or more (e.g., three) of its surfaces, is captured at a first time. A measurement of at least one dimension of one or more of the surfaces is computed and stored. A second image of the item, having a view of at least one of the two or more surfaces, is captured at a second time, subsequent to the first time. A measurement of the dimension is then computed and compared to the stored first measurement and evaluated based on the comparison.
An example embodiment of the present invention relates to a method for evaluating images of items. A first image of the item, having a view of two or more of its surfaces, is captured at a first time. A measurement of at least one dimension of one or more of the two or more surfaces is computed based on the first captured image and stored. A second image of the item, having a view of at least one of the two or more surfaces, is captured at a second time, which is subsequent to the first time. A measurement of the at least one dimension of the at least one of the two or more surfaces is computed. The computed measurement of the at least one dimension of the at least one of the two or more surfaces is compared to the stored first measurement. The computed measurement of the at least one dimension of the at least one of the two or more surfaces is evaluated based on the comparison.
The evaluating step comprises, selectively, accepting or rejecting the computed measurement of the at least one dimension of the at least one of the two or more surfaces. The captured first image and/or the captured second image each comprise information based on data relating to a characteristic of the item, and/or data relating to a wireframe model constructed of the imaged item. The information relates to one or more features of one or more surfaces of the item. The one or more surface features relate to a corresponding color or other chromatic or similar characteristic. Alternatively or additionally, the one or more surface features comprise a logo, a bar code pattern (“barcode”), or a text based, alphanumeric, ideographic, or pictographic symbol. The symbol may comprise handwritten or preprinted writing.
In an example embodiment, the comparing step comprises computing a duration of an interval between the second time and the first time. The evaluating step may comprise establishing an identity between a representation of the item in the second image with a representation of the item in the first image.
The evaluation of the image may also comprise delineating a boundary about a periphery of the one or more surface features in the first captured image. The delineated boundary is mapped to corresponding locations in a coordinate system. Data corresponding to the mapped boundary is stored.
The surface feature is then recognized in the captured second image. Data corresponding to the boundary is surveyed in relation to the recognized surface feature. The surveyed boundary data is compared to the stored boundary data. The evaluating step is then based, at least partially, on the comparison of the surveyed boundary data to the stored boundary data.
The evaluation of the images may also comprise capturing at least a third image of the item at a corresponding (e.g., third) time, which occurs between the first time and the second time. The at least third image comprises a view of the at least one of the two or more surfaces. A measurement of the at least one dimension of the at least one of the two or more surfaces is computed based on the captured at least third image. The measurement computed based on the captured at least third image is compared to the stored first measurement. The measurement computed based on the captured at least third image may be approved based on the comparison to the stored first measurement and stored.
A mean value is computed based on the stored first measurement and the stored approved measurement (from the captured at least third image). In an example embodiment, the evaluated measurement (from the second captured image) may be corrected based on the computed mean value.
An example embodiment may be implemented in which the capturing of the first image step comprises recording the view of the two or more surfaces of the item from a perspective associated with a first position of the item. The capturing of the second image step comprises recording the view of the at least one of the two or more surfaces from a perspective associated with a second position of the item. The second position is displaced (e.g., laterally, longitudinally, axially, etc.) relative to the first position.
The evaluation of the image may comprise certifying, based on the evaluating step, a charge for a commercial transaction relating to one or more of storing or transporting the item. Alternatively or additionally, the evaluation of the image may comprise certifying, based on the evaluating step, a dimensioner for a commercial use.
In another aspect, the present invention embraces a non-transitory computer readable storage medium comprising instructions, which are operable when executing on a computer processor for causing and/or controlling a process for evaluating images (e.g., as summarized above).
In yet another aspect, the present invention embraces a computer system comprising a bus component and a processor component coupled to the bus. The computer system also comprises a non-transitory storage medium component coupled to the bus component. The storage component comprises instructions, which are operable when executing on the processor component for causing and/or controlling a process for evaluating images (e.g., as summarized above).
The foregoing illustrative summary, as well as other example features, functions and/or aspects of embodiments of the invention, and the manner in which the same are accomplished, are further explained within the following detailed description of example embodiments and each figure (FIG.) of the accompanying drawings.
Example embodiments of the present invention are described in relation to evaluating image data, captured from items examined by dimensioners. Suitability of the data is thus evaluated for computing accurate dimension measurements therewith. In an example embodiment, dimensioners are thus operable for recognizing false values in the image data captured therewith dimensioners and rejecting the false values for dimension measurement computations. Further, the dimensioners are operable for correcting the captured image data and computing accurate dimension measurements based on the corrected values.
Overview.
Example embodiments are described in relation to evaluating images of items. A first image of the item, having a view of two or more of its surfaces, is captured at a first time. A measurement of at least one dimension of one or more of the surfaces is computed and stored. A second image of the item, having a view of at least one of the two or more surfaces, is captured at a second time, subsequent to the first time. A measurement of the dimension is then computed and compared to the stored first measurement and evaluated based on the comparison.
An example embodiment of the present invention uses information accessed by a dimensioner from previous images to evaluate a present image. The present image is evaluated whether a user of the dimensioner is triggering the dimensioner to make a measurement related to an item in the present image, or not. The information accessed by the dimensioner can be wireframe-based and/or image based. The wireframe based information may be economical in relation to computational resources. The image based information may give a higher confidence in decisions relating to rejecting an image or a measurement made therewith.
Example Dimensioner and Image Views.
An item with which an example embodiment may be operable may comprise a box, a crate, or another a package associated with an inventory to be stored or a cargo to be shipped or transported.
The first view 10 shows an image 15 of an item 12, which comprises a box, rendered on a display screen of an example dimensioner 11. While depicted herein as a tablet computer, the dimensioner 11 may comprise another mobile device or a computer apparatus (or component thereof) disposed or deployed in a fixed location. Three (3) sides of the item 12 are visible as well as a “floor” 13, which is representative of any surface or structure supporting the weight of the item 12. The dimensioner 11 is shown in the foreground of the image 15, which shows the box item 12 on the floor 13, which in the view 10 comprises a table surface. The image 15 shows a good wireframe 16, which is delineated about a periphery of the item 12 conforming to its three visible sides. The dimensions of the box item 12, as shown in the image 15, are accurate and thus suitable for commercial use.
The position of the item 12 shown in the second view 20 is displaced axially, relative to its position as shown in the first view 10. Wireframe dimensions may be compared from images of the item 12 taken (“captured”) over each of multiple positions, which helps confirm that the dimensioner 11 is, in fact, imaging the same box in each of the views. Thus, an example embodiment may be implemented in which an identity is established between an item 12 shown in a present image and the item, as shown in previous images.
Thus, while the view 20 shows the same box item 12 from a perspective that offers a slightly less optimal angle than the perspective shown in the view 10, the dimensions of the item 12 may be computed to be the same as the dimensions computed from the view 10 (
In an example embodiment, stronger confirmation as to the identity of the item 12 over multiple images captured at different corresponding times is implemented by comparing features of the surface of the item 12 over each of the images. A boundary may thus be delineated around the surface features. For example, bounding lines may be created around surface features based on a color or another chromatic (or other) characteristic associated with each feature. Thus, the boundaries are delineated about each feature distinguished by, e.g., the different colors. The boundaries of the surface features are then mapped to a coordinate system based on the wireframe and stored.
Bounding boxes delineated around printed text or other surface features are used for comparing sequential images to build confidence that in the identity of the box item 12 is the same, whether or not a user of the dimensioner 11 executes a “make measurement” command therewith.
Images captured from some perspectives may lack sufficient information for computing accurate measurements of a dimension of the item 12. For example, a user may continue around the item to a point at which the dimensioner 11 faces only a single end of a box item. A measurement of a depth dimension made from such a perspective may comprise erroneous information.
Erroneous measurements computed during a certification process of the dimensioner typically cause its failure. Erroneous measurements computed during commercial transactions, e.g., in relation to assessing charges for storage and/or transport of the item, cause inaccuracies such as insufficient revenue capture or overcharging.
In example embodiments, this incorrect depth measurement is rejected and deleted from display. Sequential wireframes computed from images captured at various corresponding times, and/or comparing markings on the box or other surface features of the item 12, are used to reject the depth measurement.
An example embodiment of the present invention relates to a method for evaluating the image data for accepting or rejecting dimension measurements therewith. The example process, and non-transitory computer readable storage media comprising instructions, e.g., software associated with the dimensioner 11, are operable for making related judgments appropriately. Moreover, an example embodiment is implemented in which the instructions are configured to correct the depth measurement. For example, an average of related depth measurements computed from preceding images may be used to provide the correct measurement of the depth dimension.
Example Processes.
An example embodiment of the present invention relates to a computer implemented method for evaluating image data, captured from items examined by dimensioners, in relation to suitability of the data for computing accurate dimension measurements therewith. The method may relate to a process executing on a computer system, which is configured operably as a dimensioner.
An example embodiment is implemented, in which a dimensioner is thus operable for recognizing false values in the image data captured therewith dimensioners and rejecting the false values for dimension measurement computations. Further, the dimensioners are operable for correcting the captured image data and computing accurate dimension measurements based on the corrected values.
In step 501, a first image of the item, having a view of two or more (e.g., three) of its surfaces, is captured at a first point in time.
In step 502, a measurement of at least one dimension of one or more of the surfaces is computed and stored.
In step 503, a second image of the item, which has a view of at least one of the two or more surfaces, is captured at a second point in time. The second point in time is subsequent to the first point in time.
In step 504, a measurement of the at least one dimension of the at least one of the two or more surfaces is computed from the captured second image.
In step 505, the computed measurement of the at least one dimension of the at least one of the two or more surfaces is compared to the stored first measurement.
In step 506, the computed measurement of the at least one dimension of the at least one of the two or more surfaces is evaluated based on the comparison.
In step 507, the evaluating step 506 relates to a selective acceptance or rejection of the computed measurement of the at least one dimension of the at least one of the two or more surfaces. If the computed measurement is accepted, then the process 500 may be complete.
Example embodiments may be implemented in which the captured first image and/or the captured second image each comprise information based on data relating to a characteristic of the item. Alternatively of additionally, the captured first image and/or the captured second image each comprise information based on data relating to a wireframe model of the item constructed in relation to the captured images.
The information may relate to one or more features of one or more surfaces of the item. The one or more surface features may relate to a corresponding chromatic (color related) characteristic visible on the surface. Alternatively or additionally, the one or more surface features comprise a logo, a barcode pattern, or a text based, alphanumeric, ideographic, or pictographic symbol. The symbol may comprise handwritten or preprinted writing, an emblem, icon, or the like.
In an example embodiment, the comparing step comprises computing a duration of an interval between the second time and the first time. The evaluating step may comprise establishing an identity between a representation of the item in the second image with a representation of the item in the first image using the computed interval duration. For example, the identity of the item may thus be confirmed as not having changed from the first image, captured at the first time, to the second image, captured at the subsequent second time.
The evaluation of the image at step 501 may be based, at least in part, on analysis related to one or more visible features that appear on the surface of the item. The analysis of the surface features may be implemented as described, for example below, in relation to a process 60 (
In step 61, a boundary about a periphery of the one or more surface features of the item is delineated in the first captured image. For example, boundary lines may be created about (e.g., around, surrounding, proximate to a periphery of, etc.) the surface feature(s).
In step 62, the delineated boundary is mapped to corresponding locations in a coordinate system.
In step 63, data corresponding to the mapped boundary is stored. For example, the mapped boundary data may be stored in a non-transitory computer readable storage medium such as a memory and/or a drive or flash related storage unit or the like.
In step 64, the surface feature is recognized in the captured second image.
In step 65, data corresponding to the boundary is surveyed in relation to the recognized surface feature. Upon the recognition of the surface feature in the captured second image for example, a survey feature of dimensioner software may be operable for scanning the recognized surface feature in relation to the boundary about its periphery, as it may appear in a perspective shown in a view corresponding to the captured second image.
In step 66, the surveyed boundary data is compared to the stored boundary data.
In step 67, the evaluating step is based, at least in part, on the comparison of the surveyed boundary data to the stored boundary data.
Referring again to
In step 511 for example, at least a third image of the item is captured at a corresponding (e.g., third) point in time. The third (or other corresponding) point in time is subsequent to the first point in time, but occurs prior to the second point in time. Thus, the third (or other corresponding) point in time occurs between the first point in time and the second point in time. The captured at least third image comprises a view of the at least one of the two or more surfaces.
In step 512, a measurement of the at least one dimension of the at least one of the two or more surfaces is computed based on the captured at least third image.
In step 513, the measurement computed based on the captured at least third image is compared to the stored first measurement.
In step 514, the measurement computed based on the captured at least third image is approved based on the comparison to the stored first measurement and stored (e.g., based on an independent evaluation thereof, which occurs prior to the evaluation step 506).
In step 515, a mean value is computed based on an average of the stored first measurement and the stored approved measurement from the captured at least third image.
In step 521, the evaluated measurement (which was rejected in step 507) is corrected based on the computed mean value. Upon the correction of the measurement, the process 500 may then be complete.
An example embodiment may be implemented in which the capturing of the first image step comprises recording the view of the two or more surfaces of the item from a perspective associated with a first position of the item.
The capturing of the second image step comprises recording the view of the at least one of the two or more surfaces from a perspective associated with a second position of the item. The second position is displaced (e.g., laterally, longitudinally, axially, etc.) relative to the first position.
The evaluation of the image may comprise certifying, based on the evaluating step, a charge for a commercial transaction relating to one or more of storing or transporting the item. Alternatively or additionally, the evaluation of the image may comprise certifying, based on the evaluating step, a dimensioner for a commercial use.
An example embodiment may be implemented in which the process 500 and the process 60 (
Example Computer System and Network.
The first computer system 705 is configured operably (e.g., by software code with which it is programmed) as a dimensioner. The first computer system (“dimensioner”) 705 may comprise a mobile device such as a tablet computer, portable data terminal (PDT), smartphone, portable (or personal) digital assistant (PDA) and/or another mobile or portable computing apparatus. The dimensioner 705 may also comprise a fixed or substantially stationary computer system or component thereof. The dimensioner 705 may thus be deployed, disposed, and operated in a fixed location. The fixed location may be disposed in proximity to a site associated with a storage or transport related portal. The storage or transport portal may be associated with a logistic, commercial, industrial, agricultural, military, laboratory (e.g., certification) setting or another facility.
The dimensioner 705 is operable for communicating with other devices, such as the at least one computer 798. The dimensioner 705 is coupled communicatively via the network 728 with the computer 798. The network 728 may comprise a packet-switched data network operable based on transfer control and internetworking protocols (e.g., TCP/IP).
The data network 728 may comprise a portion of one or more other networks and/or two or more sub-network (“subnet”) components. For example, the data network 728 may comprise a portion of the internet and/or a particular wide area network (WAN). The network 728 may also comprise one or more WAN and/or local area network (LAN) subnet components. Portions of the data network 728 may be operable wirelessly and/or with wireline related means. The data network 728 may also comprise, at least in part, a digital telephone network.
The at least second computer (“computer”) 798 may comprise a mobile device. The computer 798 may also be located at a particular location, where it may be disposed in a more or less fixed, or at least stationary position or configuration. In relation to the dimensioner 705, the computer 798 may also be operable as a server and/or for performing one or more functions relating to control or centralized pooling, processing or storage of information gathered or accessed therewith, e.g., with a database 777.
For example, embodiments of the present invention may be implemented in which the dimensioner 705 is operable for sending reports 745 relating to data corresponding to the evaluation of the captured images to the computer 798 over the network 728. The computer 798 may then store the image evaluation related data in the database 777, from which it may be retrieved at a later time. The data retrieved from the database 777 may be used in evaluating other (e.g., subsequent) images.
The dimensioner 705 may also be operable for capturing images photographically (including recording video) and/or scanning and reading barcode patterns and other data presented by graphic media. The dimensioner 705 may also comprise a component 746, which is operable for scanning radio frequency identification (RFID) tags and processing data associated therewith.
The images and data associated with the barcode and/or RFID tags may be sent to the computer 798. In addition to capturing and evaluating images, the dimensioner 705 may also use scanned barcodes (and RFIDs) for reading data (e.g., inventory information, price, etc.) therefrom in relation to associated items (e.g., packages, stock, products, commodities, parts, components, etc.).
The dimensioner 705 may then send the image evaluation report 745, data relating thereto, and/or the scan related data to the computer 798 over the network 728 wirelessly, via the network 728, to the computer 798.
Upon receipt thereof, the computer 798 may be operable for processing the data related to the image evaluations and the scan related data. The scan data may relate to the image evaluation. For example, the scan data may relate to the captured images, measurements associated therewith, and/or surveys of boundaries or other information related to surface features of an item.
The scan data may relate to commercial transactions relating to the transport and/or storage of an item. The scan data may also relate to a sale, transfer or other disposition of the item and associated with the barcode or RFID tag. The processing of the data may thus allow, for example, updating the database 777 in relation to inventory, tracking shipments, etc.) based on the image evaluation and other aspects of the item associated with the scanned surface features and the barcodes (or RFID tags).
The dimensioner 705 comprises a plurality of electronic components, each of which is coupled to a data bus 702. The data bus 702 is operable for allowing each of the multiple, various electronic components of the dimensioner 705 to exchange data signals conductively with each of the other electronic components thereof.
The electronic components of the dimensioner 705 may comprise integrated circuit (IC) devices, including one or more microprocessors. The electronic components of the dimensioner 705 may also comprise other IC devices, such as a microcontroller, field-programmable gate array (FPGA) or other programmable logic device (PLD) or application-specific IC (ASIC).
The microprocessors include a central processing unit (CPU) 704. The CPU 704 is operable for performing general data processing functions related to operations of the dimensioner 705. The electronic components of the dimensioner 705 may also comprise one or more other processors 744. The other microprocessors may also include a graphic processing unit (GPU) and/or digital signal processor (DSP) 704, which are each operable for performing data processing functions that may be somewhat more specialized than the general processing functions, as well as sometimes sharing some of the general processing functions with the CPU 704.
One of the processors 744 may also be operable as a “math” (mathematics) coprocessor. The math co-processor, DSP and/or GPU (“DSP/GPU”) 744 are operable for performing computationally intense data processing. The computationally intense processing relates to imaging, image evaluation, graphics, dimension measurements, wireframe manipulations, coordinate system management, logistics, and other (e.g., mathematical, financial) information.
The data processing operations comprise computations performed electronically by the CPU 704 and the DSP/GPU 744. For example, the microprocessors may comprise components operable as an arithmetic logic unit (ALU), a floating point logic unit (FPU), and associated memory cells. The memory cells comprise non-transitory data storage media, which may be configured as caches (e.g., “L1,” “L2”), registers, latches and/or buffers. The memory cells are operable for storing data electronically in relation to various functions of the processor. For example, a translational look-aside buffer (TLB) may be operable for optimizing efficiency of use of content-addressable memory (CAM) by the CPU 704 and/or the DSP/GPU 744.
The dimensioner 705 also comprises non-transitory computer readable storage media operable for storing data, e.g., electronically. For example, the dimensioner 705 comprises a main memory 706, such as a random access memory (RAM) or other dynamic storage device 706. The main memory 706 is coupled to data bus 702 for storing information and instructions, which are to be executed by the CPU 704. The main memory 706 also may be used for storing temporary variables or other intermediate information during execution of instructions by the CPU 704. Other memories (represented in the present description with reference to the RAM 706) may be installed for similar uses by the DSP/GPU 744.
The dimensioner 705 further comprises a read-only memory (ROM) 708 or other static storage device coupled to the data bus 702. The ROM 708 is operable for storing static information and instructions for use by the CPU 704. In addition to the RAM 706 and the ROM 708, the non-transitory storage media of the dimensioner 705 may comprise at least one data storage device 710. The data storage device 710 is operable for storing information and instructions and allowing access thereto.
The data storage device 710 may comprise a magnetic disk drive, flash drive, or optical disk drive. The data storage device 710 comprises non-transitory media coupled to data bus 702, and may be operable for providing a “virtual memory” function. The virtual memory operations of the storage device 710 may supplement, at least temporarily, storage capacity of other non-transitory media, such as the RAM 706.
The non-transitory storage media of the dimensioner 705 also comprises instructions (“dimensioner instructions”) 755, which is stored (e.g., electronically, magnetically, optically, physically, etc.) in relation to software for programming, controlling, and/or configuring its operations relating to evaluating images and computing measurements of items featured therein. The non-transitory dimensioner instructions 755 may also (or alternatively) be stored in association with the storage 710 and other storage components of the dimensioner 705.
Non-transitory programming instructions, software, settings and configurations related to the evaluation of images are stored (e.g., magnetically, electronically, optically, physically, etc.) by a memory, flash, or drive related non-transitory storage medium 755 and/or with the non-transitory storage medium 710. The non-transitory storage medium 710 may also store a suite 788 of instructions, which relate to a suite of other functional features with which the dimensioner 705 may also be also operable, e.g., for performing other functional features.
An example embodiment may be implemented in which the suite 788 of features relates to applications, tools and tool sets, menus (and sub-menus) and macros associated with functions of dimensioner 705 related to capturing and evaluating images. The suite 788 may also relate to scanning and reading barcode patterns and RFID tags, taking photographs, recording video and/or audio information, telephonic operations, and capturing other data related to images and presentations of graphic media and other information sources.
The dimensioner 705 comprises a user-interactive touchscreen 725, which is operable as a combined graphical user interface (GUI) and display component 725. The touchscreen 725 may comprise a liquid crystal display (LCD), which is operable for rendering images by modulating variable polarization states of an array of liquid crystal transistor components. The touchscreen 725 also comprises an interface operable for receiving haptic inputs from a user.
The haptic interface of the GUI touchscreen 725 may comprise, e.g., at least two arrays of microscopic (or transparent) conductors, each of which is insulated electrically from the other and disposed beneath a surface of the display 725 in a perpendicular orientation relative to the other. The haptic inputs comprise pressure applied to the surface of the touchscreen GUI 725, which cause corresponding local changes in electrical capacitance values proximate to the pressure application that are sensed by the conductor grids to effectuate a signal corresponding to the input.
In an example embodiment, the touchscreen GUI and display component 725 is operable for rendering graphical reports 745 in relation to dimension related image evaluations. The image evaluation reports 745 are rendered by the display 725 upon receipt of data related to the dimensioning and image evaluations from the CPU 704 and/or the GPU/DSP 744.
The touchscreen GUI component 725 may be implemented operably for rendering images over a heightened (e.g., high) dynamic range (HDR), the rendering of the images may also be based on modulating a back-light unit (BLU). For example, the BLU may comprise an array of light emitting diodes (LEDs). The LCDs may be modulated according to a first signal and the LEDs of the BLU may be modulated according to a second signal. The touchscreen 725 may render an HDR image by coordinating the second modulation signal in real time, relative to the first modulation signal.
A plurality of inputs 714 may comprise one or more electromechanical switches, which may be implemented as buttons, escutcheons, or cursor controls. The inputs 714 may also comprise a keyboard. The keyboard may comprise an array of alphanumeric (and/or ideographic, syllabary based) keys operable for typing letters, number, and other symbols. The keyboard may also comprise an array of directional (e.g., “up/down,” “left/right”) keys, operable for communicating commands and data selections to the CPU 704 and for controlling movement of a cursor rendering over the touchscreen GUI display 725.
The directional keys may be operable for presenting two (2) degrees of freedom of a cursor, over at least two (2) perpendicularly disposed axes presented on the display component of the touchscreen GUI 725. A first ‘x’ axis is disposed horizontally. A second ‘y’ axis, complimentary to the first axis, is disposed vertically. Thus, the dimensioner 705 is thus operable for specifying positions over a representation of a geometric plane and/or other coordinate systems.
Audio transducers (“Xducers”) 727 have a microphone function and a speaker function. The microphone function is operable for transducing speech and other sound into corresponding electrical signals, which may be accessed via an interface 718 and processed by one or more of the electronic components of the dimensioner 705. The speaker function is operable for transducing audibly signals accessed via the interface 718, which were generated by the electronic components. The audio transducers and associated interface 714 thus allow the dimensioner 705 to function telephonically and in response to audio user commands.
The dimensioner 705 may be operable for scanning visual data such as barcode patterns and/or other images presented on printed graphic media and/or self-lit electronic displays. Example embodiments of the present invention also relate to the use of the dimensioner 705 for taking photographs and recording video. A camera component 748 is coupled to the data bus 702. The camera component 748 is operable for receiving data related to the scanned barcode patterns.
The camera component 748 is also operable for receiving static and dynamic image data related, respectively, to the photographs and the video. The camera component 748 may receive the data captured from an image sensor 749. The image sensor 749 may comprise an array of charge-coupled devices (CCDs), photodiodes (PDs), or active complementary metal oxide semiconductor (CMOS) based imaging devices. The image sensor 749 may be operable with a system of optical components (“optics”) 747. The dimensioner and image evaluation instructions 755 and the barcode scanning (and other) feature(s) of the mobile device 700 are operable with one or more of the camera component 748, the image sensor component 749, and/or the optics 747.
The electronic components of the dimensioner 705 may also comprise an RFID scanner 746 coupled to the data bus 702. The RFID scanner 746 is operable for scanning RFID tags.
Execution of instruction sequences contained in the main memory 706 causes the CPU 704 to perform process steps associated with operations of the dimensioner 705. One or more microprocessors are operable for executing instructions contained in main memory 706. Additionally and/or alternatively, hard-wired circuitry may be used in place of, or in combination with the software instructions. Thus, the dimensioner 705 is not limited to any specific combination of circuitry, hardware, firmware, and/or software.
The term “computer readable storage medium,” as used herein, may refer to any non-transitory storage medium that participates in providing instructions to the CPU 704 (and the DSP/GPU 744) for execution. Such a medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media comprises, for example, configured/programmed active elements of the CPU 704, the DSP/GPU 744, the non-transitory stored dimensioner instructions 755 and other optical, electronic, or magnetic disks, such as storage device 710. Volatile media comprises dynamic memory associated, e.g., with the RAM 706.
Transmission media comprises coaxial cables, copper wire and other electrical conductors and fiber optics, including the wires (and/or other conductors or optics) that comprise the data bus 702.
Transmission media can also take the form of electromagnetic radiation (e.g., light waves), such as may be generated at radio frequencies (RF), and infrared (IR) and other optical frequencies. Data communications may also be effectuated using other means, including acoustic (e.g., sound related) or other mechanical, vibrational, or phonon related media.
Non-transitory computer-readable storage media may comprise, for example, flash drives such as may be accessible via universal serial bus (USB) or any medium from which a computer can read data.
Various forms of non-transitory computer readable storage media may be involved in carrying one or more sequences of one or more instructions to CPU 704 for execution. For example, the instructions may initially be carried on a magnetic or other disk of a remote computer (e.g., computer 798). The remote computer can load the instructions into its dynamic memory and send the instructions over networks 728.
The dimensioner 705 can receive the data over the network 728 and use an IR, RF or other transmitter means to convert the data to corresponding signals. An IR, RF or other signal detector or receiver (“receiver”) coupled to the data bus 702 can receive the data carried in the corresponding signals and place the data on data bus 702. The operations associated with the transmitter and the receiver may be combined in a transmitter/receiver (transceiver) means. The transmitter, receiver, and/or transceiver means may be associated with the interfaces 718.
The data bus 702 carries the data to main memory 706, from which CPU 704 and the DSP/GPU 744 retrieve and execute the instructions. The instructions received by main memory 706 may optionally be stored on storage device 710 either before or after execution by CPU 704.
The interfaces 718 may comprise a communication interface coupled to the data bus 702. In addition to interfacing audio signals between the data bus 702 and the audio transducers 727, the communication interface is also operable for providing a two-way (or more) data communication coupling to a network link 720, which may connect wirelessly at radio frequencies (RF) to the network 728. Wireless communication may also be implemented optically, e.g., at IR frequencies.
In any implementation, the communication interface 718 sends and receives electrical, electromagnetic, or optical signals that carry digital data streams representing various types of information. The network link 720 provides data communication through the network 728 to other data devices. The communication interfaces 718 may also provide audio signals to the speaker 727.
The network 728 may use one or more of electrical, electromagnetic, and/or optical signals carrying digital data streams. The signals sent over the network 728 and through the network link 720 and communication interface 718 carry the digital data to and from the dimensioner 705. The dimensioner 705 can send messages and receive data, including program code, through the network 728, network link 720, and communication interface 718.
To supplement the present disclosure, this application incorporates entirely by reference the following commonly assigned patents, patent application publications, and patent applications:
Example embodiments of the present invention have thus been described. An example embodiment of the present invention relates to a computer implemented method for evaluating images of items. A first image of the item, having a view of two or more of its surfaces, is captured at a first time. A measurement of at least one dimension of one or more of the two or more surfaces is computed based on the first captured image and stored. A second image of the item, having a view of at least one of the two or more surfaces, is captured at a second time, which is subsequent to the first time. A measurement of the at least one dimension of the at least one of the two or more surfaces is computed. The computed measurement of the at least one dimension of the at least one of the two or more surfaces is compared to the stored first measurement. The computed measurement of the at least one dimension of the at least one of the two or more surfaces is evaluated based on the comparison. The example method may be implemented by a processor component of a computer system, based on instructions stored physically in a non-transitory computer readable storage medium component.
For clarity and brevity, as well as to avoid unnecessary or unhelpful obfuscating, obscuring, obstructing, or occluding features of an example embodiment, certain intricacies and details, which are known generally to artisans of ordinary skill in related technologies, may have been omitted or discussed in less than exhaustive detail. Any such omissions or discussions are unnecessary for describing example embodiments of the invention, and not particularly relevant to understanding of significant features, functions and aspects of the example embodiments described herein.
In the specification and/or figures, typical embodiments of the invention have been disclosed. The present invention is not limited to such example embodiments. The use of the term “and/or” includes any and all combinations of one or more of the associated listed items. The figures are schematic representations and so are not necessarily drawn to scale. Unless otherwise noted, specific terms have been used in a generic and descriptive sense and not for purposes of limitation.
The present application claims the benefit of U.S. patent application Ser. No. 14/715,916 for Evaluating Image Values filed May 19, 2015 (and published Nov. 24, 2016 as U.S. Patent Publication No. 2016/0343176), now U.S. Pat. No. 9,786,101. Each of the foregoing patent application, patent publication, and patent is hereby incorporated by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14715916 | May 2015 | US |
| Child | 15726659 | US |
