Patent Application
20190042846
Methods for identifying objects in which digital scanning of at least one image portion of an image of at least one object to be identified is carried out in at least one method step for the purposes of the digital capture of points of the image are already known.
The invention proceeds from a method for identifying objects, in particular three-dimensional objects, in which digital scanning of at least one image portion of an image of at least one object to be identified is carried out in at least one method step for the purposes of the digital capture of points of the image.
It is proposed that the digital capture, at least of individual points of the image, is carried out at least dependent on a deviation of at least one characteristic of at least two points, in particular dependent on a deviation of at least one characteristic of a point captured most recently in digital fashion in relation to a characteristic of at least one point to be captured digitally. Advantageously, the method comprises at least one method step, in which an object, in particular a physical object, is converted into digital image of the object. Preferably, an object, in particular a physical object, is converted into a digital image of the object by means of at least one image sensor, for example by means of a CCD sensor, by means of a CMOS sensor, by means of a vidicon tube, by means of an iconoscope, by means of a nanosensor, by means of an x-ray sensor or the like. Preferably, at least one portion of an image of an object is digitized by means of at least one image sensor, with at least one image portion of the image being scanned digitally in at least one method step, in particular for the purposes of analyzing digital information items about the at least one image portion of the image. Preferably, individual points of the image are digitally captured at least substantially at the same time as the digital scanning of the at least one image portion of the image, or after the latter in time. Particularly preferably, the at least one image portion of the image is depicted in a manner visible to the operator by means of an optical output unit, in particular after digitization by means of an image sensor. The optical output unit is preferably embodied as a display, for example as an LC display, an LED display, an OLED display or the like.
Here, “digital scanning” should be understood to mean, in particular, an analysis of at least one image portion of an image, in particular of a digital image, of an object. Preferably, digital information items of the at least one image portion of the image, in particular of individual points of the at least one image portion of the image are analyzed during digital scanning of the at least one image portion of the image. Preferably, information items of the at least one image portion of the image, in particular of individual points of the at least one image portion of the image, encoded in binary are analyzed during digital scanning of the at least one image portion of the image. Advantageously, there is scanning of the at least one image portion of the image, in particular scanning for facilitating finding changes in at least one characteristic of at least two points, during digital scanning of the at least one image portion of the image.
The expression “digital capture” should in particular, define storage, in particular at least temporary storage, of at least one digital information item, in particular of at least one individual point of at least one image portion of an image of an object, on a digital storage medium and/or generation of at least one digital data string, in particular an individual digital data string, for at least one individual point of at least one image portion of an image of an object. The digital information item and/or the data stream for at least one individual point of the at least one image portion of the image may, for example, comprise at least one coordinate, at least one color value, at least one encryption value, at least one metadata value of an optical capture apparatus, in particular of the image sensor, at least one control value, at least one session ID, at least one enumeration value, at least one time value, at least one global location characteristic, at least one alignment value and/or at least one other value appearing expedient to a person skilled in the art. By way of example, the metadata value of the optical capture unit, in particular of the image sensor, may be embodied as a stop number, as an illumination time, as an ISO value or as another metadata value appearing expedient to a person skilled in the art. Particularly preferably, there is a digital capture of only individual points of the at least one image portion. Advantageously, there is digital capture of only individual points of the at least one image portion in at least one method step, wherein, in particular, a digital capture of all points of the at least one image portion of the image is prevented, in particular in the presence of a low-speed data connection between a mobile apparatus for digital capture of individual points and a data processing apparatus, in particular an external data processing apparatus, for processing captured points for the purposes of identifying an object.
Preferably, in at least one method step, at least one digital information item and/or at least one data string for at least one individual point of at least the image portion of the image is stored, in particular stored in a text file, and transferred for processing to a data processing apparatus, in particular to an external data processing apparatus. Preferably, only one digital information item and/or one data string of a point is captured, in particular written to a text file, when a change in at least one characteristic is detected in comparison with a digital information item and/or a data string of at least one point captured previously during the course of digital capturing. Preferably, at least one coordinate and at least one digital value for the deviation of the at least one characteristic or at least one digital value of the characteristic itself is captured digitally, in particular stored and/or written to a text file, when identifying a deviation of at least one characteristic. By way of example, the digital scanning and/or the digital capture starts at a point with the coordinates (0/0) with the characteristic x, such as e.g. a “black” color value, a “dark” brightness, or the like. In particular, points scanned following the starting point are analyzed in respect of the deviation of characteristics from the characteristic x. By way of example, if a deviation from the characteristic x is identified at a point, for example with the coordinates (2/5), during digital scanning, said point is captured digitally, in particular stored and/or written to a text file, with the coordinates thereof, in this case with the coordinates (2/5) by way of example, and with the deviating characteristic y. Preferably, at least the coordinates and the at least one characteristic of a point form a digital information item and/or a data string of the point.
By means of the configuration of the method according to the invention, a fast capture of relevant digital information items may advantageously be facilitated for the purposes of identifying and/or classifying objects. In particular, a digital capture of relevant points for the purposes of identifying an object may advantageously be facilitated within a short time interval. Advantageously, an amount of data which is usable for identifying objects may be kept small. Advantageously, a concentration of a digital capture may be directed to a presence of deviations of at least one characteristic, in particular of individual characteristics, of points of at least one image portion of an image of an object to be identified in order to advantageously facilitate a time-saving and data-amount-saving evaluation of captured data.
Furthermore, it is proposed that individual points of the image are captured digitally, at least dependent on a deviation of at least one color value of the at least two points, in particular dependent on a deviation of at least one color value of a point captured most recently in digital fashion in relation to a color value of at least one point to be captured digitally. Preferably, a digital capture of individual points is carried out at least dependent on a deviation of at least one RGB color value of the point captured most recently in digital fashion in relation to an RGB color value of at least one point to be captured digitally. Preferably, a color tolerance measure is predeterminable. By way of example, a point with an RGB color value of between “0” and “10” may be analyzed as “black” RGB color dependent on a color tolerance measure, wherein a point with an RGB color value greater than “10” may be analyzed as “dark blue” RGB color, or the like. An application of another color tolerance measure appearing expedient to a person skilled in the art is likewise conceivable. Moreover, it is also conceivable for the color tolerance measure to be adjustable in an automatic and/or manual manner dependent on at least one ambient parameter, such as e.g. a light incidence, light intensity, or the like. There may advantageously be time-saving digital scanning and/or time-saving digital capture of individual points by means of the configuration according to the invention. There may advantageously be fast digital scanning of the at least one image portion of the image on the basis of at least one deviation of at least one color value.
Advantageously, generating and/or processing an advantageously small amount of data may be achieved in order to obtain relevant information items within a short time interval for the purposes of identifying an object.
Further, it is proposed that individual points of the image are captured digitally, at least dependent on a deviation of at least one brightness value of the at least two points, in particular dependent on a deviation of at least one brightness value of a point captured most recently in digital fashion in relation to a brightness value of at least one point to be captured digitally. Preferably, a brightness tolerance measure is predeterminable. By way of example, a point with a brightness value close to a reference white may be analyzed as bright dependent on a brightness tolerance measure, wherein a point with a brightness value close to a reference black may be analyzed as dark, or the like. An application of another brightness tolerance measure appearing expedient to a person skilled in the art is likewise conceivable. Moreover, it is also conceivable for the brightness tolerance measure to be adjustable in an automatic and/or manual manner dependent on at least one ambient parameter, such as e.g. a light incidence, light intensity, or the like. There may advantageously be time-saving digital scanning and/or time-saving digital capture by means of the configuration according to the invention. There may advantageously be fast digital scanning of the at least one image portion of the image on the basis of at least one deviation of at least one brightness value. Advantageously, generating and/or processing an advantageously small amount of data may be achieved in order to obtain relevant information items within a short time interval for the purposes of identifying an object.
Moreover, it is proposed that digital scanning of the image occurs along an image direction of the at least one image portion of the image in at least one method step, said image direction extending at least substantially diagonally. Here, in particular, “at least substantially diagonal” should be understood to mean a direction extending across an image portion of an image, in particular extending across the image portion from one corner of an image portion to a further corner of the image portion. Preferably, a direction with a small deviation from an image diagonal, in particular a deviation of less than 20° or a parallel offset of less than 50 mm, should be understood also to mean extending at least substantially diagonally. It is conceivable for the method to be embodied independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points, in an alternative configuration. Preferably, the method in the alternative configuration, in particular in the configuration embodied independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points, comprises at least one method step in which digital scanning of at least one image portion of an image of at least one object to be identified is carried out for the purposes of digital capture of points of the image, wherein digital scanning of the image occurs along an image direction of the at least one image portion of the image in at least one method step, said image direction extending at least substantially diagonally. By means of the configuration according to the invention, there may advantageously be digital scanning of at least one image portion of an image within a short time interval. Advantageously, a fast analysis of at least one image portion of an image may be facilitated since, in particular, a subset of an overall number of points of at least one image portion of an image, arranged in the vicinity of an image diagonal or on the image diagonal of the at least one image portion of the image, is scanned digitally.
Furthermore, it is proposed that digital capture of individual points of the image occurs along an image direction of the at least one image portion of the image in at least one method step, said image direction extending at least substantially diagonally. It is conceivable for the method to be carried out independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points in an alternative configuration. Preferably, the method in the alternative configuration, in particular in the configuration embodied independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points, comprises at least one method step in which there is digital scanning of at least one image portion of an image of at least one object to be identified for the purposes of the digital capture of points of the image, wherein digital capture of individual points of the image occurs along an image direction of the at least one image portion of the image in at least one method step, said image direction extending at least substantially diagonally. By means of the configuration according to the invention, a large information item content may be advantageously captured within a short time interval from the at least one image portion of the image. Advantageously, a fast capture of individual points of at least one image portion of an image may be facilitated since, in particular, a subset of an overall number of points of at least one image portion of an image, arranged in the vicinity of an image diagonal or on the image diagonal of the at least one image portion of the image, is captured digitally.
Further, it is proposed that a grid is used in at least one method step for digital scanning of the at least one image portion of the image and/or for digital capture of individual points of the image. Here, in particular, a “grid” should be understood to mean a digital aid, in which scanning points or capture points have a predetermined distance from one another and/or a predetermined arrangement in relation to one another. Preferably, the grid has a mesh-like, in particular a polygon-mesh-like or circular-ring-mesh-like embodiment. Preferably, a pitch of the grid is modifiable. Preferably, the pitch specifies the number of scanning points or capture points in relation to a length of a path, such as e.g. a pitch of two points per centimeter (2 p/cm) or the like. Preferably, digital scanning of the at least one image portion of the image and/or digital capture of individual points is started at a corner point or a central point of the at least one image portion of the image, wherein the corner point or the central point is assigned, in particular, coordinates (0/0) of a Cartesian coordinate system, in particular of a two-dimensional Cartesian coordinate system. Preferably, there is digital scanning of the at least one image portion of the image and/or digital capture of individual points in accordance with the grid. By way of example, a point with the coordinates (0/0) is digitally scanned and/or digitally captured, wherein a grid with a pitch of e.g. 1 p/cm is used such that a next point to be scanned digitally has a distance of 1 cm from the point (0/0), in particular a radial distance proceeding from the point (0/0) in the case of a circular-ring-mesh-like configuration of the grid. Advantageously, reproducible scanning of the at least one image portion of the image may be achieved by means of the configuration according to the invention. Advantageously, time-saving digital scanning of the at least one image portion of the image and/or time-saving digital capture of individual points may be achieved.
Moreover, it is proposed that at least one characteristic of the grid is modified dependent on at least one characteristic of the at least one image portion of the image. It is conceivable for the method to be embodied independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points in an alternative configuration. Preferably, the method in the alternative configuration, in particular in the configuration embodied independently of the digital capture of individual points of the image at least dependent on a deviation of at least one characteristic of at least two points, comprises at least one method step in which there is digital scanning of at least one image portion of an image of at least one object to be identified for the purposes of a digital capture of point of the image, wherein, in at least one method step, a grid is used for digital scanning of the at least one image portion of the image and/or for digital capture of individual points of the image and at least one characteristic of the grid is modified dependent on at least one characteristic of the at least one image portion of the image. The at least one characteristic of the grid is preferably embodied as pitch of the grid.
However, it is also conceivable for the at least one characteristic of the grid to be embodied as a different characteristic of the grid appearing expedient to a person skilled in the art, such as e.g. a grid type (square-like grid, web-like grid, circular-ring-like grid, point-like grid or the like) of the grid, or the like. The at least one characteristic of the at least one image portion of the image may be embodied as an arrangement of objects in the image portion (foreground, background, or the like), as location characteristic of the image portion (e.g. as coordinate of a scanning point/capture point in the image portion), as an operator selection of a region of the image portion or as a different characteristic of the at least one image portion of the image appearing expedient to a person skilled in the art. Preferably, the grid is modified dynamically, in particular dependent on a location characteristic of the image portion, such as e.g. dependent on coordinates of a scanning point and/or capture point within the at least one image portion of the image, during digital scanning of the at least one image portion of the image and/or during digital capture of individual points. Advantageously, fast digital scanning of the at least one image portion of the image may be facilitated by means of the configuration according to the invention. Different regions of the at least one image portion of the image may be digitally scanned with different grids in order to facilitate an advantageous digital capture of relevant points within a short time interval.
Furthermore, it is proposed that a pitch of the grid in a vicinity of the central point of the at least one image portion of the image is narrower than in an edge region of the at least one image portion of the image.
Preferably, the central point of the at least one image portion of the image is embodied as geometric central point of the at least one image portion of the image. The term “vicinity” should in this case, in particular, be understood to mean a set of points surrounding a point, a unit and/or an element, wherein a point of the set of points at the greatest distance from the point, the unit and/or the element has a maximum distance from the unit and/or from the element of, in particular, less than 30 mm, preferably less than 20 mm and particularly preferably less than 10 mm. Here, in particular, an “edge region” should be understood to mean a region of the at least one image portion of the image which has a maximum distance of in particular less than 50 mm, preferably less than 40 mm and particularly preferably less than 20 mm from an edge delimiting the at least one image portion of the image. By means of the configuration according to the invention, a large amount of information may advantageously be captured digitally in the vicinity of a central point of the at least one image portion of the image, said amount of information being evaluable for the purposes of identifying an object, in particular wherein a smaller number of relevant information items is to be expected in the edge region of the at least one image portion of the image. It is possible to advantageously achieve fast and informative digital scanning and/or fast and informative digital capture of individual points in the vicinity of the central point of the at least one image portion of the image, said individual points very probably being very meaningful in relation to an object to be identified.
Further, it is proposed that there is a digital capture of points with a smaller deviation from at least one characteristic in a vicinity of a central point of the at least one image portion of the image than in an edge region of the at least one image portion of the image.
Preferably, a tolerance field of a deviation of at least one characteristic in a vicinity of a central point of the at least one image portion of the image is smaller than in an edge region of the at least one image portion of the image. By way of example, a point in an edge region of the at least one image portion of the image, said point having a characteristic embodied as an RGB color value which has a value between “0” and “10”, is analyzed as a “black” RGB color, with a further point in the vicinity of a central point of the at least one image portion of the image, said further point having a characteristic embodied as an RGB color value which has a value greater than “5”, being analyzed as “dark blue”. Other tolerance fields of a deviation and/or characteristics other than a color value which may be taken into account during a digital capture are likewise conceivable. Advantageously, focusing an information item capture dependent on a capture location may be facilitated by means of the configuration according to the invention. Advantageously, a large number of relevant points can be captured quickly.
Moreover, it is proposed that at least one characteristic of a grid is modified dependent on at least one database characteristic of digital images of objects which are stored in a memory unit. By way of example, the database characteristic may be an occurrence probability of a characteristic in at least one region of digital images of objects stored in the memory unit, an arrangement of colors in individual regions of digital images of objects stored in the memory unit, an arrangement of text in individual regions of digital images of objects stored in the memory unit, an arrangement of a machine-readable character code in individual regions of digital images of objects stored in the memory unit or another characteristic appearing expedient to a person skilled in the art. By way of example, a probability of a deviation from characteristics in the vicinity of a central point of an image stored in the memory unit is small such that, for example, a pitch of a grid is set to be wider in the vicinity of a central point of at least one image portion of an image of an object to be scanned than in an edge region of the at least one image portion of the image to be scanned. Moreover, it is also conceivable, for example, that an occurrence probability for a characteristic embodied as a color value with a value for “gray” is low in the vicinity of a central point of an image stored in a memory unit, and so digital scanning of at least one image portion of an image of an object to be scanned is prioritized for points with a “gray” color value in the vicinity of the central point in order to facilitate a fast reduction of possible hits or a fast assignment to an image of a stored object which is stored in the memory unit, for the purposes of identifying an object. Advantageously, a dynamic change of a grid for digital scanning of at least one image portion of an image of an object and/or for digital capture of individual points of the at least one image portion may be achieved by means of the configuration according to the invention in order, advantageously, to facilitate a fast identification and/or classification of an object.
Moreover, it is proposed that at least one edge profile of the image of the at least one object to be identified is captured digitally in at least one method step. Preferably, 3D data, in particular 3D-CAD data, of objects is stored in a memory unit, it being possible to compare said data with the digitally captured edge profiles. In particular, at least a contour of an object is captured by the digital capture of at least one edge profile. By means of the configuration according to the invention, capturing a few points for a digital capture of an edge profile can advantageously allow a form of an object to be reliably identified. Advantageously, a fast classification and/or a fast identification of an object may be facilitated on the basis of an identified form.
Further, it is proposed that a dimension and/or an arrangement of the at least one image portion of the image to be scanned digitally are/is predetermined by an operator in at least one method step. Particularly preferably, a variable and/or an arrangement of the at least one image portion of the image to be scanned are/is predetermined by an operator by means of a touch-sensitive optical output unit, in particular after digitization by means of an image sensor. By way of example, an operator may prescribe that digital scanning of an image only takes place in at least one image portion of the image having text. Furthermore, it is conceivable, for example, for an operator to adapt the size of a scanning window to the size of writing arranged on an object, graphics arranged on an object, or the like. Further prescriptions of the size and/or arrangement of the at least one image portion of the image to be scanned which appear expedient to a person skilled in the art are likewise conceivable.
Advantageously, an operator input may be taken into account by means of the configuration according to the invention for the purposes of a fast identification and/or classification of an object. A region of the image appearing relevant from the view of the operator may advantageously be selected by an operator in order to facilitate a reliable identification and/or classification of an object. Advantageously, a reduction in the digital scanning computational outlay caused by the operator input and/or reduction in the digital capture outlay caused by the operator input, for example as a consequence of selecting a small image portion of an image of an object, may be achieved.
Moreover, it is proposed that, in at least one method step, there is a digital capture of individual points of the image dependent on an identification of a machine-readable character code, in particular a barcode and/or a QR code, in the at least one image portion of the image. Particularly preferably, a digital capture of points is ceased if a machine-readable character code, in particular a barcode and/or a QR code, is identified and the machine-readable character code is read. By way of example, if a machine-readable character code is identified in an edge region and/or in a background of the at least one image portion of the image, a digital capture of points is continued, in particular according to the previously described method steps. By way of example, if a machine-readable character code is identified in the vicinity of a center and/or in a foreground of the at least one image portion of the image, a digital capture of points is ceased and the machine-readable character code is read. By means of the configuration according to the invention, a dynamic adaptation of the method according to the invention can be advantageously carried out if a machine-readable character code is identified. Advantageously, a fast identification and/or a fast classification of an object may be facilitated.
Further, it is proposed that at least one global location characteristic and/or at least one weather characteristic is/are taken into account in at least one method step during a comparison of digitally captured points of the image with data of images of objects stored in a memory unit. The global location characteristic may be embodied as a compass characteristic, a Galileo location characteristic, a GLONASS location characteristic, a Beidou location characteristic, a GPS location characteristic, or the like. The weather characteristic may be embodied as an air-pressure characteristic, a precipitation characteristic, a number-of-sun-hours characteristic, a strength-of-wind characteristic, or the like. By way of example, it is conceivable that a location characteristic embodied as a GPS location characteristic is taken into account when comparing digitally captured points of the image with data of images of objects stored in a memory unit for the purposes of facilitating an assignment of an object identification to a business X, for example a carpenter's workshop, wherein the assignment is usable for identifying an object since, for example, a carpenter's workshop will, with a high probability, wish to identify an object for wood processing or an object made of a wood material. Preferably, there may be a restriction of possible objects stored in the memory unit on the basis of these additional information items in order to facilitate a fast identification and/or fast classification. Moreover, it is also conceivable that the at least one global location characteristic and/or the at least one weather characteristic are/is taken into account during digital scanning and/or digital capture in at least one method step. By way of example, during digital scanning and/or digital capture in the case of a weather characteristic embodied as a precipitation characteristic, it is possible to take into account that a image of an object to be scanned may have points which, for example, have images of water droplets, wherein these points are preferably excludable from digital scanning and/or from digital capture or are digitally processable after digital scanning and/or after digital capture. Advantageously, further characteristics, which contribute to a fast identification and/or fast classification of an object, may be taken into account by means of the configuration according to the invention. Advantageously, additional information items after a successful identification and/or a successful classification of an object may be output to an operator dependent on at least one global location characteristic which was taken into account and/or at least one weather characteristic which was taken into account.
Moreover, it is proposed that, in at least one method step, operator data are taken into account in a comparison of digitally captured points of the image with data of images of objects which are stored in a memory unit. By way of example, the operator data may be an education state, a place of work type (carpenter's workshop, steel construction, house construction, vehicle construction, vehicle service or the like), an identification search query behavior, login data, personal data and/or further operator data appearing expedient to a person skilled in the art. Filtering in order to facilitate a fast identification and/or a fast classification of an object may advantageously be facilitated by means of the configuration according to the invention.
Furthermore, it is proposed that the digitally captured points are encrypted, in particular prior to a transfer to a data processing apparatus, in particular an external data processing apparatus. The digitally captured points are preferably encrypted using an encryption standard, already known to a person skilled in the art, for encrypting digital data. Particularly preferably, the digitally captured points are encrypted at least by means of an encryption standard according to a secure hash algorithm 1 (SHA 1). However, it is also conceivable for the digitally captured points to be encrypted by means of another encryption standard appearing expedient to a person skilled in the art, such as, for example, a future version of the encryption standard according to a secure hash algorithm, or for the digitally captured points to be encrypted by means of a plurality of encryption standards. The configuration according to the invention may advantageously facilitate a secure data transfer. Advantageously, a high security against the use of data by unauthorized third parties may be facilitated.
Furthermore, it is proposed that an operator input in respect of a type of object to be identified is taken into account in at least one method step. Preferably, there is a preselection of a type of an object to be identified in at least one method step, in particular prior to digital scanning of at least one image portion of an image of an object and/or prior to a digital capture of individual points of the image. By way of example, an operator specifies, in at least one method step, that an object to be identified is a hand-held power tool, a refrigerator, a car, a clock, a vacuum cleaner, a gardening machine or the like, with this operator input being taken into account during digital scanning of at least an image portion of an image of an object and/or prior to a digital capture of individual points of the image. Advantageously, a restriction of possible objects may already take place in an early method step. Advantageously, a fast identification and/or fast classification of an object may be facilitated.
Furthermore, it is proposed that digital scanning of the at least one image portion of the image is carried out by means of mobile apparatus which, for the purposes of transferring digital data, is connected to an external data processing apparatus. The mobile apparatus may be embodied as a portable telephone, in particular as a smartphone, as a tablet, as a laptop, as an notebook, as a phablet, as a personal computer (PC), as a mobile robot, as data glasses, as a computer which may be integrated into a piece of clothing, as an autonomous implement, as a hand-held scanner or as any other mobile apparatus appearing expedient to a person skilled in the art. Preferably, the mobile apparatus comprises at least one image sensor for digitizing at least one image portion of an image of an object. Preferably, the mobile apparatus comprises at least one optical output unit for displaying the at least one image portion of the image. The mobile apparatus is preferably provided to be connected wirelessly to an external data processing apparatus for the purposes of transferring digital data.
However, it is also conceivable for the mobile apparatus to be connected, alternatively or additionally, to the external data processing apparatus by means of wires for the purposes of transferring digital data. It is further conceivable for the mobile apparatus and the data processing apparatus to be arranged in a common apparatus, for example an apparatus embodied as a car, as a truck, as an autonomous robot or the like, and to communicate with one another by means of a wireless and/or wired data connection. Preferably, the mobile apparatus is provided for digital scanning, a digital capture and/or a transfer, wherein the external data processing apparatus is preferably provided for further processing, in particular for a comparison and/or an evaluation. However, it is also conceivable that the mobile apparatus is provided for digital scanning, digital scanning for a comparison and/or for an evaluation of data. In particular, “provided” should be understood to mean specifically configured, specifically equipped and/or specifically programmed. An element, a unit and/or an apparatus being provided for specific function should, in particular, be understood to mean that the element, the unit and/or the apparatus fulfill/fulfills and/or carry/carries out this specific function in at least one application and/or operating state. There may advantageously be digital scanning and/or digital capture of points for the purposes of identifying an object in a location-independent manner by means of the configuration according to the invention.
Moreover, it is proposed that an acceleration characteristic and/or an alignment characteristic of the mobile apparatus are/is taken into account in at least one method step. It is conceivable that, alternatively or additionally, at least one further characteristic of the mobile apparatus is taken into account, such as e.g. a radar characteristic, an infrared characteristic, a sonar characteristic, a laser characteristic, a ranging characteristic, a time-of-flight-measurement characteristic or the like. By means of the configuration according to the invention, at least one characteristic of the mobile apparatus may be advantageously evaluated for a fast identification and/or fast classification of at least one object. By way of example, a movement of the mobile apparatus relative to an object to be identified may advantageously be evaluated as a consequence of taking into account an acceleration characteristic, wherein, in particular, digital scanning of different image portions of an image of an object is realizable. By way of example, an alignment characteristic of the mobile apparatus may advantageously be taken into account in order to advantageously facilitate digital scanning and/or digital capture from different angles.
Furthermore, it is proposed that a number of items and/or a size of digital data is/are controlled and/or regulated dependent on a speed of a data connection between the mobile apparatus and the external data processing apparatus. Advantageously, a dynamic adaptation of a number of items and/or a size of digital data may be facilitated dependent on a speed of a data connection. Preferably, a digital capture of individual points is carried out at least substantially at the same time as a digital scanning, with a transfer of individual digitally captured points from the mobile apparatus to the external data processing apparatus being carried out directly following a digital capture in time. Advantageously, there may be processing of data at least largely in real time. Preferably, if a data connection between the mobile apparatus and the external data processing apparatus has a speed of more than 1 MBit/s, there is a transmission of the entire image of the at least one object to be identified, in particular in addition to a transfer of individual captured points. In particular, in at least one method step, there is a digital capture of all points of the at least one image portion of the image which are transferred individually and/or in collected fashion from the mobile apparatus to the external data processing apparatus dependent on a speed of a data connection between the mobile apparatus and the external data processing apparatus. Advantageously, it is possible to flexibly react to a current speed of a data connection in order to facilitate a fast recognition and/or a fast classification of an object in the case of a change in a speed of a data connection or if a low speed of a data connection is present.
Moreover, it is proposed that a comparison of transferred data with data of images of objects stored in a memory unit of the data processing apparatus, in particular the external data processing apparatus, is carried out by means of at least one computing unit of the data processing apparatus. This may advantageously facilitate that the mobile apparatus requires a low computational power for digital scanning and/or for digital capture and computing processes which prefer a high computational power are carried out by means of the computing unit of the data processing apparatus.
Furthermore, it is proposed that digital scanning of the at least one image portion of the image of the at least one object to be identified by means of the mobile apparatus is influenced, at least in part, by the computing unit of the data processing apparatus. It is conceivable that the data processing apparatus generates scanning commands and/or capture commands on the basis of stored data, said commands being transferred to the mobile apparatus. By way of example, it is conceivable that a digital scanning and/or a digital capture only takes place in edge regions of the at least one image portion by way of the scanning commands and/or the capture commands because, for example, an evaluation of images of objects stored in a memory unit taking account of a previously carried out digital scanning and/or digital capture of the at least one image portion of the image has yielded that the edge regions of the at least one image portion are relevant for identifying an object. Advantageously, a dynamic adaptation of a method procedure can be facilitated in order to facilitate a fast identification and/or fast classification of an object.
Further, it is proposed that there is preprocessing of the at least one image portion of the image by means of a computing unit of the mobile apparatus. Here, in particular, the term “preprocessing” should define carrying out at least one method step, in particular digital scanning, a digital capture, digital processing or the like, prior to a further method step, in particular prior to a transfer of digital data from the mobile apparatus to the data processing apparatus, an evaluation of transmitted digital data by means of the data processing apparatus, or the like. Preferably, the at least one image portion of the image is preprocessed in the form of digital scanning of the at least one image portion of the image and/or in the form of a digital capture of individual points of the image by means of the computing unit of the mobile apparatus. By means of the configuration according to the invention, there may advantageously be processing of digital data for further processing in an earlier method step. Preferably, less computational power is sufficient for preprocessing such that a cost effective mobile apparatus is usable for carrying out preprocessing. Advantageously, there may be a digitization of at least one image portion of an image into a data format expedient for further processing.
Moreover, it is proposed that the preprocessing of the at least one image portion of the image is carried out at least before a transfer of digital data of the at least one image portion of the image to the external data processing apparatus. During preprocessing by means of the computing unit of the mobile apparatus, at least individual points of the image are preferably analyzed digitally and individual data strings for the individual points are preferably generated, in particular before at least the individual points are transferred to the data processing apparatus, in particular transferred to the data processing apparatus for evaluation purposes. Advantageously, an adaptation and/or conversion of digital data into a data format that can easily be processed by the data processing apparatus can be facilitated. Advantageously, there can be a preselection of relevant data prior to a transfer of data, and so, advantageously, fast processing of the transferred data may be facilitated.
Furthermore, it is proposed that the at least one image portion of the image is preprocessed, at least before carrying out a text recognition. Preferably, at least one contrast characteristic of the at least one digitally captured point is at least changed before carrying out a text recognition. Preferably, at least one color value of the at least one digitally captured point is changed before carrying out a text recognition. In particular, at least one color value of the at least one digitally captured point is changed by means of a digital filter. Preferably, all color values of digitally captured points of the image portion are converted to the “black” or “white” color value before carrying out a text recognition. In particular, the color values are converted dependent on a comparison of a color value of a digitally captured point with a threshold stored in a database of the data processing apparatus. Preferably, there is a change in at least one contrast characteristic of the digitally captured image portion, at least in part of the image portion. Particularly preferably, the use of a digital filter function for the whole image portion is determined on the basis of the change in contrast in the at least one part of the image portion. In particular, a size of at least one individual letter, stored in a database of the data processing apparatus, is used in respect of a size, to be selected, of the at least one part of the image portion. By means of the configuration according to the invention, different texts or letters can be advantageously converted into a processable form.
Advantageously, fast processing of the data for text recognition may be facilitated.
Further, it is proposed that instructions are output to an operator in at least one method step, said instructions at least comprising movement instructions for moving a mobile apparatus provided for capturing digital points of the image, relative to the object to be identified. By way of example, it is conceivable that there is an output to an operator to carry out a movement of the mobile apparatus around the object to be identified in order, in particular, to identify text extending around the object or in order to identify the shape of the object. Moreover, it is conceivable, for example, that there is an output to an operator to carry out a movement of the mobile apparatus, relative to the object to be identified, along a longitudinal axis of the object to be identified in order to identify a maximum dimension. Further, it is for example conceivable that there is an output to an operator to carry out a movement of the mobile apparatus, relative to the object to be identified, along a direction extending at least substantially across a longitudinal axis of the object to be identified in order to generate a depth information item in respect of the object to be identified. Further outputs, appearing expedient to a person skilled in the art, to an operator to move the mobile apparatus relative to the object to be identified are likewise conceivable. Advantageously, there may be expedient digital scanning of an object to be identified by means of the configuration according to the invention. Advantageously, an operator assistance may be realized in order to facilitate reliable digital scanning of the object to be identified. A fast identification and/or fast classification of an object may advantageously be facilitated by means of the operating instructions because relevant regions of an object to be identified are digitally analyzable and/or digitally capturable in a targeted manner.
Moreover, it is proposed that the digitally captured points of the at least one image portion of the image are combined to form an image data record in at least one method step, wherein a plurality of image data records are generated for an object to be identified, said image data records differing from one another at least in view of at least one image portion characteristic, in particular in view of at least one arrangement of the image portion relative to an overall image of an object, in view of at least one alignment of the image portion, or the like. Preferably, the image data records differ at least in an image portion characteristic formed as a scanning and/or capture angle. By way of example, for the purposes of digitally scanning the at least one image portion and/or for digitally capturing individual points, an operator holds the mobile apparatus over an object to be identified, wherein, as a consequence of muscular movements, in particular involuntary muscular movements, of the operator, minimal movements of the mobile apparatus are caused relative to the object to be identified, leading to different scanning and/or capture angles. In particular, individual image portions of an image are stored, at least temporarily, by means of the mobile apparatus for digital scanning and/or digital capture of individual points. Advantageously, there may be a digital capture of individual points for each one of the individually generated image portions of an image which, in particular, are transferable to the data processing apparatus for evaluation purposes. It is also conceivable for a change of the scanning and/or capture angle to be controllable and/or regulable by means of the computing unit of the mobile apparatus. Preferably, the mobile apparatus comprises a movable recording lens unit comprising at least one drive for moving a lens. Further configurations and/or procedures for obtaining different image portions of an image which appear expedient to a person skilled in the art are likewise conceivable.
Preferably, the image data records have at least a common subset, in particular at least a common data string, of an individual point. Using the configuration according to the invention, very different information items may be generated advantageously from different image portions of an image within a short period of time, said information items being usable for a fast identification and/or a fast classification of objects.
Furthermore, it is proposed that the image data records are superposed in at least one method step. Preferably, each image data record defines a two-dimensional image of an image portion. Preferably, individual points are compared to one another dependent on coordinates of the points during the superposition of image data records. By means of the configuration according to the invention, it is possible, advantageously, to analyze striking points in more detail in order to facilitate fast identification and/or fast classification of an object.
Further, it is proposed that a new color value, in particular a “transparent” color value, is assigned to the digitally captured points of the image data records, in particular to the digitally captured points of the image data records which have a “white” color value, at least during a superposition of the image data records.
In particular, mirroring surfaces of an object to be identified and/or plastic packaging, which generate light reflections, are generated as digitally captured points of the image which have a “white” color value in the case of a digital capture. In particular, a new color value, in particular a “transparent” color value, are assigned to these digitally captured points prior to, or during, a superposition. By means of the configuration according to the invention, it is advantageously possible to remove by calculation unwanted light reflections from the digitally captured images by way of a superposition of different image data records.
Moreover, it is proposed that at least one new image portion of an image of the at least one object to be identified is calculated from the superposition of the image data records. By means of the configuration according to the invention, it is possible, advantageously, to generate unique digital images of an object which are usable for fast identification and/or a fast classification of an object.
Moreover, it is proposed that, in at least one method step, use is made of at least one aid, which is standardized or normalized in respect of the dimensions thereof, for capturing at least one spatial dimension of the object to be identified. The standardized or normalized aid may be embodied as millimeter paper, as a DIN sheet, as a grid sheet or as a different standardized or normalized aid appearing expedient to a person skilled in the art. By means of the configuration according to the invention, a determination of size can be advantageously facilitated during a digital scanning and/or during a digital capture.
Further, it is proposed that the method comprises at least one self-learning function which is based on a manual operator confirmation and/or an adaptation of an operator behavior. Preferably, the self-learning function is based on the application of a neural network.
Preferably, whether an identification of an object was correct or incorrect is learned on the basis of a manual operator confirmation. An evaluation of a probability, for example a similarity factor or the like, is also conceivable. Preferably, a preferred procedure of individual operators is learned, in particular on the basis of an adaptation of an operator behavior.
Advantageously, great ease of operation may be achieved. Moreover, a reliable identification and/or a reliable classification of an object may be advantageously facilitated by virtue of identifications and/or classifications that have already been carried out being used to optimize future identifications and/or classifications.
Moreover, it is proposed that a plurality of individual digitally captured points are collected prior to a transfer of the digitally captured points to an external data processing apparatus in at least one method step. Preferably, a plurality of individual digitally captured points are collected in the presence of a high-speed data connection since a large amount of data is transferable within a short time interval in the case of a high speed, with a small amount of data being transferable during the same time interval in the case of a low speed of a data connection. Preferably all points of an image are digitally captured and collected prior to a transfer to the data processing apparatus, in particular if a high-speed data connection is present, in at least one method step. Advantageously, there can be preprocessing of a multiplicity of digitally captured points in order to facilitate a fast identification and/or a fast classification of an object.
Furthermore, it is proposed that, in at least one method step, a transfer of digitally captured points to an external data processing apparatus occurs directly following a capture of each individual digitally captured point, in particular if a data connection with a low speed is present. An individual data string of a digitally captured point has a size of a few kilobytes.
Advantageously, a transfer may take place at least substantially in real time, with, advantageously, processing of the digitally captured points by the data processing apparatus being able to be carried out at least substantially in real time in order to facilitate a fast identification and/or a fast classification of an object.
Further, it is proposed that a selection in respect of the direct transfer or the collection of digitally captured points is dependent on a speed of a data connection between a mobile apparatus and an external data processing apparatus. A selection in respect of the direct transfer or the collection of digitally captured points is preferably dependent on a size and/or a number of items of digital data, which are produced by the digital capture. A calculation of a ratio between a speed of a data connection and a size and/or a number of items of digital data generated by the digital capture is also conceivable. Advantageously, a dynamic adaptation of the method according to the invention to a data speed can be facilitated in order to ensure that a fast identification and/or a fast classification of an object may be facilitated in the case of different data speeds.
Moreover, the invention proceeds from a system for identifying objects, in particular three-dimensional objects, comprising at least one mobile apparatus for digital scanning of at least one image portion of an image of at least one object to be identified, for the purposes of a digital capture of points of the image, in particular by means of a method according to the invention, and comprising at least one external data processing apparatus, provided for communication with at least the mobile apparatus. It is proposed that the mobile apparatus comprises at least one collective logic, at least for digital capture of individual points, and the external data processing apparatus has an object identification function which processes the digitally captured points. This may advantageously facilitate that the mobile apparatus requires a low computational power for digital scanning and/or for digital capture and computing processes which prefer a high computational power are carried out by means of the computing unit of the data processing apparatus.
Furthermore, it is proposed that the mobile apparatus comprises at least one alignment sensor and/or acceleration sensor, the captured data of which are processable by the external data processing apparatus for the purposes of identifying the object. Preferably, the mobile apparatus comprises at least one further sensor, appearing expedient to a person skilled in the art, for capturing data which are processable by the external data processing apparatus for the purposes of identifying the object. By way of example, the at least one further sensor may be a depth sensor, a radar sensor, a sonar sensor, an infrared sensor or the like. Preferably, the mobile apparatus comprises at least one evaluation unit for evaluating the data captured by means of the alignment sensor, the acceleration sensor and/or the further sensor. Preferably, the mobile apparatus comprises at least one light-generating unit, in particular a flash-light unit such as e.g. an LED flash-light unit. By way of example, it is conceivable that at least one depth information item of portions of an object is generable by an evaluation of a time-of-flight of light pulses of the flash-light unit. Further evaluations, appearing expedient to a person skilled in the art, of data captured by means of the alignment sensor, the acceleration sensor and/or the further sensor for the purposes of generating information items which are usable during an identification and/or classification are likewise conceivable. Advantageously, information items for a fast identification and/or classification of an object by means of an evaluation of sensor data of the mobile apparatus may be generated by means of the configuration according to the invention.
Further, it is proposed that the mobile apparatus comprises a touch-sensitive input unit for the purposes of selecting the at least one image portion of the image by an operator, said input unit having a selection mask for selecting the at least one image portion of the image, the size of which is modifiable by means of at least one finger of the operator. The touch-sensitive input unit is preferably embodied as a touch-sensitive display of the mobile apparatus. By way of example, the touch-sensitive input unit may be embodied as an LC display, as an LED display, as an OLED display or the like. Advantageously, a simple operability of the mobile apparatus for the purposes of a fast identification and/or a fast classification of an object may be facilitated by means of the configuration according to the invention.
Moreover, it is proposed that the data processing apparatus is embodied as a server or as a cloud. Advantageously, computational processes for identifying and/or classifying an object which prefer high computational power may advantageously be swapped in order to facilitate a fast identification and/or fast classification of an object.
The method according to the invention and/or the system according to the invention should in this case not be restricted to the above-described application and embodiment. In particular, the method according to the invention and/or the system according to the invention may have a number of individual elements, components and units and method steps which deviates from the number specified herein for the purposes of fulfilling a functionality described herein. Moreover, values lying within the stated boundaries of value ranges specified in this disclosure should also be considered to be disclosed and usable as desired.
Further advantages emerge from the following description of the figures. The drawing depicts one exemplary embodiment of the invention. The drawing, the description and the claims contain several features in combination. Expediently, a person skilled in the art will also consider the features individually and combine these to form expedient further combinations.
In the figures:
In at least one method step of the method, there is a conversion 68 of the object 10, in particular the physical object, into a digital image 42 of the object 10. Preferably, a conversion 68 of the object 10, in particular the physical object, into digital image 42 of the object 10 is carried out by means of at least one image sensor 70 (
In at least one method step of the method there is a one-to-one comparison of digital information items of the at least one image portion 16, 16, 18 of the image 42, in particular a one-to-one comparison of the at least one image portion 16, 16, 18 of the image 42 or of the entire image 42, with images stored in the memory unit 30 of the data processing apparatus 34 and/or images to which the data processing apparatus 34 has access as a consequence of a data connection, such as e.g. images of objects 10 which may be found on the Internet, or the like. The images stored in the memory unit 30 of the data processing apparatus 34 may be e.g. 3D-CAD data, digital photos, digital videos or the like. If a correspondence of the digitally captured image 42 with at least one image stored in memory unit 30 of the data processing apparatus 34 as a result of the one-to-one comparison emerges, the method is terminated and an operator is presented with a result. If no correspondence emerges, further method steps of the method of preferably run through.
Preferably, there is preprocessing of the at least one image portion 14, 16, 18 of the image 42 by means of a computing unit 40 of the mobile apparatus 36 in at least one method step of the method. Preferably, there is character code scanning 72 of the at least one image portion 14, 16, 18 of the image 42 in respect of the presence of at least one machine-readable character code 32, in particular a QR code, barcode or the like, in particular simultaneously with the digital scanning 12 and/or the digital capture 20 or with time offset from the digital scanning 12 and/or the digital capture 20, in at least one method step of the method. Preferably, there is text scanning 74 of the at least one image portion 14, 16, 18 of the image 42 in respect of the presence of text, in particular simultaneously with the digital scanning 12 and/or the digital capture 20 or with time offset from the digital scanning 12 and/or the digital capture 20, in at least one method step of the method. Preferably, there is deep-learning data structuring 76 of the at least one image portion 14, 16, 18 of the image 42 in at least one method step of the method in order, for example, to identify more quickly the at least one image portion 14, 16, 18 of the image 42 in the case of a subsequent query, or the like. In particular, deep-learning data structuring 76 of the at least one image portion 14, 16, 18 of the image 42 is carried out simultaneously with the digital scanning 12 and/or with the digital capture 20, or with time offset from the digital scanning 12 and/or the digital capture 20.
Preferably, the method has at least one self-learning function which is based on a manual operator confirmation and/or an adaptation of the operator behavior. The self-learning function preferably comprises the use of a neural network. Further configurations of the self-learning function which appear expedient to a person skilled in the art are also conceivable.
Preferably, there is data string generation 78 of individual points 44, 46 of the at least one image portion 14, 16, 18 of the image 42, in particular as a consequence of the digital capture 20, in at least one method step of the method. By way of example, a data string for at least one individual point 44, 46 of the at least one image portion 14, 16, 18 of the image 42 may comprise at least one coordinate, at least one color value, at least one encryption value, at least one metadata value of an optical capture apparatus, in particular of the image sensor 70, at least one control value, at least one session ID, at least one enumeration value, at least one time value, at least one global location characteristic, at least one alignment value and/or at least one other value appearing expedient to a person skilled in the art.
Preferably, there is a transfer 58 of digital data from the mobile apparatus 36 to a data processing apparatus 34, in particular to an external data processing apparatus 34 (
The digital capture 20 at least of individual points 44, 46 of the image 42 is carried out at least dependent on a deviation of at least one characteristic of at least two points 44, 46, in particular dependent on a deviation of at least one characteristic of a point 44 captured most recently in digital fashion in relation to a characteristic of at least one point 46 to be captured digitally. Preferably, at least one digital information item and/or at least one data string for at least one individual point 44, 46 of the at least one image portion 14, 16, 18 of the image 42 is stored, in particular stored in a text file, during the digital capture 20.
Preferably, a digital information item and/or a data string of a point 46 is only captured, in particular written to a text file, when a change of at least one characteristic in relation to a characteristic occurring in a digital information item and/or in a data string of at least one point 44 captured previously was determined during digital scanning 12. Preferably, at least one coordinate of the point 46 and at least one digital value for the deviation of the at least one characteristic or a digital value of the characteristic itself is captured digitally, in particular stored and/or written to a text file, when identifying a deviation of at least one characteristic. The digital capture 20 of individual points 44, 46 of the image 42 is preferably carried out at least dependent on a deviation of at least one color value of the at least two points 44, 46. Alternatively or additionally, it is conceivable that the digital capture 20 of individual points 44, 46 of the image 42 is carried out at least dependent on a deviation of at least one brightness value of the at least two points 44, 46. By way of example, the digital scanning 12 and/or the digital capture 20 is started at a point 44 with the coordinates (0/0) with the characteristic x, such as e.g. a “black” color value, a “dark” brightness or the like. In particular, points 46 scanned following the point 44 are analyzed in respect of a deviation of characteristics from the characteristic x. By way of example, if a deviation from the characteristics x is identified at a point 46, for example with the coordinates (4/7), during the digital scanning 12, this point 46 is captured digitally, in particular stored and/or written to a text file, with the coordinates thereof, here the coordinates (4/7) in an exemplary manner, and the deviating characteristic y. Preferably, at least the coordinates and the at least one characteristic of a point 44, 46 form a digital information item and/or a data string of the point 44, 46. The digital information item and/or the data string for at least one individual point 44, 46 of the at least one image portion 14, 16, 18 of the image 42 may, for example, comprise at least one coordinate, at least one color value, at least one encryption value, at least one metadata value of an optical capture apparatus, in particular of the image sensor 70, at least one control value, at least one session ID, at least one enumeration value, at least one time value, at least one global location characteristic, at least one alignment value and/or at least one other value appearing expedient to a person skilled in the art.
Digital scanning 12 of the image 42 occurs along an image direction 22 of the at least one image portion 14, 16, 18 of the image 42 in at least one method step of the method, said image direction extending at least substantially diagonally (
A grid 24 is used in at least one method step of the method for digital scanning 12 of the at least one image portion 14, 16, 18 of the image 42 and/or for digital capture 20 of individual points 44, 46 of the image 42. Preferably, the digital scanning 12 of the at least one image portion 14, 16, 18 of the image 42 and/or the digital capture 20 of individual points 44, 46 is carried out in accordance with the grid 24. The grid 24 preferably has a mesh-like, in particular a circular-ring-mesh-like embodiment, with the corner 86 or the central point 26 being used as a starting point of the grid 24 for digital scanning 12 and/or for digital capture 20 and the digital scanning 12 and/or the digital capture 20 being carried out along the image direction 22 extending at least substantially diagonally, in accordance with a pitch of the grid 24 (
At least one characteristic of the grid 24 is modified dependent on at least one database characteristic of digital images of objects 10 which are stored in the memory unit 30 or to which the data processing apparatus 34 has access in at least one method step of the method.
By way of example, the database characteristic may be an occurrence probability of a characteristic of at least one region of digital images of objects 10 stored in the memory unit 30, an arrangement of colors in individual regions of digital images of objects 10 stored in the memory unit 30, an arrangement of text in individual regions of digital images of objects 10 stored in the memory unit 30, an arrangement of a machine-readable character code 32 in individual regions of digital images of objects 10 stored in the memory unit 30 or another characteristic appearing expedient to a person skilled in the art. By way of example, a probability of a deviation from characteristics in the vicinity of a central point of an image stored in the memory unit 30 is small such that, for example, a pitch of the grid 24 is set to be wider in the vicinity of the central point 26 of the at least one image portion 14, 16, 18 of the image 42 of the object 10 to be scanned than in the edge region 28 of the at least one image portion 14, 16, 18 of the image 42 to be scanned. Moreover, it is also conceivable, for example, that an occurrence probability for a characteristic embodied as a color value with a value for “gray” is low in the vicinity of a central point of an image stored in the memory unit 30, and so digital scanning 12 of the at least one image portion 14, 16, 18 of the image 42 of the object 10 to be scanned is prioritized for points 44, 46 with a “gray” color value in the vicinity of the central point 26 in order to facilitate a fast reduction of possible hits or a fast assignment to an image which is stored in the memory unit 30, for the purposes of identifying the object 10.
Preferably, the transfer 58 of the digitally captured points 44, 46 from the mobile apparatus 36 to the data processing apparatus 34 occurs in time after the digital scanning 12 and/or after the digital capture 20 of the individual points 44, 46, for the purposes of further processing, in particular for the purposes of an evaluation 80, by the data processing apparatus 34. The digitally captured points 44, 46 are encrypted in at least one method step of the method, in particular prior to a transfer 58 to the data processing apparatus 34. The digitally captured points 44, 46 are encrypted at least by means of an encryption standard according to a secure hash algorithm 1 (SHA 1). However, it is also conceivable that the digitally captured points 44, 46 are encrypted by means of another encryption standard appearing expedient to a person skilled in the art, such as e.g. a future version of the encrypted standard according to a secure hash algorithm, or that the digitally captured points 44, 46 are encrypted by means of a plurality of encryption standards.
A plurality of individual digitally captured points 44, are collected prior to the transfer 58 of the digitally captured points 44, 46 to the data processing apparatus 34, in particular the external data processing apparatus 34, in at least one method step of the method. In at least one method step of the method, the transfer of digitally captured points 44, 46 to the data processing apparatus 34, in particular the external data processing apparatus 34, occurs directly following the digital capture 20 of each individual digitally captured point 44, 46. A selection in respect of the direct transfer 58 or the collection of digitally captured points 44, 46 is preferably controlled and/or regulated dependent on the speed of the data connection between the mobile apparatus 36 and the external data processing apparatus 34, in particular the external data processing apparatus 34. A number of items and/or a size, in particular a data size, of digital data is/are controlled and/or regulated dependent on the speed of a data connection between the mobile apparatus 36 and the data processing apparatus 34, in particular the external data processing apparatus 34. If a data connection between the mobile apparatus 36 and the data processing apparatus 34, in particular the external data processing apparatus 34, has a speed of more than 1 MBit/s, there is a transmission of the entire image 42 of the at least one object 10 to be identified, in particular in addition to a transfer 58 of individual captured points 44, 46. When transmitting the entire image 42, all points 44, 46 of the image 42 may have previously be captured digitally by means of the mobile apparatus 36, wherein, preferably, a digital photo of the object 10 was captured with the mobile apparatus 36, said digital photo being transferred to the data processing apparatus 34, in particular the external data processing apparatus 34. Preferably, by means of the data processing apparatus 34, in particular the external data processing apparatus 34, the transferred data are matched with data which are stored in the memory unit 30 and/or to which the data processing apparatus 34 has access. Matching is carried out in at least one method step of the method dependent on a correspondence of at least one color value and at least one coordinate of captured points 44, 46 with points which are stored in the memory unit 30 and/or to which the data processing apparatus 34 has access. An identification and/or a classification of the object 10 may be performed on the basis of this matching. If a correspondence emerges from matching at least one color value and at least one coordinate of captured points 44, 46 and stored points, the method is completed and a result is presented to an operator. If there is no correspondence, further method steps of the method are preferably run through.
The digital capture 20 of individual points 44, 46 of the image 42 is carried out dependent on an identification of the machine-readable character code 32, in particular a barcode and/or a QR code, in the at least one image portion 14, 16, 18 of the image 42 (
Text scanning 74 for finding text present on the object is carried out in at least one method step of the method. Preferably, the at least one image portion 14, 16, 18 of the image 42 is preprocessed, in particular by means of the mobile apparatus 36, at least before carrying out the text recognition, in particular by the data processing apparatus 34. Preferably, at least one contrast characteristic of the at least one digitally captured point 44, 46 is at least changed before carrying out a text recognition. Preferably, at least one color value of the at least one digitally captured point 44, 46 is changed before carrying out a text recognition, in particular during the preprocessing. In particular, at least one color value of the at least one digitally captured point 44, 46 is changed by means of a digital filter. Preferably, all color values of digitally captured points 44, 46 of the at least one image portion 14, 16, 18 of the image 42 are converted to a “black” or “white” color value before carrying out the text recognition. In particular, the color value is converted dependent on a comparison of a color value of a digitally captured point 44, 46 with a threshold stored in a database, in particular the memory unit 30, of the data processing apparatus 34. Preferably, there is a change in at least one contrast characteristic of the at least one digitally captured image portion 14, 16, 18, at least in part of the at least one image portion 14, 16, 18 of the image 42. Particularly preferably, the use of a digital filter function for the at least one whole image portion 14, 16, 18 of the image 42 is determined on the basis of the change in contrast in the at least one part of the at least one image portion 14, 16, 18 of the image 42. In particular, a size of at least one individual letter, stored in the database of the data processing apparatus 34, is used in respect of the size, to be selected, of the at least one part of the at least one image portion 14, 16, 18 of the image 42. The at least one preprocessed image portion 14, 16, 18 of the image 42 is transferred to the data processing apparatus 34. Preferably, digital text recognition is carried out by means of the data processing apparatus 34, in particular the external data processing apparatus 34. If the text recognition is successful and if the identified text may be assigned to an object 10 stored in the memory unit 30 or to an object 10, to which the data processing apparatus 34 has access, for example by way of an Internet connection, the method is completed and a result is presented to an operator. If there is no text recognition or there is no assignment, further method steps of the method are preferably run through.
At least one edge profile of the image 42 of the at least one object 10 to be identified is captured digitally 20 in at least one method step of the method. Preferably, 3D data, in particular 3D-CAD data, of objects 10 is stored in the memory unit 30, it being possible to compare said data with the digitally captured edge profiles. In particular, at least a contour of the object 10 is captured by the digital capture 20 of at least one edge profile. A digital information item of the edge profile is transferred to the data processing apparatus 34 for matching purposes. If there is a correspondence between the captured edge profile and an edge profile which is stored in the memory unit 30 and/or to which the data processing apparatus 34 has access, the method is completed and a result is presented to an operator. If there is no correspondence, further method steps of the method are preferably run through.
A size and/or an arrangement of the at least one image portion 14, 16, 18 of the image 42 to be scanned digitally are/is predetermined by an operator in at least one method step of the method. The mobile apparatus 36 comprises the touch-sensitive input unit 64 for the purposes of selecting the at least one image portion 14, 16, 18 of the image 42 by an operator, said input unit having a selection mask 66 for selecting the at least one image portion 14, 16, 18 of the image 42, the size of which is modifiable by means of at least one finger of the operator (
At least one global location characteristic and/or at least one weather characteristic are/is taken into account in at least one method step of the method during a comparison of digitally captured points 44, 46 of the image 42 with data of images of objects 10 which are stored in the memory unit 30 or to which the data processing apparatus 34 has access. In at least one method step of the method, operator data are taken into account in the comparison of digitally captured points 44, 46 of the image 42 with data of images 42 of objects 10 which are stored in the memory unit 30 or to which the data processing apparatus 34 has access. An operator input in respect of the type of an object 10 to be identified is taken into account in at least one method step of the method. An acceleration characteristic and/or an alignment characteristic of the mobile apparatus 36 are/is taken into account in at least one method step of the method. The mobile apparatus 36 comprises at least one alignment sensor 60 and/or acceleration sensor 62, the data captured thereby being processable by the external data processing apparatus 34 for the purposes of identifying the object 10. Furthermore, it is conceivable that further data and/or characteristics appearing expedient to a person skilled in the art are taken into account when identifying the object 10. Moreover, it is conceivable that additional information items, such as e.g. offered accessories for the identified object 10, warranty expiry dates for the identified object 10, expansion suggestions for machinery or the like, may be output dependent on the identified object 10 in at least one method step of the method.
Instructions are output to an operator in at least one method step of the method, said instructions at least comprising movement instructions for moving a mobile apparatus 36 provided for digitally capturing 20 digital points 44, 46 of the image 42, relative to the object 10 to be identified. By way of example, it is conceivable that there is an output to an operator to carry out a movement of the mobile apparatus 36 around the object 10 to be identified in order, in particular, to identify text extending around the object 10 or in order to capture the shape of the object 10, in particular the three-dimensional shape. Moreover, it is conceivable, for example, that there is an output to an operator to carry out a movement of the mobile apparatus 36, relative to the object 10 to be identified, along a longitudinal axis of the object 10 to be identified in order to capture a maximum dimension of the object 10. Further, it is for example conceivable that there is an output to an operator to carry out a movement of the mobile apparatus 36, relative to the object 10 to be identified, along a direction extending at least substantially across a longitudinal axis of the object 10 to be identified in order to generate a depth information item in respect of the object 10 to be identified. Further outputs, appearing expedient to a person skilled in the art, to an operator to move the mobile apparatus 36 relative to the object 10 to be identified are likewise conceivable.
The digitally captured points 44, 46 of the at least one image portion 14, 16, 18 of the image 42 are combined to form an image data record 48, 50, 52 in at least one method step of the method, with a plurality of image data records 48, 50, 52 being generated for an object 10 to be identified, said image data records differing from one another at least in view of at least one image portion characteristic (
The individual method steps of the method for identifying the object 10 may run with a time offset or at the same time. The sequence of the individual method steps of the method is preferably dependent on digitally captured information items, dependent on operator inputs and dependent on commands which are output to the mobile apparatus 36 from the data processing apparatus 34.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2016 201 373.4 | Jan 2016 | DE | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2017/051499 | 1/25/2017 | WO | 00 |
