Methods and systems for detecting cracks in illuminated electronic device screens

Information

  • Patent Grant
  • 10909673
  • Patent Number
    10,909,673
  • Date Filed
    Monday, March 18, 2019
    5 years ago
  • Date Issued
    Tuesday, February 2, 2021
    3 years ago
Abstract
Systems and methods for detecting the cracks in illuminated electronic device screens are disclosed. In one embodiment, the method includes receiving an image of an electronic device screen and retrieving a plurality of kernels, each having values corresponding to a line region and a non-line region, with the orientation of the line region and the non-line region differing for each kernel. At least some of the kernels are applied to the image to obtain, at various locations of the image, values corresponding to the line regions and the non-line regions. Based on the values corresponding to the line regions and the non-line regions, cracks are automatically identified in the electronic device screen.
Description
TECHNICAL FIELD

The present disclosure is directed generally to methods and systems for evaluating mobile phones and other consumer electronic devices and, more particularly, to methods and systems associated with detecting cracks in screens of such devices.


BACKGROUND

It is often necessary to visually evaluate a screen of a mobile device (e.g., a smartphone or tablet) to identify cracks or other defects in the mobile device. For example, pricing the mobile device, assessing the mobile device for possible repair, and evaluating the mobile device for warranty coverage all may require identification of any cracks in the mobile device's screen and/or in non-screen portions of the device. Individualized manual inspection of mobile device screens for cracks is slow, cumbersome, and can yield inconsistent results. Current automated methods for detecting cracks in other contexts are often over-inclusive resulting in high rates of false-positive crack indications, particularly when the mobile device screen is illuminated. Accordingly, there is a need for improved methods and systems for automatically detecting cracks in mobile device screens.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a schematic diagram illustrating components of a suitable computing environment for implementing various aspects of the present technology.



FIG. 2 is a flow diagram of a routine for identifying cracks in an illuminated electronic device screen, in accordance with an embodiment of the relevant technology.



FIG. 3A illustrates an image pyramid of an electronic device with multiple layers for use in the routine of FIG. 2, and FIG. 3B illustrates a variety of kernels for use in the routine of FIG. 2, in accordance with an embodiment of the relevant technology.



FIG. 4 is an isometric view of a machine employing methods and systems in accordance embodiments of the present technology for recycling mobile phones and/or other electronic devices.



FIGS. 5A-5D are a series of isometric views of the machine of FIG. 4 with a number of exterior panels removed to illustrate operation of the machine in accordance with an embodiment of the present technology.





DETAILED DESCRIPTION

Overview


The following disclosure describes systems and methods for automated visual inspection and evaluation of electronic device screens. In particular, at least some embodiments of the present technology enable automatic crack detection in illuminated electronic device screens, which pose particular problems for conventional crack-detection techniques. Illuminated electronic device screens—that is, screens that are actively emitting light—pose particular difficulties in detecting cracks as the images displayed by the emitted light can result in improper crack identification.


To detect cracks, in accordance with some embodiments, an image of the illuminated electronic device screen is obtained under both lighted conditions (i.e., an external light is applied during the image capture) and unlighted conditions (i.e., no external light is applied during the image capture). The unlighted image can then be subtracted from the lighted image which reduces the intensity of the illuminated image of the device screen. The resulting image can be enhanced and converted to grayscale before performing crack detection.


In one embodiment, the routine can first identify cracks in non-screen regions of the image. If no cracks are found in this region, then the routine can identify cracks in the screen region utilizing the methods as described herein. In some embodiments, for example, the routine can first generate an “image pyramid” in which multiple different images are generated by scaling and subsampling the images. For example, a first “layer” in the image pyramid is the original image, the second downsampled by a factor of 2 in each direction, a third layer is downsampled by a factor of 3 in each direction, a fourth layer is downsampled by a factor of 4 in each direction, etc. Next, the routine can begin with a first layer of the image pyramid and convolve the image with a set of multiple kernels (also called convolution matrices) configured to identify energy response above some threshold for a line at various angles. Each kernel can include a line configured to correspond to a crack at or near a particular angular orientation (e.g., 5 degrees with respect to the horizontal, 15 degrees, 30 degrees, 45 degrees, etc.). Each kernel can further include four regions or quadrants: the left portion of the line (LL), the right portion of the line (RL), above the line (AL), and below the line (BL). The values computed in each of these regions (e.g., minimum brightness, maximum brightness, average brightness, and standard deviation of brightness) can be used to determine whether a line in the image that corresponds to that particular kernel is identified in that location, indicating the presence of a crack at that location. For example, if the average brightness of the LL and RL regions is greater than the average brightness of the AL and BL regions by some amount (e.g., by 8 or more brightness units), then a crack is indicated for that kernel at that location. At a given location, each kernel can be applied in sequence until a crack is identified. If no crack is identified, an adjacent location is selected (e.g., by translating some predetermined number of pixels away from the previous location), and the kernels are again applied in sequence. This continues until the kernels have swept across all locations corresponding to the screen region of the electronic device. If the number of identified cracks in that layer exceeds some predetermined threshold, then the screen is considered cracked. If the number of identified cracks do not exceed the predetermined threshold, then the process repeats with the next layer in the image pyramid. This iterative process can advantageously identify cracks in illuminated electronic device screens without unduly misidentifying images from the illuminated screens as cracks.


Certain details are set forth in the following description and in FIGS. 1-5D to provide a thorough understanding of various embodiments of the present technology. In other instances, well-known structures, materials, operations and/or systems often associated with smartphones and other handheld devices, consumer electronic devices, computer hardware, software, and network systems, etc. are not shown or described in detail in the following disclosure to avoid unnecessarily obscuring the description of the various embodiments of the technology. Those of ordinary skill in the art will recognize, however, that the present technology can be practiced without one or more of the details set forth herein, or with other structures, methods, components, and so forth. The terminology used below should be interpreted in the broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain examples of embodiments of the technology. Indeed, certain terms may even be emphasized below; however, any terminology intended to be interpreted in any restricted manner will be specifically defined as such in this Detailed Description section.


The accompanying Figures depict embodiments of the present technology and are not intended to be limiting of the scope of the present technology. The sizes of various depicted elements are not necessarily drawn to scale, and these various elements may be arbitrarily enlarged to improve legibility. Component details may be abstracted in the Figures to exclude details such as the position of components and certain precise connections between such components when such details are unnecessary for a complete understanding of how to make and use the invention.


In the Figures, identical reference numbers may identify identical, or at least generally similar, elements. To facilitate the discussion of any particular element, the most significant digit or digits of any reference number may refer to the Figure in which that element is first introduced. For example, element 101 is first introduced and discussed with reference to FIG. 1.


Detection of Cracks in Illuminated Electronic Device Screens



FIG. 1 illustrates an embodiment of an environment 100 in which various aspects of the present technology can be implemented. The environment 100 includes an imaging device 101 configured to obtain images and/or video of an electronic device 103 (e.g., a mobile phone, tablet, notebook, etc.). The imaging device 101 is in communication with a computing device 105 and a database 107 via a communications link 109. In at least one embodiment, the imaging device 101 is positioned within a consumer-operated kiosk that can be used to evaluate and recycle the electronic device 103.


The imaging device 101 includes a processing component 111, a memory 213, input and output components 115 and 117, and a power component 125. The imaging device 101 further includes an image sensor 127, associated optics 129, an illumination source 131, and a communication component 119. The communication component 119 includes a wired connection 123 and a wireless transceiver 121. The computing device 105 can include several components similar to components of the imaging device 101. For example, the computing device 105 can include a processing component 133, memory 135 (which can store an operating system 137, applications 139, and data 141), along with input 143 and output 145 components and a power component 153. A communication component 147 of the computing device 105 includes a wired connection 151 and a wireless transceiver 147. These features of the imaging device 101 and the computing device 105 are described in more detail below in the context of a routine for detecting cracks in illuminated electronic device screens in accordance with an embodiment of the present technology.



FIG. 2 is a flow diagram of a routine for identifying cracks in an illuminated electronic device screen in accordance with an embodiment of the present technology. FIG. 3A illustrates an image pyramid of an electronic device with multiple layers, and FIG. 3B illustrates a variety of kernels for use in the routine of FIG. 2. The routine 200 of FIG. 2 can be carried out by the computing device 105 or another suitable computing device. With reference to FIGS. 2-3B together, the routine 200 begins in block 201 by subtracting a lighted image of an electronic device with an illuminated screen from a non-lighted image of the electronic device with the illuminated screen. For example, an image of the illuminated electronic device screen is obtained under both a lighted condition (i.e., an external light is applied during the image capture) and an unlighted condition (i.e., no external light is applied during the image capture). For example, the images can be obtained with the imaging device 101 and electronically transmitted to the computing device 105. The unlighted image can then be subtracted from the lighted image, which reduces the intensity of the illuminated image of the device screen. In some embodiments, the resulting image is then enhanced and converted to grayscale before performing crack detection.


In block 203, the routine 200 checks for an animated background by, for example, determining whether there is a large discrepancy in the screen portion of the image between the lighted image and the non-lighted image, or between subsequent images taken under the same lighting conditions. In one embodiment, several images of the screen can be taken in succession, and each image can then be subtracted from the others, or sequentially, or each from the first image, etc. The resulting difference can then be evaluated, e.g., if a brightness in the screen region of the resulting difference exceeds a predetermined threshold, then a discrepancy is identified. A discrepancy indicates an animated or otherwise changing wallpaper or background, which may deleteriously affect the operation of the routine 200. Accordingly, if an animated background is identified, a user can be prompted to disable this feature or the crack detection routine can be bypassed altogether.


In block 205, the routine 200 identifies cracks outside the screen region. This can be performed by the computing device using crack detection techniques such as a Canny edge detector, Hough transform, and other automated crack detection techniques, such as those described in more detail in co-pending and commonly owned U.S. patent application Ser. No. 15/130,851, titled METHODS AND SYSTEMS FOR DETECTING CRACKS IN ELECTRONIC DEVICES, filed Apr. 15, 2016, which is hereby incorporated by reference in its entirety. In some embodiments, if there are cracks found in the region outside the screen, then the phone is identified as “damaged” and the remainder of the crack detection process described below is bypassed. If no cracks are found in this region, then the routine can proceed to identify cracks in the screen region as described below.


Next, in block 207 the routine 200 generates an “image pyramid” in which multiple different images are generated by scaling and subsampling the image. FIG. 3A illustrates various layers of an image pyramid of an image of an electronic device. As illustrated, a bottommost “layer” 301 is larger or higher resolution than subsequent layers 303, 305, and 307. Each subsequent layer of the pyramid is downsampled to a greater degree. For example, the first or bottommost layer 301 in the image pyramid is the original image, the second layer 303 can be downsampled by a factor of 2 in each direction with respect to layer 301, the third layer 305 can be downsampled by a factor of 3 in each direction with respect to layer 301, the fourth layer 307 can be downsampled by a factor of 4 in each direction with respect to layer 301, etc. The layers 301, 303, 305, 307 of the image pyramid provide various sizes and/or resolutions of the image of the electronic device.


As described in more detail below, kernels can be convolved to select regions of these layers. Due to downsampling, the corresponding area of the electronic device screen 302 increases with each subsequent layer. The region 309, for example, illustrates a region corresponding to a particular kernel size and is not necessarily drawn to scale. In one embodiment, the region 309 corresponds to a region of 8×8 pixels in each layer, though in various embodiments the size of the kernels used can vary. As illustrated, the region 309 corresponds to a smaller proportional region of the screen in layer 301 than in layer 303, and similarly the region 309 corresponds to still smaller proportional regions of the screen in layers 305 and 307.


In block 209, the routine 200 selects the first layer 301 of the image pyramid. In one embodiment, the first layer 301 is the bottommost or original image. In block 211, the routine 200 identifies cracks in the selected layer. Identifying cracks involves a subroutine that first selects a first kernel and a first location in block 213. The first location can be, for example, an upper corner 304 of the screen 302 of the electronic device in the selected layer, and the first kernel can be, for example, kernel 311a in FIG. 3B. As the routine 200 proceeds with other kernels (as in block 221), a next kernel is selected, for example kernel 311b in FIG. 3B. This process can continue until all the kernels (e.g., 311a-311j) have been applied to the selected location.


In block 215, the routine 200 overlays the selected kernel at the selected location and identifies cracks. The routine can begin with the first layer of the image pyramid and convolve the image with a set of multiple kernels configured to identify cracks at various angles. Each kernel can be configured to correspond to a crack at or near a particular angular orientation (e.g., 5 degrees with respect to the horizontal, 15 degrees with respect to the horizontal, 30 degrees with respect to the horizontal, 45 degrees with respect to the horizontal, etc.). FIG. 3B illustrates multiple kernels 311a-j. Each of these 10 kernels is configured to detect cracks of different orientations by overlaying each kernel over a particular portion of the image and convolving the kernel with that portion of the image. For example, the kernels 311 can be configured to align with and be overlaid on 8×8 pixel areas (or any other suitable size) in the image under evaluation. Although 10 kernels are illustrated here, in other embodiments there may be more or fewer kernels to provide greater or lesser granularity with respect to the orientation of cracks detected by the kernels. Each kernel includes four regions or quadrants, as illustrated by kernel 313, which is a schematic representation of kernel 311d and kernel 315 which is a schematic representation of kernel 311). As shown by kernels 313 and 315, the kernels include a left line region (LL) and a right line region (RL). These region are adapted to correspond to left and right portions of a crack if present in the portion of the image to which the kernel is convolved. The kernels also include a below-the-line region (BL) and an above-the-line region (AL). These regions are adapted to correspond to portions outside of the crack in the portion of the image to which the kernel is convolved. Convolving a kernel to a selected portion of an image involves evaluating the pixel values in these four regions to determine if a crack generally corresponding to the orientation of the selected kernel is identified, as described in more detail below. Since the kernel corresponds to a larger proportional area of the screen in higher layers of the pyramid (i.e. those images that have been downsampled to a greater degree), the kernels are configured to detect cracks of greater thicknesses in those layers, and of smaller thicknesses in less downsampled layers. This configuration allows a single kernel (e.g., a kernel configured to detect cracks of approximately 15 degree orientation with respect to the horizontal) to detect cracks of varying thicknesses depending on the layer to which the kernel is applied.


As noted above, the kernel is aligned with a pixel at a selected location and values of the image that correspond to the four quadrants of the kernel (left portion of the line (LL), right portion of the line (RL), above the line (AL), and below the line (BL)) are identified. For each of these quadrants, the routine 200 can calculate the minimum brightness, maximum brightness, average brightness, and standard deviation of brightness. In one embodiment, the average brightness of the line region (Lavg) is calculated by averaging the brightness for the LL and RL regions and is designed as Lavg. The average brightness of the non-line region is then calculated by averaging the brightness for the AL and BL regions, and is designated as ALBLavg. With these values, a number of calculations can be used to determine if cracks are present and to perform secondary checks if cracks are found. By way of example, in one embodiment the selected location is marked as cracked if Lavg is greater than ALBLavg by some threshold amount, e.g. greater than eight brightness units.


If a crack is found at this step, then a series of secondary checks can be applied to reduce the incidence of false-positive crack identification. A first secondary check can include, for example, determining whether the average brightness values for the AL and BL regions (i.e., the non-line regions) are sufficiently close to one another. If the average brightness in these regions differs by greater than some threshold amount (e.g., greater than 5 brightness units apart), then any identified crack is disregarded. This secondary check ensures that the background of the identified crack is consistent.


A second secondary check can exclude any identified crack if either the AL or BL regions (i.e., the non-line regions) are too dark, e.g. having average brightness values less than 35 where the image has been normalized to an average brightness of 140). This excludes false-positives that may be attributable to the location being close to a dark icon displayed on the screen, or an artificial dark spot due to a subtraction artifact.


A third secondary check can exclude any identified crack if the average brightness of the RL and LL regions (Lavg) is much brighter than the average of the AL and BL regions (ALBLavg), for example if Lavg is greater than ALBLavg by more than 50 brightness units. This third secondary check can avoid situations in which characters displayed by the active display are inappropriately categorized as cracks in the initial crack detection process.


A fourth secondary check can exclude any identified crack if the average brightness values for LL and RL (i.e. the line regions) are too far apart, for example greater than 10 brightness units apart from one another. This ensures that any identified underlying crack extends along both the LL and RL regions, thereby excluding false-positives attributable to characters displayed in the active display that align with the LL region moreso than the RL region or vice versa. An actual crack that extends across the location covered by the kernel will tend to yield similar brightness values in the RL and LL regions.


A fifth secondary check can exclude any identified crack if any of the four regions (RL, LL, AL, and BL) have a maximum pixel brightness greater than some threshold value, e.g, greater than 110 brightness units. This can exclude areas in which artificially bright areas due to glints or image processing artifacts can negatively affect the crack-detection algorithm.


A sixth secondary check can exclude any identified crack if any of the four regions (RL, LL, AL, and BL) have a minimum pixel brightness below some value, e.g., less than 25 brightness units. This excludes false-positives that may be attributable to the location being close to a dark icon displayed on the screen or an artificial dark spot due to a subtraction artifact.


A seventh secondary check can evaluate each column and row of the kernel at the location for which a crack was identified to determine whether, for any three adjacent LL or RL values, the brightness values are monotonically increasing or decreasing. For example, kernel 313 shown in FIG. 3B includes at least three adjacent LL values in the third column. To perform the seventh secondary check, the routine 200 determines whether the pixel locations in the image corresponding to those adjacent LL values correspond to increasing or decreasing values. A true crack will tend to have a gradient of brightness across three adjacent LL or RL values, leading to monotonically increasing or decreasing brightness values. Characters presented on an active display, in contrast, may present equal brightness values across three adjacent LL or RL values, and accordingly would not pass this seventh secondary check.


Following the initial crack detection (e.g., if Lavg is greater than ALBLavg by more than some threshold amount), one or more of the secondary checks described above can be performed to confirm the indication of a crack at that location with that kernel. If any of the secondary checks indicate that the identified crack should be disregarded as a false positive, then no crack is found for that kernel at that location. If the initially identified crack passes all of the secondary checks applied, then a crack is indicated and the routine proceeds as described below. In some embodiments, an initially identified crack is excluded only if it fails some threshold number of the secondary checks (e.g., if the initially identified crack fails at least two secondary checks, at least three secondary checks, etc.).


In decision block 217, the routine 200 determines whether a crack is found for the selected kernel at the selected location. If no crack was found during the evaluation of block 215, then the routine 200 proceeds to decision block 219 to determine whether the final kernel has been completed (i.e., there are no remaining kernels in the series that have not yet been convolved at the selected location). If there are remaining kernels, then the routine 200 continues to block 221 to select the next kernel (e.g., moving from kernel 311a to kernel 311b in FIG. 3B) and the process returns to block 215 to overlay the newly selected kernel at the same location.


Returning to decision block 217, if a crack was found during the evaluation of block 215, then after decision block 217 the routine 200 proceeds to decision block 223 to determine whether the final location has been evaluated. If not (i.e., there are remaining locations on the screen in the selected layer that have not yet been evaluated for cracks), then the routine proceeds to block 225, selects the next location (e.g., by moving a predetermined number of pixels to one side) and returns to block 215 to overlay the first kernel at the new location. This process can loop until each location on the screen has been evaluated. The locations can be overlapping portions, for example the adjacent location can be a 8×8 pixel square that is two pixels to the right of the previous 8×8 pixel square. The amount of overlap and the size of the kernels can be varied as desired. In some embodiments, the number of locations at which cracks have been identified is totaled and, if the sum exceeds some threshold value, the routine terminates with an indication that the screen is cracked. If the total number of locations at which cracks have been identified does not exceed the threshold, then the routine can proceed to evaluate additional layers of the image pyramid as described below.


Once the final location has been completed as determined in decision block 223, the routine 200 proceeds to decision block 227 to determine if the final layer has been completed. If not (i.e., there are remaining layers of the image pyramid that have not yet been evaluated), then the routine 200 continues to block 229 to select the next layer in the image pyramid, and returns to block 215 to overlay the first kernel at the first location in the newly selected layer and begins the crack identification process. If, in decision block 227, the routine 200 determines that the final layer has been completed, then the routine 200 ends. At this point, any number of cracks have been identified in various regions of the electronic device screen and in various layers of the image pyramid. These identified cracks can be evaluated to determine an overall crack score for the device, to test whether the total number exceeds a predetermined threshold, or to otherwise evaluate the overall condition of the electronic device for possible purchase.


Computing Environment


Referring again to FIG. 1, additional details are set forth below regarding the computing environment in which the routine 200 can be performed. The imaging device 101 can be, for example, a digital camera (e.g., having a CCD or CMOS sensor) capable of capturing still and/or moving images of the electronic device 103, and transmitting captured images over the communications link 109 to remote devices. In some embodiments, the imaging device 101 can be incorporated into a user-operated kiosk as described in more detail below. The imaging device 101 can include a camera and an associated fixture, base, or other imaging area in which the electronic device 103 is to be placed for imaging. This can provide a standard background against which the images and/or video of the electronic device 103 are obtained. The imaging device 101 and/or the associated optics can be configured in order to capture images and/or video of the electronic device 103 from various angles. The imaging device 101 can also include an illumination source (e.g., LEDs, fluorescent bulbs, lamps, etc.) which can also aid in obtaining images of the electronic device 103 under uniform lighting conditions.


The electronic device 103 can be, for example, a smartphone, a tablet, a laptop, a handheld gaming device, a media player, or any such device submitted for evaluation that has a screen or other surface that may suffer cracks or similar defects. Although many embodiments of the present technology are described herein in the context of mobile phones, aspects of the present technology are not limited to mobile phones and generally apply to other consumer electronic devices. Such devices include, as non-limiting examples, all manner of mobile phones; smartphones; handheld devices; personal digital assistants (PDAs); MP3 or other digital music players; tablet, notebook, ultrabook and laptop computers; e-readers; all types of cameras; GPS devices; set-top boxes and other media players; VoIP phones; universal remote controls; wearable computers; and larger consumer electronic devices, such as desktop computers, TVs, projectors, DVRs, game consoles, etc.


The computing device 105 can be a CPU (e.g., housed within a user-operated kiosk) or another suitable processing device. The computing device 105 is configured to receive images of the electronic device 103 from the imaging device 101 and to automatically analyze the images to detect the presence of cracks or other defects. In some embodiments, the computing device 105 is remote from the imaging device 101 and can be in communication via the communications link 109. In other embodiments, the computing device 105 is connected to the imaging device 101 via a hardwire connection, or in certain embodiments the imaging device 101 and the computing device 105 are integrated into the same machine. The computing device 105 is also in communication with the database 107 which can store data used in automatically analyzing the images of the electronic device 103. The database 107 may also store the results of the automatic analysis of the images, other data about the electronic device 103, etc.


In the illustrated embodiment, various devices including the imaging device 101 and the computing device 105 exchanges information with one another via the communication link 109. Although the communication link 109 can include a publicly available network (e.g., the Internet with a web interface), a private communication link (e.g., an intranet or other network) can also be used. Moreover, in various embodiments the imaging device 101 is connected to a host computer (not shown) that facilitates the exchange of information between the imaging device 101, the computing device 105, remote computers, mobile devices, etc.


In the illustrated embodiment, the imaging device 101 includes the processing component 111 that controls operation of the imaging device 101 in accordance with computer-readable instructions stored in memory 113. The processing component 111 may include any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The processing component 111 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices. Aspects of the present technology can be embodied in a special purpose computing device or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein. Aspects of the present technology can also be practiced in distributed computing environments in which functions or modules are performed by remote processing devices that are linked through a communications network, such as a local area network (LAN), wide area network (WAN), or the Internet. In a distributed computing environment, modules can be located in both local and remote memory storage devices.


The processing component 111 is connected to memory 113, which can include a combination of temporary and/or permanent storage, and both read-only memory (ROM) and writable memory (e.g., random access memory or RAM), writable non-volatile memory such as flash memory or other solid-state memory, hard drives, removable media, magnetically or optically readable discs, nanotechnology memory, biological memory, and so forth. As used herein, memory does not include a transitory propagating signal per se. The memory 213 includes data storage that contains programs, software, and information, such as an operating system and data. Imaging device 101 operating system and data can include software and databases configured to control imaging device 101 components, process images, communicate and exchange data and information with remote computers and other devices, etc.


The imaging device 101 further includes input components 115 that can receive input from user interactions and provide input to the processing component 111, typically mediated by a hardware controller that interprets the raw signals received from the input device and communicates the information to the processing component 111 using a known communication protocol. Examples of an input component 115 include touchpad, a keyboard (with physical or virtual keys), a pointing device (such as a mouse, dial, or eye tracking device), a touchscreen that detects contact events when it is touched by a user, a microphone that receives audio input, etc. The imaging device 101 can also include various other input components 115 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices), biometric sensors (e.g., fingerprint sensors), light sensors, card readers (e.g., magnetic stripe readers or memory card readers) or the like.


The processing component 111 is also connected to one or more various output components 117, e.g., directly or via a hardware controller. The output devices can include a display on which text and graphics are displayed. The display can be, for example, an LCD, LED, or OLED display screen, an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to a user. The output components 117 can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc. In some implementations, a speaker and microphone are implemented by a combined audio input-output device.


In the illustrated embodiment, the imaging device 101 further includes one or more communication components 119. The communication components can include, for example, a wireless transceiver 121 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM; CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connection 123 (e.g., one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.). The communication components 119 are suitable for communication between the imaging device 101 and other local and/or remote devices, e.g., the computing device 105, directly via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109 (which can include the Internet, a public or private intranet, a local or extended Wi-Fi network, cell towers, the plain old telephone system (POTS), etc.). For example, the wireless transceiver 121 of the imaging device 101 can connect to a wireless transceiver 149 of the computing device via the wireless connection. The imaging device 101 further includes power 125, which can include battery power and/or facility power for operation of the various electrical components associated with the imaging device 101.


The imaging device 101 further includes the image sensor 127, optics 129, and illumination source 131. The image sensor 127 can be, for example, a CCD sensor, a CMOS sensor, or any other type of image sensor or array of sensors. The image sensor 127 can be aligned with optics 129, for example one or more lenses, filters, or other optical elements, configured to orient and modulate incoming light before it reaches the image sensor 127. The illumination source 131 can be configured to direct illumination towards the field of view of the imaging device 101, and can be any type of light source, for example LEDs, fluorescent bulbs, etc. In some embodiments, the illumination source 131 includes multiple different types of light sources which can be individually activated, for example infrared, ultraviolet, broadband, etc.


The computing device 105 includes several components similar to those in the imaging device 101. In the illustrated embodiment, the computing device 105 includes a processing component 133 that controls operation of the computing device 105 in accordance with computer-readable instructions stored in memory 135. The processing component 133 may be any logic processing unit, such as one or more central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The processing component 133 may be a single processing unit or multiple processing units in an electronic device or distributed across multiple devices. The processing component 133 is connected to memory 135, which includes data storage that contains programs, software, and information, such as an operating system 137, application programs 139, and data 141. The operating system 137 can include, for example, Windows®, Linux®, Android™, iOS®, and/or an embedded real-time operating system. The application programs 139 and data 141 can include software and databases configured to control computing device 105 components, process and evaluate images received from the imaging device 101, communicate and exchange data and information with remote computers and other devices, etc.


The computing device 105 can include input components 143, such as a keyboard (with physical or virtual keys), a pointing device (such as a mouse, joystick, dial, or eye tracking device), a touchscreen, a microphone, and a camera for still photograph and/or video capture. The computing device 105 can also include various other input components 143 such as GPS or other location determination sensors, motion sensors, wearable input devices with accelerometers (e.g. wearable glove-type input devices); biometric sensors (e.g., fingerprint sensors), light sensors, card readers (e.g., magnetic stripe readers or memory card readers) and the like.


The processing component 133 can also be connected to one or more various output components 145, e.g., directly or via a hardware controller. The output devices can include a display such as an LCD, LED, or OLED display screen (such as a desktop computer screen, handheld device screen, or television screen), an e-ink display, a projected display (such as a heads-up display device), and/or a display integrated with a touchscreen that serves as an input device as well as an output device that provides graphical and textual visual feedback to the user. The output devices can also include a speaker for playing audio signals, haptic feedback devices for tactile output such as vibration, etc.


In the illustrated embodiment, computing device 105 further includes one or more communication components 147. The communication components can include, for example, a wireless transceiver 149 (e.g., one or more of a Wi-Fi transceiver; Bluetooth transceiver; near-field communication (NFC) device; wireless modem or cellular radio utilizing GSM, .CDMA, 3G and/or 4G technologies; etc.) and/or a wired network connector port 251 (e.g., one or more of an Ethernet port, cable modem, FireWire cable, Lightning connector, universal serial bus (USB) port, etc.). The communication components 147 are suitable for communication between the computing device 105 and other local and/or remote computing devices, e.g., the imaging device 101 via a wired or wireless peer-to-peer connection and/or indirectly via the communication link 109. For example, the wireless transceiver 149 of the computing device 105 can connect to the wireless transceiver 121 of imaging device 101, and/or the wired connector port 151 of the computing device 105 can connect to the wired connector port 123 of the imaging device 101. The computing device 105 further includes power 153, which can include battery power and/or facility power for operation of the various electrical components associated with the computing device 105.


Unless described otherwise, the construction and operation of the various components shown in FIG. 1 are of conventional design. As a result, such components need not be described in further detail herein, as they will be readily understood by those skilled in the relevant art. In other embodiments, the computing device 105 and the imaging device 101 include other features that may be different from those described above. In still further embodiments, the computing device 105 and/or the imaging device 101 include more or fewer features similar to those described above.


Kiosk Environment


In some embodiments, the routines described herein can be carried out using a kiosk that includes an imaging device (e.g., the imaging device 101) therein. In some embodiments, the kiosk can perform some or all of the functions performed by the computing device 105 described above, for example processing and evaluating images received from the imaging device 101. The kiosk can include, for example, a processing component (e.g., the computing device 105) and memory storing instructions that, when executed by the processing component, perform operations such as the routine 200 described above. FIG. 4, for example, is an isometric view of a kiosk 400 for recycling and/or other processing of mobile phones and other consumer electronic devices in accordance with the present technology. The term “processing” is used herein for ease of reference to generally refer to all manner of services and operations that may be performed or facilitated by the kiosk 400 on, with, or otherwise in relation to an electronic device. Such services and operations can include, for example, selling, reselling, recycling, donating, exchanging, identifying, evaluating, pricing, auctioning, decommissioning, transferring data from or to, reconfiguring, refurbishing, etc., mobile phones and other electronic devices. Although many embodiments of the present technology are described herein in the context of mobile phones, aspects of the present technology are not limited to mobile phones and generally apply to other consumer electronic devices. Such devices include, as non-limiting examples, all manner of mobile phones, smart phones, handheld devices, PDAs, MP3 players, tablet, notebook and laptop computers, e-readers, cameras, etc. In some embodiments, it is contemplated that the kiosk 400 can facilitate selling and/or otherwise processing larger consumer electronic devices, such as desktop computers, TVs, game consoles, etc., as well smaller electronic devices such as Google Glass™, smart-watches, etc.


In the illustrated embodiment, the kiosk 400 is a floor-standing self-service kiosk configured for use by a user 401 (e.g., a consumer, customer, etc.) to recycle, sell, and/or perform other operations with a mobile phone or other consumer electronic device. In other embodiments, the kiosk 400 can be configured for use on a countertop or a similar raised surface. Although the kiosk 400 is configured for use by consumers, in various embodiments the kiosk 400 and/or various portions thereof can also be used by other operators, such as a retail clerk or kiosk assistant to facilitate the selling or other processing of mobile phones and other electronic devices.


In the illustrated embodiment, the kiosk 400 includes a housing 402 that is approximately the size of a conventional vending machine. The housing 402 can be of conventional manufacture from, for example, sheet metal, plastic panels, etc. A plurality of user interface devices are provided on a front portion of the housing 402 for providing instructions and other information to users, and/or for receiving user inputs and other information from users. For example, the kiosk 400 can include a display screen 404 (e.g., a liquid crystal display (“LCD”) or light emitting diode (“LED”) display screen, a projected display (such as a heads-up display or a head-mounted device), and so on) for providing information, prompts, etc., to users. The display screen 404 can include a touch screen for receiving user input and responses to displayed prompts. In addition or alternatively, the kiosk 400 can include a separate keyboard or keypad for this purpose. The kiosk 400 can also include an ID reader or scanner 412 (e.g., a driver's license scanner), a fingerprint reader 414, and one or more cameras 416 (e.g., digital still and/or video cameras, identified individually as cameras 416a-c). The kiosk 400 can additionally include output devices such as a label printer having an outlet 410, and a cash dispenser having an outlet 418. Although not identified in FIG. 4, the kiosk 400 can further include a speaker and/or a headphone jack for audibly communicating information to users, one or more lights for visually communicating signals or other information to users, a handset or microphone for receiving verbal input from the user, a card reader (e.g., a credit/debit card reader, loyalty card reader, etc.), a receipt or voucher printer and dispenser, as well as other user input and output devices. The input devices can include a touchpad, pointing device such as a mouse, joystick, pen, game pad, motion sensor, scanner, eye direction monitoring system, etc. Additionally the kiosk 400 can also include a bar code reader, OR code reader, bag/package dispenser, a digital signature pad, etc. In the illustrated embodiment, the kiosk 400 additionally includes a header 420 having a display screen 422 for displaying marketing advertisements and/or other video or graphical information to attract users to the kiosk. In addition to the user interface devices described above, the front portion of the housing 402 also includes an access panel or door 406 located directly beneath the display screen 404. As described in greater detail below, the access door is configured to automatically retract so that the user 401 can place an electronic device (e.g., a mobile phone) in an inspection area 408 for automatic inspection by the kiosk 400.


A sidewall portion of the housing 402 can include a number of conveniences to help users recycle or otherwise process their mobile phones. For example, in the illustrated embodiment the kiosk 400 includes an accessory bin 428 that is configured to receive mobile device accessories that the user wishes to recycle or otherwise dispose of. Additionally, the kiosk 400 can provide a free charging station 426 with a plurality of electrical connectors 424 for charging a wide variety of mobile phones and other consumer electronic devices.



FIGS. 5A-5D are a series of isometric views of the kiosk 400 with the housing 402 removed to illustrate selected internal components configured in accordance with an embodiment of the present technology. Referring first to FIG. 5A, in the illustrated embodiment the kiosk 400 includes a connector carrier 540 and an inspection plate 544 operably disposed behind the access door 406 (FIG. 4). In the illustrated embodiment, the connector carrier 540 is a rotatable carrousel that is configured to rotate about a generally horizontal axis and carries a plurality of electrical connectors 542 (e.g., approximately 25 connectors) distributed around an outer periphery thereof. In other embodiments, other types of connector carrying devices (including both fixed and movable arrangements) can be used. In some embodiments, the connectors 542 includes a plurality of interchangeable USB connectors configured to provide power and/or exchange data with a variety of different mobile phones and/or other electronic devices. In operation, the connector carrier 540 is configured to automatically rotate about its axis to position an appropriate one of the connectors 542 adjacent to an electronic device, such as a mobile phone 550, that has been placed on the inspection plate 544 for recycling. The connector 542 can then be manually and/or automatically withdrawn from the connector carrier 540 and connected to a port on the mobile phone 550 for electrical analysis. Such analysis can include, e.g., an evaluation of the make, model, configuration, condition, etc.


In the illustrated embodiment, the inspection plate 544 is configured to translate back and forth (on, e.g., parallel mounting tracks) to move an electronic device, such as the mobile phone 550, between a first position directly behind the access door 406 and a second position between an upper chamber 530 and an opposing lower chamber 532. Moreover, in this embodiment the inspection plate 544 is transparent, or at least partially transparent (e.g., formed of glass, Plexiglas, etc.) to enable the mobile phone 550 to be photographed and/or otherwise optically evaluated from all, or at least most viewing angles (e.g., top, bottom, sides, etc.) using, e.g., one or more cameras, mirrors, etc. mounted to or otherwise associated with the upper and lower chambers 530 and 532. When the mobile phone 550 is in the second position, the upper chamber 530 can translate downwardly to generally enclose the mobile phone 550 between the upper chamber 530 and the lower chamber 532. The upper chamber 530 is operably coupled to a gate 538 that moves up and down in unison with the upper chamber 530.


In some embodiments, the kiosk 400 includes the imaging device 101 disposed within the upper hood 530. The imaging device 101 can be used as described above to facilitate visual inspection of the mobile phone 550 in order to evaluate the screen for cracks. The upper chamber 530 and/or the lower chamber 532 can also include one or more magnification tools, scanners (e.g., bar code scanners, infrared scanners, etc.) or other imaging components (not shown) and an arrangement of mirrors (also not shown) to view, photograph and/or otherwise visually evaluate the mobile phone 550 from multiple perspectives. In some embodiments, one or more of the cameras and/or other imaging components discussed above can be movable to facilitate device evaluation. For example, as noted above with respect to FIG. 1, the imaging device 101 can be affixed to a moveable mechanical component such as an arm, which in turn can be moved using a belt drive, rack and pinion system, or other suitable drive system coupled to an electronic controller (e.g., the computing device 105). The inspection area 408 can also include weight scales, heat detectors, UV readers/detectors, and the like, for further evaluation of electronic devices placed therein. The kiosk 400 can further include an angled binning plate 536 for directing electronic devices from the transparent plate 544 into a collection bin 534 positioned in a lower portion of the kiosk 400.


The kiosk 400 can be used in a number of different ways to efficiently facilitate the recycling, selling and/or other processing of mobile phones and other consumer electronic devices. Referring to FIGS. 4-5D together, in one embodiment a user wishing to sell a used mobile phone, such as the mobile phone 550, approaches the kiosk 400 and identifies the type of device the user wishes to sell in response to prompts on the display screen 404. Next, the user may be prompted to remove any cases, stickers, or other accessories from the device so that it can be accurately evaluated. Additionally, the kiosk 400 may print and dispense a unique identification label (e.g., a small adhesive-backed sticker with a quick response code (“QR code”), barcode, or other machine-readable indicia, etc.) from the label outlet 410 for the user to adhere to the back of the mobile phone 550. After this is done, the door 406 retracts and opens allowing the user to place the mobile phone 550 onto the transparent plate 544 in the inspection area 408 (FIG. 5A). The door 406 then closes and the transparent plate 544 moves the mobile phone 550 under the upper chamber 530 as shown in FIG. 5B. The upper chamber 530 then moves downwardly to generally enclose the mobile phone 550 between the upper and lower chambers 530 and 532, and the cameras and/or other imaging components in the upper and lower chambers 530 and 532 perform a visual inspection of the mobile phone 550. In one embodiment, the visual inspection of the mobile phone 550 includes performing the routine 200 (FIG. 2) to detect cracks in the screen. In some embodiments, the visual inspection includes a computer-implemented visual analysis (e.g., a three-dimensional (“3D”) analysis) performed by a processing device within the kiosk (e.g., a CPU) to confirm the identification of the mobile phone 550 (e.g. make, model and/or sub-model) and/or to evaluate or assess the condition and/or function of the mobile phone 550 and/or its various components and systems. For example, the visual analysis can include computer-implemented evaluation (e.g., a digital comparison) of images of the mobile phone 550 taken from top, side and/or end view perspectives to determine length, width, and/or height (thickness) dimensions of the mobile phone 550. The visual analysis can further include a computer-implemented inspection of a display screen on the mobile phone 550 to check for, e.g., cracks in the glass and/or other damage or defects in the LCD (e.g., defective pixels, etc.).


Referring next to FIG. 5C, after the visual analysis is performed and the device has been identified, the upper chamber 530 returns to its upper position and the transparent plate 544 returns the mobile phone 550 to its initial position near the door 406. The display screen 404 can also provide an estimated price, or an estimated range of prices, that the kiosk 400 may offer the user for the mobile phone 550 based on the visual analysis, and/or based on user input (e.g., input regarding the type, condition, etc. of the phone 550). If the user indicates (via, e.g., input via the touch screen) that they wish to proceed with the transaction, the connector carrier 540 automatically rotates an appropriate one of the connectors 542 into position adjacent the transparent plate 544, and door 406 is again opened. The user can then be instructed (via, e.g., the display screen 404) to withdraw the selected connector 542 (and its associated wire) from the carrousel 540, plug the connector 542 into the corresponding port (e.g., a USB port) on the mobile phone 550, and reposition the mobile phone 550 in the inspection area on the transparent plate 544. After doing so, the door 406 once again closes and the kiosk 400 (e.g. the kiosk CPU) performs an electrical inspection of the device via the connector 542 to further evaluate the condition of the phone as well as specific component and operating parameters such as the memory, carrier, etc. In addition or alternatively, in some embodiments the electrical inspection can include a determination of phone manufacturer information (e.g., a vendor identification number or VID) and product information (e.g., a product identification number or PID). In some embodiments, the kiosk 400 can perform the electrical analysis using one or more of the methods and/or systems described in detail in the commonly owned patents and patent applications identified herein and incorporated by reference in their entireties.


After the visual and electronic analysis of the mobile phone 550, the user is presented with a phone purchase price via the display screen 404, If the user declines the price (via, e.g., the touch screen), a retraction mechanism (not shown) automatically disconnects the connector 542 from the mobile phone 550, the door 406 opens, and the user can reach in and retrieve the mobile phone 550. If the user accepts the price, the door 406 remains closed and the user may be prompted to place his or her identification (e.g., a driver's license) in the ID scanner 412 and provide a thumbprint via the fingerprint reader 414. As a fraud prevention measure, the kiosk 400 can be configured to transmit an image of the driver's license to a remote computer screen, and an operator at the remote computer can visually compare the picture (and/or other information) on the driver's license to an image of the person standing in front of the kiosk 400 as viewed by one or more of the cameras 416a-c (FIG. 4) to confirm that the person attempting to sell the phone 550 is in fact the person identified by the driver's license. In some embodiments, one or more of the cameras 416a-c can be movable to facilitate viewing of kiosk users, as well as other individuals in the proximity of the kiosk 400. Additionally, the person's fingerprint can be checked against records of known fraud perpetrators. If either of these checks indicate that the person selling the phone presents a fraud risk, the transaction can be declined and the mobile phone 550 returned. After the user's identity has been verified, the transparent plate 544 moves back toward the upper and lower chambers 530 and 532. As shown in FIG. 5D, however, when the upper chamber 530 is in the lower position the gate 538 permits the transparent plate 544 to slide underneath but not electronic devices carried thereon. As a result, the gate 538 knocks the mobile phone 550 off of the transparent plate 544, onto the binning plate 536 and into the bin 534. The kiosk can then provide payment of the purchase price to the user. In some embodiments, payment can be made in the form of cash dispensed from the cash outlet 418. In other embodiments, the user can receive remuneration for the mobile phone 550 in various other useful ways. For example, the user can be paid via a redeemable cash voucher, a coupon, an e-certificate, a prepaid card, a wired or wireless monetary deposit to an electronic account (e.g., a bank account, credit account, loyalty account, online commerce account, mobile wallet etc.), Bitcoin, etc.


As those of ordinary skill in the art will appreciate, the foregoing routines are but some examples of ways in which the kiosk 400 can be used to recycle or otherwise process consumer electronic devices such as mobile phones. Although the foregoing example is described in the context of mobile phones, it should be understood that the kiosk 400 and various embodiments thereof can also be used in a similar manner for recycling virtually any consumer electronic device, such as MP3 players, tablet computers, PDAs, and other portable devices, as well as other relatively non-portable electronic devices such as desktop computers, printers, devices for implementing games, entertainment or other digital media on CDs, DVDs, Blu-ray, etc. Moreover, although the foregoing example is described in the context of use by a consumer, the kiosk 400 in various embodiments thereof can similarly be used by others, such as a store clerk, to assist consumers in recycling, selling, exchanging, etc. their electronic devices.


The disclosed technology also includes the disclosures of U.S. patent application Ser. No. 14/498,763, titled “METHODS AND SYSTEMS FOR PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” filed by the applicant on Sep. 26, 2014; U.S. patent application Ser. No. 14/500,739, titled “MAINTAINING SETS OF CABLE COMPONENTS USED FOR WIRED ANALYSIS, CHARGING, OR OTHER INTERACTION WITH PORTABLE ELECTRONIC DEVICES,” filed by the applicant on Sep. 29, 2014; U.S. patent application Ser. No. 14/873,158, titled “WIRELESS-ENABLED KIOSK FOR RECYCLING CONSUMER DEVICES,” filed by the applicant on Oct. 1, 2015; U.S. patent application Ser. No. 14/873,145, titled “APPLICATION FOR DEVICE EVALUATION AND OTHER PROCESSES ASSOCIATED WITH DEVICE RECYCLING,” filed by the applicant on Oct. 1, 2015; U.S. patent application Ser. No. 14/506,449, titled “SYSTEM FOR ELECTRICALLY TESTING MOBILE DEVICES AT A CONSUMER-OPERATED KIOSK, AND ASSOCIATED DEVICES AND METHODS,” filed by the applicant on Oct. 3, 2014; U.S. patent application Ser. No. 14/925,357, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” filed by the applicant on Oct. 28, 2015; U.S. patent application Ser. No. 14/925,375, titled “METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES,” filed by the applicant on Oct. 28, 2015; U.S. patent application Ser. No. 14/964,963, titled “METHODS AND SYSTEMS FOR PROVIDING INFORMATION REGARDING COUPONS/PROMOTIONS AT KIOSKS FOR RECYCLING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” filed by the applicant on Dec. 10, 2015; U.S. patent application Ser. No. 14/568,051, titled “METHODS AND SYSTEMS FOR IDENTIFYING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” filed by the applicant on Dec. 11, 2014; U.S. patent application Ser. No. 14/966,346, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” filed by the applicant on Dec. 11, 2015; U.S. patent application Ser. No. 14/598,469, titled “METHODS AND SYSTEMS FOR DYNAMIC PRICING AND PERFORMING OTHER PROCESSES ASSOCIATED WITH RECYCLING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” filed by the applicant on Jan. 16, 2015; U.S. patent application Ser. No. 14/660,768, titled “SYSTEMS AND METHODS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH A LASER,” filed by the applicant on Mar. 17, 2015; U.S. patent application Ser. No. 14/663,331, titled “DEVICE RECYCLING SYSTEMS WITH FACIAL RECOGNITION,” filed by the applicant on Mar. 19, 2015; U.S. provisional application No. 62/169,072, titled “METHODS AND SYSTEMS FOR VISUALLY EVALUATING ELECTRONIC DEVICES,” filed by the applicant on Jun. 1, 2015; U.S. provisional application No. 62/202,330, titled “METHODS AND SYSTEMS FOR INSPECTING MOBILE DEVICES AND OTHER CONSUMER ELECTRONIC DEVICES WITH ROBOTIC ACTUATION,” filed by the applicant on Aug. 7, 2015; U.S. patent application Ser. No. 15/057,707, titled “METHODS AND SYSTEMS FOR RECORDING INTERACTIONS WITH A SYSTEM FOR PURCHASING MOBILE PHONES AND OTHER ELECTRONIC DEVICES,” filed by the applicant on Mar. 1, 2016; U.S. patent application Ser. No. 14/873,158, titled “WIRELESS-ENABLED KIOSK FOR RECYCLING CONSUMER DEVICES,” filed by the applicant on Oct. 1, 2015; U.S. patent application Ser. No. 14/873,145, titled “APPLICATION FOR DEVICE EVALUATION AND OTHER PROCESSES ASSOCIATED WITH DEVICE RECYCLING,” filed by the applicant on Oct. 1, 2015; U.S. patent application Ser. No. 14/925,357, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” filed by the applicant on Oct. 28, 2015; U.S. patent application Ser. No. 14/925,375, titled “METHODS AND SYSTEMS FOR FACILITATING PROCESSES ASSOCIATED WITH INSURANCE SERVICES AND/OR OTHER SERVICES FOR ELECTRONIC DEVICES,” filed by the applicant on Oct. 28, 2015; U.S. patent application Ser. No. 14/934,134, titled “METHODS AND SYSTEMS FOR EVALUATING AND RECYCLING ELECTRONIC DEVICES,” and U.S. patent application Ser. No. 14/967,183, titled “SYSTEMS AND METHODS FOR RECYCLING CONSUMER ELECTRONIC DEVICES,” filed Dec. 11, 2015; U.S. patent application Ser. No. 15/130,851, titled “METHODS AND SYSTEMS FOR DETECTING CRACKS IN ELECTRONIC DEVICES,” filed Apr. 15, 2016; U.S. patent application Ser. No. 15/176,975 titled “METHODS AND SYSTEMS FOR DETECTING SCREEN COVERS ON ELECTRONIC DEVICES,” filed Jun. 8, 2016; and U.S. patent application No. 62/332,736, titled “METHODS AND SYSTEMS FOR DETECTING DAMAGE IN EDGE REGIONS OF MOBILE ELECTRONIC DEVICES,” filed May 6, 2016 each of which is incorporated herein by reference in its entirety. All of the patents and patent applications listed above are commonly owned by the applicant of the present application, and they along with any other patents or patent applications identified herein are incorporated herein by reference in their entireties.


While the Internet is shown, a private network, such as an intranet may likewise be used herein. The network may have a client-server architecture, in which a computer is dedicated to serving other client computers, or it may have other architectures such as peer-to-peer, in which one or more computers serve simultaneously as servers and clients. A database or databases, coupled to the server computer(s), stores much of the web pages and content exchanged between the user computers. The server computer(s), including the database(s), may employ security measures to inhibit malicious attacks on the system and preserve the integrity of the messages and data stored therein (e.g., firewall systems, message encryption and/or authentication (e.g., using transport layer security (TLS) or secure socket layers (SSL)), password protection schemes, encryption of stored data (e.g., using trusted computing hardware), and the like).


One skilled in the relevant art will appreciate that the concepts of the invention can be used in various environments other than location based or the Internet. In general, a display description may be in HTML, XML or WAP format, email format or any other format suitable for displaying information (including character/code-based formats, algorithm-based formats (e.g., vector generated), and bitmapped formats). Also, various communication channels, such as local area networks, wide area networks, or point-to-point dial-up connections, may be used instead of the Internet. The system may be conducted within a single computer environment, rather than a client/server environment. Also, the user computers may comprise any combination of hardware or software that interacts with the server computer, such as television-based systems and various other consumer products through which commercial or noncommercial transactions can be conducted. The various aspects of the invention described herein can be implemented in or for any e-mail environment.


Although not required, aspects of the invention are described in the general context of computer-executable instructions, such as routines executed by a general-purpose data processing device, e.g., a server computer, wireless device or personal computer. Those skilled in the relevant art will appreciate that aspects of the invention can be practiced with other communications, data processing, or computer system configurations, including Internet appliances, hand-held devices (including personal digital assistants (PDAs)), wearable computers, all manner of cellular or mobile phones (including Voice over IP (VoIP) phones), dumb terminals, media players, gaming devices, multi-processor systems, microprocessor-based or programmable consumer electronics, set-top boxes, network PCs, mini-computers, mainframe computers, and the like. Indeed, the terms “computer,” “server,” “host,” “host system,” and the like, are generally used interchangeably herein, and refer to any of the above devices and systems, as well as any data processor. Input devices may include a touchpad, keyboard and/or a pointing device such as a mouse. Other input devices are possible such as a microphone, joystick, pen, game pad, scanner, digital camera, video camera, and the like. The data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, digital video disks (DVDs), Bernoulli cartridges, RAMs, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a local area network (LAN), wide area network (WAN) or the Internet.


Aspects of the invention can be embodied in a special purpose computer or data processor that is specifically programmed, configured, or constructed to perform one or more of the computer-executable instructions explained in detail herein. While aspects of the invention, such as certain functions, are described as being performed exclusively on a single device, the invention can also be practiced in distributed environments where functions or modules are shared among disparate processing devices, which are linked through a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.


Aspects of the invention may be stored or distributed on tangible computer-readable media, including magnetically or optically readable computer discs, hard-wired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, biological memory; or other data storage media. The data storage devices may include any type of computer-readable media that can store data accessible by a computer, such as magnetic hard and floppy disk drives, optical disk drives, magnetic cassettes, tape drives, flash memory cards, DVDs, Bernoulli cartridges, RAM, ROMs, smart cards, etc. Indeed, any medium for storing or transmitting computer-readable instructions and data may be employed, including a connection port to a network such as a LAN, WAN, or the Internet. Alternatively, computer implemented instructions, data structures, screen displays, and other data under aspects of the invention may be distributed over the Internet or over other networks (including wireless networks), on a propagated signal on a propagation medium (e.g.; an electromagnetic wave(s), a sound wave, etc.) over a period of time, or they may be provided on any analog or digital network (packet switched, circuit switched, or other scheme). The terms “memory” and “computer-readable storage medium” include any combination of temporary, persistent, and/or permanent storage, e.g., ROM, writable memory such as RAM, writable non-volatile memory such as flash memory, hard drives, solid state drives, removable media, and so forth, but do not include a propagating signal per se.


The above Detailed Description of examples and embodiments of the invention is not intended to be exhaustive or to limit the invention to the precise form disclosed above. While specific examples for the invention are described above for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize. References throughout the foregoing description to features, advantages, or similar language do not imply that all of the features and advantages that may be realized with the present technology should be or are in any single embodiment of the invention. Rather, language referring to the features and advantages is understood to mean that a specific feature, advantage, or characteristic described in connection with an embodiment is included in at least one embodiment of the present technology. Thus, discussion of the features and advantages, and similar language, throughout this specification may, but do not necessarily, refer to the same embodiment. Furthermore, the described features, advantages, and characteristics of the present technology may be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the present technology can be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the present technology.


Any patents and applications and other references noted above, including any that may be listed in accompanying filing papers, are incorporated herein by reference. Aspects of the invention can be modified, if necessary, to employ the systems, functions, and concepts of the various references described above to provide yet further implementations of the invention.


Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like, are to be construed in an inclusive sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to,” As used herein, the terms “connected,” “coupled,” or any variant thereof, means any connection or coupling, either direct or indirect, between two or more elements; the coupling or connection between the elements can be physical, logical, or a combination thereof. Additionally, the words “herein,” “above,” “below,” and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. Where the context permits, words in the above Detailed Description using the singular or plural number may also include the plural or singular number respectively. The word “or,” in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list.


The teachings of the invention provided herein can be applied to other systems, not necessarily the system described above. The elements and acts of the various examples described above can be combined to provide further implementations of the invention. Some alternative implementations of the invention may include not only additional elements to those implementations noted above, but also may include fewer elements. Further any specific numbers noted herein are only examples—alternative implementations may employ differing values or ranges.


While the above description describes various embodiments of the invention and the best mode contemplated, regardless how detailed the above text, the invention can be practiced in many ways. Details of the system may vary considerably in its specific implementation, while still being encompassed by the present disclosure. As noted above, particular terminology used when describing certain features or aspects of the invention should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the invention with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the invention to the specific examples disclosed in the specification, unless the above Detailed Description section explicitly defines such terms. Accordingly, the actual scope of the invention encompasses not only the disclosed examples, but also 811 equivalent ways of practicing or implementing the invention under the claims.


From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the various embodiments of the invention. Further, while various advantages associated with certain embodiments of the invention have been described above in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the invention. Accordingly, the invention is not limited, except as by the appended claims. Although certain aspects of the invention are presented below in certain claim forms, the applicant contemplates the various aspects of the invention in any number of claim forms. Accordingly, the applicant reserves the right to pursue additional claims after filing this application to pursue such additional claim forms, in either this application or in a continuing application.

Claims
  • 1. A method performed by one or more computing systems for detecting a crack in a screen of an electronic device, the method comprising: overlaying at least one kernel on an image of the screen of the electronic device at a selected location, wherein the kernel is configured to detect a crack at an orientation and comprises a matrix that has a plurality of regions; for each of the plurality of regions,determining a brightness value at the selected location; determining an average brightness value of a first two or more regions and an average brightness value of a second two or more regions;and automatically detecting a crack at the selected location if the average brightness values value of the first two or more regions is greater than the average brightness value of the second two or more plurality of regions by at least a predetermined threshold amount.
  • 2. The method of claim 1, further comprising: generating an image pyramid with multiple layers of the image, each of the layers being downsampled to a different degree; andfor each of the layers, overlaying the kernel on the layer to obtain, at various locations of the layer, brightness values for the plurality of regions.
  • 3. The method of claim 1 wherein the at least one kernel includes at least 10 kernels, and wherein each kernel is configured to detect a crack at a different orientation.
  • 4. The method of claim 1 wherein overlaying the kernel on the image comprises moving the kernel across each location on the image and multiplying underlying pixel values of the image with values of the kernel.
  • 5. The method of claim 1 wherein the plurality of first two or more regions include a left-line (LL) region, and a right-line (RL) region, and wherein the second two or more regions include an above-the-line (AL) region and a below-the-line (BL) region.
  • 6. The method of claim 1 wherein the kernel is configured to align the pixel areas in the image.
  • 7. The method of claim 1 further comprising, if no crack is automatically identified for the kernel at the selected location, overlaying a next kernel at the selected location.
  • 8. The method of claim 1 further comprising, if a crack is automatically identified for the kernel at the selected location, overlaying the kernel at a next location.
  • 9. The method of claim 5 further comprising determining whether at least one of the following conditions is satisfied: (a) an average the brightness value of the AL region and an average the brightness value of the BL region are within a predetermined range of one another; (b) the average brightness value of the AL region or the average brightness value of the BL region is below a predetermined threshold level; (c) the average brightness of the LL region and the RL region is greater than the average brightness of the AL region and the BL region by a predetermined threshold amount; (d) the average brightness value of the LL region and the average brightness value of the RL region differ from one another by more than a predetermined threshold amount; (e) any brightness value in the LL, RL, AL, or BL regions is greater than a predetermined threshold value; (f) any brightness value in the LL, RL, AL, or BL regions is lower less than a predetermined threshold value; and (g) any three consecutive brightness values within the LL region or the RL region values have corresponding brightness levels that do not increase or decrease monotonically, wherein, if any of conditions (a)-(f) are satisfied, then the identified crack is discarded.
  • 10. The method of claim 1, further comprising, before overlaying the kernel on the image, evaluating the image of the screen to determine if an animated background is present.
  • 11. A method performed by one or more computing systems for detecting a crack in an illuminated electronic device screen, the method comprising: convolving an image of the illuminated electronic device screen with a plurality of kernels, wherein each kernel is configured to detect a crack at a different orientation and comprises a matrix that has a plurality of regions, and wherein convolving the image with the plurality of kernels comprises: for each of a plurality of locations of the image: overlaying a kernel at the location; for each of the plurality of regions, determining a brightness value at the location; determining an average brightness value of a first two or more regions and an average brightness value of a second two or more regions; automatically detecting a crack at the location if the average brightness values of the first two or more regions is greater than the average brightness value of the second two or more of the plurality of regions by at least a predetermined threshold amount; if a crack is detected at the location, overlaying the kernel at a next location; and if no crack is detected at the location, overlaying a next kernel at the location.
  • 12. The method of claim 11, further comprising: generating an image pyramid with multiple layers of the image, each of the layers being downsampled to a different degree; andfor each of the layers, convolving the layer with the plurality of kernels.
  • 13. The method of claim 11 wherein the plurality of kernels comprise at least 10 kernels.
  • 14. The method of claim 11 wherein overlaying a kernel at the location includes aligning the kernel with pixel areas in the image.
  • 15. The method of claim 14 wherein, automatically detecting a crack further comprises performing one or more secondary analyses based on brightness values in one or more of the first or second two or more regions.
  • 16. One or more computing systems for detecting a crack in an illuminated electronic device screen, the one or more computing systems comprising: one or more computer-readable storage mediums storing computer-executable instructions for controlling the one or more computing systems to: overlay a kernel on an image of the illuminated electronic device screen at a selected location, wherein the kernel is configured to detect a crack at an orientation and comprises a matrix that has a plurality of regions; for each of the plurality of regions, determine a brightness value at the selected location; determine an average brightness value for a first two or more regions and an average brightness value for a second two or more regions; and automatically detect a crack at the selected location, wherein automatically detecting a crack comprises identifying a crack if the average brightness values value of the first two or more regions is greater than and the average brightness value of the second two or more plurality of regions by at least a predetermined threshold amount; and one or more processors for executing the computer-executable instructions stored in the one or more computer-readable storage mediums.
  • 17. The one or more computing systems of claim 16 wherein the computer-executable instructions further control the one or more computing systems to: generate an image pyramid with multiple layers of the image, each of the layers being downsampled to a different degree; andfor each of the layers, overlay the kernel on the layer to obtain, at various locations of the layer, brightness values for the plurality of regions.
  • 18. The one or more computing systems of claim 16 wherein overlaying the kernel on the image comprises moving the kernel across each location on the image and multiplying underlying pixel values of the image with values of the kernel.
  • 19. The one or more computing systems of claim 16 wherein overlaying a kernel on an image of the illuminated electronic device screen includes overlaying the kernel on an image of an illuminated mobile phone screen.
  • 20. The method of claim 1 wherein overlaying at least one kernel on an image of the screen of the electronic device includes overlaying the at least one kernel on an image of a screen of a mobile phone.
CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No. 15/195,828, titled “METHODS AND SYSTEMS FOR DETECTING CRACKS IN ILLUMINATED ELECTRONIC DEVICE SCREENS,” and filed Jun. 28, 2016, now U.S. Pat. No. 10,269,110, the disclosure of which is incorporated herein by reference in its entirety.

US Referenced Citations (310)
Number Name Date Kind
3808439 Renius Apr 1974 A
4248334 Hanley et al. Feb 1981 A
4519522 McElwee May 1985 A
4715709 Sekine et al. Dec 1987 A
4821118 Lafreniere Apr 1989 A
4870357 Young et al. Sep 1989 A
4878736 Hekker et al. Nov 1989 A
4927051 Falk et al. May 1990 A
4951308 Bishop et al. Aug 1990 A
5027074 Haferstat Jun 1991 A
5077462 Newell et al. Dec 1991 A
5091773 Fouche et al. Feb 1992 A
5105149 Tokura Apr 1992 A
5216502 Katz Jun 1993 A
5280170 Baldwin Jan 1994 A
5319459 Mochizuki et al. Jun 1994 A
5339096 Beaufort et al. Aug 1994 A
5419438 Squyres et al. May 1995 A
5436554 Decker Jul 1995 A
5570920 Crisman et al. Nov 1996 A
5572444 Lentz et al. Nov 1996 A
5610710 Canfield et al. Mar 1997 A
5717780 Mitsumune et al. Feb 1998 A
5747784 Walter et al. May 1998 A
5775806 Allred Jul 1998 A
5839058 Phillips et al. Nov 1998 A
5920338 Katz Jul 1999 A
5949901 Nichani et al. Sep 1999 A
5965858 Suzuki et al. Oct 1999 A
5966654 Croughwell et al. Oct 1999 A
5987159 Nichani Nov 1999 A
5988431 Roe Nov 1999 A
6029851 Jenkins et al. Feb 2000 A
6041229 Turner Mar 2000 A
6181805 Koike et al. Jan 2001 B1
6228008 Pollington et al. May 2001 B1
6259827 Nichani Jul 2001 B1
6264104 Jenkins et al. Jul 2001 B1
6330354 Companion et al. Dec 2001 B1
6330958 Ruskin et al. Dec 2001 B1
6393095 Robinson May 2002 B1
6462644 Howell et al. Oct 2002 B1
6529837 Kang Mar 2003 B1
6535637 Wootton et al. Mar 2003 B1
6573886 Lehtinen et al. Jun 2003 B1
6587581 Matsuyama et al. Jul 2003 B1
6595684 Casagrande et al. Jul 2003 B1
6633377 Weiss et al. Oct 2003 B1
6667800 Larsson et al. Dec 2003 B1
6754637 Stenz Jun 2004 B1
6758370 Cooke et al. Jul 2004 B2
6798528 Hartman Sep 2004 B1
6822422 Sagawa Nov 2004 B2
6842596 Morii et al. Jan 2005 B2
6854656 Matsumori Feb 2005 B2
7069236 Tsunenari Jun 2006 B1
7076449 Tsunenari et al. Jul 2006 B2
7178720 Strubbe et al. Feb 2007 B1
7234609 DeLazzer et al. Jun 2007 B2
7251458 O'Connell Jul 2007 B2
7268345 Schultz Sep 2007 B2
7334729 Brewington Feb 2008 B2
7520666 Pevzner et al. Apr 2009 B2
7529687 Phan May 2009 B1
7567344 LeBlanc Jul 2009 B2
7646193 Suzuki et al. Jan 2010 B2
7649450 Campion et al. Jan 2010 B2
7702108 Amon et al. Apr 2010 B2
7735125 Alvarez et al. Jun 2010 B1
7761331 Low et al. Jul 2010 B2
7783379 Beane et al. Aug 2010 B2
7881965 Bowels et al. Feb 2011 B2
8010402 Sharma et al. Aug 2011 B1
8019588 Wohlberg Sep 2011 B1
8025229 Hammond et al. Sep 2011 B2
8031930 Wang et al. Oct 2011 B2
8107243 Guccione et al. Jan 2012 B2
8112325 Foy et al. Feb 2012 B2
8195511 Bowles et al. Jun 2012 B2
8200533 Librizzi et al. Jun 2012 B2
8254883 Uchida Aug 2012 B2
8266008 Siegel et al. Sep 2012 B1
8423404 Bowels et al. Apr 2013 B2
8429021 Kraft et al. Apr 2013 B2
8463646 Bowles Jun 2013 B2
8543358 Trabona Sep 2013 B2
8566183 Bonar et al. Oct 2013 B1
8606633 Tarbert et al. Dec 2013 B2
8718717 Vaknin et al. May 2014 B2
8743215 Lee Jun 2014 B1
8824136 Interian et al. Sep 2014 B1
9010627 Prasad et al. Apr 2015 B1
9043026 Lien et al. May 2015 B2
9195979 Geller Nov 2015 B2
9317989 Grow et al. Apr 2016 B2
9582101 Chang et al. Feb 2017 B2
9595238 Won Mar 2017 B2
9818160 Bowles et al. Nov 2017 B2
9881284 Bowles Jan 2018 B2
9885672 Forutanpour Feb 2018 B2
9911102 Bowles Mar 2018 B2
10032140 Bowles et al. Jul 2018 B2
10055798 Bowles et al. Aug 2018 B2
10127647 Forutanpour et al. Nov 2018 B2
10269110 Forutanpour Apr 2019 B2
10401411 Snook et al. Sep 2019 B2
10417615 Bowles et al. Sep 2019 B2
10438174 Bowles et al. Oct 2019 B2
10445708 Hunt et al. Oct 2019 B2
10475002 Silva Nov 2019 B2
20010039531 Aoki Nov 2001 A1
20020014577 Ulrich et al. Feb 2002 A1
20020035515 Moreno Mar 2002 A1
20020067184 Smith et al. Jun 2002 A1
20020087413 Mahaffy et al. Jul 2002 A1
20020129170 Moore et al. Sep 2002 A1
20020157033 Cox Oct 2002 A1
20020162966 Yoder Nov 2002 A1
20020186878 Hoon et al. Dec 2002 A1
20030006277 Maskatiya et al. Jan 2003 A1
20030018897 Bellis, Jr. et al. Jan 2003 A1
20030036866 Nair et al. Feb 2003 A1
20030061150 Kocher et al. Mar 2003 A1
20030146898 Kawasaki et al. Aug 2003 A1
20030170529 Sagawa Sep 2003 A1
20030197782 Ashe Oct 2003 A1
20030204289 Banerjee et al. Oct 2003 A1
20040012825 Tesavis Jan 2004 A1
20040114153 Andersen et al. Jun 2004 A1
20040141320 Bock et al. Jul 2004 A1
20040150815 Sones et al. Aug 2004 A1
20040156557 Van Der Weij Aug 2004 A1
20040156667 Van Der Weij et al. Aug 2004 A1
20040186744 Lux Sep 2004 A1
20040205015 DeLaCruz Oct 2004 A1
20040235513 O'Connell Nov 2004 A1
20040242216 Boutsikakis Dec 2004 A1
20040262521 Devitt et al. Dec 2004 A1
20050027622 Walker et al. Feb 2005 A1
20050109841 Ryan et al. May 2005 A1
20050128551 Yang Jun 2005 A1
20050137942 LaFleur Jun 2005 A1
20050139661 Eglen et al. Jun 2005 A1
20050143149 Becker et al. Jun 2005 A1
20050167620 Cho et al. Aug 2005 A1
20050187657 Hashimoto et al. Aug 2005 A1
20050216120 Rosenberg et al. Sep 2005 A1
20050222690 Wang et al. Oct 2005 A1
20050231595 Wang et al. Oct 2005 A1
20050240958 Nguyen et al. Oct 2005 A1
20060167580 Whittier Jan 2006 A1
20060038114 Cofer et al. Feb 2006 A9
20060047573 Mitchell et al. Mar 2006 A1
20060074756 Boykin Apr 2006 A1
20060184379 Tan et al. Aug 2006 A1
20060195384 Bauer et al. Aug 2006 A1
20060217152 Fok et al. Sep 2006 A1
20060219776 Finn Oct 2006 A1
20060229108 Cehelnik Oct 2006 A1
20060235747 Hammond et al. Oct 2006 A1
20060261931 Cheng et al. Nov 2006 A1
20060271431 Wehr et al. Nov 2006 A1
20060279307 Wang et al. Dec 2006 A1
20060280356 Yamagashi Dec 2006 A1
20070013124 Graef et al. Jan 2007 A1
20070032098 Bowels et al. Feb 2007 A1
20070057815 Foy et al. Mar 2007 A1
20070129906 Stoecker et al. Jun 2007 A1
20070133844 Waehner et al. Jun 2007 A1
20070150403 Mock et al. Jun 2007 A1
20070140310 Rolton et al. Jul 2007 A1
20070205751 Suzuki et al. Sep 2007 A1
20070263099 Motta et al. Nov 2007 A1
20070269099 Nishino et al. Nov 2007 A1
20070281734 Mizrachi Dec 2007 A1
20080004828 Mizrachi Jan 2008 A1
20080027581 Saether et al. Jan 2008 A1
20080033596 Fausak et al. Feb 2008 A1
20080097770 Low et al. Apr 2008 A1
20080109746 Mayer May 2008 A1
20080111989 Dufour et al. May 2008 A1
20080149720 Colville Jun 2008 A1
20080177598 Davie Jul 2008 A1
20080207198 Juric Aug 2008 A1
20080231113 Guccione et al. Sep 2008 A1
20080255901 Carroll et al. Oct 2008 A1
20080256008 Kwok Oct 2008 A1
20080281691 Pearson et al. Nov 2008 A1
20080296374 Gonen et al. Dec 2008 A1
20080303915 Omi Dec 2008 A1
20080306701 Zhong et al. Dec 2008 A1
20090051907 Li et al. Feb 2009 A1
20090079388 Reddy Feb 2009 A1
20090078775 Giebel et al. Mar 2009 A1
20090095047 Patel et al. Apr 2009 A1
20090160668 Crowley et al. Jun 2009 A1
20090184865 Valo et al. Jul 2009 A1
20090190142 Taylor et al. Jul 2009 A1
20090207743 Huq et al. Aug 2009 A1
20090244285 Chathukutty Oct 2009 A1
20090247133 Holmen et al. Oct 2009 A1
20090251815 Wang et al. Oct 2009 A1
20090262341 Konopa et al. Oct 2009 A1
20090265035 Jenkinson et al. Oct 2009 A1
20090299543 Cox et al. Dec 2009 A1
20090312009 Fishel Dec 2009 A1
20090321511 Browne Dec 2009 A1
20100005004 Hudak et al. Jan 2010 A1
20100063894 Lundy Mar 2010 A1
20100088192 Bowles et al. Apr 2010 A1
20100110174 Leconte May 2010 A1
20100115887 Schroeder et al. May 2010 A1
20100147953 Barkan Jun 2010 A1
20100157280 Kusevic et al. Jun 2010 A1
20100161397 Gauthier et al. Jun 2010 A1
20100162359 Casey et al. Jun 2010 A1
20100169231 Bowles et al. Jul 2010 A1
20100185506 Wolff Jul 2010 A1
20100219234 Forbes Sep 2010 A1
20100228676 Librizzi et al. Sep 2010 A1
20100235198 Fini et al. Sep 2010 A1
20100237854 Kumhyr et al. Sep 2010 A1
20100262481 Baker et al. Oct 2010 A1
20110035322 Lively Feb 2011 A1
20110043628 Yun Feb 2011 A1
20110060641 Grossman et al. Mar 2011 A1
20110067520 Ihrke et al. Mar 2011 A1
20110113479 Ganem May 2011 A1
20110235853 Bowles et al. Sep 2011 A1
20110313840 Mason et al. Dec 2011 A1
20120016518 Saario et al. Jan 2012 A1
20120026582 Okabe et al. Feb 2012 A1
20120029985 Wilson et al. Feb 2012 A1
20120030097 Hagan et al. Feb 2012 A1
20120054113 Jayaraman et al. Mar 2012 A1
20120063501 Aguren Mar 2012 A1
20120078413 Baker Mar 2012 A1
20120116928 Gventer May 2012 A1
20120116929 Gventer May 2012 A1
20120117001 Gventer et al. May 2012 A1
20120127307 Hassenzahl May 2012 A1
20120146956 Jenkinson Jun 2012 A1
20120191562 Bowles et al. Jul 2012 A1
20120235812 De Mello et al. Sep 2012 A1
20120254046 Librizzi et al. Oct 2012 A1
20120303431 Phillips et al. Nov 2012 A1
20130006713 Haake Jan 2013 A1
20130034305 Jahanshahi et al. Feb 2013 A1
20130046611 Bowles et al. Feb 2013 A1
20130046699 Bowles et al. Feb 2013 A1
20130124426 Bowles et al. May 2013 A1
20130126741 Srivastava et al. May 2013 A1
20130144797 Bowles et al. Jun 2013 A1
20130155061 Jahanshahi et al. Jun 2013 A1
20130173434 Hartman Jul 2013 A1
20130181935 McKenzie et al. Jul 2013 A1
20130191236 Bowles Jul 2013 A1
20130198089 Bowles Aug 2013 A1
20130198144 Bowles Aug 2013 A1
20130226679 Bowles Aug 2013 A1
20130246211 Sullivan Sep 2013 A1
20130246212 Sullivan Sep 2013 A1
20130253700 Carson et al. Sep 2013 A1
20130275314 Bowles Oct 2013 A1
20130284805 Kraft et al. Oct 2013 A1
20130290146 West et al. Oct 2013 A1
20130297388 Kyle, Jr. et al. Nov 2013 A1
20140006451 Mullis et al. Jan 2014 A1
20140012643 Behrisch Jan 2014 A1
20140038556 DeSousa Feb 2014 A1
20140052329 Amirpour Feb 2014 A1
20140067710 Gventer et al. Mar 2014 A1
20140143161 Ahn May 2014 A1
20140150100 Gupta et al. May 2014 A1
20140156883 Bowles Jun 2014 A1
20140214505 Shuster-Arechiga et al. Jul 2014 A1
20140235258 Chen et al. Aug 2014 A1
20140244315 Cahill et al. Aug 2014 A1
20140278244 Humphrey et al. Sep 2014 A1
20140297368 Ferder Oct 2014 A1
20140347473 Wolff et al. Nov 2014 A1
20150006281 Takahashi Jan 2015 A1
20150066677 Bowles et al. Mar 2015 A1
20150088731 Ackerman Mar 2015 A1
20150193797 Gerrity Jul 2015 A1
20150206200 Edmondson et al. Jul 2015 A1
20150278529 Cho et al. Oct 2015 A1
20150120485 Nash Nov 2015 A1
20150332206 Trew et al. Nov 2015 A1
20150356637 Graffia et al. Dec 2015 A1
20160019607 Burmester et al. Jan 2016 A1
20160019685 Nguyen et al. Jan 2016 A1
20160055392 Nakano Feb 2016 A1
20160092849 Cirannek et al. Mar 2016 A1
20160125548 Bowles et al. May 2016 A1
20160125612 Seki et al. May 2016 A1
20160132840 Bowles et al. May 2016 A1
20160171456 Bowles et al. Jun 2016 A1
20160171544 Heminger et al. Jun 2016 A1
20160171575 Bowles et al. Jun 2016 A1
20160210648 Cirannek et al. Jul 2016 A1
20160269401 Saito et al. Sep 2016 A1
20160275460 Ploetner et al. Sep 2016 A1
20160275518 Bowles et al. Sep 2016 A1
20160379287 Dabiri Dec 2016 A1
20170083886 Silva et al. Mar 2017 A1
20170091823 Adinarayan et al. Mar 2017 A1
20170169401 Beane et al. Jun 2017 A1
20170278191 Tassone et al. Sep 2017 A1
20170286920 Silva et al. Oct 2017 A1
Foreign Referenced Citations (91)
Number Date Country
2818533 May 2012 CA
1365479 Aug 2002 CN
2708415 Jul 2005 CN
1864088 Nov 2006 CN
1957320 May 2007 CN
200965706 Oct 2007 CN
102246384 Nov 2011 CN
202351953 Jul 2012 CN
202394296 Aug 2012 CN
102654927 Sep 2012 CN
102812500 Dec 2012 CN
102930642 Feb 2013 CN
102976004 Mar 2013 CN
103198562 Jul 2013 CN
103226870 Jul 2013 CN
203242065 Oct 2013 CN
103440607 Dec 2013 CN
103544772 Jan 2014 CN
203408902 Jan 2014 CN
103662541 Mar 2014 CN
103679147 Mar 2014 CN
203520502 Apr 2014 CN
203588366 May 2014 CN
103954626 Jul 2014 CN
105513201 Apr 2016 CN
1168253 Jan 2002 EP
1703436 Sep 2006 EP
2167553 May 1986 GB
7112801 May 1995 JP
H7334583 Dec 1995 JP
2000121564 Apr 2000 JP
3123095 Jan 2001 JP
2002019147 Jan 2002 JP
2002183286 Jun 2002 JP
2002259528 Sep 2002 JP
2002302252 Oct 2002 JP
2002324264 Nov 2002 JP
2002358354 Dec 2002 JP
2003139516 May 2003 JP
2003242243 Aug 2003 JP
2003264007 Sep 2003 JP
2003267509 Sep 2003 JP
2004021569 Jan 2004 JP
2004288143 Oct 2004 JP
2004303102 Oct 2004 JP
2004341681 Dec 2004 JP
2006127308 May 2006 JP
2006195814 Jul 2006 JP
2006227764 Aug 2006 JP
2006260246 Sep 2006 JP
2007141266 Jun 2007 JP
2007179516 Jul 2007 JP
2007265340 Oct 2007 JP
2008522299 Jun 2008 JP
2008293391 Dec 2008 JP
2007086725 Apr 2009 JP
2009245058 Oct 2009 JP
2009250971 Oct 2009 JP
2010177720 Aug 2010 JP
2012058932 Mar 2012 JP
2013033361 Feb 2013 JP
2013037441 Feb 2013 JP
2013531823 Aug 2013 JP
20000064168 Nov 2000 KR
20130085255 Jul 2013 KR
20140037543 Mar 2014 KR
WO115096 Mar 2001 WO
WO205176 Jan 2002 WO
WO225613 Mar 2002 WO
WO239357 May 2002 WO
WO3012717 Feb 2003 WO
WO3014994 Feb 2003 WO
WO2004021114 Mar 2004 WO
WO2004114490 Dec 2004 WO
WO2005008566 Jan 2005 WO
WO2005101346 Oct 2005 WO
WO2006058601 Jun 2006 WO
WO2006080851 Aug 2006 WO
WO2007066166 Jun 2007 WO
WO9128176 Oct 2009 WO
WO2009128173 Oct 2009 WO
WO2009129526 Oct 2009 WO
WO2010040116 Apr 2010 WO
WO2010128267 Nov 2010 WO
WO2010128315 Nov 2010 WO
WO2011131016 Oct 2011 WO
WO2012138679 Oct 2012 WO
WO2013063042 May 2013 WO
WO2013074819 May 2013 WO
WO2014075055 May 2014 WO
WO2015022409 Feb 2015 WO
Non-Patent Literature Citations (31)
Entry
ColorCrack: Identifying Cracks in Glass James Max Kanter Massachusetts Institute of Technology 77 Massachusetts Ave; Sep. 2017.
2006 Florida Statutes Title XXXIII, Chapter 538, Sections 538.03 and 538.04, 7 pages.
Aftermarket Cellular Accessories, “Cellular Phone Model Identification,” retrieved from http://web/archive.org/web/20060328064957/http://aftermarketcellular.com/ic/identification.html on Mar. 16, 2014, published Mar. 28, 2006, 3 pages.
Altec Lansing User's Guide 2007, 8 pages.
Bournique, D.: “Mobile Karma Shuts Down As iCloud and Blacklists Challenge Used Phone Buyers”, Prepaid Phone News, Jul. 23, 2014 (Jul. 23, 2014), XP055229747, Retrieved from the Internet <URL:http://www.prepaidphonenews.com/2014/07/mobile-karma-shuts-down-as-icloud-and.html>; accessed Nov. 27, 2017; 2 pages.
Business Wire, “The World's First Office Photography Machine” at CES 2008 Launched by Ortery Technologies, Jan. 7, 2008, 3 pages.
CNET, “Tackling LCD “burn ins”, and dead/stick Pixels”, published Sep. 2, 2009, retrieved from http://www.cnet.com/news/tackling-lcd-burn-ins-and-deadstuck-pixels/.
Evgenii Masunov, Mar. 25, 2010, http://www.appleinsider.ru/news/ipone-obladaet-luchshim-tachskrinom-provereno_robotom.html, 4 pages.
Geekanoids, You Tube Video, “Apple iPhone 3GS Unboxing and Review”, uploaded on Jun. 19, 2009, retrieved from http://www.youtube.com/watch?v=GCEi9QAeDqk on Sep. 2, 2009.
Graffia et al., “Retail Station for E-Device Identification, Assessment, and Trade-In”, Jun. 6, 2014 (Drawings and Specification) (Year: 2014).
GSM Arena Glossary, “LCD (Liquid Crystal Display”, retrieved from http://www.gsmarena.com/glossary.php3?term=lcd on Apr. 28, 2016, 1 page.
Investopedia: What's the difference between weighted average accounting and FIFO/LILO accounting methods? Aug. 19, 2010. Accessed via archive.org [https://web.archive.org/web/20100819200402/http://www.investopedia.com/ask/answers/09/weighted-average-fifo-lilo-accounting.asp].
Kanter, James Max, “Color Crack:Identifying Cracks in Glass,” dated Dec. 9, 2014; retrieved from the internet http://www.jmaxkanter.com/static/papers/color_crack.pdf on Sep. 22, 2017.
Lambert, Emily, “Use It Up, Wear It Out”, Forbes 175.5 (2005): 77-78. Business Source Complete. Web. Jan. 6, 2015, 3 pages.
Littleton Partners with Donations Ink (Jan. 19, 2006) US Fed News Service, Including US State News. Web. Jan. 6, 2015, 1 page.
MobileGazette.com, “2006 in Review: The Good, The Bad and The Ugly”, published Dec. 2006, retrieved from http://www.mobilegazette.com/2006-review-06x12x22.htm on Nov. 11, 2015.
Oliveira, et al., “Automatic crack detection on road imagery using anisotropic diffusion and region linkage,” 18th European Signal Processing Conference (EUSIPCO-2010), Aug. 23, 2010, pp. 274-278.
PC World, “Wipe Your Cell Phone's Memory Before Giving it Away”, published Jan. 2006, retrieved from http://www.washingtonpost.com/wp-dyn/content/article/2006/01/30/AR2006013001144.html on Nov. 10, 2015.
Perng et al., “A Novel Vision System for CRT Panel Auto-Inspection”, Proceedings of the 2005 IEEE International Conference on Mechatronics, Jul. 10-12, 2005, pp. 4.
Perng et al., “A Novel Vision System for CRT PaNnel Auto-Inspection”, Journal of the Chinese Institute of Industrial Engineers, vol. 24, No. 5, pp. 341-350 (2007).
Rawson, Chris, “TUAW: 25 Ways to Check the Hardware on Your iPhone 4”, published Aug. 12, 2010, retrieved at http://www.tuaw.com/2010/08/13/hardware-test-your-iphone-4/ on Feb. 28, 2014.
Rehg et al. “Vision for a Smart Kiosk” IEEE, Computer Society Conference on Computer Vision and Pattern Recognition (1997).
Steinhilper, R. “Remanufacturing: The Ultimate Form of Recycling”, Fraunhofer IRBVerlag, 1998, parts 1-3, http://www.reman.org/Publications_main.htm.
SimplySellular, “Get Cash for your Old Cell Phone”, published Apr. 2, 2010, retrieved from http://simplysellular.com/conditions.php on Jan. 6, 2015, 2 pages.
Tecace Software: “Your phone appraisal—Movaluate—Android Apps on Google Play”, Android Apps on Google Play, Aug. 12, 2013 (Aug. 12, 2013), XP055230264, Retrieved from the Internet <URL:https://play.google.com/store/apps/details?id=com.tecace.android.app.movaluate&hl=en>; accessed Nov. 27, 2017; 2 pages.
Trading devices for dollars, The Economist (US) 405.8813:8 (US), Economist Intelligence Unit N.A. Incorporated, Dec. 1, 2012.
Turner, “5 MP3 Players for Pumping Up Your Workouts,” Mashable.com, Nov. 4, 2010, available online at https://mashable.com/2010/11/04/mp3-players-for-sports/ (Year: 2010).
Wilson, Doug, “Liquid Crystal Display (LCD) Inspection System”, National Instruments Case Study, available May 10, 2009, retrieved from http://sine.ni.com/cs/app/cod/p/id/cs-345 on Jan. 5, 2015, 2 pages.
Yahoo Answers, “What is a Clean ESN?” published Jun. 23, 2009, retrieved from http://web.archive.org/web/20090623215042/http://answers.yahoo.com/question/inde,8020US?qid=20080318061012AANFRco on Apr. 3, 2014.
Zhang, Yiyang, “The design of glass crack detection system based on image preprocessing technology,” 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, IEEE, Dec. 20, 2014; pp. 39-42.
International Search Report and Written Opinion dated Oct. 10, 2017 in International Application No. PCT/US2017/039639, 19 pages.
Related Publications (1)
Number Date Country
20200020091 A1 Jan 2020 US
Continuations (1)
Number Date Country
Parent 15195828 Jun 2016 US
Child 16357041 US