Not Applicable
1. Field of the Invention
The present invention generally relates to recycling of electronic devices. More specifically, the present invention relates to a kiosk for visually analyzing electronic devices and providing remuneration to an owner for recycling of the electronic device.
2. Description of the Related Art
There has been a large increase in the number of electronic devices used by the typical consumer. These devices include cell phones, PDA's, mp3 players, GPS devices, cameras, beepers, remote controls, cordless phones, calculators, etc. The rapid pace at which new technology and models of electronic devices are introduced creates a situation where many consumers upgrade or replace one or more recyclable device on a frequent basis. Often, the consumer does not dispose of the prior electronic device, but rather just stops using it and begins using the new device. This may happen over several generations of such devices.
In addition to the electronic devices mentioned above, there are many other types of devices that have relatively high frequency replacement rates, including portable mobile electronic devices, such as cell phones, MP3 players, etc, and non-portable electronic devices, such as computers, printers, and the like. In addition to electronic devices, there are content based digital media such as games on CD, DVD, or cartridge, or entertainment mass storage items such as CDs, DVDs, BluRay, etc. There is a need for handling of such items in an ecologically friendly manner, both via recycling or by proper disposal procedures. It has not been convenient for owners of electronic devices to either recycle such devices or to properly dispose of such devices. There is currently little incentive for a device owner to “do the right thing” with a used device. When the owner just stops using a device and simply puts it in storage: the opportunity for recycling or re-use by another party is lost. If the owner just throws the device away in normal trash containers, the proper recycling or safe disposing of the device is thwarted.
One particular problem associated with this phenomenon can be illustrated by an example of mobile phones. There are more than 3.6 billion mobile phone users in the world with an annual growth of 10% per annum. The replacement rate of mobile handsets is roughly every 18 months as new models have more features and new standards evolve. Wireless carriers also offer new phones below cost, or free, as incentives to get customers to sign lucrative two-year service contracts ensuring a constant build-up of old mobile phones. Old mobile phones and other mobile devices (pagers, PDAs) present a growing threat to the environment. As of 2007, there are more than 750 million mobile phones waiting to be recycled in the US, either in drawers or already in the waste stream. Another 150+ million or so are added every year. Once in the waste stream, these devices may leak Lead, Mercury, Cadmium, Arsenic and other toxic substances into the water supply. Municipalities often incinerate their waste, instantly putting these toxic elements into the air, and they return to earth in rain water. A problem that needs to be solved is to make it easy and accessible for the public to recycle or resell their mobile phones and other recyclable devices. Two reasons why mobile phones are not being recycled or resold are difficult access to recycling or reselling facilities, and secondly security concerns about the information stored on the mobile phone. In addition to mobile phones, the same problems apply to many other electronic devices.
Technology has not yet provided a resolution to this problem. One invention is Bishop, U.S. Pat. No. 4,951,308 for Automated Vending Of Cellular Hand-Held Telephones And Cellular Telephone Services, which discloses a vending machine that dispenses cellular telephones purchased by consumers through the vending machine. Bishop essentially adds to the problem by making it easier to acquire mobile phones.
Taylor et al., U.S. Patent Publication Number 2009/0190142, for a Method And System For Connecting A Data Storage Device To A Kiosk, discloses a kiosk with a docking port and an optical recognition device for identifying a data port on a data storage device. Taylor is directed at printing digital images at a photo kiosk.
The prior art has failed to recognize the problems associated with recycling mobile phones in a manner that is enticing to a consumer yet financially rewarding to the recycler. Further, the prior art has failed to provide an automated means for visually inspecting a LCD screen of a mobile phone to determine if the LCD screen is damaged. Additionally, the prior art has failed to provide an automated means for determining if an electronic device submitted for recycling and remuneration is authentic.
The present invention enables one to securely recycle, donate, trade-in, and/or sell mobile phones in a publicly accessible location. In an embodiment where mobile phones are recycled, the invention is used by a mobile phone owner to submit his/her mobile phone for recycling via a recycling kiosk and receive compensation in some manner. The compensation might be dispersed via cash, voucher, credit or debit card, or other magnetic or electronic transaction methods.
In one embodiment, a method for conducting the collection of previously used electronic devices for the purpose of recycling and refurbishing uses a kiosk in a publicly accessible location. The kiosk displays one or more transaction options. The method further includes interaction between the user and the kiosk display options which may include powering the electronic device, testing and optical scanning, erasing of the stored data in the electronic device, determination and acceptance by consumer of compensation for the electronic device's value. The method may further include selection by consumers through interaction with the kiosk a variety of compensation methods including dispensing of cash, or redeemable voucher via coupon, or credit card debiting or crediting, electronic donation to user specified charity or charities, or other electronic payment methods.
One aspect of the present invention is a method for analysis of an electronic device and financial remuneration to a user for submission of the electronic device. The method comprises positioning an electronic device in an inspection area of a kiosk; wherein the inspection area has a light. The method further comprises imaging a display screen of the electronic device in a deactivated mode. Next, the method comprises imaging a display screen of the electronic device in an active mode, wherein the light is off, to generate an analysis image of the electronic device. The method further comprises imaging the display screen of the electronic device in the active mode, wherein the light is on, to generate a first image of the electronic device. Next, the method comprises subtracting a first image of the electronic device from the analysis image of the electronic device to generate a subtraction image of the electronic device. The subtraction image is compared to the image of the electronic device in a deactivated mode to determine if the display screen of the electronic device has any defects and to define an analyzed electronic device. Lastly, the method comprises determining a value for the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value of the analyzed electronic device.
The kiosk of the method comprises a housing, the housing comprising a user interface on an exterior surface of the housing for the user to input information, an upper dome and a lower dome, wherein the upper dome and the lower dome comprise a plurality of mirrors. The kiosk further comprises an upper chamber camera, a lower chamber camera and a transparent surface. The kiosk further comprises a processor within the housing and in communication with the at least one camera, the processor configured to identify the brand and model number of the electronic device based on at least one of the information from the user and the images from the at least one camera, the processor configured to determine a financial remuneration value for the electronic device.
Another aspect of the present invention is a method for analysis of an electronic device and financial remuneration to a user for submission of the electronic device. The method comprises positioning an electronic device in an inspection area of a kiosk, the inspection area having a camera. The method further comprises imaging a portion of the electronic device, the portion comprising the perimeter of the electronic device, resulting in a perimeter image. The method further comprises inspecting the perimeter image of the electronic device obtained by at least one camera disposed in the inspection area to determine if a display screen of the electronic device has any defects and to define an analyzed electronic device. Lastly the method comprises determining a value for the analyzed electronic device.
The kiosk of the method comprises a housing, a user interface on an exterior surface of the housing for the user to input information, an upper dome and a lower dome, wherein the upper dome and the lower dome comprise a plurality of mirrors. The kiosk further comprises an upper chamber camera, a lower chamber camera and a transparent surface. The kiosk also comprises a processor within the housing and in communication with the at least one camera, the processor configured to identify the brand and model number of the electronic device based on at least one of the information from the user and the images from the at least one camera, the processor configured to determine a financial remuneration value for the electronic device.
The method further includes wherein information from the perimeter image includes a model name and location of a LED aperture. Additionally, the processor is configured to automatically adjust to a rectangular shape for the perimeter image. The perimeter image comprises a 360 degree image. Information from the perimeter image comprises a location of a USB port, a location of the volume control buttons, a location of the camera button, and a location of the power on and off button. The information from the perimeter image also comprises a location of the camera lens and a logo of the electronic device.
Yet another aspect of the present invention is a method for analysis of an electronic device and financial remuneration to a user for submission of the electronic device. The method comprises positioning an electronic device in an inspection area of a kiosk; wherein the inspection area has a light. The method further comprises imaging a display screen of the electronic device with lights of the inspection area illuminating the display screen of the device. Next, the method comprises imaging a display screen of the electronic device with the lights of the inspection area off, to generate an analysis image of the electronic device. Next, the method comprises subtracting the analysis image of the electronic device from the first image of the electronic device to generate a synthesized image of the electronic device. The subtraction image is compared to trained images of electronic devices. If the electronic device is a fake with a picture printed on cardboard underneath the glass where the LCD would normally be positioned, and the electronic device is without electronic components inside, then when the lights are off there will be nothing coming from the screen. By doing some processing on the first image, and detecting that it has multiple colors and color variation on the display screen area, yet it isn't emitting any light, the method assumes that the electronic device is a fake. The method also explicitly trains fake display electronic devices as they usually have the same picture in the LCD area. Lastly, the method comprises determining a value for the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value of the analyzed electronic device.
This method also determines crack detection on the display screen, which is related to detecting if the electronic device has multiple color variations. The method determines the imaging is not getting actual cracks in the glass confused with pictures underneath the glass, so doing some sort of color entropy metric assist in distinguishing one from the other (cracks in the glass do not give off multiple different colors).
Yet another aspect of the present invention is a method for analysis of an electronic device to determine the authenticity of the electronic device, and to provide financial remuneration to a user for submission of the electronic device if the electronic device is authentic. The method includes positioning an electronic device in an inspection area of a kiosk; wherein the inspection area has a light. The method also includes imaging the electronic device wherein the light of the inspection area is on to generate a first image. The method also includes imaging the electronic device wherein the light of the inspection area is off to generate a second image of the electronic device. The method also includes generating a synthesized image of the electronic device from the first image and the second image, wherein the synthesized image is generated to resemble an image of the electronic device would be with the display screen off. The method also includes comparing the synthesized image to a trained image of a plurality of electronic devices to determine the authentic of the electronic device, wherein the train image comprises a display screen utilized by unauthentic electronic devices.
The method may further include detecting cracks in the display screen. The method may also utilize a color entropy metric.
Yet another aspect of the present invention is a dome shaped apparatus, the dome shaped apparatus comprising an upper dome, a lower dome and the upper and lower dome comprising a plurality of walls, wherein the plurality of walls are composed of mirrors. The dome shaped apparatus further comprises a transparent surface and at least one camera, the camera capable of obtaining a 360 degree view of an electronic device placed within the dome shaped apparatus. The upper dome preferably comprises an upper chamber camera. The lower dome preferably comprises a lower chamber camera. Preferably, a combination of the each of the upper dome and lower dome cameras and the plurality of mirrors allow for an image of the device placed on the transparent surface. Preferably, the combination of the each of the upper dome and lower dome cameras and the plurality of mirrors allow for a 360 degree of the electronic device placed on the transparent surface. Each of the upper dome and lower dome cameras are moveable.
Having briefly described the present invention, the above and further objects, features and advantages thereof will be recognized by those skilled in the pertinent art from the following detailed description of the invention when taken in conjunction with the accompanying drawings.
The invention allows for automatic analysis of an electronic device to determine if the device damaged in order to ascertain a value for recycling the electronic device. The automatic analysis is preferably performed utilizing a kiosk or recycling machine. The kiosk has an inspection area with an upper chamber and a lower chamber. Preferably each chamber has a camera. The kiosk also has a transparent plate between the inspection area to allow for viewing the bottom of an electronic device placed on the transparent plate. Each chamber preferably has multiple mirrors to provide multiple views of an electronic device within the inspection area. The mirrors allow for obtaining a multi-dimensional view of an electronic device placed on the transparent plate. Preferably, the mirrors allow for obtaining a 360 degree view of an electronic device placed on a rotatable transparent plate. Preferably, the mirrors allow for determining a height, width and/or length of an electronic device.
Mobile phones are preferably partitioned into three basic shapes: 1) a flip phone or clam shell type such as the MOTOROLA RAZR; 2) a slider phone which exposes a keyboard or screen such as the MOTORLA DROID; and 3) a bar shape phone such as the Apple iPHONE or the Research in Motion BLACKBERRY. The invention is also utilized with a network of kiosks in public spaces that perform a combination of recycling processing steps that receive, identify, visually inspect, electrically test, electrically erase, grade quality, containerize (bag), label, and inventory recyclable electronic devices. Each kiosk determines some form of compensation to an owner of the device. This compensation is preferably in the form of a direct payment, a credit on an account, a donation to a charity, a discount coupon for future purchases, or some similar form of compensation. The device owner has the choice to accept the offered compensation or reverse the transaction and retrieve the device.
In the following description, an example is given with respect to mobile phones. However, those skilled in the pertinent art will recognize that the system can be implemented with any number of other devices that have a LCD screen, without departing from the spirit and scope of the system.
As shown in
The kiosk 100 allows for automatic visual analysis of an electronic device to identify the electronic device and to determine electronic device is damaged in order to ascertain a value for recycling the electronic device. Further, the kiosk 100 also allows for electrical analysis of the electronic device. An additional explanation of a recycling kiosk is set forth in U.S. patent application Ser. No. 13/438,924, filed on Apr. 4, 2012, for a Kiosk For Recycling Electronic Devices, which is hereby incorporated by reference in its entirety.
As shown in
As shown in
The kiosk 100 is of a typical size and shape of a vending machine, such as a soda machine, coin changing machine, can recycling machine, or other vending machines. The housing 105 of the kiosk 100 protects the internal mechanism 101 and secures electronic devices submitted for recycling. The housing 105 is preferably constructed of a metal material, such as steel or aluminum, to prevent authorized access to the kiosk 100.
The inspection area 106 is preferably designed to permit a detailed visual inspection of an electronic device such as a mobile phone, tablet computer, e-reader, MP3 players, PDA. The size of the inspection area 106 is preferably 30 centimeters (“cm”) in length, by 30 cm in width and 20 cm in height. The walls of the inspection area are preferably white and/or mirrored to provide imaging of the electronic device.
The couplings from the kiosk 100 and to a remote computer are preferably a single coupling to a communications network such as the internet via wired LAN, wireless LAN, cellular or any other proprietary communications system. The Kiosk 100 preferably includes a processor 160 for processing the information obtained from the mobile phone and for controlling the components of the kiosk 100. Preferably, the processor 160 is a standard personal computer (“PC”) or other type of embedded computer running any operating system such as Linux or MAC OS. The processor 160 is most preferably a small form factor PC with integrated hard disk drive (“HDD”), central processing unit (“CPU”) and universal serial bus (“USB”) ports to communicate with the other components of the kiosk 100. One most preferred CPU is a DELL PC OPTIPLEX 780. Alternatively, the processing means is a microprocessor with a standalone motherboard which interfaces to a discrete HDD, power supply and the other components of the kiosk 100. The kiosk 100 preferably includes a memory 161 or other storage device, such as a disk drive, that stores the executable applications, test software, databases and other software required to operate the recycling kiosk 100.
The external communication component for the kiosk 100 preferably includes a wired Ethernet to provide connection to the internet, or alternatively the external communication component includes a wireless modem such as GSM, CDMA, 3G and 4G technologies for data communications.
As shown in
The processor 160 identifies the electronic device 150 submitted for recycling using information from the visual inspection and user interface. The processor 160 also determines the proper electrical connector 505 for connection to the data port of the electronic device 150 using information obtained during the visual inspection or from the user interface. The processor 160 also directs and receives information from the electrical analysis of the electronic device 150 performed using the electrical connector 505 connected to the data port of the electronic device 150. The processor also preferably determines a financial remuneration for the submitted electronic device 150 based on the visual inspection, optionally the electrical analysis and data stored in the memory 161 of the kiosk or information provided externally through the external communication component 167.
A flow chart for a preferred recycling method is shown in
If the electronic device is supported for refurbishment/resale the customer is then encouraged to engage the testing/rating operation of the system. At step 304, the system has determined the correct connector to couple to the electronic device. Connectivity options and are not limited to cable, standard or proprietary connectors, hard docks, reading removable or external physical memory or other wireless methods like WiFi, Bluetooth, RFID, NFC, and the like. At step 305 the electronic device is connected and inserted into inspection area 106. If this has been done correctly, the customer is given some indication (e.g. a green light) and the system proceeds to step 306. At step 306 the electronic device is tested for operation using diagnostics and operating via, for example, the OMSI interface. The diagnostics preferably includes electrical and physical testing including testing the electronic device's battery, screen, memory, button functionality and structural integrity.
Preferably, the electronic device is imaged and analysis software is used to identify scratches, cracks, wear patterns, dents, broken or missing pieces, inclusion of features such as lenses, buttons, connectors, badges, labeling and/or branding. Identification may be done by image comparison or other similar methods where the image taken of the electronic device is normalized and compared to a reference image. Other inspection methods may be used in conjunction with visual and/or electrical testing including weighing to determine specific weight and use that data to further refine verification of manufacturer and verification of exact device model. In another embodiment, the photographic image is used to identify the correct manufacturer and model number/product number. Visual identification could include any combination of the following: calculations based upon measurement, physical (e.g., mm, inches), pixel count or other. Identification based upon electronic device dimensions, location/size of buttons, LCD and other physical characteristics. One camera or multiple cameras may be used to determine height, width, depth as needed. Identification based on OCR (Optical Character Recognition) of identifiers such as Carrier (for phone and tablet computers), brand, model, serial number, other identifiers. Identification based upon barcodes. Consumer may be asked to orient CE on its front, back, side and then asked to change orientation as needed. Consumer may even be asked to remove CE cover(s), batteries and the like in order to gain access to identifiable items, such alphanumeric or barcode data. The kiosk 100 provides a way to use visual inspection with electrical inspection to identify a device, determine its value, and reduce possible fraud.
In one embodiment, the kiosk 100 communicates with the carrier associated with a mobile phone to collect any information that could be germane to the device, including, for example, validation or authentication, registered ownership, account status, time in service, and the like. In some cases, when the customer's identification information does not match the registered owner information, the kiosk 100 automatically contacts the assumed owner in some manner (automated telephone call, email, text message, etc.) to alert the owner of the phone of the possible transaction.
Another feature of an embodiment of the kiosk 100 is to determine if there is personal information on the electronic device. This is determined by the presence of data in particular storage registers in the memory (e.g., quick-key stored numbers) or by looking at file types (jpegs, mp3's, etc.), or just assuming all non-default storage locations must contain personal data. The customer is offered the chance to erase the data from the phone. One option allows the customer to request that the data be first downloaded and then sent to a location designated by the customer (e.g., email address, website, etc.). In another embodiment, there is a slot for the customer to enter a memory card (e.g. USB drive. memory stick, etc.) whereupon the kiosk 100 uploads the data to the memory device. In still another embodiment, the kiosk 100 offers a web location from which the user retrieves the data at some later time if desired. In another embodiment, the user elects to have the data placed in another electronic device purchased by the customer at the kiosk 100 or in the location of the kiosk 100 or some other store. The customer preferably selects a user name and password to access the system provided storage location.
Once the value is determined, the value is provided at step 307 to the kiosk. The kiosk 100 then offers the customer a price or other remuneration for the phone that is typically less than the resale value. In other embodiments, the kiosk 100 offers the customer a price or remuneration that is at the current real-time market price. At step 308 it is determined if the user wishes to accept the offer. If not, the kiosk 100 proceeds to step 309 and opens the door and releases the electronic device back to the customer. If the user wishes to accept the offer, the kiosk 100 proceeds to step 310. At a point where the user accepts a price, the kiosk 100 may then lock down the inspection area to prevent further access to the electronic device by the user. The kiosk 100 then disconnects any cables that have been attached. At step 310, the user indicates acceptance of the decision by confirming on the keypad or touch-screen. At this point the kiosk 100 proceeds with deleting the personal data from the electronic device. In addition, once the transaction is confirmed, the kiosk 100 tags the electronic device with a transaction number that is associated with the diagnostic data and the transaction itself. This is preferably a printed adhesive label that is affixed physically to the phone and/or the loading of electronic data corresponding to the transaction number onto the phone itself for traceability purposes.
At step 311, the kiosk 100 completes any additional testing and diagnostics of the electronic device, disconnects the cable from the electronic device, and prints a receipt for the customer. Transfer of funds may be authorized via the kiosk 100 by crediting a customer credit card or account by dispensing cash, or by dispensing a voucher or coupon. At step 312 the kiosk 100 updates its inventory database and transmits the update via a communications network to a kiosk server.
One preferred method of the present invention is illustrated in the flow chart of
Preferably, the kiosk 100 of the method comprises a housing 105, the housing 105 comprising a user interface on an exterior surface of the housing for the user to input information, an upper dome and a lower dome, wherein the upper dome and the lower dome comprise a plurality of mirrors. The kiosk 100 further comprises an upper chamber camera, a lower chamber camera and a transparent surface. The kiosk 100 further comprises a processor 160 within the housing and in communication with the at least one camera, the processor 160 configured to identify the brand and model number of the electronic device based on at least one of the information from the user and the images from the at least one camera, the processor 160 configured to determine a financial remuneration value for the electronic device.
The upper and lower domes preferably comprise walls composed of mirrors. The dome shaped apparatus further comprises a transparent surface and at least one camera, the camera capable of obtaining a multiple views of an electronic device placed within the dome shaped apparatus. The upper dome preferably comprises an upper chamber camera. The lower dome preferably comprises a lower chamber camera. Preferably, a combination of each of the upper dome and lower dome cameras and the plurality of mirrors allow for an image of the device placed on the transparent surface. Preferably, the combination of each of the upper dome and lower dome cameras and the plurality of mirrors allow for a 360 degree of the electronic device placed on the transparent surface. Preferably, each of the upper dome and lower dome cameras are moveable.
An alternative method of the present invention is illustrated in the flow chart of
The information from the perimeter image preferably includes a model name and location of a LED aperture. Additionally, the processor 160 is configured to automatically adjust the perimeter edge to a rectangular shape, to compensate for screen damages that result in distorted image due to blacking out of certain parts of the screen. The perimeter image comprises a 360 degree image. Information from the perimeter image comprises a location of a USB port, a location of the volume control buttons, a location of the camera button, and a location of the power on and off button. The information from the perimeter image also comprises a location of the camera lens and a logo of the electronic device.
Preferably, visual inspection and recognition software is utilized by the kiosk 100 to analyze a mobile phone 150. In one preferred method, a recognition algorithm is applied to a specific make and model of a mobile phone 150. The visual inspection and recognition software determines the borders of a mobile phone 150 under inspection to determine the external dimensions of the mobile phone 150. The external dimensions are utilized to determine a subset of possible mobile phones from a master database of mobile phones stored in the memory 161 of the kiosk 100 or available online to the kiosk 100 using external communications. The visual inspection and recognition software then preferably uses a set of secondary and tertiary features to further distinguish the mobile phone 150. These secondary and tertiary features can include placement and size of the display screen, placements and size of the keyboard, unique buttons, placement of ports, and other distinguishing features. Once an exact make and model of the mobile phone is determined, the visual inspection and recognition software subtracts an image of the mobile phone 150 from an image of a perfect mobile phone for the same make and model. The result of the subtraction is preferably a quantifiable number of pixels that are calibrated into categories of broken or missing parts, cracked screen, and low, medium or high wear.
Alternatively, the visual inspection is performed using neural network pattern recognition techniques to identify the mobile phone 150, then filter algorithms are utilized to determine defects such as cracked screens. Further, those skilled in the pertinent art will recognize that other visual inspection techniques may be employed without departing from the scope and spirit of the present invention.
Further, visual inspection optionally includes obtaining a heat signature for the mobile phone 150. One preferred method of obtaining a heat signature of a mobile phone 150 is to raster a laser across the mobile phone to characterize a heat decay profile of the submitted mobile phone 150. This heat decay profile is then compared to a heat decay profile for a perfect sample of the same mobile phone 150. The heat decay profile indicates the wear of the external surface of the mobile phone 150, which is used in calculating the financial remuneration for the mobile phone 150.
Yet another method of the present invention comprises positioning an electronic device in an inspection area of a recycling kiosk 100, powering up the electronic device and displaying a known image on a LCD screen of the electronic device. The known image on the LCD screen of the electronic device is compared with a stored duplicate of the known image stored on the recycling kiosk to determine any defects in the LCD screen of the electronic device and to define an analyzed electronic device. The method further comprises determining a value for the analyzed electronic device.
In one embodiment of this method, the known image is a start-up image for the carrier of the electronic device. In an alternative embodiment, the known image is an image of a national park. The method may further comprise performing an electrical analysis of the electronic device.
The method preferably images the electronic device in whatever state the electronic device is in when the electronic device is placed into the kiosk. Then the method compares the images to the training database of all the different types of electronic devices that have been trained in the past (and all the trained images are preferably with their screens off).
The method preferably images more than the display screen of the electronic device. The method preferably images everything (some keyboards light up, on Blackberries for instance) on the electronic device.
The method preferably subtracts the analysis image from the first image. The method also preferably multiples the analysis image by a multiplier factor, to account for changes in the brightness of the screen. For instance, if the brightness of the screen does not change at all between the two images, the multiplier factor is 1. If the brightness of the screen was ½ as bright during the analysis image as during the “first image”, the analysis image is multiplied by 2 so that the brightness matches for better subtraction (basically there is a brightness compensation factor to account for screens that have auto-brightness that change when the dome light of the kiosk is on versus off). This image is the “synthesized” image, because the image is synthesized in part with the subtraction. The subtracted image is used synonymously with synthesized image.
The method preferably compares the subtracted image to all the different trained images of electronic devices, to first identify the electronic device, and then to analyze defects once the electronic device is identified. But the primary purpose of doing the subtraction is to generate an image of what the electronic device would look like if its screen was off, because it is preferred to compare that image to the trained images of electronic devices, which have their screens off, to identify the electronic device in the first place. Then, analyzing for defects comes after the electronic device is identified (or identified what it might be, which it might be a set of five or ten electronic devices that are similar).
Preferably, images are generated for the electronic device in the kiosk and compared to training data to identify the electronic device and determine the condition of all its features.
In another embodiment, there are two steps to processing: 1) obtain the silhouette images to determine where the electronic device is in the kiosk and the size of the electronic device (including the side view, the size of the sides of the electronic device, etc); 2) obtain the fully lit images and “map the texture” of the electronic device across the silhouette images to determine what the electronic device actually looks like when the electronic device is surrounded by light, instead of just the silhouette.
In one embodiment, the mirrors are only a small section of the walls of the chamber. Most of the walls are preferably white plastic/paint, made to diffuse the light to create uniform lighting, and minimize specular reflections.
In a preferred kiosk, five of the six faces of the electronic device are seen. The top camera sees the front of the electronic device and three of its sides (left, top, right), and the bottom camera sees the back of the electronic device. The part of the electronic device at the bottom (on an IPHONE phone, where the cable connector is) isn't visible because there only have three mirrors, not four. So the combination of both cameras sees five of the six sides, and the top camera only sees four of the six sides. The location, size, shape and color of all the buttons, regardless of the function, are imaged. For example, the IPHONE 4S mobile phonet looks identical to the VERIZON IPHONE 4 mobile phone, except that it has a SIM card slot on the side. So the kiosk 100 uses the presence of that SIM card slot to determine that the electronic device is an IPHONE 4S mobile phone, and not an VERIZON IPHONE 4 mobile phone.
The present invention preferably extracts features from the training images and stores them in a database, along with other information such as the make and model of the electronic device, the area/location of the screen, and other data.
The “perimeter image” is preferably not used to detect defects in the screen. The present invention analyzes the silhouette (area) of the image to help identify the device, because this silhouette provides the dimensions of the phone, and helps narrow down the devices in the training database to compare to (no sense comparing a big phone to all the small ones . . . just compare to other phones of a similar size).
Another aspect of the present invention is detection of fake electronic devices. As shown in
Another aspect of the present invention is phone screen crack detection. As shown in
From the foregoing it is believed that those skilled in the pertinent art will recognize the meritorious advancement of this invention and will readily understand that while the present invention has been described in association with a preferred embodiment thereof, and other embodiments illustrated in the accompanying drawings, numerous changes modification and substitutions of equivalents may be made therein without departing from the spirit and scope of this invention which is intended to be unlimited by the foregoing except as may appear in the following appended claims. Therefore, the embodiments of the invention in which an exclusive property or privilege is claimed are defined in the following appended claims.
The present application claims priority to U.S. Provisional Patent Application 61/593,358 filed on Feb. 1, 2012, claims priority to U.S. Provisional Patent Application 61/607,548, filed on Mar. 6, 2012, claims priority to U.S. Provisional Patent Application 61/607,572, filed on Mar. 6, 2012, and is also a continuation-in-part application of U.S. patent application Ser. No. 13/438,924, filed on Apr. 4, 2012, which claims priority to U.S. Provisional Patent Application 61/472,611 filed on Apr. 6, 2011, now abandoned, which is a continuation-in-part application of U.S. patent application Ser. No. 12/785,465, filed on May 23, 2010, now U.S. Pat. No. 8,200,533, issued on Jun. 12, 2012, which is a continuation-in-part application of U.S. patent application Ser. No. 12/727,624, filed on Mar. 19, 2010, now U.S. Pat. No. 7,881,965, which issued on Feb. 1, 2011, which is a continuation-in-part application of U.S. patent application Ser. No. 12/573,089, filed on Oct. 2, 2009, now U.S. Pat. No. 8,195,511, issued on Jun. 5, 2012, which claims priority to U.S. Provisional Patent Application 61/102,304 filed on Oct. 2, 2008, now abandoned, and 61/183,510 filed on Jun. 2, 2009, now abandoned, all of which are herein incorporated by reference in their entireties.
Number | Date | Country | |
---|---|---|---|
61593358 | Feb 2012 | US | |
61607548 | Mar 2012 | US | |
61102304 | Oct 2008 | US | |
61183510 | Jun 2009 | US | |
61472611 | Apr 2011 | US | |
61607572 | Mar 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13438924 | Apr 2012 | US |
Child | 13753539 | US | |
Parent | 12785465 | May 2010 | US |
Child | 13438924 | US | |
Parent | 12727624 | Mar 2010 | US |
Child | 12785465 | US | |
Parent | 12573089 | Oct 2009 | US |
Child | 12727624 | US |