Systems and methods for mobile image capture and processing of documents

Information

  • Patent Grant
  • 10878401
  • Patent Number
    10,878,401
  • Date Filed
    Tuesday, January 14, 2020
    4 years ago
  • Date Issued
    Tuesday, December 29, 2020
    3 years ago
Abstract
Techniques for processing images of documents captured using a mobile device are provided. The images can include different sides of a document from a mobile device for an authenticated transaction. In an example implementation, a method includes inspecting the images to detect a feature associated with a first side of the document. In response to determining an image is the first side of the document, a type of content is selected to be analyze on the image of the first side and one or more of regions of interests (ROIs) are identified on the image of the first side that are known to include the selected type of content. A process can include receiving a sub-image of the image of the first side from the preprocessing unit, and performing content detection test on the sub-image.
Description
BACKGROUND
Technical Field

The embodiments described herein relate to processing images of documents captured using a mobile device, and more particularly to real-time detection of the content of a financial document for use in mobile banking applications.


Related Art

Banks and other businesses have become increasingly interested in electronic processing of check and other financial documents in order to expedite processing of these documents. Users can scan a copy of the document using a scanner or copier to create an electronic copy of the document that can be processed instead of a hardcopy original which would otherwise need to be physically sent to the recipient for processing. For example, some banks can process digital images of checks and extract check information from the image needed to process the check without requiring that the physical check be routed throughout the bank for processing. However, the type of information and the accuracy of information which can be processed from an image of a check are limited. As a result, some checks cannot be processed and are rejected during the mobile deposit process.


Mobile phones that incorporate cameras have also become ubiquitous and may also be useful to capture images of financial documents for mobile processing of financial information through a mobile network connection with a banking institution or business. However, the process of uploading images of financial documents is often prone to user error, as the user is often unaware of whether the document is complete and ready for processing by a business or financial institution. A user with a mobile phone or portable electronic device cannot interact with an employee of the bank in order to determine whether the financial document is ready to be processed.


Therefore, there is a need for the ability to obtain additional information from a digital image of a check which has been captured by a mobile device in order to streamline mobile banking applications and reduce the amount of transaction errors when a document is incomplete.


SUMMARY

Systems and methods for processing an image of a check captured using a mobile device, such as a mobile phone, are provided. These techniques can be implemented on a mobile device and at a central server, and can be used to identify content on a check and determine whether the check is ready to be processed by a business or financial institution. The system can identify portions of the check—such as the endorsement area—to determine if the check has been properly endorsed. If the check lacks an endorsement, a real time notification can be provided to a user which uploaded the check image so the user can correctly endorse the check and upload a new check image. Additional portions of the check, including the signature line, the addressee field, etc. can be checked to ensure that the check is ready to be deposited by the bank.


According to one embodiment, a mobile check image processing system for identifying content in regions of an image of a check captured by a mobile device is provided. The system may comprise a preprocessing unit which receives an image of a check from a mobile device, selects a type of content to be detected on the check image, and identifies at least one region of interest (ROI); a testing unit which performs at least one content detection test on the at least one ROI to detect content of the selected type on the check image; and a feedback unit which receives a result of the at least one content detection test and provides the result to a user. The ROI may correspond to an endorsement region on a back side of the check.


According to another embodiment, a method of identifying content in regions of an image of a check captured by a mobile device is provided. The method may comprise receiving an image of a check from a mobile device; selecting a type of content to be detected on the check image; identifying at least one region of interest (ROI) on the check image; performing at least one content detection test on the at least one ROI to detect content of the selected type on the check image; and providing a result of the at least one content detection test to a user. The ROI may correspond to an endorsement region on a back side of the check.


According to yet another embodiment, a computer-implemented method for processing a mobile-captured image of a check embodied on a computer with a processor and a memory may comprise receiving an image of a check from a mobile device; selecting a type of content to be detected on the check image; identifying at least one region of interest (ROI) on the check image; performing at least one content detection test on the at least one ROI to detect content of the selected type on the check image; and providing a result of the at least one content detection test to a user. The ROI may correspond to an endorsement region on a back side of the check.


These and other features, aspects, and embodiments are described below in the section entitled “Detailed Description.”





BRIEF DESCRIPTION OF THE DRAWINGS

Features, aspects, and embodiments are described in conjunction with the attached drawings, in which:



FIG. 1 is a high level block diagram of a system for identifying content in regions of an image of a check captured by a mobile device, according to one exemplary embodiment;



FIG. 2 is a flow diagram of a method for identifying content in regions of an image of a check captured by a mobile device, according to one exemplary embodiment;



FIG. 3 is an image of a back side of a check depicting an endorsement region where an endorsement should be present, according to one exemplary embodiment;



FIG. 4 is an image of a front side of a check depicting a payee field which can be compared with an endorsement to determine the authenticity of the endorsement, according to one exemplary embodiment;



FIG. 5 is a method for testing the quality of a MICR (Magnetic Ink Character Recognition) line of the check image, according to an embodiment;



FIG. 6 is a method for testing the aspect ratios of front and back images of a check to test whether the images are of the same check, according to an embodiment; and



FIG. 7 is a block diagram of a computing device on which the mobile image quality assurance system described above can be implemented, according to an embodiment: and



FIG. 8 is a simplified block diagram illustrating an example-computing module in accordance with one embodiment.





DETAILED DESCRIPTION

The following detailed description is directed to certain specific embodiments. However, it will be understood that these embodiments are by way of example only and should not be seen as limiting the systems and methods described herein to the specific embodiments, architectures, etc. In this description, reference is made to the drawings wherein like parts are designated with like numerals throughout.


Systems and methods for processing an image of a check captured using a mobile device, such as a mobile phone, are provided. These techniques can be implemented on a mobile device and at a central server, and can be used to identify content on a check and determine whether the check is ready to be processed by a business or financial institution. The system can identify portions of the check—such as the endorsement area—to determine if the check has been properly endorsed. If the check lacks an endorsement, a real time notification can be provided to a user which uploaded the check image so the user can correctly endorse the check and upload a new check image. Additional portions of the check, including the signature line, the addressee field, etc. can be checked to ensure that the check is ready to be deposited by the bank.


Differentiating between characteristics of checks provides additional information to a bank being asked to deposit the check as to the potential risk of the check being fraudulent. The risk of fraudulent checks varies depending on the characteristics of the check, and so a bank can set up various customized rules. If the check has a characteristic that is commonly associated with fraud, the bank may immediately deny the request, or request additional processing of the check image before deciding whether to deposit the check. The user is sent a message if the deposit is denied, and may be provided with instructions to manually deposit the check so that the bank can review the original check.


Content Identification



FIG. 1 is a high level block diagram of a system for identifying content in regions of an image of a check captured by a mobile device, according to one exemplary embodiment. A Mobile Check Image Processing System (MCIPS) 100 is shown as a single unit, although one or more of the components of the MCIPS 100 may reside on a mobile device 102 or on an MCIPS server 104 connected with the mobile device through a network (not shown). In the embodiment illustrated in FIG. 1, a user of the mobile device 102 captures an image of a check (“check image”) 106 using an image capture device incorporated within the mobile device 102 or connected with the mobile device 102. The check image 106 may include more than one image file, as the user may need to submit an image of a front side of the check and a back side of the check in order for the check to be deposited with a bank. Also, in some cases more than one image may need to be taken of one side of the check in order to clearly capture the content of the check, so the check image 106 will therefore refer to the one or more images of the check which are submitted to the MCIPS 100. The check image 106 is transmitted from the mobile device 102 to a preprocessing unit 108 at the MCIPS server 104, where the check image 106 is processed to select a type of content to be identified and identify at least one region of interest (ROI) where that type of content would be present. The ROI will correspond to a particular area of the check that is known to contain specific content, such as an endorsement, a payor name, a payor address, bank account number, routing number, etc. Programs which execute particular algorithms to identify a specific ROI are stored in an ROI programs database 110 connected with the preprocessing unit 108. The preprocessing unit 108 selects one or more programs to run which identify one or more ROIs on the check image 106 that should contain the specific content needed to perform a mobile deposit process. In the embodiments described herein, the ROI may be an endorsement region on a back side of the check where an endorsement is found.


Once the ROIs are identified, the check image 106 is sent to a testing unit 112 to perform one or more content detection tests on the identified ROIs. In one embodiment, the preprocessing unit may send a sub-image of the check image 106 which contains only the identified ROIs in order to streamline the process by sending only the relevant ROIs that need to be tested. Sending the sub-image would be particularly beneficial if the preprocessing unit is located on the mobile device 102 and the testing unit is located on the MCIPS server 104, as the transmission of only the ROIs across a network would take less time. The testing unit 112 obtains content detection tests from a test and rules database 114 connected with the testing unit 112. The content detection tests are programs that identify specific content in the ROIs, such as an endorsement signature in an endorsement ROI. The content detection tests may identify the presence or absence of particular content or distinguish between one or more types of content in the ROI. For example, an endorsement content detection test may first identify whether an endorsement is present in the endorsement ROI, but will also determine the type of endorsement—such as a hand-written signature or a stamp.


In one embodiment, the content on the check can be manually entered by the user. The check content can be optionally provided by the user at the time that the check is captured. This check content can include various information from the check, such as the check amount, check number, routing information from the face of the check, or other information, or a combination thereof. In some embodiments, a mobile deposition application requests this information from a user of the mobile device, allows the user to capture an image of a check or to select an image of a check that has already been captured, or both, and the mobile deposit information provides the check image, the check content, and other processing parameters to the MCIPS 100.


Once the testing unit performs the appropriate content detection tests, the results of the tests are forwarded to a feedback unit 116 to analyze the results and provide appropriate feedback to the user or to a bank 118. If the endorsement content detection test determines that there is no endorsement on the check, the feedback unit 116 will generate a message to send back to the mobile device 102 telling the user that the endorsement is missing and perhaps requesting that the user endorse the check and upload a new image of the endorsed check. Or, if the endorsement is complete, the feedback unit 116 will generate and send a message to the mobile device 102 indicating that the check is properly endorsed and will be deposited in the user's account. The feedback unit 116 may also generate messages to send to the bank 118 which is receiving the deposited check. For example, the messages may indicate whether the check is ready to be deposited, if a problem has been detected which requires the bank to perform additional processing of the check image, or if the user needs to physically bring the check in.


The feedback unit 116 may generate messages by accessing a feedback message database 120 which stores the messages. The feedback message database 120 may also store rules for generating messages based on the results of the tests performed. In one embodiment, the bank 118 may configure the rules stored in the feedback message database 120 so that certain messages are sent to the bank or the user depending on the results of the tests performed.


The feedback unit 116 may also be configured to take a particular action that coincides with the message that is being delivered to the user or the bank. If an endorsement is not present on the check, the feedback unit 116 may also suspend the mobile deposit process and await a new check image from the user. Once the revised check image is received and the testing unit 112 returns a positive test confirming the presence of an endorsement, the feedback unit 116 reactivates the mobile deposit process and sends a message to the bank 118 that the check is ready to be deposited.


In certain embodiments, the mobile application can display information on the mobile device shortly after the user takes the mobile document image to allow the user to retake the image if the image is found to have defects that affect the overall status of the image. In some embodiments, where the MCIPS 100 is implemented at least in part on the mobile device, the MCIPS 100 can include a user interface module that is configured to display the test results message on a screen of the mobile device 102.



FIG. 1 merely provides a description of the logical components of the MCIPS 100. In some embodiments, the MCIPS 100 can be implemented on the mobile device, in software, hardware, or a combination thereof. In other embodiments, the MCIPS 100 can be implemented on a remote server (not shown), and the mobile device can send the check image 106 e.g., via a wireless interface, to the remote server for processing. The remote server sends the test results and test messages to the mobile device 102 to indicate whether the mobile image passed testing. In some embodiments, part of the functionality of the MCIPS 100 can be implemented on the mobile device 102 while other parts of the MCIPS 100 are implemented on the remote server. The MCIPS 100 can be implemented in software, hardware, or a combination thereof. In still other embodiments, the MCIPS 100 can be implemented entirely on the remote server, and can be implemented using appropriate software, hardware, or a combination thereof.



FIG. 2 is a flow diagram of a method for identifying content in at least one region of an image of a check captured by a mobile device, according to one exemplary embodiment. In step 205, the check image is received from the mobile device. In step 210, the type of content to be identified is selected—either a test to check for an endorsement or a test to determine other content. In one embodiment, both tests can be selected and run either simultaneously or in sequence.


If the endorsement test is selected (“Endorsement”), the next step is step 215 to identify a region of interest (ROI) where the endorsement would be present on the check. In many situations, the ROI is on the back of the check in an endorsement area (see FIG. 3). Next, in step 220, a content detection test is run on the selected ROI to determine if an endorsement is present. In step 225, the results of the test of whether the endorsement is present are used to determine the next step. If the endorsement is not present, then, in step 230, the user is notified that the check they are attempting to deposit has not been endorsed. This notification may also include instructions to correct the error. Once the user is notified, the mobile deposit process may be suspended (step 270) until another image is submitted. If the endorsement is present in the ROI, an endorsement comparison test may be executed at step 235, where the identified endorsement is compared with either a signature or stamp stored on the MCIPS server, or where the signature or stamp is compared with the name listed in a payee field (see FIG. 4) on a front area of the check to determine if the person or entity endorsing the check is the same person that the check is addressed to. In step 240, if the endorsement does not match the stored endorsement or the payee field, the user is notified (step 230) and the mobile deposit process may be suspended (step 270). If the endorsement does match the payee field name or the stored endorsement signature or stamp, the mobile deposit process may be completed in step 245.


If the “Other Type” test is selected at step 210, a region of interest (ROI) on the check image is identified in step 250 where the other type content would be indicated. In step 255, a content detection test is run on the identified ROI to determine characteristics of the other type. Once the characteristics of the other type have been identified, the characteristics are evaluated in step 260 based on processing rules established for the other type. For example, the processing rule could check for a proper signature by a payer.



FIG. 3 is an image of a back side 300 of a check, depicting an endorsement region 302 where an endorsement should be present, according to one exemplary embodiment.



FIG. 4 is an image of a front side 400 of a check, depicting a payee field 402 which can be used to compare with the identified endorsement in order to determine if the endorsement and the payee fields match.


According to some embodiments, the systems and methods for identifying content of a check can be integrated with one or more mobile applications that process mobile document images, such as mobile deposit applications for processing images of checks to be deposited into a bank account. According to an embodiment, the mobile application can run on the mobile device and can be integrated to use mobile image quality assurance functionality that is implemented on the mobile device and/or on a remote server. The mobile application can use the system for identifying content of a check to streamline the mobile deposit process.


MICR-Line Test


In one embodiment, an image of a check can be rejected if the MICR-line on the check cannot be clearly detected in the image. MICR stands for Magnetic Ink Character Recognition. Information can be printed on the front of a check in a special typeface using a special magnetized ink. Therefore, the MICR-line test is useful to determine which side of the check is in a check image before a region of interest (ROI) is selected. A MICR IQA test can use optical character recognition techniques to identify the MICR information on a check. If the MICR line on the front of the check is damaged, simply retaking an image of the check will not correct the defects in the image and the image will be rejected; however, if the MICR line was merely blurry or unreadable due to one or more of the factors described above, retaking the image after correcting one or more of factors may result in a high-enough quality image that the MICR line can be read from the check.



FIG. 5 illustrates a method for testing the quality of a MICR (Magnetic Ink Character Recognition) line of the check image, according to an embodiment. The MICR-line Test is used to determine whether a high quality image of a check front has been captured using the mobile device according to an embodiment. The MICR-line Test can be used in conjunction with a Mobile Deposit application to ensure that images of checks captures for processing with the Mobile Deposit information are of a high enough quality to be processed so that the check can be electronically deposited. Furthermore, if a mobile image fails the MICR-line Test, the failure may be indicative of incorrect subimage detections and/or poor overall quality of the mobile image, and such an image should be rejected anyway.



FIG. 5 is a flow chart of a method for executing a MICR-line Test according to an embodiment. A mobile image is received (step 505) and a bitonal image is generated from the mobile image (step 510). In an embodiment, preprocessing unit 108 extracts the document subimage from the check image as described above, including preprocessing such as geometric correction. The extracted subimage can then be converted to a bitonal snippet by the preprocessing unit 108. The MICR line is then identified in the bitonal snippet (step 515). According to an embodiment, a MICR recognition engine is then applied to identify the MICR-line and to compute character-level and overall confidence values for the image (step 520). These confidences can then be normalized to the 0-1000 scale used by the mobile IQA tests where 1000 means high quality and 0 means poor MICR quality. The confidence level is then returned (step 525). As described above, the test result value is provided to the testing unit 112 where the test result value can be compared to a threshold value associated with the test. If the test result value falls below the threshold associated with the test, detailed test result messages can be retrieved from the feedback and rules database 120 and provided to the user via the feedback unit 116 to indicate why the test failed and what might be done to remedy the test. For example, the user may simply need to retake the image to adjust for geometrical or other factors, such as poor lighting or a shadowed document. In some instances, the user may not be able to correct the errors. For example, if the MICR line on the document is damaged or incomplete and the document will continue to fail the test even if the image were retaken.


Front-as-Rear Test



FIG. 6 is a method for testing the aspect ratios of front and back images of a check to test whether the images are of the same check, according to an embodiment. A Front-as-Rear Test can be used to determine whether an image that is purported to be the back of a check is actually an image of the front of the check according to an embodiment. The Front-as-Rear Test is a check specific Boolean test. The test returns a value of 0 if an image fails the test and a value of 1000 if an image passes the test. If an MICR-line is identified on what is purported to be an image of the back of the check, the image will fail the test and generate a test message that indicates that the images of the check have been rejected because an image of the front of the check was mistakenly passed as an image of the rear of the check.


An image of the rear of the check is received (step 605) and the image is converted to a bitonal snippet by preprocessing unit 108 of the MCIPS 100 (step 610). A MICR recognition engine is then applied to identify a MICR-line in the bitonal snippet (step 615). The results from the MICR recognition engine can then be normalized to the 0-1000 scale used by the mobile IQA tests, and the normalized value compared to a threshold value associated with the test (step 620). According to an embodiment, the test threshold can be provided as a parameter to the test along with the with mobile document image to be tested. According to an embodiment, the threshold used for this test is lower than the threshold used in the MICR-line Test described above.


If the normalized test result equals or exceeds the threshold, then the image includes an MICR-line and the test is marked as failed (test result value=0), because a MICR line was identified in what was purported to be an image of the back of the check. If the normalized test result is less than the threshold, the image did not include a MICR line and the test is marked as passed (test result value=1000). The test results value is then returned (step 625).


Computer-Implemented Embodiment



FIG. 7 is an exemplary embodiment of a mobile device 700 than can be used to implement the mobile IQA system according to an embodiment. Mobile device 700 includes a processor 710. The processor 710 can be a microprocessor or the like that is configurable to execute program instructions stored in the memory 720 and/or the data storage 740. The memory 720 is a computer-readable memory that can be used to store data and or computer program instructions that can be executed by the processor 710. According to an embodiment, the memory 720 can comprise volatile memory, such as RAM and/or persistent memory, such as flash memory. The data storage 740 is a computer readable storage medium that can be used to store data and or computer program instructions. The data storage 740 can be a hard drive, flash memory, a SD card, and/or other types of data storage.


The mobile device 700 also includes an image capture component 730, such as a digital camera. According to some embodiments, the mobile device 700 is a mobile phone, a smart phone, or a PDA, and the image capture component 730 is an integrated digital camera that can include various features, such as auto-focus and/or optical and/or digital zoom. In an embodiment, the image capture component 730 can capture image data and store the data in memory 720 and/or data storage 740 of the mobile device 700.


Wireless interface 750 of the mobile device can be used to send and/or receive data across a wireless network. For example, the wireless network can be a wireless LAN, a mobile phone carrier's network, and/or other types of wireless network.


I/O interface 760 can also be included in the mobile device to allow the mobile device to exchange data with peripherals such as a personal computer system. For example, the mobile device might include a USB interface that allows the mobile to be connected to USB port of a personal computer system in order to transfers information such as contact information to and from the mobile device and/or to transfer image data captured by the image capture component 730 to the personal computer system.


Those of skill in the art will appreciate that the various illustrative modules, components, engines, and method steps described in connection with the above described figures and the embodiments disclosed herein can often be implemented as electronic hardware, software, firmware or combinations of the foregoing. To clearly illustrate this interchangeability of hardware and software, various illustrative modules and method steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled persons can implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the invention. In addition, the grouping of functions within a module or step is for ease of description. Specific functions can be moved from one module or step to another without departing from the invention.


Moreover, the various illustrative modules, components, modules, engines, and method steps described in connection with the embodiments disclosed herein can be implemented or performed with hardware such as a general purpose processor, a digital signal processor (“DSP”), an application specific integrated circuit (“ASIC”), field programmable gate array (“FPGA”) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor is hardware and can be a microprocessor, but in the alternative, the processor can be any hardware processor or controller, microcontroller. A processor can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.


Additionally, the steps of a method or algorithm and the functionality of a component, engine, or module described in connection with the embodiments disclosed herein can be embodied directly in hardware, in software executed by a processor, or in a combination of the two. Software can reside in computer or controller accessible computer-readable storage media including RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium including a network storage medium. An exemplary storage medium can be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium can be integral to the processor. The processor and the storage medium can also reside in an ASIC.


Referring now to FIG. 9, computing module 1900 that can be sued to implement the systems and methods described herein and may represent, for example, computing or processing capabilities found within desktop, laptop and notebook computers; mainframes, supercomputers, workstations or servers; or any other type of special-purpose or general-purpose computing devices as may be desirable or appropriate for a given application or environment. Computing module 1900 might also represent computing capabilities embedded within or otherwise available to a given device. For example, a computing module might be found in other electronic devices. Computing module 1900 might include, for example, one or more processors or processing devices, such as a processor 1904. Processor 1904 might be implemented using a general-purpose or special-purpose processing engine such as, for example, a microprocessor, controller, or other control logic.


Computing module 1900 might also include one or more memory modules, referred to as main memory 1908. For example, random access memory (RAM) or other dynamic memory might be used for storing information and instructions to be executed by processor 1904. Main memory 1908 might also be used for storing temporary variables or other intermediate information during execution of instructions by processor 1904. Computing module 1900 might likewise include a read only memory (“ROM”) or other static storage device coupled to bus 1902 for storing static information and instructions for processor 1904.


The computing module 1900 might also include one or more various forms of information storage mechanism 1910, which might include, for example, a media drive 1912 and a storage unit interface 1920. The media drive 1912 might include a drive or other mechanism to support fixed or removable storage media 1914. For example, a hard disk drive, a floppy disk drive, a magnetic tape drive, an optical disk drive, a CD or DVD drive (R or RW), or other removable or fixed media drive. Accordingly, storage media 1914 might include, for example, a hard disk, a floppy disk, magnetic tape, cartridge, optical disk, a CD or DVD, or other fixed or removable medium that is read by, written to or accessed by media drive 1912. As these examples illustrate, the storage media 1914 can include a computer usable storage medium having stored therein particular computer software or data.


In alternative embodiments, information storage mechanism 1910 might include other similar instrumentalities for allowing computer programs or other instructions or data to be loaded into computing module 1900. Such instrumentalities might include, for example, a fixed or removable storage unit 1922 and an interface 1920. Examples of such storage units 1922 and interfaces 1920 can include a program cartridge and cartridge interface, a removable memory (for example, a flash memory or other removable memory module) and memory slot, a PCMCIA slot and card, and other fixed or removable storage units 1922 and interfaces 1920 that allow software and data to be transferred from the storage unit 1922 to computing module 1900.


Computing module 1900 might also include a communications interface 1924. Communications interface 1924 might be used to allow software and data to be transferred between computing module 1900 and external devices. Examples of communications interface 1924 might include a modem or softmodem, a network interface (such as an Ethernet, network interface card, WiMedia, IEEE 802.XX or other interface), a communications port (such as for example, a USB port, IR port, RS232 port Bluetooth® interface, or other port), or other communications interface. Software and data transferred via communications interface 1924 might typically be carried on signals, which can be electronic, electromagnetic (which includes optical) or other signals capable of being exchanged by a given communications interface 1924. These signals might be provided to communications interface 1924 via a channel 1928. This channel 1928 might carry signals and might be implemented using a wired or wireless communication medium. These signals can deliver the software and data from memory or other storage medium in one computing system to memory or other storage medium in computing system 1900. Some examples of a channel might include a phone line, a cellular link, an RF link, an optical link, a network interface, a local or wide area network, and other wired or wireless communications channels.


Computing module 1900 might also include a communications interface 1924. Communications interface 1924 might be used to allow software and data to be transferred between computing module 1900 and external devices. Examples of communications interface 1924 might include a modem or softmodem, a network interface (such as an Ethernet, network interface card, WiMAX, 802.XX or other interface), a communications port (such as for example, a USB port, IR port, RS232 port, Bluetooth interface, or other port), or other communications interface. Software and data transferred via communications interface 1924 might typically be carried on signals, which can be electronic, electromagnetic, optical or other signals capable of being exchanged by a given communications interface 1924. These signals might be provided to communications interface 1924 via a channel 1928. This channel 1928 might carry signals and might be implemented using a wired or wireless medium. Some examples of a channel might include a phone line, a cellular link, an RF link, an optical link, a network interface, a local or wide area network, and other wired or wireless communications channels.


In this document, the terms “computer program medium” and “computer usable medium” are used to generally refer to physical storage media such as, for example, memory 1908, storage unit 1920, and media 1914. These and other various forms of computer program media or computer usable media may be involved in storing one or more sequences of one or more instructions to a processing device for execution. Such instructions embodied on the medium, are generally referred to as “computer program code” or a “computer program product” (which may be grouped in the form of computer programs or other groupings). When executed, such instructions might enable the computing module 1900 to perform features or functions of the present invention as discussed herein.


While certain embodiments have been described above, it will be understood that the embodiments described are by way of example only. Accordingly, the systems and methods described herein should not be limited based on the described embodiments. Rather, the systems and methods described herein should only be limited in light of the claims that follow when taken in conjunction with the above description and accompanying drawings.

Claims
  • 1. A mobile device, comprising: a memory and a processor, the memory configured to store instructions configured to cause the processor to: receive images of different sides of a check from a camera included in the mobile device;determine an image is of the first side of the check;select content types to be analyze on the image of the first side;identify a plurality of regions of interests (ROIs) on the image of the first side that are known to include the selected content types; andtransmit a sub-image of the image of the of the first side to a testing unit, wherein the sub-image is an extracted portion smaller than the image of the first side including a plurality of the identified ROIs;receive the sub-image of the image of the first side; andperform a plurality of content detection tests on the sub-image which includes a plurality of the identified ROIs to test the quality of the selected content types in the image of the first side; andgenerate feedback to notify a user of the mobile device when the selected type of content fails one or more of the plurality of content detection tests.
  • 2. The mobile device of claim 1, wherein the instructions are further configured to cause the processor to compute a confidence value for the sub-image.
  • 3. The mobile device of claim 1, wherein the instructions are further configured to cause the processor to conduct geometric correction on the sub-image.
  • 4. The mobile device of claim 1, the feature associated with the first side is a Magnetic Ink Character Recognition (MICR)-line.
  • 5. The mobile device of claim 1, wherein at least one ROI corresponds to an endorsement region on a first side of the check.
  • 6. The mobile device of claim 5, wherein a selected content type is an endorsement.
  • 7. The mobile device of claim 1, wherein the instructions are further configured to cause the processor to determine whether the check includes characteristics associated with fraud based on the results of the plurality of content detection tests.
  • 8. A mobile device, comprising: a memory and a processor, the memory configured to store instructions configured to cause the processor to: receive images of different sides of a check from a camera included in the mobile device;determine an image is of the first side of the check;select content types to be analyze on the image of the first side;identify a plurality of regions of interests (ROIs) on the image of the first side that are known to include the selected content types; andtransmit a sub-image of the image of the of the first side to a testing unit, wherein the sub-image is an extracted portion smaller than the image of the first side including a plurality of the identified ROIs;receive the sub-image of the image of the first side; andperform a plurality of content detection tests on the sub-image which includes a plurality of the identified ROIs to test the quality of the selected content types in the image of the first side;generate feedback to notify a user of the mobile device when the selected type of content fails one or more of the plurality of content detection tests; anddetermine whether the check includes characteristics associated with fraud based on the results of the plurality of content detection tests.
  • 9. The mobile device of claim 8, wherein the instructions are further configured to cause the processor to compute a confidence value for the sub-image.
  • 10. The mobile device of claim 8, wherein the instructions are further configured to cause the processor to conduct geometric correction on the sub-image.
  • 11. The mobile device of claim 8, the feature associated with the first side is a Magnetic Ink Character Recognition (MICR)-line.
  • 12. The mobile device of claim 8, wherein at least one ROI corresponds to an endorsement region on a first side of the check.
  • 13. The mobile device of claim 12, wherein a selected content type is an endorsement.
RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 15/838,088, filed on Dec. 11, 2017, which is a continuation of U.S. patent application Ser. No. 13/488,349, now U.S. Pat. No. 9,842,331, filed on Jun. 4, 2012, which is a continuation-in-part of U.S. patent application Ser. No. 12/906,036, filed on Oct. 15, 2010, now U.S. Pat. No. 8,577,118, which is a continuation-in-part of U.S. patent application Ser. No. 12/778,943, filed on filed May 12, 2010, now U.S. Pat. No. 8,582,862. U.S. patent application Ser. No. 13/488,349 is also a continuation-in-part of U.S. patent application Ser. No. 12/346,026, filed on Dec. 30, 2008, now U.S. Pat. No. 7,978,900, which claims the benefit of U.S. Provisional Patent Application No. 61/022,279, filed on Jan. 18, 2008. U.S. patent application Ser. No. 13/488,349 is also a continuation-in-part of U.S. patent application Ser. No. 12/778,943, filed on May 12, 2010, now U.S. Pat. No. 8,582,862, all of which are hereby incorporated by reference in their entirety.

US Referenced Citations (151)
Number Name Date Kind
5600732 Ott et al. Feb 1997 A
5751841 Leong et al. May 1998 A
5761686 Bloomberg Jun 1998 A
5966473 Takahashi Oct 1999 A
6038351 Rigakos Mar 2000 A
6038553 Hyde, Jr. Mar 2000 A
6345130 Dahl Feb 2002 B1
6621919 Mennie et al. Sep 2003 B2
6735341 Horie et al. May 2004 B1
6807294 Yamazaki Oct 2004 B2
6947610 Sun Sep 2005 B2
6985631 Zhang Jan 2006 B2
6993205 Lorie et al. Jan 2006 B1
7020320 Filatov Mar 2006 B2
7245765 Myers et al. Jul 2007 B2
7283656 Blake et al. Oct 2007 B2
7331523 Meier et al. Feb 2008 B2
7376258 Klein et al. May 2008 B2
7377425 Ma et al. May 2008 B1
7426316 Vehvilainen Sep 2008 B2
7433098 Klein et al. Oct 2008 B2
7548641 Gilson et al. Jun 2009 B2
7558418 Verma et al. Jul 2009 B2
7593595 Heaney, Jr. et al. Sep 2009 B2
7606741 King et al. Oct 2009 B2
7735721 Ma Jun 2010 B1
7793835 Coggeshall et al. Sep 2010 B1
7869098 Corso et al. Jan 2011 B2
7873200 Oakes, III Jan 2011 B1
7876949 Oakes, III Jan 2011 B1
7949176 Nepomniachtchi May 2011 B2
7950698 Popadic et al. May 2011 B2
7953268 Nepomniachtchi May 2011 B2
7982770 Kahn et al. May 2011 B1
7978900 Nepomniachtchi et al. Jul 2011 B2
7983468 Ibikunle et al. Jul 2011 B2
7986346 Kaneda et al. Jul 2011 B2
7996317 Gurz Aug 2011 B1
8000514 Nepomniachtchi et al. Aug 2011 B2
8023155 Jiang Sep 2011 B2
8118216 Hoch et al. Feb 2012 B2
8126252 Abernethy et al. Feb 2012 B2
8180137 Faulkner et al. May 2012 B2
8290237 Burks et al. Oct 2012 B1
8300917 Borgia et al. Oct 2012 B2
8320657 Burks et al. Nov 2012 B1
8339642 Ono Dec 2012 B2
8358826 Medina, III Jan 2013 B1
8379914 Nepomniachtchi et al. Feb 2013 B2
8532419 Coleman Sep 2013 B2
8538124 Harpel Sep 2013 B1
8542921 Medina Sep 2013 B1
8559766 Tilt et al. Oct 2013 B2
8959033 Oakes, III Feb 2015 B1
9058512 Medina, III Jun 2015 B1
9842331 Nepomniachtchi Dec 2017 B2
20010014183 Sansom-Wai et al. Aug 2001 A1
20010016084 Pollard et al. Aug 2001 A1
20010019664 Pilu Sep 2001 A1
20020003896 Yamazaki Jan 2002 A1
20020012462 Fujiwara Jan 2002 A1
20020041717 Murata et al. Apr 2002 A1
20020067846 Foley Jun 2002 A1
20030072568 Lin et al. Apr 2003 A1
20030086615 Dance et al. May 2003 A1
20030161523 Moon et al. Aug 2003 A1
20030177100 Filatov Sep 2003 A1
20040012679 Fan Jan 2004 A1
20040037448 Brundage Feb 2004 A1
20040109597 Lugg Jun 2004 A1
20040213434 Emerson et al. Oct 2004 A1
20040218799 Mastie et al. Nov 2004 A1
20050011957 Attia et al. Jan 2005 A1
20050065893 Josephson Mar 2005 A1
20050097046 Singfield May 2005 A1
20050100216 Myers et al. May 2005 A1
20050143136 Lev et al. Jun 2005 A1
20050196071 Prakash et al. Sep 2005 A1
20050213805 Blake et al. Sep 2005 A1
20050219367 Kanda et al. Oct 2005 A1
20050220324 Klein et al. Oct 2005 A1
20050242186 Ohbuchi Nov 2005 A1
20050261990 Gocht et al. Nov 2005 A1
20060008167 Yu et al. Jan 2006 A1
20060008267 Kim Jan 2006 A1
20060012699 Miki Jan 2006 A1
20060045379 Heaney et al. Mar 2006 A1
20060071950 Kurzweil et al. Apr 2006 A1
20060072822 Hatzav et al. Apr 2006 A1
20060140504 Fujimoto et al. Jun 2006 A1
20060164682 Lev Jul 2006 A1
20060177118 Ibikunle Aug 2006 A1
20060182331 Gilson et al. Aug 2006 A1
20060210192 Orhun Sep 2006 A1
20060221415 Kawamoto Oct 2006 A1
20060280354 Murray Dec 2006 A1
20060291727 Bargeron Dec 2006 A1
20070053574 Verma et al. Mar 2007 A1
20070058851 Quine et al. Mar 2007 A1
20070076940 Goodall et al. Apr 2007 A1
20070081796 Fredlund et al. Apr 2007 A1
20070084911 Crowell Apr 2007 A1
20070086643 Spier Apr 2007 A1
20070140678 Yost et al. Jun 2007 A1
20070154071 Lin Jul 2007 A1
20070156438 Popadic et al. Jul 2007 A1
20070168382 Tillberg Jul 2007 A1
20070171288 Inoue et al. Jul 2007 A1
20070195174 Oren Aug 2007 A1
20070206877 Wu et al. Sep 2007 A1
20070211964 Agam Sep 2007 A1
20070288382 Narayanan et al. Dec 2007 A1
20080031543 Nakajima et al. Feb 2008 A1
20080040259 Snow et al. Feb 2008 A1
20080062437 Rizzo Mar 2008 A1
20080089573 Mori et al. Apr 2008 A1
20080174815 Komaki Jul 2008 A1
20080183576 Kim et al. Jul 2008 A1
20080192129 Walker et al. Aug 2008 A1
20080212901 Castigila Sep 2008 A1
20080231714 Estevez et al. Sep 2008 A1
20080247629 Gilder et al. Oct 2008 A1
20080267510 Paul et al. Oct 2008 A1
20090063431 Erol et al. Mar 2009 A1
20090092322 Erol et al. Apr 2009 A1
20090125510 Graham et al. May 2009 A1
20090141962 Borgia et al. Jun 2009 A1
20090185241 Nepomniachtchi Jul 2009 A1
20090185736 Nepomniachtchi Jul 2009 A1
20090185737 Nepomniachtchi Jul 2009 A1
20090185738 Nepomniachtchi Jul 2009 A1
20090261158 Lawson Oct 2009 A1
20100073735 Hunt et al. Mar 2010 A1
20100074547 Yu et al. Mar 2010 A1
20100080471 Haas et al. Apr 2010 A1
20100102119 Gustin Apr 2010 A1
20100104171 Faulkner et al. Apr 2010 A1
20100114765 Gustin May 2010 A1
20100114766 Gustin May 2010 A1
20100114771 Gustin May 2010 A1
20100114772 Gustin May 2010 A1
20100200660 Moed Aug 2010 A1
20100208282 Isaev Aug 2010 A1
20110013822 Meek Jan 2011 A1
20110081051 Tayal et al. Apr 2011 A1
20110091092 Nepomniachtchi Apr 2011 A1
20110280450 Nepomniachtchi et al. Nov 2011 A1
20120030104 Huff Feb 2012 A1
20120070062 Houle Mar 2012 A1
20120230577 Calman Sep 2012 A1
20140040141 Gauvin Feb 2014 A1
Foreign Referenced Citations (4)
Number Date Country
20040076131 Aug 2004 KR
20070115834 Dec 2007 KR
2006075967 Jul 2006 WO
2006136958 Dec 2006 WO
Non-Patent Literature Citations (4)
Entry
Office Action dated May 27, 2020 for related U.S. Appl. No. 16/282,250 in 18 pages.
International Search Report issued in related International Application No. PCT/US2011/056593 dated May 30, 2012 (3 pages).
Office Action dated Jan. 9, 2020 for related U.S. Appl. No. 16/397,728 in 56 pages.
Office Action dated Mar. 20, 2020 in related U.S. Appl. No. 16/282,250, in 20 pages.
Related Publications (1)
Number Date Country
20200151703 A1 May 2020 US
Provisional Applications (1)
Number Date Country
61022279 Jan 2008 US
Continuations (2)
Number Date Country
Parent 15838088 Dec 2017 US
Child 16742439 US
Parent 13488349 Jun 2012 US
Child 15838088 US
Continuation in Parts (4)
Number Date Country
Parent 12906036 Oct 2010 US
Child 13488349 US
Parent 12778943 May 2010 US
Child 12906036 US
Parent 12346026 Dec 2008 US
Child 13488349 US
Parent 12778943 May 2010 US
Child 12346026 US