This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2023-049042 filed Mar. 24, 2023.
The present disclosure relates to an image processing system, a non-transitory computer readable medium, and a method for processing an image.
Japanese Unexamined Patent Application Publication No. 2009-094903 discloses an image processing apparatus that determines, on the basis of image data including plural pixels, whether the image data is a plain image. The image processing apparatus includes a determination unit that determines whether the image data indicates a plain image by comparing a feature value calculated from the image data with a threshold and a setting unit that receives a reading method employed when image data is read from a document and/or an output method employed when image data is output through printing and that sets the threshold used for the determination in accordance with the input method.
When a processor determines whether a document image indicates a blank sheet by obtaining, from image information regarding a red, green, and blue (RGB) color space, histograms of maximum values and histograms of maximum differences of RGB, the processor undesirably determines a non-blank sheet as a blank sheet if all the maximum values and all the maximum differences of RGB are the same, even if a color of letters or a pattern is different from a background color of a document. A “blank sheet” refers to a plain document without letters or patterns.
Aspects of non-limiting embodiments of the present disclosure relate to improvement in accuracy of a determination whether a document image indicates a non-blank sheet, compared to when the determination is made by obtaining histograms of maximum values and histograms of maximum differences of RGB from image information regarding an RGB color space.
Aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above. However, aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
According to an aspect of the present disclosure, there is provided an image processing system including an image reader that reads a document image and that generates image information regarding a CIELAB color space, and a processor configured to: obtain an a*b*-plane two-dimensional histogram for the image information; obtain a background color of the document image using the a*b*-plane two-dimensional histogram and count a number of black spots of the image information for each of bins of the a*b*-plane two-dimensional histogram; subtract the number of black spots in a bin determined to include the background color from a total number of black spots in all the bins; and determine, if an obtained value is larger than a predetermined threshold, that the document image indicates a non-blank sheet.
An exemplary embodiment of the present disclosure will be described in detail based on the following figures, wherein:
An exemplary embodiment of the present disclosure will be described in detail hereinafter with reference to the drawings. In the present exemplary embodiment, an image forming apparatus will be described as an example of an image processing system.
The image forming apparatus 20 according to the present exemplary embodiment includes a document reading unit 30 as an example of an image reader, and an image forming unit 40 is provided below the document reading unit 30. The document reading unit 30 includes a document conveying unit (not illustrated) in a document cover 32. The document conveying unit sequentially draws a document 150 set on a document feeding unit 32A provided for the document cover 32 and feeds the document 150 onto a platen glass (not illustrated). The document reading unit 30 reads images recorded on the fed document 150. The document conveying unit then discharges the document 150 from which the images have been read onto a document discharge unit 32B provided for the document cover 32. The document reading unit 30 generates image information regarding a CIELAB color space from the read images recorded on the document 150.
The document reading unit 30 is provided with a user interface 34 that receives various operations from a user. The user interface 34 includes a display 34A on which display buttons for receiving operations using a software program and various pieces of information are displayed and hardware keys 34B such as a numeric keypad. The display 34A is a touch panel where a display device such as a liquid crystal panel and a position input device such as a touchpad are combined together. The user interface 34, which includes the display buttons on the display 34A and the hardware keys 34B, is used to set the number of copies and magnification for the copying function and dial a phone number for the facsimile function. The hardware keys 34B may be omitted.
The image forming unit 40 includes sheet storage units 42 storing sheets of paper that serve as a recording medium for forming images. The image forming unit 40 takes out the sheets stored in the sheet storage units 42 one by one and forms images based on image data on the sheets through, for example, electrophotography. The image forming unit 40 then discharges, to a discharge unit, which is not illustrated, the sheets on which the images have been formed.
As illustrated in
The image forming apparatus 20 according to the present exemplary embodiment also includes a storage unit 52 storing various pieces of data, application programs, and the like. The image forming apparatus 20 includes a display control unit 54 that is connected to the user interface 34 and that controls display of various operation screens and the like on the display 34A of the user interface 34. The image forming apparatus 20 also includes an operation input detection unit 56 that is connected to the user interface 34 and that detects operations input through the user interface 34. In the image forming apparatus 20, the storage unit 52, the display control unit 54, and the operation input detection unit 56 are electrically connected to the system bus 58. The storage unit 52 may be, for example, a hard disk drive (HDD) or a nonvolatile storage unit such as a flash memory.
The image forming apparatus 20 according to the present exemplary embodiment also includes a reading control unit 62 that controls an operation for optically reading an image performed by a document optical reading unit 60 and an operation for feeding a document performed by the document conveying unit and an image formation control unit 64 that controls a process for forming an image performed by the image forming unit 40 and conveyance of sheets to the image forming unit 40 performed by a conveying unit 44. The image forming apparatus 20 also includes a communication link interface unit 66 that is connected to the communication link, which is not illustrated, and that communicates communication data with external apparatuses connected to the communication link, such as servers, and an image processing unit 68 that performs various types of image processing. The image forming apparatus 20 also includes a facsimile interface unit 70 that is connected to the telephone line, which is not illustrated, and that communicates facsimile data with facsimile apparatuses connected to the telephone line. The image forming apparatus 20 also includes a communication control unit 72 that controls communication of facsimile data through the facsimile interface unit 70. In the image forming apparatus 20, the communication control unit 72, the reading control unit 62, the image formation control unit 64, the communication link interface unit 66, the facsimile interface unit 70, and the image processing unit 68 are electrically connected to the system bus 58.
With the above configuration, the image forming apparatus 20 according to the present exemplary embodiment accesses the RAM 50C, the ROM 50B, and the storage unit 52 using the CPU 50A. The image forming apparatus 20 also controls, using the CPU 50A, display of information such as operation screens and various messages on the display 34A of the user interface 34 through the display control unit 54. The image forming apparatus 20 also controls operation of the document optical reading unit 60 and the document conveying unit through the reading control unit 62. The image forming apparatus 20 also controls, using the CPU 50A, operation of the image forming unit 40 and the conveying unit 44 through the image formation control unit 64 and the communication of communication data through the communication link interface unit 66. The image forming apparatus 20 controls, using the CPU 50A, the communication of facsimile data performed by the communication control unit 72 through the facsimile interface unit 70. The image forming apparatus 20 also detects, using the CPU 50A, operations performed on the user interface 34 on the basis of operation information detected by the operation input detection unit 56 and performs various types of control based on the operations.
Next, a functional configuration that the CPU 50A of the control unit 50 achieves in the image forming apparatus 20 according to the present exemplary embodiment by loading a program stored in the ROM 50B into the RAM 50C and executing the program.
The control unit 50 has functions of an L* histogram creation section 80, an a* histogram creation section 82, a b* histogram creation section 84, an image binarization section 86, a contrast presence determination section 88, an L* pixel count table creation section 90, a background color determination section 92, a pixel counting section 94, a black spot counting section 96, and a blank sheet determination section 98. Although the functional configuration illustrated in
The L* histogram creation section 80 obtains an L* histogram for image information regarding a CIELAB color space obtained by reading a document image using the document optical reading unit 60. For example, the L* histogram creation section 80 creates an L* histogram illustrated in
The L* histogram created by the L* histogram creation section 80 is a histogram where a frequency is the number of pixels in each of predetermined intervals (bins) for L* in the image information regarding the CIELAB color space.
The a* histogram creation section 82 obtains an a* histogram for image information regarding a CIELAB color space. For example, the a* histogram creation section 82 creates an a* histogram illustrated in
The a* histogram created by the a* histogram creation section 82 is a histogram where the frequency is the number of pixels in each of predetermined intervals (bins) for a* in the image information regarding the CIELAB color space.
The b* histogram creation section 84 obtains a b* histogram for image information regarding a CIELAB color space. For example, the b* histogram creation section 84 creates a b* histogram illustrated in
The b* histogram created by the b* histogram creation section 84 is a histogram where the frequency is the number of pixels in each of intervals (bins) for b* in the image information regarding the CIELAB color space.
The bins in the L*, a*, and b* histograms are optimally set in advance through an experiment or the like. In the L*, a*, and b* histograms, the number of bins may be different from each other. The number of bins in the a* and b* histograms, however, needs to be the same.
The image binarizing section 86 binarizes image information regarding a CIELAB color space.
The contrast presence determination section 88 determines presence or absence of a contrast in image information regarding a CIELAB color space using an L* histogram. More specifically, if the L* histogram includes two or more peaks that exceed the predetermined threshold Lth1, the contrast presence determination section 88 determines that there is a contrast. In other words, if there is one peak that exceeds the threshold Lth1 in the L* histogram, the contrast presence determination section 88 determines that there is no contrast. Even if the frequency of a bin adjacent to a bin including a peak exceeding the threshold Lth1 exceeds the threshold Lth1, the number of peaks is counted as one.
The L* pixel count table creation section 90 creates an L* pixel count table, which is an example of an a*b*-plane two-dimensional histogram. That is, the L* pixel count table creation section 90 creates the L* pixel count table, which is an example of the a*b*-plane two-dimensional histogram, from obtained a* and b* histograms. The L* pixel count table is divided into areas corresponding to bins of the a* and b* histograms and has a function of holding the number of black spots counted by the pixel counting section 94 for each area. In the present exemplary embodiment, each area of the a*b*-plane two-dimensional histogram (L* pixel count table) will be referred to as a “bin area”. These bin areas are an example of bins of the a*b*-plane two-dimensional histogram in the present disclosure.
The background color determination section 92 obtains a background color of a document image using an L* pixel count table (a*b*-plane two-dimensional histogram). More specifically, as illustrated in
The pixel counting section 94 counts the number of black spots on the basis of a binary image obtained by the image binarizing section 86 and causes a corresponding bin area of an L* pixel count table to hold the number of black spots (refer to
The black spot counting section 96 subtracts, in an L* pixel count table, the number of black spots in a bin area determined to include a background color from the total number of black spots in all bin areas. The black spot counting section 96 then determines whether an obtained value is larger than a threshold Cth.
The blank sheet determination section 98 has a function of determining whether the document 150 is a blank sheet or a non-blank sheet. More specifically, if the contrast presence determination section 88 determines that there is a contrast and/or the obtained value is larger than the predetermined threshold Cth, the blank sheet determination section 98 determines that a document image indicates a non-blank sheet.
If the contrast presence determination section 88 determines that there is no contrast and the obtained value is smaller than or equal to the threshold Cth, on the other hand, the blank sheet determination section 98 determines that a document image indicates a blank sheet.
When a document 152 is a colored blank sheet (e.g., a pink sheet) as illustrated in
When a document 154 is a colored sheet (e.g., a pink sheet) with letters thereon (e.g., blue letters) as illustrated in
When a document 156 is a colored sheet (e.g., a pink sheet) with letters thereon (e.g., red letters) as illustrated in
When a document 158 is a colored sheet (e.g., a pink sheet) with letters thereon (e.g., light blue letters) (i.e., when similar luminance values are observed in the case of a colored sheet and colored letters) as illustrated in
When a document 160 is a colored sheet (e.g., a pink sheet) with letters thereon (e.g., blue letters) (when letters occupy an area larger than that of a background color) as illustrated in
Next, a specific process performed by the image forming apparatus 20 according to the present exemplary embodiment configured as described above will be described.
In step S200, the CPU 50A generates image information regarding a CIELAB color space of the document 150 read by the document optical reading unit 60 and proceeds to step S202.
In step S202, the CPU 50A obtains L*, a*, and b* histograms. That is, the CPU 50A creates the L* histogram, the a* histogram, and the b* histogram. The CPU 50A also creates an a*b*-plane two-dimensional histogram. The CPU 50A then proceeds to step S204.
In step S204, the CPU 50A obtains a background color from the a*b*-plane two-dimensional histogram. More specifically, the CPU 50A determines, as a background color of a document image, a color included in a bin area of the two-dimensional histogram located at an intersection between a highest peak of the a* histogram and a highest peak of the b* histogram. The CPU 50A then proceeds to step S206.
In step S206, the CPU 50A binarizes the document image and proceeds to step S208.
In step S208, the CPU 50A counts the number of black spots in each of bin areas of the a*b*-plane two-dimensional histogram.
In step S210, the CPU 50A determines whether the L* histogram includes two or more bins where the frequency exceeds the threshold Lth1. In other words, the CPU 50A determines whether the L* histogram includes two or more peaks that exceed the threshold Lth1. If the L* histogram includes two or more bins where the frequency exceeds the threshold Lth1, the CPU 50A proceeds to step S216, and if the number of such bins is one, the CPU 50A proceeds to step S214.
In step S212, the CPU 50A subtracts, in the a*b*-plane two-dimensional histogram, the number of black spots in the bin area determined to include the background color from the total number of black spots in all the bin areas and determines whether an obtained value is larger than the predetermined threshold Cth. If the obtained value is larger than the predetermined threshold Cth, the CPU 50A proceeds to step S216, and if the obtained value is smaller than or equal to the predetermined threshold Cth, the CPU 50A proceeds to step S214.
In step S214, the CPU 50A determines that the document 150 is a blank sheet and ends the process.
In step S216, the CPU 50A determines that the document 150 is a non-blank sheet and ends the process.
Next, modifications of the process performed by the control unit 50 of the image forming apparatus 20 according to the present exemplary embodiment will be described.
In this modification, a process for determining a non-blank sheet illustrated in
In the process illustrated in
Steps S210 and S212 may be switched as necessary.
Although an example where the image forming apparatus 20 performs the processes illustrated in
Although an example where the image forming apparatus 20, which is an example of the image processing system, performs the processes illustrated in
In the embodiments above, the term “processor” refers to hardware in a broad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
The processes performed by the image forming apparatus 20 according to the above exemplary embodiment may be achieved by software, hardware, or a combination of software and hardware. The processes performed by the image forming apparatus 20 may be stored in a storage medium as programs and distributed.
The present disclosure is not limited to the above description, and may be modified in various ways and implemented without deviating from the scope thereof.
The foregoing description of the exemplary embodiments of the present disclosure has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical applications, thereby enabling others skilled in the art to understand the disclosure for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the disclosure be defined by the following claims and their equivalents.
(((1)))
An image processing system including:
The image processing system according to (((1))),
The image processing system according to (((1))),
The image processing system according to any of (((1))) to (((3))),
The image processing system according to any of (((1))) to (((4))),
The image processing system according to (((5))),
A program causing a computer to execute a process for processing an image, the process including:
Number | Date | Country | Kind |
---|---|---|---|
2023-049042 | Mar 2023 | JP | national |