This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2023-049041 filed Mar. 24, 2023.
The present disclosure relates to an image processing system, a non-transitory computer readable medium, and a method for processing an image.
Japanese Unexamined Patent Application Publication No. 2009-094903 discloses an image processing apparatus that determines, on the basis of image data including plural pixels, whether the image data is a plain image. The image processing apparatus includes a determination unit that determines whether the image data indicates a plain image by comparing a feature value calculated from the image data with a threshold and a setting unit that receives a reading method employed when image data is read from a document and/or an output method employed when image data is output through printing and that sets the threshold used for the determination in accordance with the input method.
When a processor determines whether a document image indicates a blank sheet by obtaining, from image information regarding a red, green, and blue (RGB) color space, histograms of maximum values and histograms of maximum differences of RGB, the processor undesirably determines a non-blank sheet as a blank sheet if all the maximum values and all the maximum differences of RGB are the same, even if a color of letters or a pattern is different from a background color of a document. A “blank sheet” refers to a plain document where no letters or patterns are written.
Aspects of non-limiting embodiments of the present disclosure relate to improvement in accuracy of a determination whether a document image indicates a non-blank sheet, compared to when the determination is made by obtaining histograms of maximum values and histograms of maximum differences of RGB from image information regarding an RGB color space.
Aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above. However, aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
According to an aspect of the present disclosure, there is provided an image processing system including an image reader that reads a document image and that generates image information regarding a CIELAB color space, and a processor configured to: obtain L*, a*, and b* histograms for the image information; determine whether there is a contrast in the image information using the L* histogram; determine whether there is a hue difference in the image information using the a* and b* histograms; and determine, if there is a contrast and/or there is a hue difference, that the document image indicates a non-blank sheet.
An exemplary embodiment of the present disclosure will be described in detail based on the following figures, wherein:
An exemplary embodiment of the present disclosure will be described in detail hereinafter with reference to the drawings. In the present exemplary embodiment, an image forming apparatus will be described as an example of an image processing system.
The image forming apparatus 20 according to the present exemplary embodiment includes a document reading unit 30 as an example of an image reader, and an image forming unit 40 is provided below the document reading unit 30. The document reading unit 30 includes a document conveying unit (not illustrated) in a document cover 32. The document conveying unit sequentially draws a document 150 set on a document feeding unit 32A provided for the document cover 32 and feeds the document 150 onto a platen glass (not illustrated). The document reading unit 30 reads images recorded on the fed document 150. The document conveying unit then discharges the document 150 from which the images have been read onto a document discharge unit 32B provided for the document cover 32. The document reading unit 30 generates image information regarding a CIELAB color space from the read images recorded on the document 150.
The document reading unit 30 is provided with a user interface 34 that receives various operations from a user. The user interface 34 includes a display 34A on which display buttons for receiving operations using a software program and various pieces of information are displayed and hardware keys 34B such as a numeric keypad. The display 34A is a touch panel where a display device such as a liquid crystal panel and a position input device such as a touchpad are combined together. The user interface 34, which includes the display buttons on the display 34A and the hardware keys 34B, is used to set the number of copies and magnification for the copying function and dial a phone number for the facsimile function. The hardware keys 34B may be omitted.
The image forming unit 40 includes sheet storage units 42 storing sheets of paper that serve as a recording medium for forming images. The image forming unit 40 takes out the sheets stored in the sheet storage units 42 one by one and forms images based on image data on the sheets through, for example, electrophotography. The image forming unit 40 then discharges, to a discharge unit, which is not illustrated, the sheets on which the images have been formed.
As illustrated in
The image forming apparatus 20 according to the present exemplary embodiment also includes a storage unit 52 storing various pieces of data, application programs, and the like. The image forming apparatus 20 includes a display control unit 54 that is connected to the user interface 34 and that controls display of various operation screens and the like on the display 34A of the user interface 34. The image forming apparatus 20 also includes an operation input detection unit 56 that is connected to the user interface 34 and that detects operations input through the user interface 34. In the image forming apparatus 20, the storage unit 52, the display control unit 54, and the operation input detection unit 56 are electrically connected to the system bus 58. The storage unit 52 may be, for example, a hard disk drive (HDD) or a nonvolatile storage unit such as a flash memory.
The image forming apparatus 20 according to the present exemplary embodiment also includes a reading control unit 62 that controls an operation for optically reading an image performed by a document optical reading unit 60 and an operation for feeding a document performed by the document conveying unit and an image formation control unit 64 that controls a process for forming an image performed by the image forming unit 40 and conveyance of sheets to the image forming unit 40 performed by a conveying unit 44. The image forming apparatus 20 also includes a communication link interface unit 66 that is connected to the communication link, which is not illustrated, and that communicates communication data with external apparatuses connected to the communication link, such as servers, and an image processing unit 68 that performs various types of image processing. The image forming apparatus 20 also includes a facsimile interface unit 70 that is connected to the telephone line, which is not illustrated, and that communicates facsimile data with facsimile apparatuses connected to the telephone line. The image forming apparatus 20 also includes a communication control unit 72 that controls communication of facsimile data through the facsimile interface unit 70. In the image forming apparatus 20, the communication control unit 72, the reading control unit 62, the image formation control unit 64, the communication link interface unit 66, the facsimile interface unit 70, and the image processing unit 68 are electrically connected to the system bus 58.
With the above configuration, the image forming apparatus 20 according to the present exemplary embodiment accesses the RAM 50C, the ROM 50B, and the storage unit 52 using the CPU 50A. The image forming apparatus 20 also controls, using the CPU 50A, display of information such as operation screens and various messages on the display 34A of the user interface 34 through the display control unit 54. The image forming apparatus 20 also controls operation of the document optical reading unit 60 and the document conveying unit through the reading control unit 62. The image forming apparatus 20 also controls, using the CPU 50A, operation of the image forming unit 40 and the conveying unit 44 through the image formation control unit 64 and the communication of communication data through the communication link interface unit 66. The image forming apparatus 20 controls, using the CPU 50A, the communication of facsimile data performed by the communication control unit 72 through the facsimile interface unit 70. The image forming apparatus 20 also detects, using the CPU 50A, operations performed on the user interface 34 on the basis of operation information detected by the operation input detection unit 56 and performs various types of control based on the operations.
Next, a functional configuration that the CPU 50A of the control unit 50 achieves in the image forming apparatus 20 according to the present exemplary embodiment by loading a program stored in the ROM 50B into the RAM 50C and executing the program.
The control unit 50 has functions of an L* histogram creation section 80, an a* histogram creation section 82, a b* histogram creation section 84, a contrast presence determination section 86, a hue difference determination section 88, and a blank sheet determination section 90. Although the functional configuration illustrated in
The L* histogram creation section 80 obtains an L* histogram for image information regarding a CIELAB color space obtained by reading a document image using the document optical reading unit 60. For example, the L* histogram creation section 80 creates an L* histogram illustrated in
The L* histogram created by the L* histogram creation section 80 is a histogram where a frequency is the number of pixels in each of predetermined intervals (bins) for L* in the image information regarding the CIELAB color space.
The a* histogram creation section 82 obtains an a* histogram for image information regarding a CIELAB color space. For example, the a* histogram creation section 82 creates an a* histogram illustrated in
The a* histogram created by the a* histogram creation section 82 is a histogram where the frequency is the number of pixels in each of predetermined intervals (bins) for a* in the image information regarding the CIELAB color space.
The b* histogram creation section 84 obtains a b* histogram for image information regarding a CIELAB color space. For example, the b* histogram creation section 84 creates a b* histogram illustrated in
The b* histogram created by the b* histogram creation section 84 is a histogram where the frequency is the number of pixels in each of intervals (bins) for b* in the image information regarding the CIELAB color space.
The intervals in the L*, a*, and b* histograms are optimally set in advance through an experiment or the like. In the L*, a*, and b* histograms, the number of intervals may be different from each other. The number of intervals in the a* and b* histograms, however, needs to be the same.
The contrast presence determination section 86 determines presence or absence of a contrast in the image information regarding the CIELAB color space using the L* histogram. More specifically, if the L* histogram includes two or more peaks that exceed the predetermined threshold Lth1, the contrast presence determination section 86 determines that there is a contrast. In other words, if there is one peak that exceeds the threshold Lth1 in the L* histogram, the contrast presence determination section 86 determines that there is no contrast. Even if the frequency of a bin adjacent to a bin including a peak exceeding the threshold Lth1 exceeds the threshold Lth1, the number of peaks is counted as one.
The hue difference determination section 88 determines presence or absence of a hue difference in the image information regarding the CIELAB color space using the a* and b* histograms. More specifically, if the a* histogram includes two or more peaks that exceed the predetermined threshold ath1 and/or the b* histogram includes two or more peaks that exceed the predetermined threshold bth1, the hue difference determination section 88 determines that there is a hue difference in the image information regarding the CIELAB color space. In other words, if there is one peak that exceeds the threshold ath1 in the a* histogram or there is one peak that exceeds the threshold bth1 in the b* histogram, the hue difference determination section 88 determines that there is no hue difference. Even if the frequency of a bin adjacent to a bin including a peak that exceeds the threshold ath1 exceeds the threshold ath1, the number of peaks is counted as one. Similarly, even if the frequency of a bin adjacent to a bin including a peak that exceeds the threshold bth1 exceeds the threshold bth1, the number of peaks is counted as one.
The blank sheet determination section 90 has a function of determining whether the document 150 is a blank sheet or a non-blank sheet. More specifically, if the contrast presence determination section 86 determines that there is a contrast and/or the hue difference determination section 88 determines that there is a hue difference, the blank sheet determination section 90 determines that a document image indicates a non-blank sheet.
If the contrast presence determination section 86 determines that there is no contrast and the hue difference determination section 88 determines that there is no hue difference, on the other hand, the blank sheet determination section 90 determines that a document image indicates a plain sheet (blank sheet). More specifically, if the number of peaks that exceed the threshold Lth1 in the L* histogram, the number of peaks that exceed the threshold ath1 in the a* histogram, and the number of peaks that exceed the threshold bth in the b* histogram are all one, the blank sheet determination section 90 determines that a document image indicates a blank sheet.
If the blank sheet determination section 90 determines that the document image indicates a blank sheet but L* of a bin including a peak is smaller than or equal to the predetermined threshold Lth1, the blank sheet determination section 90 determines that the document image indicates a non-blank sheet. If the blank sheet determination section 90 determines that the document image indicates a blank sheet and L* of a bin including a peak exceeds a predetermined threshold Lth3, on the other hand, the blank sheet determination section 90 determines that the document image indicates a white blank sheet.
When a document 152 is a white blank sheet as illustrated in
In addition, as illustrated in
Since the number of peaks that exceed the threshold Lth1 in the L* histogram, the number of peaks that exceed the threshold ath1 in the a* histogram, and the number of peaks that exceed the threshold bth1 in the b* histogram are all one as illustrated in
When a document 154 is a white sheet with black letters thereon as illustrated in
In addition, as illustrated in
Since the L* histogram includes two peaks that exceed the threshold Lth1 as illustrated in
When a document 156 is a pink sheet with black letters thereon as illustrated in
In addition, as illustrated in
Since the L* histogram includes two peaks that exceed the threshold Lth1 and the a* histogram includes two peaks that exceed the threshold ath1 as illustrated in
When a document 158 is a pink sheet with light blue letters thereon (i.e., when similar luminance values are observed in the case of a colored sheet and colored letters) as illustrated in
In addition, as illustrated in
Since the a* histogram includes two peaks that exceed the threshold ath1 and the b* histogram includes two peaks that exceed the threshold bth1 as illustrated in
When a document 160 is a pink sheet with red letters thereon (i.e., when similar hues are observed in the case of a colored sheet and colored letters) as illustrated in
In addition, as illustrated in
Since the L* histogram includes two peaks that exceed the threshold Lth1 as illustrated in
When a document 162 is a pink sheet with black letters thereon (when letters occupy an area larger than that of a background color) as illustrated in
In addition, as illustrated in
Since the L* histogram includes two peaks that exceed the threshold Lth1 and the a* histogram includes two peaks that exceed the threshold ath1 as illustrated in
Next, a specific process performed by the image forming apparatus 20 according to the present exemplary embodiment configured as described above will be described.
In step S200, the CPU 50A generates image information regarding a CIELAB color space of the document 150 read by the document optical reading unit 60 and proceeds to step S202.
In step S202, the CPU 50A obtains L*, a*, and b* histograms. That is, the CPU 50A creates the L* histogram, the a* histogram, and the b* histogram and proceeds to step S204.
In step S204, the CPU 50A determines whether the number of bins where the frequency exceeds the threshold Lth1 is larger than or equal to a threshold Lth2 in the L* histogram. In the present exemplary embodiment, the threshold Lth2 is 2. That is, the CPU 50A determines whether there are two or more bins where the frequency exceeds the threshold Lth1. If the L* histogram includes two or more bins where the frequency exceeds the threshold Lth1, the CPU 50A proceeds to step S214, and if the number of such bins is one, the CPU 50A proceeds to step S206.
In step S206, the CPU 50A determines whether the number of bins where the frequency exceeds the threshold ath1 is larger than or equal to a threshold ath2 in the a* histogram. In the present exemplary embodiment, the threshold ath2 is 2. That is, the CPU 50A determines whether there are two or more bins where the frequency exceeds the threshold ath1. If the a* histogram includes two or more bins where the frequency exceeds the threshold ath1, the CPU 50A proceeds to step S214, and if the number of such bins is one, the CPU 50A proceeds to step S208.
In step S208, the CPU 50A determines whether the number of bins where the frequency exceeds the threshold bth1 is larger than or equal to a threshold bth2 in the b* histogram. In the present exemplary embodiment, the threshold bth2 is 2. That is, the CPU 50A determines whether there are two or more bins where the frequency exceeds the threshold bth1. If the b* histogram includes two or more bins where the frequency exceeds the threshold bth1, the CPU 50A proceeds to step S214, and if the number of such bins is one, the CPU 50A proceeds to step S210.
In step S210, the CPU 50A determines whether L* of the bin where the frequency exceeds the threshold Lth1 (i.e., the bin including a peak) in the L* histogram is smaller than or equal to the threshold Lth3. If L* of the bin including a peak is smaller than or equal to the threshold Lth3 in the L* histogram, the CPU 50A proceeds to step S214, and if L* of the bin including a peak exceeds the threshold Lth3, the CPU 50A proceeds to step S212.
In step S212, the CPU 50A determines that the document 150 is a blank sheet (white blank sheet) and ends the process.
In step S214, the CPU 50A determines that the document 150 is a non-blank sheet and ends the process.
Next, modifications of the process performed by the control unit 50 of the image forming apparatus 20 according to the present exemplary embodiment will be described.
In a first modification, step S220 replaces steps S210 and S212 in the process illustrated in
In a second modification, step S230 is added to the process illustrated in
In the process illustrated in
Steps S204, S206, and S208 may be switched as necessary.
Although an example where the image forming apparatus 20 performs the processes illustrated in
Although an example where the image forming apparatus 20, which is an example of the image processing system, performs the processes illustrated in
In the embodiments above, the term “processor” refers to hardware in a broad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
The processes performed by the image forming apparatus 20 according to the above exemplary embodiment may be achieved by software, hardware, or a combination of software and hardware. The processes performed by the image forming apparatus 20 may be stored in a storage medium as programs and distributed.
The present disclosure is not limited to the above description, and may be modified in various ways and implemented without deviating from the scope thereof.
The foregoing description of the exemplary embodiments of the present disclosure has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical applications, thereby enabling others skilled in the art to understand the disclosure for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the disclosure be defined by the following claims and their equivalents.
(((1)))
An image processing system including:
The image processing system according to (((1))),
The image processing system according to (((1))) or (((2))),
The image processing system according to any of (((1))) to (((3))),
The image processing system according to any of (((1))) to (((3))),
The image processing system according to (((5))),
The image processing system according to (((6))),
The image processing system according to (((5))) or (((6))),
A program causing a computer to execute a process for processing an image, the process including:
Number | Date | Country | Kind |
---|---|---|---|
2023-049041 | Mar 2023 | JP | national |