Patent Application
20240176567
The present disclosure relates to an image processing apparatus, an image processing method, and a storage medium, and more particularly, to a technique that masks a scanned image and then prints it or transmits it to a cloud service or the like to store.
Electronic data of a scanned image generated by reading a document with a scanner may be shared with others. At this time, in the case that the scanned image is obtained by scanning a document containing personal information or confidential information, such as a personal identification document, an application document, a contract document, a design drawing, or the like, masking (so-called redacting) may be performed in which a part of the scanned image (for example, confidential matters within the scanned image) is painted black to make it invisible.
As a method of masking a part of a scanned image generated by reading a document with a scanner, there are a method of masking at a preset position, a method of manually designating a position to be masked, and the like. For example, Japanese Laid-Open Patent Publication (kokai) No. 2020-205493 discloses an information processing apparatus that performs a masking processing with respect to electronic data of N (N≥2) documents on the basis of mask position designation information designating a mask position in units of pages, and generates N electronic files divided for each number of pages included in the mask position designation information.
A multifunction peripheral (MFP) having a function of cooperating with a cloud service as a save destination when a scanned image generated by a scanner is stored (saved) as an electronic file has been known, and a user is able to transmit the electronic file generated by the MFP to the cloud service designated by the user. Here, one of the purposes of transmitting the electronic file of the scanned image to the cloud service is to change the storage and sharing of the document from the conventional printed matter to the electronic file. Therefore, it is desirable that a desired electronic file can be easily obtained from a large number of stored electronic files, and as one of the methods, there is a method of using document information of the electronic file as a file name of the electronic file. In addition, for example, it is conceivable to utilize information of a character string or a barcode in the scanned image as a file name or a folder name utilizing document information in the electronic file.
At this time, whether or not the information under a masked portion may be used for the file name of the electronic file of the scanned image including the masked portion (hereinafter, referred to as “a mask region”) depends on the application of the electronic file. That is, in the case that the electronic file is shared with the other person to whom the information under the mask region is not desired to be disclosed or the save destination of the electronic file is disclosed to the other person, the information under the mask region cannot be used for the file name or the folder name. On the other hand, for personal storage purposes or the like, convenience can be enhanced by using information under the mask region for the file name. In addition, there is a similar circumstance in a folder name in the case that the electronic file is stored and saved in the folder.
The present disclosure provides an image processing apparatus, an image processing method, and a storage medium that are capable of storing an electronic file including a mask region with an appropriate name.
Accordingly, the present disclosure provides an image processing apparatus comprising one or more memory that stores instructions; and one or more processor that executes the instructions to: control a display device to display a preview of a scanned image; designate a first region where masking is applied to the scanned image; and designate a second region including character information to be used for storing the scanned image, wherein, in a case that there is an overlapping region in which the first region and the second region overlap, the overlapping region is displayed on the preview so that a user is able to recognize the overlapping region.
According to one aspect of the present disclosure, it is possible to store the electronic file including the mask region with the appropriate name.
Further features of the present disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
The present disclosure will now be described in detail below with reference to the accompanying drawings showing embodiments thereof.
Hereinafter, a preferred embodiment of the present disclosure will be described in detail with reference to the accompanying drawings.
The MFP 110 is a multifunction peripheral having a plurality of functions such as a scanner and a printer, is an example of an image forming apparatus, and has a function of scanning a document to generate an image file and transferring the generated image file to an external storage service or the like capable of storing a file. The external storage 120 stores various data such as an image file received via the Internet, and executes a service of acquiring various data from an external device via a web browser.
The CPU 211 reads a control program stored in the ROM 212 or the HDD 214 into the RAM 213 and executes the control program, thereby controlling the overall operation of the MFP 110 and executing various functions of the MFP 110 such as reading, printing, and communication. The ROM 212 stores programs such as an operating system (OS) executed by the CPU 211 to control the operation of the MFP 110, parameters necessary for executing the programs, and the like. The RAM 213 is used as a temporary storage unit such as a main memory and a work area of the CPU 211. It should be noted that, in the present embodiment, it is assumed that one CPU 211 executes each processing illustrated in a flowchart to be described below using one storage unit (the RAM 213 or the HDD 214). However, the present disclosure is not limited to such a processing form, and for example, a plurality of CPUs and a plurality of RAMs or HDDs may cooperate to execute each processing.
The HDD 214 is a mass storage unit that stores image data and various programs. The operation unit I/F 215 is an interface that connects the operation unit 220 and the controller 210. The operation unit 220 includes a display device such as a liquid crystal monitor including a touch panel, a keyboard, and the like, receives an operation by a user, and notifies the CPU 211 of an instruction according to the operation input.
The printer I/F 216 is an interface that connects the printer unit 221 and the controller 210. Printing data is transferred from the controller 210 to the printer unit 221 via the printer I/F 216, and is printed on a recording medium such as a sheet having a predetermined size in the printer unit 221. The scanner I/F 217 is an interface that connects the scanner unit 222 and the controller 210. The scanner unit 222 reads a document set on a document table or an automatic document feeder (ADF) (not shown) to generate image data, and inputs the image data to the controller 210 via the scanner I/F 217. The MFP 110 can perform copying in which the image data generated by the scanner unit 222 is output as printed matter from the printer unit 221, and can perform file transmission or mail transmission to the outside.
The modem I/F 218 is an interface that connects the modem 223 and the controller 210. The modem 223 transmits and receives image data to and from a facsimile machine (not shown) on the public switched telephone network (PSTN) by facsimile communication. The network I/F 219 is an interface that connects the controller 210 (the MFP 110) to a LAN. The MFP 110 can transmit image data and information to and receive various types of information from services on the Internet using the network I/F 219.
The CPU 311 reads the control program stored in the ROM 312 to the RAM 313 and executes the control program to control the overall operation of the external storage 120. The ROM 312 stores programs that can be executed by the CPU 311, parameters necessary for executing the programs, and the like. The RAM 313 is used as a temporary storage unit such as a main memory and a work area of the CPU 311. The HDD 314 is a mass storage device that stores image data and various programs. The network I/F 315 is an interface that connects the external storage 120 to the Internet. The external storage 120 performs processing such as transmission and reception and storage of various types of information in response to a request notified from an external device such as the MFP 110 via the network I/F 315.
A scan execution part 411, an image data storage part 412, and a print execution part 413 included in the native function unit 410 are provided in the MFP 110 as standard. The additional function unit 420 includes a display control part 421, a scan instruction part 422, an image processing part 423, a data management part 424, a print instruction part 425, a data conversion part 426, and an external storage access part 427. Each part included in the additional function unit 420 is an application additionally installed in the MFP 110. The additional function unit 420 is an application based on Java (registered trademark), and thus can easily add a function to the MFP 110. It should be noted that another additional application (not shown) may be installed in the MFP 110.
Here, the functions of the functional blocks of the MFP 110 will be mainly described by exemplifying generation, image processing, storage, and printing of a scanned image.
The display control part 421 displays a user interface (UI) screen for receiving an operation by the user on a display device which is an element of the operation unit 220. For example, a UI screen for accepting an operation of scan setting or scan start, a preview of a scanned image, designation of a mask region (a region to be masked, that is, a region where masking is applied) to be described below, output setting, an output start operation, and the like is displayed on the display device of the operation unit 220.
The scan instruction part 422 requests the scan execution part 411 to execute scan processing according to the scan setting input from the UI screen. Upon receiving a scan request including scan settings from the scan instruction part 422, the scan execution part 411 drives the scanner unit 222 in accordance with the scan request to optically read a document and generate a scanned image (image data). The generated scanned image is transmitted to the image data storage part 412, and the image data storage part 412 stores the scanned image received from the scan execution part 411 in the HDD 214. At this time, the scan execution part 411 transmits an image identifier uniquely indicating the stored scanned image to the scan instruction part 422. The image identifier includes a number, a symbol, an alphabet, and the like for uniquely identifying a scanned image in the MFP 110.
The image processing part 423 performs, for example, analysis processing and processing on the scanned image. Specifically, the image processing part 423 receives the image identifier from the scan instruction part 422, and acquires the scanned image corresponding to the image identifier from the image data storage part 412. The image processing part 423 performs recognition processing such as character region analysis, optical character recognition (OCR), barcode region analysis, and image rotation and inclination correction on the acquired scanned image. Furthermore, the image processing part 423 generates a mask composite image (data) generated by combining the mask image with the scanned image in accordance with region designation processing corresponding to the mask region and the like input from the UI screen, and instructs the image data storage part 412 to store the mask composite image. It should be noted that the region designation processing will be described below with reference to the flowchart of
The data management part 424 stores information such as coordinates, a file name, and a save destination designated in the region designation processing in association with the image identifier. In addition, the data management part 424 stores the coordinates, the file name, and the save destination designated in the region designation processing in the HDD 214 as preset information.
The print instruction part 425 transmits the print processing request according to the print setting input from the UI screen and the image identifier received from the image processing part 423 to the print execution part 413. The print execution part 413 receives the print processing request and the image identifier transmitted from the print instruction part 425, acquires image data (scanned image or mask composite image) corresponding to the image identifier from the image data storage part 412, and generates printing data in response to the print processing request. The print execution part 413 transmits the generated printing data to the printer unit 221 via the printer I/F 216, and the printer unit 221 prints the scanned image or the mask composite image on a recording medium.
The data conversion part 426 acquires image data (the scanned image or the mask composite image) corresponding to the image identifier received from the image processing part 423 from the image data storage part 412, and converts the image data into a file format according to the output setting input from the UI screen. In addition, the data conversion part 426 acquires the file name corresponding to the image identifier received from the image processing part 423 from the data management part 424, sets the file name of the converted file, and transmits the converted file and the image identifier corresponding thereto to the data management part 424. The data management part 424 stores the file received from the data conversion part 426 in association with the image identifier.
The external storage access part 427 transmits a processing request to a cloud service or the like that provides a storage function (a storage service). It should be noted that the cloud service generally stores a file in a cloud storage using a protocol such as representational state transfer (REST) or simple object access protocol (SOAP), and discloses various interfaces for acquiring the stored file from an external device. The external storage access part 427 operates the cloud service by using the disclosed interface of the cloud service. In addition, the external storage access part 427 acquires the file corresponding to the image identifier received from the image processing part 423, and transmission information from the data management part 424. Then, the external storage access part 427 transmits the file acquired from the data management part 424 to the external storage 120 via the network I/F using the transmission information acquired from the data management part 424.
Next, a processing executed by the MFP 110 will be described.
Before starting S501, the CPU 211 displays a main screen (not shown) on which buttons for executing an application provided by the MFP 110 are arranged on the display device of the operation unit 220. An additional application (hereinafter, referred to as “a masking application”) that masks a partial region of a scanned image and transmits the partially masked scanned image to a cloud service can be used by additional installation to the MFP 110. When the masking application is installed in the MFP 110, a button for instructing the specification of the masking application to the CPU 211 is displayed on the main screen, and the CPU 211 starts the process of S501 when detecting the pressing of the button.
In S501, the CPU 211 starts (reads and executes) the masking application. In S502, the CPU 211 displays a masking method selection screen, which is an initial screen of the masking application, on the display device of the operation unit 220.
In S503, the CPU 211 determines whether or not the preset selection button 601 is pressed (selected) on the masking method selection screen 600. In the case of being determined that the preset selection button 601 has been pressed (YES in S503), the CPU 211 executes the process of S504. On the other hand, in the case of being determined that the preset selection button 601 has not been pressed, that is, the manual selection button 602 has been pressed (NO in S503), the CPU 211 executes the process of S505.
In S504, the CPU 211 displays a preset list screen on the display device of the operation unit 220.
In S505, the CPU 211 displays a scan screen.
The output setting field 801 is a button for designating an output method of the masked scanned image, and one or both of printing and saving can be selected. The file format designation field 802 is enabled when an output including “save” (that is, “print and save” or “save only”) is set in the output setting field 801, and is a button for designating a file format when saving the mask composite image. The scan setting field 803 is a group of buttons for setting document scan conditions, and accepts setting changes of “document size”, “color”, “double-sided”, and “detailed settings”. It should be noted that in the “detailed settings”, it is possible to change and set the resolution, the image quality, the document size mixture, the density, and the like.
The scan button 804 is a button for executing document scanning under the conditions set in the scan setting field 803. In the page number display area 805, the number of scanned document pages is displayed. The return button 806 is a button for returning to the previous screen. When the return button 806 is pressed, the display is switched to the masking method selection screen 600 in
For example, when the determination in S503 is ‘NO’, the CPU 211 displays the scan screen 800 in a state where the output setting and the scan setting stored as the initial values of the masking application are set in the output setting field 801, the file format designation field 802, and the scan setting field 803. On the other hand, for example, in the case that the “insurance card” of the preset button 701 is selected, the CPU 211 reads the setting related to the button ID of the “insurance card”. Then, the CPU 211 displays the scan screen 800 in which the read settings are reflected in the output setting field 801, the file format designation field 802, and the scan setting field 803.
When the user sets a document to be scanned on the document table or the ADF and presses the scan button 804, the CPU 211 starts the process of S506. In S506, the CPU 211 executes scanning to generate a scanned image which is image data obtained by electronizing the document, generates an image identifier uniquely indicating the generated scanned image, and stores the generated scan image and image identifier in the HDD 214 in association with each other. It should be noted that the number of scanned pages displayed in the page number display area 805 is incremented each time the generation of the scanned image for one page is completed.
When the user presses the next button 807 after the scan of the document to be scanned is completed, the CPU 211 starts the process of S507. In S507, the CPU 211 executes an analysis processing of the scanned image. The analysis processing of the scanned image is executed by the CPU 211 functioning as the image processing part 423. The image processing part 423 analyzes the character region existing in the image, and stores the coordinates of the character region and the analysis result of acquiring the characters in the character region in the HDD 214 in association with the image identifier. It should be noted that when a region determined to be a two-dimensional barcode or a three-dimensional barcode is detected in the analysis processing of the scanned image, the CPU 211 acquires coordinates of the barcode and information corresponding to the barcode, includes the information in the analysis result, and stores the information in the HDD 214 in association with the image identifier.
In S508, the CPU 211 executes a region designation processing. Here, the region designation processing will be described in detail.
In S901, the CPU 211 determines whether or not an output including “save” has been selected in the output setting field 801 of the scan screen 800 (that is, whether “print and save” or “save only” has been selected). In the case of being determined that the output including “save” has been selected (YES in S901), the CPU 211 executes the process of S902. Hereinafter, the subsequent processes in the case where “print and save” is selected in S901 will be described.
In S902, the CPU 211 determines whether or not “preset” has been pressed (selected) on the masking method selection screen 600. In the case of being determined that the “manual” button has been pressed (NO in S902), the CPU 211 executes the process of S904. Subsequently, the processes from S905 to S911 will be described on the assumption that the processing has been advanced from S902 to S904, and a case where the determination of S902 is “YES” and the process of S903 is performed will be described below.
In S904, the CPU 211 displays the preview screen on the display device of the operation unit 220.
The preview screen 1000 includes a delete button 1003, a reduction button 1004, a full display button 1005, an enlargement button 1006, a previous page button 1007, a page display region 1008, a next page button 1009, a color designation button 1010, and a transparent display button 1011.
The delete button 1003 is a button for deleting a mask region or an OCR region currently selected on the preview image 1002. The reduction button 1004 is a button for reducing the display magnification of the preview image 1002 to perform reduction display. The full display button 1005 is a button for changing the magnification of the preview image 1002 to the maximum magnification such that the preview image fits within the preview area 1001 and displaying the preview image. The enlargement button 1006 is a button for increasing the display magnification of the preview image 1002 to perform enlargement display. It should be noted that, in the case that the display magnification is changed to a display magnification larger than the display magnification by the full display button 1005 by operating the enlargement button 1006, a part of the preview image 1002 is not displayed in the preview area 1001. At this time, although not shown, a scroll bar for moving the display region of the preview image 1002 in the preview area 1001 is displayed in the preview area 1001.
The previous page button 1007 is a button for displaying a scanned image of a previous page as the preview image 1002 in the case that there are a plurality of pages of scanned images. In the page display region 1008, the page number of the currently displayed scanned image and the total number of pages are displayed. The next page button 1009 is a button for displaying a scanned image of the next page as the preview image 1002 in the case that there are a plurality of pages of scanned images.
The color designation button 1010 is a button for designating a color (a color of masking) to be applied to the mask region. The transparent display button 1011 is a button for semi-transparent display of the mask region on the preview image 1002. By enabling the semi-transparent display, the preview image 1002 is displayed in a mode in which the user can visually recognize the character string or the like under the mask region.
The preview screen 1000 includes first to fifth mode switching buttons 1012 to 1016. The first to fifth mode switching buttons 1012 to 1016 are buttons for adding or selecting various regions within the preview screen 1000, and these buttons are exclusively switched so that only one can be selected.
The first mode switching button 1012 is a button for switching to a mode for selecting a mask region already added (set) to the preview image 1002. The second mode switching button 1013 is a button for switching to a mode for adding a new mask region to the preview image 1002. The third mode switching button 1014 is a button for switching to a mode for designating a character region of a character string to be used for a file name or a folder name among character strings on the preview image 1002. The fourth mode switching button 1015 is a button for switching to a mode for designating a barcode region to be used for a file name or a folder name among barcodes on the preview image 1002. The fifth mode switching button 1016 is a button for switching to a mode in which an image registered in advance in the MFP 110 is inserted as a mask.
Various regions can be added or designated in a state where any one of the second to fourth mode switching buttons 1013 to 1015 is selected by the user touching the preview area 100 with a finger or the like. For example, when detecting a touch operation in the preview area 1001, the CPU 211 starts drawing a rectangle starting from the touch position. When the user moves the finger while touching the screen (touch panel) of the display device of the operation unit 220 and then it is detected that the finger has moved from the screen, the CPU 211 displays a rectangle having the point as an end point. The rectangular region is a newly added mask region, a newly designated character region, or a newly designated barcode region.
In the case of the mode of adding the mask region, the color set by the color designation button 1010 is reflected on the inserted rectangle, and the coordinates and color of the start point and the end point of the rectangle are stored in the HDD 214. In the case of the mode for designating the character region, the CPU 211 acquires and stores the character string included in the coordinates of the inserted rectangle and the coordinates thereof from the analysis result of the scanned image executed in S507. At that time, the selected character string may be displayed in an easy-to-understand manner for the user by surrounding the corresponding character string on the preview image 1002 with a line or the like. In the case of the mode for designating the barcode region, the CPU 211 acquires, from the analysis result of the scanned image executed in S507, the coordinates of the barcode included in the coordinates of the inserted rectangle and the value (a number, a character string, or the like) read from the barcode, and stores the coordinates and the value. At that time, the selected barcode may be displayed in an easy-to-understand manner for the user by surrounding the barcode on the corresponding preview image with a line or the like.
Upon detecting the pressing of the fifth mode switching button 1016, the CPU 211 displays a screen (not shown) displaying a list of images registered as masks on the display device of the operation unit 220. Upon detecting that the user selects one of the images, the CPU 211 inserts the selected image into the preview area 1001. When the insertion of the image is completed, the first mode switching button 1012 is automatically switched to be enabled, and the movement of the image and the adjustment of the size can be performed.
The preview screen 1000 is provided with an external storage 120 set as a save destination of a scanned image or the like in the MFP 110 and a save destination display area 1017 for displaying a folder path. As the folder name of the folder path of the save destination, a character string or a value of a barcode acquired from the scanned image can be used, which will be described in detail below. The save destination display area 1017 is provided with an edit button 1018 for displaying an edit screen for setting or changing the external storage or the folder path as the save destination on the display device of the operation unit 220.
The preview screen 1000 is provided with a file name display area 1019 for displaying a file name set for the scanned image (the mask composite image). Similarly to the folder name, a character string or a value of a barcode in the scanned image can be used as the file name. The file name display area 1019 is provided with an edit button 1020 for displaying an edit screen for setting or changing a file name on the display device of the operation unit 220.
The preview screen 1000 includes a return button 1021 for returning to the previous scan screen 800 and a next button 1022 for completing the operation of the preview screen 1000 and proceeding to the next processing.
The mask region 1023 is a mask region being selected in the mode in which the first mode switching button 1012 is selected. The mask region 1023 is highlighted, for example, by displaying a thick frame so that the user can easily recognize the selected state. It should be noted that the color of the frame indicating the mask region being selected can be changed using the color designation button 1010. Furthermore, in the mask region 1023, square icons are displayed on four sides and four corners in order to make the user recognize that the mask region can be re-edited. When the user drags and moves one square icon, a point or a line on which the square on the diagonal line is displayed serves as a start point, and enlargement and reduction of the mask region can be performed in a direction moved from the start point. Therefore, the user can adjust the shape and size of the mask region by dragging the square icon. It should be note that, in the case that a mask region (a mask region that is not highlighted) other than the selected mask region is dragged, the mask region moves according to the drag operation while maintaining the current size.
When the delete button 1003 is pressed in the case that there is a selected mask region, masking of the selected mask region is released. The display mode of the delete button 1003 may be controlled so as to be enabled only in the case that there is a selected mask region. For example, upon detecting the pressing of the delete button 1003 in the state of
In the mask regions 1023 to 1026, information such as a character string in each region can be visually recognized. This is because the transparent display button 1011 is enabled (selected). When the selection of the transparent display button 1011 is released, the state changes to a state in which the user cannot visually recognize the character string or the like in the mask regions 1023 to 1026.
The character region 1027 in the preview image 1002 includes a character string in the mask region 1026 designated by the mode in which the third mode switching button 1014 is selected. Unlike the mask region, the character region is displayed in a frame without a color of filling. At this time, a label such as “OCR1” is displayed separately from “mask 4” and the like so that the character region and the mask region can be distinguished from each other. It should be noted that the color of the frame indicating the character region can be changed using the color designation button 1010.
The ID 1101 is a value uniquely indicating each piece of region information. The type 1102 indicates a type of the region, and includes a mask, a character, a barcode, an image, and the like. The start point 1103 is a value indicating the start point of the region, and is represented by coordinates (X, Y) indicating the position in the horizontal direction and the vertical direction with the upper left of the preview image 1002 as the origin. The end point 1104 is a value indicating the end point of the region, and is indicated by the coordinates of the lower right point of the region. Therefore, each region is represented by a rectangle in which the coordinates of the start point 1103 are set as the upper left point and the coordinates of the end point 1104 are set as the lower right point.
The value 1105 is information related to each region, and is a mask color (a color code) in the case of a mask region, a character string acquired by OCR in the case of a character region, a character string acquired from a barcode in the case of a barcode region, and a path of an image used in the case of an image inserted from another.
Next, a method of setting a file name of a scan composite image will be described. Upon detecting the pressing of the edit button 1020 of the file name, the CPU 211 causes the preview screen 1000 to transition to a name input screen.
First to fourth input auxiliary areas 1232 to 1235 used for inputting a file name are displayed on the name input screen 1230. In the first input auxiliary area 1232, a button group for inputting a fixed text is provided, and any text or a separator character (a hyphen, an underbar, a blanks, and the like) prepared in advance can be input to the file name. For example, in the case that “text” is selected, a text input keyboard (not shown) is displayed on the display device of the operation unit 220, and the user can input any text.
In the second to fourth input auxiliary areas 1233 to 1235, a group of buttons for inputting a variable value whose value changes according to the scan date and time and information acquired from the scanned image to a file name is provided. The second input auxiliary area 1233 is provided with buttons for inputting date and time information at the time of scanning to a file name, and the date and time information can be easily input to the file name by inputting using each button of “year/month/day/hour/minute/second”.
The third input auxiliary area 1234 is provided with a button for inputting character information acquired from the character region designated in the preview area 1001 to a file name. Here, the character string in the character region 1027 of
The fourth input auxiliary area 1235 is provided with a button for inputting character information acquired from the barcode region designated in the preview area 1001 to a file name. It should be noted that in
The name input screen 1230 has a name route display area 1236 in which buttons provided in the first to fourth input auxiliary areas 1232 to 1235 are used for input is displayed. In the name route display area 1236, the text input from the first input auxiliary area 1232 is displayed as it is, but the inputs from the buttons displayed in the second to fourth input auxiliary areas 1233 to 1235 are displayed in the form of [variable name]. The “variable name” includes information related to the name of each button. In the example of
The name input screen 1230 is provided with a delete button 1237 for deleting the character string input to the file name. The delete button 1237 deletes characters one by one from the end of the character string of the file name, but when the deletion target is other than a fixed value, the character strings corresponding to [variable name] in the name route display area 1236 are collectively deleted by one-time deletion. For example, in the example of
The name input screen 1230 is provided with a cancel button 1238 and a determine button 1239. The cancel button 1238 is a button for canceling the editing on the name input screen 1230, closing the name input screen 1230, and redisplaying the preview screen 1000. The determine button 1239 is a button for confirming editing on the name input screen 1230, saving the input contents, closing the name input screen 1230, and redisplaying the preview screen 1000. The confirmed file name is displayed in a file name display area 1019 of the preview screen 1000. The information in the name route display area 1236 is stored as a setting value of the preset button 701 at the time of information registration to the preset button 701. Therefore, when a preset is selected when the masking application is used for a scanned image of another document, the setting value corresponding to the variable value changes according to the scan date and time of the other document and information acquired from the scanned image. Therefore, by using the preset information, a file name utilizing the information of the scanned document can be easily set.
Next, a method of setting a file save destination will be described. Upon detecting the pressing of the edit button 1018 on the preview screen 1000, the CPU 211 causes the preview screen 1000 displayed on the display device of the operation unit 220 to transition to a save destination setting screen.
In the save destination setting field 1241, an external storage as a transmission destination of the scanned image can be set, and “cloud A” is set here.
In the root folder setting area 1242, a root folder under the external storage set in the save destination setting field 1241 can be set, and a path of the currently set root folder and a reference button for selecting the root folder are displayed. Upon detecting the pressing of the reference button in the root folder setting area 1242, the CPU 211 starts connection to the external storage set in the save destination setting field 1241. When authentication is required to access the external storage set in the save destination setting field 1241, a screen (not shown) required for the authentication is displayed. When the authentication is completed, a list of folders that can be used under the settable external storage is displayed in the save destination setting field 1241, and the user can select a desired folder and change the root folder. In the example of
The first to third sorting folder areas 1243 to 1245 are areas for setting a sorting route of folders. In each of the first to third sorting folder areas 1243 to 1245, an area for displaying a set folder name and an edit button are displayed.
In a “sorting folder 1” in the first sorting folder area 1243, a folder name immediately below the root folder set in the root folder setting area 1242 is set. In a “sorting folder 2” of the second sorting folder area 1244, a folder name immediately below the “sorting folder 1” is set. In a “sorting folder 3” of the third sorting folder area 1245, a folder name immediately below the “sorting folder 2” is set. Therefore, it is possible to set folder sorting routes for three hierarchies in the first to third sorting folder areas 1243 to 1245 starting from the root folder in the root folder setting area 1242.
Setting of each folder in the first to third sorting folder areas 1243 to 1245 can be performed by an edit button provided in each area. Upon detecting the pressing of any of the edit buttons in the first to third sorting folder areas 1243 to 1245, the CPU 211 displays a name input screen equivalent to the name input screen 1230 in
The cancel button 1246 is a button for canceling (discarding) the contents on the save destination setting screen 1240, closing the save destination setting screen 1240, and redisplaying the preview screen 1000 on the display device of the operation unit 220. The determine button 1247 is a button for confirming and saving the contents on the save destination setting screen 1240, closing the save destination setting screen 1240, and redisplaying the preview screen 1000. Upon detecting the pressing of the determine button 1247, the CPU 211 stores the setting on the save destination setting screen 1240 and displays the set information in the save destination display area 1017. At this time, the CPU 211 displays the storage name, the root folder path, and the sorting folder name in one so that the user can easily understand the path of the save destination.
The description refers back to the flowchart of
The presence or absence of the overlapping region can be determined by comparing the coordinates of the start point and the end point. Specifically, in the case that the start point coordinates of one of the two regions are (Xa1, Ya1), the end point coordinates thereof are (Xa2, Ya2), the start point coordinates of the other region are (Xb1, Yb1), and the end point coordinates thereof are (Xb2, Yb2), the following Formulae 1 to 4 are compared. As a result, it is found that there is an overlapping region when one or more of the values of the X coordinate and one or more of the values of the Y coordinate are satisfied in the following Formulae 1 to 4. That is, the case where there is an overlapping region refers to a case where the entire character region is included in the mask region, a case where a part of the character region overlaps the mask region, a case where the entire barcode region is included in the mask region, and a case where a part of the barcode region overlaps the mask region. In addition, the reverse comparison is performed by the following Formulae 5 to 8. When one or more values of the X coordinate and one or more values of the Y coordinate are satisfied in the following Formulae 5 to 8, it is understood that there is an overlapping region.
[Mathematical formula 1]
Xb1<Xa1<Xb2 Formula 1
Xb1<Xa2<Xb2 Formula 2
Yb1<Ya1<Yb2 Formula 3
Yb1<Ya2<Yb2 Formula 4
Xa1<Xb1<Xa2 Formula 5
Xa1<Xb2<Xa2 Formula 6
Ya1<Yb1<Ya2 Formula 7
Ya1<Yb2<Ya2 Formula 8
In the example of
In S906, the CPU 211 determines whether or not one or more overlapping regions have been found on the basis of the check result in S905. In the case of being determined that the overlapping region is found (YES in S906), the CPU 211 executes the process of S907, and in the case of being determined that the overlapping region is not found (NO in S906), the CPU executes the process of S909. In the example of
In S907, the CPU 211 displays a processing selection screen on the display device of the operation unit 220.
The processing selection screen 1300A includes a region number display area 1302 indicating the number of discovered overlapping regions and a display area of first to third options 1303 to 1305 for selecting processing to be executed for the overlapping regions. The first option 1303 is an option in which there is no problem in the current state of the overlapping region, the mask region and the character region are maintained, and no processing is performed. The second option 1304 is an option of instructing processing of releasing (removing) the designation of the mask region of the overlapping region. It should be noted that the file name is not changed in the case where first option 1303 is selected and the case where second option 1304 is selected.
The third option 1305 is an option of instructing processing of releasing (canceling) the use of the character region (or the barcode region) under the mask region. When the processing of the third option 1305 is executed, the use of the character information for the folder name and the file name is released, and thus, the file name and the folder name after execution of the third option 1305 are displayed together in the display area of the third option 1305. As a result, the user can determine whether or not the processing by the third option 1305 may be executed. It should be noted that, in the case of the processing selection screen 1300A, after the processing of the third option 1305 is executed, the designation of the entire region of “OCR1” is released.
It should be noted that, in the present embodiment, the processing for the overlapping region is selected using the first to third options 1303 to 1305, but the contents of the options to be displayed may be changed according to the setting of the masking application. For example, in the case that it is desired to prohibit the use of the character string under the mask region for the file name, it may be possible to separately set the first option 1303 to be hidden.
The processing selection screen 1300A is provided with a cancel button 1306 and a confirm button 1307. The cancel button 1306 is a button for canceling (discarding) the display content on the processing selection screen 1300A, closing the processing selection screen 1300A, and redisplaying the preview screen 1000 in
It should be noted that the processing selection screen 1300A shows an example in which one overlapping region is found. In the case that a plurality of overlapping regions is found, for example, in the case that two overlapping regions are found and the first one thereof is displayed in the preview area 1301, “selection of processing (1/2)” is displayed in the region number display area 1302. Then, by changing the confirm button 1307 to buttons such as “next” and “previous”, the processing for the overlapping region can be selected in order. At this time, the confirm button is displayed or the next button cannot be selected on the screen for selecting the processing for the last overlapping region. As a result, it is possible to recognize that the selected processing has been executed for all the overlapping regions.
Upon detecting that the processing of any one of the first to third options 1303 to 1305 is selected and the confirm button 1307 is pressed, the CPU 211 executes the processing of S908. In S908, the CPU 211 executes the selected processing and updates the region information, the save destination, and the information of the file name.
In S909, the CPU 211 stores information such as coordinates and values of the character region, the barcode region, and the mask region in the HDD 214 as a final result. Here, in addition to the case where the entire character region is included in the mask region as shown in the processing selection screen 1300A of
Region information 1100B in
On the processing selection screen 1300B, an option selection option 1308 for enlarging the mask region of the partial overlapping region to the entire overlapping region, that is, for enlarging the mask region to the entire region of the character region (and the barcode region) is provided. The option selection option 1308 is displayed only when the partial overlapping region is the processing target, and thus, is displayed on the processing selection screen 1300B of
Although not shown, when an option is selected on the processing selection screen 1300B in
According to the processes of S905 to S909, the following effects can be obtained. That is, by displaying the processing selection screens 1300A and 1300B in the case that there is an overlapping region, it is possible to notify the user of a setting mistake of the mask region and a setting mistake of using information under the mask region. In addition, the user can select and execute an appropriate processing while viewing the preview area 1301 on the processing selection screens 1300A and 1300B. It should be noted that in the case of being determined in S906 that there is no overlapping region (NO in S906), the processes in S907 and S908 are not executed, and the current region information is stored in the HDD 214 as a final result in S909.
When the region information is confirmed in S909, the CPU 211 generates a folder path from the set information in S910. In S911, the CPU 211 generates a file name. In S912, the CPU 211 combines (top-coating process) the mask region designated for the scanned image with the image of the designated color and stores the image in the HDD 214, and then ends the present process, thereby ending the process of S508. It should be noted that the processes of S913 to S916 will be described below.
The description refers back to the flowchart of
The print setting display area 1401 is displayed when an item including “print” is selected in the output setting field 801. In the print setting display area 1401, the number of copies can be set, and settings of duplex printing, paper size, imposition, and the like can be changed by pressing a button of “Other print settings”.
The confirmation display area 1402 is displayed when an item including “save” is selected in the output setting field 801. In the confirmation display area 1402, setting values of the save destination and the file name set on the preview screen 1000 are displayed. The option selection option 1403 has a check box, and by checking the check box, various regions and various setting information of this time can be registered as a preset. The return button 1404 is a button for returning to the preview screen 1000. The execution button 1405 is a button for executing printing, saving, and preset registration.
When the execution button 1405 is pressed, the CPU 211 determines whether or not to perform preset registration in S510. In the determination in S510, it is determined that the preset registration is to be performed when the check box of the option selection option 1403 is checked. Upon determining to perform the preset registration (YES in S510), the CPU 211 executes the process of S511, and upon determining not to perform the preset registration (NO in S510), the CPU executes the process of S513.
In S511, the CPU 211 displays a preset name setting screen (not shown) on the display device of the operation unit 220, and accepts the input of the preset name from the user. At this time, the user can register the contents to be preset-registered with any preset name. When the preset name is input, in S512, the CPU 211 stores various setting contents such as the current various regions, setting information, and preset name in the HDD 214 in association with the button ID of the preset button 701.
The preset information 1500 includes region information 1505 and save settings 1506 set on the preview screen 1000, and print settings 1507. The region information 1505 stores coordinate information such as a mask region and a character region. However, since the character information acquired from the character region or the like changes depending on the document, the information is not registered in the “value” of the region information 1505. In the save setting 1506, a name route and a folder path route are stored, but specific values (character strings) are not registered since character information acquired from a character region or the like varies depending on a document. In the print settings 1507, the contents of the print settings on the execution confirmation screen 1400 are registered. In this way, by registering various regions and various settings once set as presets, it is possible to easily perform processing in the masking application for documents of the same format in the next and subsequent times by using the presets.
In S513, the CPU 211 determines whether or not setting for printing has been made. In the case of being determined that the setting to perform printing has been made (YES in S513), the CPU 211 executes the process of S514, and in the case of being determined that the setting not to perform printing has been made (NO in S513), the CPU executes the process of S515. In S514, the CPU 211 executes printing processing of the mask composite image.
In S515, the CPU 211 determines whether or not setting for saving has been made. In the case of being determined that the setting for saving has been made (YES in S515), the CPU 211 executes the process of S516, and in the case of being determined that the setting for saving has not been made (NO in S515), this processing is terminated.
In S516, the CPU 211 executes save processing of the mask composite image, and then ends the process. At this time, the mask composite image is converted into the file format designated on the scan screen 800. Further, the mask composite image is transmitted to the save destination (for example, the external storage 120) designated on the preview screen 1000 with the designated file name, and the saving in the save destination is completed. When the masking application processing is completed in this way, the CPU 211 executes screen switching processing of the display device of the operation unit 220. The new screen at that time may be the masking method selection screen 600 for the next scan, or may be a main screen (not shown).
Next, a case where it is determined in S902 of the region designation processing in S508 that “preset” has been pressed on the masking method selection screen 600 will be described. In the case of being determined that “preset” has been pressed in S902 (YES in S902), the CPU 211 executes the process of S903. Hereinafter, the processes of S903 to S912 will be described focusing on the difference from the case where it is determined that the “manual” has been pressed on the masking method selection screen 600.
In S903, the CPU 211 acquires region information and setting information of the button ID selected on the preset list screen 700. In S904, the CPU 211 displays the preview screen reflecting the setting acquired in S903. For example, in the case that the preset information shown in
Upon detecting that the next button 1022 is pressed in
When the processing of the flowchart of
Next, a case where it is determined in S901 of the region designation processing in S508 that “print only” is selected in the output setting field 801 of the scan screen 800 will be described. In the case of being determined that the item including “save” has not been pressed in S901, that is, “print only” has been pressed (NO in S901), the CPU 211 executes the process of S913.
In S913, the CPU 211 determines whether or not “preset” has been pressed (selected) on the masking method selection screen 600. In the case of being determined that “preset” has been pressed (YES in S913), the CPU 211 executes the process of S914, and in the case of being determined that “manual” has been pressed (NO in S913), the CPU executes the process of S915.
In S914, the CPU 211 acquires region information and the like related to the button ID selected on the preset list screen 700, as in S903.
In S915, the CPU 211 displays the preview screen 1000. At this time, although not shown, the third mode switching button 1014, the fourth mode switching button 1015, the save destination display area 1017, the edit button 1018, the file name display area 1019, and the edit button 1020, which are items used for saving, are hidden (not shown). Therefore, as when the item including “save” is selected, the determination processes (S906 to S908) as to whether there is an overlapping region is not performed.
When the next button 1022 on the preview screen 1000 is pressed, the CPU 211 stores information on the mask region in S916 as in S909. Thereafter, in S912, the CPU 211 combines the mask region designated for the scanned image with the image of the designated color, and stores the composite image in the HDD 214. When the region designation processing in S508 is completed, the CPU 211 displays the execution confirmation screen 1400 on the display device of the operation unit 220 in S509. At this time, although not shown, the confirmation display area 1402 related to the save processing is not displayed because it is unnecessary. Upon detecting the pressing of the execution button 1405 on the execution confirmation screen 1400, the CPU 211 executes the processes of S510 to S515.
The preferred embodiment of the present disclosure has been described above. When data suitable for a scanned image is stored using character information acquired from the scanned image that needs to be masked, it is necessary to pay attention whether there is no problem in using character information of a mask region in the scanned image for a file name or a folder name. Meanwhile, in the present embodiment, the mask region, and the character region and the barcode region used for the file name and the folder name are simultaneously displayed on the preview screen of the scanned image. As a result, it is possible to reduce the risk of erroneously using information under the mask region in the scanned image.
Furthermore, according to the present embodiment, even in the case that the user does not notice that the mask region overlaps the character region or the barcode region (there is an overlapping region), the processing selection screen is displayed, so that it is possible to notify the user that there is an overlapping region. As a result, when masking the scanned image and saving the file, it is possible to use only information that has no problem even if it is shared with others as a file name and save the file.
Although the present disclosure has been described in detail based on the preferred embodiments thereof, the present disclosure is not limited to these specific embodiments, and various forms without departing from the gist of the present disclosure are also included in the present disclosure. Furthermore, each embodiment described above merely illustrates an embodiment of the present disclosure, and each embodiment can be appropriately combined.
For example, the image processing system in
Embodiment(s) of the present disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., ASIC) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2022-191705, filed on Nov. 30, 2022, which is hereby incorporated by reference herein in its entirety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2022-191705 | Nov 2022 | JP | national |
