Image processing apparatus and control method

Abstract

An image processing apparatus comprises an image processing unit configured to generate an image to be saved, and a control unit configured to control the image processing unit in response to an instruction for generating a second image from a first image and saving the second image. When the second image is saved in response to the instruction, the image processing unit adds protection information to the second image and save the second image, the protection information being recorded in the first image for protecting at least a part of the image.

Description

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an image processing technique of saving or displaying an image viewing of which is restricted.

Description of the Related Art

There has been known a technique of partially masking an image with mosaic processing or the like for the sake of privacy protection. Japanese Patent No. 5993575 describes a medical imaging system with which a protection part of a screenshot is masked, and the resultant image is attached to an email. However, when an image is permanently masked, switching is required between an image provided to a user who should not view the image and an image provided to a user who can view the image.

In view of this, a technique of displaying an image with a mask removed to a user with a viewing authority, and displaying an image in which a protection part is replaced with another image to a user without the viewing authority has been proposed in ISO/IEC 19566-4. Japanese Patent No. 4209128 describes a technique with which certain information is appended to image data, and the certain information is removed at the time of resaving, so that whether image data is resaved image data or the original image data can be determined.

However, when in a state where a user with the viewing authority viewing the image with the mask removed, an image of the screen (a screenshot image) is captured and saved, the image with the mask removed is saved. This means that this image, which can be viewable for the users without the viewing authority, may be redistributed.

SUMMARY OF THE INVENTION

The present invention has been made in consideration of the aforementioned problems, and realizes techniques enabling, in a case where a new image is generated from an original image and saved, the same protection as the original image to be given to the newly saved image.

In order to solve the aforementioned problems, the present invention provides an image processing apparatus comprising: an image processing unit configured to generate an image to be saved; and a control unit configured to control the image processing unit in response to an instruction for generating a second image from a first image and saving the second image, wherein when the second image is saved in response to the instruction, the image processing unit adds protection information to the second image and save the second image, the protection information being recorded in the first image for protecting at least a part of the image.

In order to solve the aforementioned problems, the present invention provides an image processing apparatus comprising: an image processing unit configured to generate an image to be displayed; and a control unit configured to control the image processing unit in response to an instruction for displaying the image, wherein the image processing unit includes: a protection information determination unit configured to determine whether protection information for protecting at least a part of the image is recorded in the image to be displayed; and a viewing authority determination unit configured to determine whether a user has a viewing authority for the image to be displayed.

In order to solve the aforementioned problems, the present invention provides a method of controlling an image processing apparatus comprising: receiving an instruction for generating a second image from a first image and saving the second image; and in case of saving the second image in response to the instruction, adding protection information to the second image and saving the second image, the protection information being added to the first image for protecting at least a part of the image.

In order to solve the aforementioned problems, the present invention provides a method of controlling an image processing apparatus comprising: generating an image to be displayed in response to an instruction for displaying the image, wherein the generating includes: determining whether protection information for protecting at least a part of the image is recorded in the image to be displayed; and determining whether a user has a viewing authority for the image to be displayed.

In order to solve the aforementioned problems, the present invention provides a non-transitory computer-readable storage medium storing a program for causing a computer to function as an image processing apparatus comprising: an image processing unit configured to generate an image to be saved; and a control unit configured to control the image processing unit in response to an instruction for generating a second image from a first image and saving the second image, wherein when the second image is saved in response to the instruction, the image processing unit adds protection information to the second image and save the second image, the protection information being recorded in the first image for protecting at least a part of the image.

In order to solve the aforementioned problems, the present invention provides a non-transitory computer-readable storage medium storing a program for causing a computer to function as an image processing apparatus comprising: an image processing unit configured to generate an image to be displayed; and a control unit configured to control the image processing unit in response to an instruction for displaying the image, wherein the image processing unit includes: a protection information determination unit configured to determine whether protection information for protecting at least a part of the image is recorded in the image to be displayed; and a viewing authority determination unit configured to determine whether a user has a viewing authority for the image to be displayed.

According to the present invention, in a case where anew image is generated from an original image and saved, the same protection as the original image can be given to the newly saved image.

Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of an apparatus according to a first embodiment.

FIG. 2 is a flowchart illustrating image saving processing according to the first embodiment.

FIG. 3A to FIG. 3C are diagrams illustrating image save instructions according to the first embodiment.

FIG. 4 is a diagram illustrating a data structure of image information according to the first embodiment.

FIG. 5 is a block diagram illustrating a configuration of an apparatus according to a second embodiment.

FIG. 6A to FIG. 6C are diagrams illustrating display images according to the second embodiment.

FIG. 7A and FIG. 7B are flowcharts illustrating image display processing and image saving processing according to a second embodiment.

FIG. 8A to FIG. 8C are diagrams illustrating image generation instructions according to the second embodiment.

FIG. 9 is a diagram illustrating a method of updating image information and protection information according to a third embodiment.

DESCRIPTION OF THE EMBODIMENTS

Hereinafter, embodiments will be described in detail by referring to the accompanying drawings. The following embodiments do not limit the invention according to the claims. Although a plurality of features is described in the embodiments, some of the plurality of features may not be essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, identical or similar components are denoted by identical reference signs, and redundant description will be omitted.

While an image processing apparatus according to the present invention is applied to an information processing apparatus such as a personal computer (PC) or an information processing terminal such as a smart device and a tablet PC in the embodiments described below, the image processing apparatus according to the present invention is not limited to these and may be also applied to an imaging apparatus such as a digital camera that can capture images.

First Embodiment

In a first embodiment, an example of a configuration will be described where when image information is to be newly saved as a screenshot image of a display screen or a copied image, if protection information for protecting at least a part of an image unviewable is recorded in the image information of the source image for saving, the image information to be newly saved is saved in a state of the protection information also added thereto.

<Apparatus Configuration>

First, a configuration and functions of an image processing apparatus according to the present embodiment will be described with reference to FIG. 1.

FIG. 1 is a block diagram illustrating the configuration of the image processing apparatus according to the present embodiment.

An image processing apparatus 101 includes a control unit 102, a memory 103, a storage unit 104, an operation unit 105, a display unit 106, an image processing unit 107, a communication unit 108, and a bus 109.

The control unit 102 includes an arithmetic operation processor such as a CPU and an MPU that controls the entire image processing apparatus 101. The control unit 102 implements processing of embodiments described below by executing programs stored in the storage unit 104 described below.

The memory 103 is a RAM or the like used as a work area for deploying constants and variables for operation of the control unit 102, a program read out from the storage unit 104, and the like. The memory 103 is used as a buffer memory that temporarily holds data and commands (instructions) to be output to the control unit 102.

The storage unit 104 is a ROM, a memory card, a hard disk, or the like that stores an operating system (OS) that is basic software executed by the control unit 102 or an application for implementing an applicative function in cooperation with the OS. The storage unit 104 stores a program for causing the control unit 102 to execute processing in the first embodiment and a second embodiment described below.

The operation unit 105 is an operation member such as a mouse or a keyboard that receives a user operation, and outputs various instructions to the control unit 102. The operation unit 105 is integrally formed with the display unit 106, and includes a touch panel configured to operate an image, a UI screen, or the like.

The display unit 106 is a display device such as a display or a monitor including an LCD or organic EL. The display unit 106 displays images held by the image processing apparatus 101, as well as webpages and images received over a network by the communication unit 108 as described below. In addition, the display unit 106 displays a UI screen for interactive operations.

The image processing unit 107 includes a GPU that executes processing such as modification of an image, color conversion of an image, and combining of images, processing such as reading-out/writing-in of additional information (metadata) recorded in a file of image information, and the like. The image processing unit 107 executes processing for generating image information from the webpages or the images displayed on the display unit 106.

The image processing unit 107 includes a protection information determination unit 110 and a protection information saving unit 111. The protection information determination unit 110 determines whether the protection information is recorded in the image information to be saved. The protection information saving unit 111 adds the protection information recorded in the image information to be saved to the image information to be newly saved and save.

In the present embodiment, the image information to be saved is original image information for generating a screenshot image or a copy image.

The protection information is information for applying mask processing or the like on a protection region included in at least a part of the image information to be saved, to make the protection region unviewable for the sake of protection. The protection region is the face of a person in the image, confidential information, and the like. In the case of a screenshot image, a plurality of images may be displayed in one screen, and thus may include a plurality of protection regions.

In the protection information, as described below with reference to FIG. 6, data with the image of the protection region encrypted and coordinate data indicating a position where a decrypted image is to be restored for the image having the mask processing applied on the protection region are recorded. The protection information is recorded as metadata in the image information, or is recorded as a metadata file separate from the image information.

To decrypt the encrypted data included in the protection information, key information is required. Thus, the presence or absence of the key information respectively indicates viewable or unviewable for the image information to be saved or the protection region of the image information to be displayed. The key information may be included in the protection information, but is preferably managed separately from the protection information and acquired from the outside over a network or the like, for restriction of viewing by users without viewing authority as described in a second embodiment below.

The communication unit 108 is an interface that is communicably connected to a network such as the Internet or a local area network (LAN).

The bus 109 connects each of the components 102 to 108 of the image processing apparatus 101 such that data can be transmitted and received between the components.

<Image Saving Processing>

Now, image saving processing according to the present embodiment will be described with reference to FIG. 2.

FIG. 2 is a flowchart illustrating image saving processing according to the present embodiment.

The processing in FIG. 2 is implemented by the control unit 102 of the image processing apparatus 101 executing a program stored in the storage unit 104, and controlling each of the components of the image processing apparatus 101. The processing in FIG. 2 starts when a screenshot instruction or a copy instruction is input to the control unit 102 by the user operating the operation unit 105 in a state in which a webpage or an image is displayed on the display unit 106 of the image processing apparatus 101.

In the following description, the image information to be saved includes one with the protection information recorded, and one without the protection information recorded.

In step S201, when the operation unit 105 receives an image save instruction, the control unit 102 generates the image information to be saved from the image displayed on the display unit 106, and waits until the image saving processing becomes executable by the control unit 102, with the image information to be saved and the image save instruction held in the memory 103. Once the image saving processing becomes executable by the control unit 102, the control unit 102 outputs the image information to be saved and the image save instruction to the image processing unit 107.

FIG. 4 is a diagram illustrating a data structure of the image information. As illustrated in FIG. 4, image information 401 includes metadata 402 and image data 403. In the metadata 402, protection information 402a is recorded. There may be a case where the image information 401 only includes an image file including the image data 403, and a metadata file including the metadata 402 is prepared as a separate file.

In the present embodiment, the format of the metadata is not limited. Any format enabling the protection information to be recorded may be employed. A possible example of such a format includes Exif. The image data 403, which is pixel data, may also be data after spatial frequency transformation or data after compression and encryption, depending on the file format. In the present embodiment, the image data 403 may be saved in any file format. The file format may also be one including metadata, such as JPEG and TIFF. Even a file format without metadata for recording the protection information, such as bitmap and RAW, may be used, in combination with a metadata file, which is a separate file for recording the protection information.

In step S202, when the image information to be saved and the image save instruction are input to the image processing unit 107 from the control unit 102, the protection information determination unit 110 determines whether the protection information is recorded in the image information to be saved. When the protection information determination unit 110 determines that the protection information is recorded in the information to be saved, the processing proceeds to S203. When the protection information determination unit 110 determines that the protection information is not recorded in the image information to be saved, the processing proceeds to S204.

In step S203, the protection information saving unit 111 adds the protection information determined in S202 to image information to be newly saved. Then, the image processing unit 107 outputs, to the storage unit 104, the image information to be newly saved to which the protection information is added. In the process, the image processing unit 107 may output an image save completion notification to the control unit 102.

In step S204, the image information to be newly saved, acquired from the image processing unit 107, is saved in the storage unit 104.

The saving of the image information is assumed that the file of the image information 401 is recorded at a predetermined location in a file system. Still, in a system constantly running, a system not requiring a screenshot image or a copy image to be permanently held, or the like, the image information may not be recorded as the file of the image information 401, and may be recorded in the storage unit 104 to be read out from the storage unit 104 and used as required.

The timing when the image processing unit 107 outputs the image save completion notification to the control unit 102 may be after the processing in step S204. In this case, upon saving the image information to be newly saved, the storage unit 104 outputs the image save completion notification to the image processing unit 107. Upon receiving the image save completion notification, the image processing unit 107 outputs the image save completion notification to the control unit 102. Alternatively, the image processing unit 107 may not output the image save completion notification to the control unit 102, and the storage unit 104 may output the image save completion notification to the control unit 102 after saving the image information to be newly saved.

There may be a plurality of patterns regarding how the image save instruction is transmitted and received. FIG. 3A to FIG. 3C are diagrams illustrating three example pattern types. In FIG. 3A to FIG. 3C, a UI 301 is a UI screen displayed on the display unit 106. An OS 302 and an application 303 are software executed by the image processing apparatus 101. The image save instruction can be transmitted and received in the modes illustrated in FIG. 3A to FIG. 3C and the like. FIG. 3A illustrates a mode in which the image save instruction is output from the UI 301 to the OS 302, and the image information is saved by the function of the OS 302. FIG. 3B illustrates a mode in which the image save instruction is output from the UI 301 to the OS 302 and then the image save instruction is output from the OS 302 to the application 303, and the image information is saved as the function of the application 303. FIG. 3C illustrates a mode in which the image save instruction is output from the UI 301 to the application 303, and the image information is saved as the function of the application 303.

In a possible case according to the pattern illustrated in FIG. 3A, the OS 302 may receive the image save instruction in step S201 and execute the processing in step S202 and after. In a possible case according to the pattern illustrated in FIG. 3B, the OS 302 may receive the image save instruction in step S201 and output the image save instruction to the application 303. Then, the application 303 may receive the image save instruction and execute the processing in step S202 and after. Then, the application 303 may output an image save instruction completion notification to the OS 302. In a possible case according to the pattern illustrated in FIG. 3C, the application 303 may receive the image save instruction in step S201 and execute the processing in step S202 and after.

As details of the patterns of FIG. 3B and FIG. 3C, there may be a case where the application 303 has the image display function, and a case where the application 303 has no image display function, and only a screenshot image of the display screen is saved.

In the image saving processing of the present embodiment, when the protection information is added to the image information newly saved, the mask processing is applied for the image information to make the protection region unviewable. Key information is required to make the protection region viewable. Thus, even if the newly saved image information is redistributed, the protection region can be protected so as not to be viewable.

As described above, according to the present embodiment, when a new image is generated from an image to which the protection information is added and the new image is saved, the newly saved image is provided with the protection information and saved. Thus, the newly saved image can be protected in the same manner as that for the original image.

Second Embodiment

Next, a second embodiment will be described with reference to FIG. 5.

In the second embodiment, a description will be given on an example of a configuration in which control is performed to make a protection region of image information to be displayed viewable or unviewable depending on whether the user has the viewing authority, and of a configuration in which control is performed whether the image information to be saved is provided with the protection information and saved depending on whether the user has the viewing authority.

In an image processing apparatus 501 according to the second embodiment, the image processing unit 107 includes a viewing authority determination unit 502, in addition to the configuration according to the first embodiment illustrated in FIG. 1. The other configurations are the same as those in the first embodiment illustrated in FIG. 1.

The protection information determination unit 110 determines whether the protection information is recorded in the image information to be saved or the image information to be displayed. The protection information saving unit 111 adds the protection information recorded in the image information to be saved to the image information to be newly saved and save. Based on the protection information recorded in the image information to be displayed, the image processing unit 107 generates a display image on which the mask processing is applied to make the protection region unviewable for the image information to be newly displayed.

The image information to be displayed according to the present embodiment is original image information for generating the display image, and includes an image held by the image processing apparatus 501, a webpage or an image received by the communication unit 108 over the network, and a screenshot image or a copy image saved through the image saving processing of the first embodiment. The image information to be saved is original image information for generating a screenshot image or a copy image. The protection information will be described below with reference to FIG. 6A to FIG. 6C.

In the following description, the image information to be displayed includes one with the protection information recorded, and one without the protection information recorded. The user may or may not have the key information for viewing the protection information of the image information to be displayed.

<Image Display Processing>

First of all, processing of controlling the protection region in the image information to be displayed, to be viewable or unviewable depending on whether the user has the viewing authority, will be described with reference to FIG. 7A.

FIG. 7A is a flowchart illustrating image display processing according to the present embodiment.

The processing in FIG. 7A is implemented by the control unit 102 of the image processing apparatus 501 executing a program stored in the storage unit 104, and controlling each of the components of the image processing apparatus 501. The processing in FIG. 7A starts when an instruction for displaying the image information on the display unit 106 is input to the control unit 102 by the user operating the operation unit 105.

In step S701, the control unit 102 reads out the image information to be displayed, and waits until the image display processing becomes executable by the control unit 102, with the image information to be displayed and an image generation instruction held in the memory 103. Once the image display processing becomes executable by the control unit 102, the control unit 102 outputs the image information to be displayed and the image generation instruction to the image processing unit 107. Note that image information acquired from the outside over the network may be saved in the storage unit 104.

In step S702, when the image information to be displayed and the image generation instruction are input to the image processing unit 107 from the control unit 102, the protection information determination unit 110 determines whether the protection information is recorded in the image information to be displayed. When the protection information determination unit 110 determines that the protection information is recorded in the image information to be displayed, the processing proceeds to S703. When the protection information determination unit 110 determines that the protection information is not recorded in the image information to be displayed, the processing proceeds to S705.

In step S703, the viewing authority determination unit 502 determines whether the user has the viewing authority for the image information to be displayed. When the viewing authority determination unit 502 determines that the user has the viewing authority for the image information to be displayed, the processing proceeds to S704. When the viewing authority determination unit 502 determines that the user does not have the viewing authority for the image information to be displayed, the processing proceeds to S705. An example of a possible method for determining whether the viewing is restricted includes determining whether the image processing apparatus 501 has the key information for the protection information recorded in the image information to be displayed. The key information may be acquired from the outside over the network and the like and stored in the storage unit 104 of the image processing apparatus 501, and may be acquired over the network at a timing of determination on whether the user has the viewing authority.

In step S704, based on the protection information recorded in the image information to be displayed, the image processing unit 107 generates the display image with the protection region of the image information to be displayed made viewable. Then, the processing proceeds to step S706.

In step S705, the image processing unit 107 generates a display image with the protection region of the image information to be displayed made unviewable. Then, the processing proceeds to step S706.

FIG. 6A to FIG. 6C are diagrams illustrating display images of the present embodiment.

The image information to be displayed is assumed to be an image with a protection region 601 made unviewable as illustrated in FIG. 6B. In this case, when the protection information is recorded in the image information to be displayed, or when the user has the viewing authority, encrypted image information in the protection region 601 in FIG. 6C is decrypted using the key information. Thus, the display image restored from the image illustrated in FIG. 6B, that is, the image with the protection region 601 made viewable as illustrated in FIG. 6A is generated. On the other hand, when the protection information is not recorded in the image information to be displayed, or the user does not have the viewing authority, the image in FIG. 6B, that is, an image with the protection region 601 in FIG. 6A made unviewable is generated.

In the present embodiment, in the metadata 402 of the image information 401 in FIG. 4, image information with the image of the protection region 601 in FIG. 6C encrypted, the key information for decrypting the encrypted image of the protection region 601 in FIG. 6C, and coordinate data indicating the position where the decrypted image of the protection region 601 in FIG. 6C is to be restored for the image with the mask processing applied on the protection region 601 as illustrated in FIG. 6B are recorded as the protection information. The key information may not be recorded in the metadata 402, and may be held by the image processing apparatus 501 or may be acquired from the outside over the network, as long as the information can be acquired at the time of decrypting.

For example, when the image of the protection region 601 in FIG. 6 (has a rectangular shape and includes metadata describing the size of the image, the coordinate data may be coordinate information indicating coordinates (X, Y) of the upper left point. When the metadata describing the size of the image in FIG. 6C is not included or when the image is decrypted to have a size different from that described in the metadata of the image in FIG. 6C, coordinate data on a width W and a height H is recorded in the metadata, in addition to the coordinate information indicating the coordinates (X, Y) of the upper left point. The image in FIG. 6A is restored using these pieces of coordinate data.

In step S706, the image processing unit 107 outputs the display image generated in step S704 or S705 and an image generation completion notification to the control unit 102. Upon receiving the image generation completion notification from the image processing unit 107, the control unit 102 outputs the display image to the display unit 106. The display unit 106 displays the display image input from the control unit 102.

With the image display processing of the present embodiment, the protection region is displayed to be viewable when the protection information is recorded in the image information to be displayed or when the user has the viewing authority, but the protection region is displayed to be unviewable when the protection information is not recorded in the image information to be displayed or when the user does not have the viewing authority.

In the present embodiment, an example of a configuration of controlling the protection region in the image information to be displayed, to be viewable or unviewable depending on whether the user has the viewing authority is described, but this should not be construed in a limiting sense. For example, also when an image is displayed on a display device provided separately from the image processing apparatus 501 of the present embodiment, the image illustrated in FIG. 6B can be displayed as the display image, because the image in FIG. 6C encrypted is recorded in the metadata 402 as the protection information for the image information to be displayed. Thus, also when an image is displayed on a display device provided separately from the image processing apparatus 501 of the present embodiment, the image as illustrated in FIG. 6B with the protection region made unviewable can be displayed when the user does not have the viewing authority for the image information to be displayed.

There may be a plurality of patterns regarding how the image generation instruction is transmitted and received. FIG. 8A to FIG. 8C are diagrams illustrating three example pattern types. The image generation instruction can be transmitted and received in the modes illustrated in FIG. 8A to FIG. 8C and the like. FIG. 8A illustrates a mode in which the UI 301 outputs the image generation instruction to the OS 302, and the display image is generated with control for viewing restriction performed as the function of the OS 302. FIG. 8B illustrates a mode in which the UI 301 outputs the image generation instruction to the OS 302, the OS 302 outputs the image generation instruction to an application 803, and the display image is generated with the control for viewing restriction performed as the function of the application 803. FIG. 8C illustrates a mode in which the UI 301 outputs the image generation instruction to the application 803, and the display image is generated with the control for viewing restriction performed as the function of the application 803.

As described above, with the image display processing of the present embodiment, the protection region of the image information to be displayed can be controlled to be viewable or unviewable.

Furthermore, with the present embodiment, control can be performed to or not to save the image information to be saved with the protection information added thereto, depending on whether the user has the viewing authority.

<Image Saving Processing>

Next, processing of performing control to or not to save the image information to be saved with the protection information added thereto, depending on whether the user has the viewing authority, will be described with reference to FIG. 7B.

FIG. 7B is a flowchart illustrating image saving processing according to the present embodiment.

The processing in FIG. 7B is implemented by the control unit 102 of the image processing apparatus 501 executing a program stored in the storage unit 104, and controlling each of the components of the image processing apparatus 501. The processing in FIG. 7B starts when a screenshot instruction or a copy instruction is input to the control unit 102 by the user operating the operation unit 105 in a state in which image information to be displayed such as a webpage or a reproduced image is displayed on the display unit 106 of the image processing apparatus 501.

Similar processing as those in steps S201 and S202 in FIG. 2 are performed in steps S711 and S712.

When the protection information determination unit 110 determines that the protection information is recorded in the image information to be saved in step S712, the processing proceeds to S713. When the protection information determination unit 110 determines that the protection information is not recorded in the image information to be saved, the processing proceeds to S715.

In step S713, the viewing authority determination unit 502 determines whether the user has the viewing authority for the image information to be saved. When the viewing authority determination unit 502 determines that the user has the viewing authority for the image information to be saved, the processing proceeds to S714. When the viewing authority determination unit 502 determines that the user does not have the viewing authority for the image information to be saved, the processing proceeds to S715.

Similar processing as those in steps S203 and S204 in FIG. 2 are performed in steps S714 and S715.

With the image saving processing of the present embodiment, image information to be newly saved has the mask processing applied to make the protection region 601 in FIG. 6B unviewable, when the protection information is recorded in the image information to be saved and the user has the viewing authority for the image information to be saved. Key information is required to make the protection region viewable. Thus, even if the newly saved image information is redistributed, the protection region can be protected so as not to be viewable.

When the protection information is not recorded in the image information to be saved or when the user does not have the viewing authority for the image information to be saved, no protection information needs to be added to the image information to be newly saved. Thus, only the image information having the mask processing applied to make the protection region 601 unviewable as in FIG. 6B is saved.

As described above, with the image saving processing of the present embodiment, control can be performed to or not to save the image information to be saved with the protection information added thereto, depending on whether the user has the viewing authority.

The timing when the image processing unit 107 outputs the image save completion notification to the control unit 102 may be after the processing in step S715. In this case, when the control unit 102 outputs the image save completion notification to the display unit 106, the image processing unit 107 outputs the image save completion notification to the control unit 102. Alternatively, the image processing unit 107 may not output the image save completion notification to the control unit 102, and may output the image save completion notification to the control unit 102 after the display unit 106 has displayed the image.

The application 303 in FIG. 3B and FIG. 3C and the application 803 in FIG. 8B and FIG. 8C are logically different applications, but may be the same application.

Third Embodiment

Next, a third embodiment will be described with reference to FIG. 9.

In the third embodiment, an example is described in which when the image information to be saved is not displayed with the original image size, the protection information of the image information to be saved is updated and displayed.

In the present embodiment, when the protection information is added to the image information to be newly saved in step S203 in FIG. 2 and step S714 in FIG. 7B, the protection information included in the metadata 402 is updated, and the updated protection information is added.

It is assumed that, in the metadata 402 of the image information 401, the image in FIG. 6C encrypted, the key information used for decrypting the image in FIG. 6C encrypted, and coordinate data indicating the position where the image in FIG. 6C is to be restored in the image in FIG. 6B, are recorded as the protection information. A possible example of the coordinate data includes coordinate information indicating the coordinates (X, Y) of the upper left point, when the image illustrated in FIG. 6C is a rectangular image.

Still, when, as illustrated in FIG. 8B and FIG. 8C, the image generated as the function of the application 803 is displayed, as illustrated in FIG. 9, the display image is not necessarily displayed with the original image size as illustrated in FIG. 6A or FIG. 6B. In this case, the image information (screenshot image) to be saved is saved with a size different from the original image size. And, the image is displayed at a position (X0, Y0) that is a display position offset with respect to the overall position in the original image. Also, the image obtained by decrypting the image in FIG. 6C encrypted, would not have a size defined by the width W and the height H. Also in a case where the image in FIG. 6C encrypted is decrypted to restore the image in FIG. 6B, the image needs to be restored at a position different from the coordinates (X, Y) of the image in FIG. 6B, which is the protection information before the update.

Thus, in the present embodiment, when the protection information is added to the image information to be newly saved in step S203 in FIG. 2, the display size of the image information to be saved is acquired, and scaling ratios for the horizontal and vertical directions in the screen are calculated from the display size acquired and a size of the original image information (image information to be saved before the display size is changed). A width W′ and a height H′ that are the display sizes of the image in FIG. 6C are obtained from the size of the image in FIG. 6C, which is the protection information before the update, the width W and the height H, and the scaling ratios obtained. Coordinates (X′, Y′) of the image information to be saved after the update are obtained from coordinates (X0, Y0) of a position offset from the position of the image in FIG. 6A or FIG. 6B, the coordinates (X, Y) of the image in FIG. 6B, which is the protection information before the update, and the scaling ratios obtained.

With the information thus obtained being the protection information after the update, the image in FIG. 6C encrypted, the key information used for decrypting the image in FIG. 6C encrypted, and the coordinate data indicating the position where the image in FIG. 6C is to be restored in the image in FIG. 9 are added to the metadata 402 of the image information to be newly saved. The coordinate data includes the coordinate information indicating the coordinates (X′. Y′) of the upper left point, and the width W′ and the height H′.

With the present embodiment, when the display image is not displayed with the original image size, the protection information of the image information to be newly saved can be updated and saved based on the display image.

OTHER EMBODIMENTS

Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

This application claims the benefit of Japanese Patent Application No. 2021-174069, filed Oct. 25, 2021 which is hereby incorporated by reference herein in its entirety.

Claims

1. An image processing apparatus comprising: a display unit;a memory, including instructions stored thereon, which when executed by the processor cause the image processing apparatus to: generate an image to be saved; andin response to an instruction for generating a second image from a first image and saving the second image: determine whether protection information for protecting at least a part of the image is recorded in the image to be displayed; anddetermine whether a user has a viewing authority for the image to be displayed,wherein in a case where the user has the viewing authority, generate an image in which a protection region in the image to be displayed is viewable,in a case where the user does not have the viewing authority, generate an image in which the protection region in the image to be displayed is made unviewable,wherein in a state that the image is displayed the protection region is viewable, when the second image is saved in response to the instruction, add second protection information to the second image and save the second image, the second protection information being based on the protection information recorded in the first image for protecting at least a part of the image,wherein in a state that the image is displayed the protection region is unviewable, when the second image is saved in response to the instruction, second protection information is not added to the second image and save the second image,wherein the second image includes an image processed a protection region included in at least a part of the first image cannot be viewed, andwherein in the protection information, at least data with an image of the protection region being encrypted and data indicating a position, wherein a decrypted image of the protection region is to be restored for the second image, are recorded; andupdate, for the protection information to be added to the second image, a size of the image of the protection region in the protection information and the data indicating the position where the image of the protection region is to be restored for the second image, based on a size of the first image and a size at which the first image is displayed.

2. The apparatus according to claim 1, wherein the istructions, when executed by the processor, further cause the apparatus to: determine whether a user has a viewing authority for the first image, andbased on determining that the user does not have the viewing authority, save the second image without the protection information added to the second image.

3. The apparatus according to claim 2, wherein the instructions, when executed by the processor, further cause the apparatus to: determine whether the user has the viewing authority, based on presence or absence of information for decrypting the encrypted data.

4. The apparatus according to claim 1, wherein the second image is a screenshot image or a copy image of the first image.

5. A method of controlling an image processing apparatus comprising: receiving an instruction for generating a second image from a first image and saving the second image; andin response to an instruction for generating a second image from a first image and saving the second image: determine whether protection information for protecting at least a part of the image is recorded in the image to be displayed; anddetermine whether a user has a viewing authority for the image to be displayed,wherein in a case where the user has the viewing authority, generate an image in which a protection region in the image to be displayed is viewable, andin a case where the user does not have the viewing authority, generate an image in which the protection region in the image to be displayed is made unviewable,wherein in a state that the image is displayed the protection region is viewable, when the second image is saved in response to the instruction, add second protection information to the second image and save the second image, information being based on the protection information recorded in the first image for protecting at least a part of the image,wherein in a state that the image is displayed the protection region is unviewable, when the second image is saved in response to the instruction, second protection information is not added to the second image and save the second image,wherein the second image includes an image processed a protection region included in at least a part of the first image cannot be viewed, andwherein in the protection information, at least data with an image of the protection region being encrypted and data indicating a position, where a decrypted image of the protection region is to be restored for the second image, are recorded; and update, for the protection information to be added to the second image, a size of the image of the protection region in the protection information and the data indicating the position where the image of the protection region is to be restored for the second image, based on a size of the first image and a size at which the first image is displayed.

6. A non-transitory computer-readable storage medium storing a program for causing a computer to function as an image processing apparatus comprising: generate an image to be saved; andin response to an instruction for generating a second image from a first image and saving the second image: determine whether protection information for protecting at least a part of the image is recorded in the image to be displayed; anddetermine whether a user has a viewing authority for the image to be displayed,wherein in a case where the user has the viewing authority, generate an image in which a protection region in the image to be displayed is viewable, andin a case where the user does not have the viewing authority, generate an image in which the protection region in the image to be displayed is made unviewable,wherein in a state that the image is displayed the protection region is viewable, when the second image is saved in response to the instruction, add second protection information to the second image and save the second image, information being based on the protection information recorded in the first image for protecting at least a part of the image,wherein in a state that the image is displayed the protection region is unviewable, when the second image is saved in response to the instruction, second protection information is not added to the second image and save the second image,wherein the second image includes an image processed a protection region included in at least a part of the first image cannot be viewed, andwherein in the protection information, at least data with an image of the protection region being encrypted and data indicating a position, where a decrypted image of the protection region is to be restored for the second image, are recorded; andupdate, for the protection information to be added to the second image, a size of the image of the protection region in the protection information and the data indicating the position where the image of the protection region is to be restored for the second image, based on a size of the first image and a size at which the first image is displayed.