IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM STORING IMAGE PROCESSING PROGRAM

Information

  • Patent Application
  • 20230300333
  • Publication Number
    20230300333
  • Date Filed
    May 30, 2023
    a year ago
  • Date Published
    September 21, 2023
    a year ago
Abstract
An image processing device includes: a memory; and a processor coupled to the memory and configured to: acquire a first feature map output from a hidden layer by forward propagation of image data; acquire a plurality of second feature maps output from the hidden layer by forward propagation of each of a plurality of pieces of decoded data obtained by sequentially encoding the image data by using different quantization values and thereafter decoding the encoded image data; calculate a degree of influence of each block of the image data on a recognition result by backpropagating each error between the first feature map and the plurality of second feature maps; and determine a quantization value of each block when the image data is encoded.
Description
Claims
  • 1. An image processing device comprising: a memory; anda processor coupled to the memory and configured to: acquire a first feature map output from a hidden layer by forward propagation of image data;acquire a plurality of second feature maps output from the hidden layer by forward propagation of each of a plurality of pieces of decoded data obtained by sequentially encoding the image data by using different quantization values and thereafter decoding the encoded image data;calculate a degree of influence of each block of the image data on a recognition result by backpropagating each error between the first feature map and the plurality of second feature maps; anddetermine a quantization value of each block when the image data is encoded.
  • 2. The image processing device according to claim 1, wherein the processor: acquires a third feature map output by backpropagating, up to a layer before the hidden layer, an error between an output result output from an output layer by the forward propagation of the image data and an output result output from the output layer by forward propagation of decoded data obtained by encoding the image data by using a predetermined quantization value and decoding ; andsets an error of an area that corresponds to the third feature map to zero and backpropagates the error when each error between the first feature map and the plurality of second feature maps is backpropagated.
  • 3. The image processing device according to claim 1, wherein each error between the first feature map and the plurality of second feature maps is calculated by weighting and adding an error between corresponding channels.
  • 4. An image processing device comprising: a memory; anda processor coupled to the memory and configured to: acquire a first feature map output from a hidden layer by forward propagation of image data;acquire a plurality of second feature maps output from the hidden layer by forward propagation of each of a plurality of pieces of decoded data obtained by sequentially encoding the image data by using different quantization values and thereafter decoding the encoded image data;calculate a degree of influence of each block of the image data on a recognition result by aggregating signal intensity of each area of the first feature map and the plurality of second feature maps for each block; anddetermine a quantization value of each block when the image data is encoded.
  • 5. The image processing device according to claim 4, wherein the processor: specify a positional relationship between each area of the first feature map and a predetermined second feature map and each block of the image data by backpropagating an error between the first feature map and the predetermined second feature map.
  • 6. The image processing device according to claim 4, wherein the processor: specify a positional relationship between each area of the first feature map and a predetermined second feature map and each block of the image data by dividing an error between the first feature map and the predetermined second feature map into a plurality of areas and sequentially backpropagating errors of the respective areas.
  • 7. The image processing device according to claim 1, wherein the processor: encode the image data by using the quantization value.
  • 8. The image processing device according to claim 1, wherein a position of the hidden layer from which each of the first feature map and the second feature maps is acquired or a change interval of the quantization value used when the image data is sequentially encoded is dynamically changed by using, as an index, an amount of calculation, a calculation time, recognition accuracy, an amount of power, or an amount of heat generation.
  • 9. An image processing method comprising: acquiring a first feature map output from a hidden layer by forward propagation of image data;acquiring a plurality of second feature maps output from the hidden layer by forward propagation of each of a plurality of pieces of decoded data obtained by sequentially encoding the image data by using different quantization values and thereafter decoding the encoded image data; andcalculating a degree of influence of each block of the image data on a recognition result by backpropagating each error between the first feature map and the plurality of second feature maps, and determines a quantization value of each block when the image data is encoded.
Continuations (1)
Number Date Country
Parent PCT/JP2021/001047 Jan 2021 WO
Child 18325155 US