Patent Application
20200311496
This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2019-056833 filed Mar. 25, 2019.
The present invention relates to an image processing apparatus and a non-transitory computer readable medium storing an image processing program.
Known in the related art is a photo book data creation system creating a panoramic synthesis image wider than an individual image by extracting a plurality of images as moving image scenes from moving image data and synthesizing the images (see, for example, JP2013-038528A).
Also known in the related art is an information processing apparatus including first display means for cutting out at least a part of a first image as a second image, causing the cut second image to be displayed on a display unit, and performing scroll display by moving the position of the display frame of the second image on the first image in accordance with user input, first predetermined condition determination means for determining whether or not a first predetermined condition is satisfied, first acquisition means for acquiring a copy image obtained by copying of the second image displayed on the display unit in response to the first predetermined condition determination means determining that the first predetermined condition is satisfied, and second acquisition means for acquiring a copy image obtained by copying of a non-display range as a range other than the display range of the first image cut out as the second image (see, for example, JP2018-073143A).
Aspects of non-limiting embodiments of the present disclosure relate to an image processing apparatus with which content larger in size than a screen can be generated as a single still image with greater ease than in a case where the content is divided into a plurality of still images and generated.
Aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above. However, aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
An image processing apparatus includes an acquisition unit acquiring content larger in size than a screen and scrolled on the screen as a moving image, an extraction unit extracting, from the moving image, a plurality of frame images corresponding to a plurality of divided images obtained by division of the content based on a size of the screen, and a generation unit generating a single still image by synthesizing the plurality of frame images extracted by the extraction unit.
Exemplary embodiment(s) of the present invention will be described in detail based on the following figures, wherein:
Hereinafter, embodiments according to the present invention will be described in detail based on accompanying drawings.
In the drawings, the same or equivalent components and parts are denoted by the same reference numerals.
In addition, the dimensional proportions in the drawings are exaggerated for convenience of description and may differ from actual proportions.
As illustrated in
Image data is transmitted from the mobile terminal 10 to an image forming device (not illustrated) such as a multifunction printer by means of, for example, Wi-Fi (registered trademark) or Bluetooth (registered trademark), which will be described later. As a result, the image of the image data is printed onto a sheet of paper.
Here, “image” is content (such as a web page, a document, and a photograph) 14 larger in size than a screen 12 in the mobile terminal 10.
The mobile terminal 10 is not provided with a technical standard (such as an application corresponding to a print function) for printing the content 14 larger in size than the screen 12 as a single still image.
As illustrated in
The configurations are connected so as to be capable of communicating with each other via a bus 22.
The CPU 30, which is a central arithmetic processing unit, executes various programs and controls each part.
In other words, the CPU 30 reads a program from the ROM 28 and executes the program by using the RAM 26 as a work region.
The CPU 30 controls each of the above-described configurations and performs various types of arithmetic processing in accordance with the program recorded in the ROM 28.
In the present embodiment, a non-transitory computer readable medium storing an image processing program is stored in the ROM 28.
The CPU 30 is an example of a control unit.
The ROM 28 stores various programs and various data.
The RAM 26 temporarily stores a program or data as a work region.
The communication interface 24 is an interface for communicating with another device such as an image forming device. A standard such as Wi-Fi (registered trademark) and Bluetooth (registered trademark) is used for the communication interface 24.
In executing the non-transitory computer readable medium storing an image processing program, the image processing apparatus 20 realizes various functions by using the above-described hardware resources.
The functional configurations realized by the image processing apparatus 20 will be described below.
As illustrated in
Each functional configuration is realized by the CPU 30 reading and executing the non-transitory computer readable medium storing an image processing program stored in the ROM 28.
The acquisition unit 32 acquires the content 14 scrolled on the screen 12 as a moving image.
The extraction unit 34 extracts, from the moving image, a plurality of frame images 16 (see
The generation unit 36 generates one still image 18 (see
Specifically, the acquisition unit 32 acquires, as the moving image, the content 14 scrolled on the screen 12 as a result of user operation by using, for example, the function of “screen recording” that the mobile terminal 10 is equipped with.
At this time, the acquisition unit 32 acquires the speed of the scrolling, the direction of the scrolling, and the size of the screen 12 in the direction of the scrolling as well.
As illustrated in
In addition, as illustrated in
As illustrated in
At this time, the generation unit 36 performs the synthesis by deleting an image not related to the content 14 from each of the plurality of frame images 16 in time series.
Here, “image not related to the content 14” is an image including at least one of a header 15 or a footer (not illustrated) displayed at the upper and lower ends of the midway frame image 16.
In addition, the generation unit 36 is capable of synthesizing the image including at least one of the header 15 or the footer (not illustrated) with at least one of the upper or lower ends of the single still image 18 (see
In addition, the mobile terminal 10 is configured such that scrolling of the screen 12 is automatically possible instead of being manually possible by a user.
In other words, the mobile terminal 10 is configured such that the content 14 is automatically scrolled in a predetermined direction and at a predetermined speed under the control of the CPU 30.
In this case, the extraction unit 34 extracts the plurality of frame images 16 in time series by using the size of the screen 12 in the scrolling direction and the scrolling speed acquired by the acquisition unit 32.
In a case where the content 14 has a plurality of pages, the acquisition unit 32 acquires a moving image for each page, the extraction unit 34 extracts a plurality of the frame images 16 for each page, and the generation unit 36 generates one independent still image 18 for each page.
Also, the generation unit 36 is configured to generate the still image generated for each page as the single still image 18 combined in one page.
The action of each embodiment in the image processing apparatus 20 configured as described above will be described below.
The CPU 30 reads the non-transitory computer readable medium storing an image processing program from the ROM 28, develops the non-transitory computer readable medium storing an image processing program in the RAM 26, and executes the non-transitory computer readable medium storing an image processing program. Automatically performed as a result is image processing in which the content 14 larger in size than the screen 12 is turned into the single still image 18.
A comparative example will be described first.
In a case where the content 14 larger in size than the screen 12 and displayed by scrolling on the screen 12 of the mobile terminal 10 not having an application or the like corresponding to a print function is completely printed, the frame image 16 displayed on the screen 12 is photographed for each scrolling by means of the screenshot photographing function provided as standard in the operation system (OS) of the mobile terminal 10 and the still image 18 is printed for each of the frame images 16 as illustrated in
In other words, the content 14 is divided into a plurality of sheets (three sheets in the illustrated example) and printed.
Accordingly, a problem arises such as partial omission of the content 14, partial duplication of the content 14, and a changed order of the content 14.
In addition, the header 15 and the footer are also printed for each printed frame image 16, and thus a problem arises in the form of a region of needless printing at the upper and lower ends of the sheet.
In other words, the printing space at the upper and lower ends of the sheet is wasted.
Such a problem is addressed in the present embodiment.
This will be described below.
A first embodiment will be described first.
As illustrated in
Then, the screen 12 on which the target content 14 is displayed is scrolled manually by a user (Step S12).
Once the scrolling of the screen 12 is completed, “image recording” is stopped (Step S13).
As a result, the acquisition unit 32 acquires a moving image.
In addition, the acquisition unit 32 calculates the size of the scrolled content 14 (size of the region from the upper end to the lower end of the content 14) from the acquired moving image (Step S14).
Then, the extraction unit 34 selects (extracts) the plurality of frame images 16 necessary for synthesizing (creating) the still image 18 equivalent to the region of the content 14 from the moving image acquired by the acquisition unit 32 (Step S15).
Once the frame images 16 are selected in this manner, the generation unit 36 creates the single still image 18 by synthesizing common parts in the selected frame images 16 and deleting an image not related to the content 14 (Step S16).
As a result, the entire content 14 is more easily printed (or printable) as the single still image 18 than in a case where the content 14 is divided and printed into a plurality of still images even with the mobile terminal 10 not provided with a technical standard for printing the content 14 larger in size than the screen 12 as a single still image (see
Although the first embodiment has been described above, there is an advantage that the apparatus configuration of the image processing apparatus 20 is simplified, as compared with a case where the acquisition unit 32 acquires the automatically scrolled content 14 (screen 12) as a moving image, as the acquisition unit 32 acquires the manually scrolled content 14 (screen 12) as a moving image.
In addition, the extraction unit 34 extracts the frame images 16 by using the scrolling speed, the scrolling direction, and the size of the screen 12 in the scrolling direction even though the content 14 (screen 12) is manually scrolled.
Accordingly, the content 14 is printed without partial omission or duplication.
In addition, as the acquisition unit 32 acquires the automatically scrolled content 14 (screen 12) as a moving image, there is an advantage that the moving image is acquired with greater ease than in a case where the acquisition unit 32 acquires the manually scrolled content 14 (screen 12) as a moving image.
When the content 14 (screen 12) is automatically scrolled, the extraction unit 34 extracts the plurality of frame images 16 by using the size of the screen 12 in the scrolling direction and the scrolling speed.
Accordingly, the content 14 is printed without partial omission or duplication.
In a case where the content 14 is automatically scrolled, the screen 12 is scrolled at a constant speed. Accordingly, even though the content 14 has a blank part, there is no possibility of a change in the length of the blank part.
However, in a case where the content 14 is manually scrolled, it is difficult to scroll the screen 12 at a constant speed, and thus the presence of a blank part in the content 14 may lead to a change in the length of the blank part.
As described above, the generation unit 36 performs the synthesis by deleting, from each of the plurality of frame images 16, an image not related to the content 14, that is, an image including at least one of the header 15 or the footer displayed at the upper and lower ends of the screen 12.
Accordingly, needless printing of the header 15 and the footer (unnecessary regions) in the single still image 18 is prevented as compared with a case where the header 15 and the footer not related to the content 14 in each of the plurality of frame images 16 are synthesized as they are.
The generation unit 36 is capable of synthesizing the image including at least one of the header 15 or the footer with the single still image 18, and thus it is possible to print only one header 15 and/or the footer in the single still image 18 (see
Next, a second embodiment will be described.
Description of actions common to the first and second embodiments will be appropriately omitted below.
As illustrated in
Then, the screen 12 on which the target content 14 is displayed is scrolled manually by a user (Step S22).
Once the scrolling of the screen 12 is completed, “image recording” is stopped (Step S23).
As a result, the acquisition unit 32 acquires a moving image.
Here, when it is desired to set the lower end of the region (final frame) appearing as the final frame image 16 of the moving image in the region of the content 14 as the lower end (end) of the content 14 (when it is desired to set a specific position part above the actual lower end of the content 14 as the end), “image recording” is stopped up to the lower end.
As a result, the acquisition unit 32 acquires the region up to the lower end as the region of the content 14 for synthesis of the still image 18.
In addition, the acquisition unit 32 calculates the size of the scrolled content 14 (size of the region from the upper end of the content 14 to the lower end determined as described above) from the acquired moving image (Step S24).
Then, the extraction unit 34 selects (extracts) the plurality of frame images 16 necessary for synthesizing (creating) the still image 18 equivalent to the region of the content 14 from the moving image acquired by the acquisition unit 32 (Step S25).
Once the frame images 16 are selected in this manner, the generation unit 36 creates the single still image 18 by synthesizing common parts in the selected frame images 16 and deleting an image not related to the content 14 (Step S26).
As a result, only the necessary part of the content 14 is printed (or printable) as the single still image 18 (see
Although the second embodiment has been described above, the extraction unit 34 extracts, as the final frame image 16, the frame image 16 corresponding to a part of the content 14 displayed on the screen 12 at the completion of the user scrolling operation.
Accordingly, the region printed as the single still image 18 can be set in any manner by a user and is not the entire content 14.
In other words, according to the second embodiment, there is an advantage that only a part of the content 14 desired by a user is printable.
A third embodiment will be described below.
Description of actions common to the first and third embodiments will be appropriately omitted below.
As illustrated in
Then, the screen 12 on which the target content 14 is displayed is scrolled manually by a user and then, in a case where there is another target content 14, the link to the next content 14 is pressed for display of the content 14 (transition to the additional content 14) and the screen 12 on which the additional content 14 is displayed is scrolled (Step S32).
This is repeated until the end of the plurality of contents 14.
Then, “image recording” is stopped once the scrolling of the screen 12 displaying the final content 14 finishes (Step S33).
As a result, the acquisition unit 32 acquires a moving image.
Subsequently, the processing returns to the first content 14 and the start frame is set as the current point (Step S34).
Next, it is determined whether or not there is the content 14 (screen transition frame) transitioned ahead of the current point (Step S35).
The presence or absence of the transitioned content 14 is determined by whether or not the link to the next content 14 is pressed.
In the case of absence of the screen transition frame, the single still image 18 is created by a process similar to the first embodiment or the second embodiment.
In the case of presence of the screen transition frame, the acquisition unit 32 calculates the size (region) of the scrolled content 14, targeting the moving image between the current point and ahead of the screen transition frame (Step S36).
Then, the extraction unit 34 selects (extracts) the plurality of frame images 16 necessary for synthesizing (creating) the still image 18 equivalent to the region of the content 14, targeting the moving image between the current point and ahead of the screen transition frame (Step S37).
Once the frame images 16 are selected in this manner, the generation unit 36 creates the single still image 18 by synthesizing common parts in the selected frame images 16 and deleting an image not related to the content 14 (Step S38).
Then, the screen transition frame is set as the current point (Step S39).
Subsequently, the processing returns to Step S35 and Steps S35 to S39 are repeatedly executed until the final content 14.
As a result, each of the plurality of contents 14 is printed (or printable) as one independent still image 18.
The plurality of contents 14 may be printed together as one independent still image 18.
Although the third embodiment has been described above, in a case where the content 14 has a plurality of pages, the acquisition unit 32 acquires the moving image for each page, the extraction unit 34 extracts the plurality of frame images 16 for each page, and the generation unit 36 generates the single still image 18 by synthesizing the still image generated for each page.
Accordingly, the content 14 having a plurality of pages is printed as one independent still image 18 for each page.
In addition, the generation unit 36 is capable of selectively generating the content 14 having a plurality of pages together as the single still image 18 and, in this case, printing is performed as the single still image 18 collected in one page.
Although the image processing apparatus 20 according to the present embodiment has been described above, the image processing apparatus 20 according to the present embodiment is not limited to the above embodiment and various improvements or modifications are possible without departing from the scope of the present invention.
For example, the direction of the scrolling is not limited to the vertical direction that is the longitudinal direction of the screen 12 and the direction of the scrolling may be the lateral direction that is a direction orthogonal to the longitudinal direction of the screen 12.
The same as the above applies to this case as well.
The image processing apparatus 20 according to the present embodiment is not limited to the configuration incorporated in the mobile terminal 10 and the image processing apparatus 20 may be incorporated in an image forming device such as a multifunction printer (not illustrated).
Further, the image processing apparatus 20 according to the present embodiment may be distributed and incorporated in the mobile terminal 10 and the image forming device.
For example, the acquisition unit 32 and the extraction unit 34 may be incorporated in the mobile terminal 10 with the generation unit 36 incorporated in the image forming device.
Although the generation unit 36 generates the single still image 18 by superimposing (synthesizing) common parts in plurality of frame images 16 in time series according to the description of the above embodiment, the present invention is not limited to this aspect.
It is a matter of course that the generation unit 36 generates the single still image 18 by disposing each frame image 16 in order in the case of absence of the common parts in the plurality of frame images 16 in time series (in the case of separation without omission).
The processing executed by the CPU 30 reading software (program) in the above-described embodiment may be executed by various processors other than the CPU 30.
Examples of the processors in this case include a programmable logic device (PLD) allowing a post-manufacturing change in circuit configuration such as a field-programmable gate array (FPGA) and a dedicated electric circuit as a processor having a circuit configuration of dedicated design in order to execute specific processing such as an application specific integrated circuit (ASIC).
The image processing may be executed with one of the various processors or a combination of two or more processors of the same or different types (such as a plurality of FPGAs and a CPU-FPGA combination).
In addition and more specifically, the hardware structure of the various processors is an electric circuit in which a circuit element such as a semiconductor device is combined.
Although the non-transitory computer readable medium storing an image processing program is stored (installed) in advance in the ROM 28 according to the description of each embodiment, the present invention is not limited thereto.
The non-transitory computer readable medium storing an image processing program may be provided in the form of being recorded in a recording medium such as a compact disk read only memory (CD-ROM), a digital versatile disk read only memory (DVD-ROM), and a universal serial bus (USB) memory.
In addition, the non-transitory computer readable medium storing an image processing program may be downloaded from an external device via a network.
The foregoing description of the exemplary embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-056833 | Mar 2019 | JP | national |
