This nonprovisional application claims priority under 35 U.S.C. § 119(a) on Patent Application No. 2007-300762 filed in Japan on Nov. 20, 2007, the entire contents of which are hereby incorporated by reference.
1. Field of the Invention
The present invention relates to an image processing apparatus processing color image data including two or more types of image data and, more specifically, to a technique of outputting color image data including two or more types of image data in good color tone.
2. Description of the Background Art
Recently, a display apparatus including a large display and a PC (Personal Computer) connected thereto comes to be widely used as a presentation tool for a meeting, conference and the like. PC displays data and the like input from an external device such as a scanner on the large display. The large display gives highly effective visual impression to the attendants of a conference and improves information transmitting effect of the presentation.
As a method of more effectively using a display apparatus as such, the display apparatus may be connected to an image forming apparatus to form a system. If it becomes possible to print the data displayed on the display apparatus, the printout may be used as materials or proceedings of the conference. The systemization attains the effects of better understanding of conference contents by the attendants and better knowledge of conference contents by parties involved but not attending the conference.
In a meeting, a user of the display apparatus may display data read from a scanner (hereinafter referred to as “read data”) on the large display and he/she may write electronic figure, character data and the like using a drawing application, for example, to indicate a part of the displayed image or to write notes. Data written in this manner will be hereinafter referred to as “written data.” When combined data including the read data and written data is displayed on a screen, the written data tends to appear brighter and sharper than the read data. The reason may be that the user often selects a brilliant color different from the read data on the background, when he/she forms the written data. Thus, on the displayed image, the written data and read data are displayed distinguished from each other and, therefore, the written data can serve as a pointer.
When image data provided by combining different types of data is to be output to a certain device, sometimes there arises a problem in the image to be output.
By way of example, broadcast image handling image signals of a plurality of different formats (hereinafter referred to as “multi-format data image”) sometimes encounters the following problem. The multi-format data image refers to an image on which image signals of different formats such as moving image, still image and teletext broadcasting are displayed on one image plane. The moving image, still image and teletext broadcasting have mutually different image characteristics and, when an image of a certain type is to be displayed with high quality, image or images of other type or types come to be less visible.
A solution to such a problem is disclosed in Japanese Patent Laying-Open No. 2002-44559 (hereinafter referred to as “'559 application”). According to the technique disclosed in '559 application, in multi-format broadcast image, data of various formats are separated from each other to form layered image signals, different image processing is executed on each layered image signal in accordance with parameters set in advance in accordance with characteristics of each data, and thereafter, the results are combined and displayed. Therefore, it is possible to improve image quality in displaying data of each format.
In the image processing apparatus displaying combined data in which read data and written data are superposed, when the combined data is printed, particularly the written data tends to be less sharp or darker and duller than when it is displayed. This is because RGB value ranges that the read data can assume on the display differ from those of the written data.
Graph 1 shown in
Referring to
The apparatus disclosed in '559 application is directed to improving display image quality when image signals of mutually different formats are displayed superposed one after another. Therefore, this technique cannot directly be applied when image data having different RGB value ranges are to be combined and printed. Accordingly, the technique disclosed in '559 application cannot solve the problem that combined data including read data and written data cannot appropriately be printed by the image processing apparatus.
There is also a problem peculiar to the written data that the data is visibly well recognized when displayed in brilliant color on the screen while the written data is printed not in such a brilliant color but dull tone and hence, it becomes difficult to distinguish the written data from the read data. The technique disclosed in '559 application cannot solve such a problem, either.
Specifically, the conventional technique has a problem that appropriate image processing cannot be done on image data including color image data of a first type and color image data of a second type.
An object of the present invention is to provide an image processing apparatus, handling combined data including the color image data of the first type and the color image data of the second type, capable of performing appropriate color conversion both on the color image data of the first type and the color image data of the second type.
Another object of the present invention is to provide an image processing apparatus, handling combined data including the color image data of the first type and the color image data of the second type, capable of performing appropriate color conversion both on the color image data of the first type and the color image data of the second type, and capable of outputting the data superposed on each other.
According to an aspect, the present invention provides an image processing apparatus, including: a storage unit storing color image data including color image data of a first type and color image data of a second type; a first image processing circuit executing a first color conversion process on the color image data of the first type, in response to a predetermined instruction of image processing; and a second image processing circuit executing, in response to the instruction, a second color conversion process different from the first color conversion process, on the color image data of the second type.
It is often the case that the color image data of the first type and the color image data of the second type have different color characteristics. Therefore, when the same color conversion process is executed on these data, image quality of an image coming from at least either one of the color image data degrades unavoidably. On the contrary, when the first color conversion process is performed on the color image data of the first type by the first image processing circuit and the second color conversion process different from the first color conversion process is performed on the color image data of the second type by the second image processing circuit, both color conversions can be performed appropriately. As a result, an image processing apparatus handling combined data including color image data of the first type and the color image data of the second type, capable of performing appropriate color conversion both of the color image data of the first type and the color image data of the second type can be provided.
Preferably, the image processing apparatus further includes an output device superposing, on the color image data of the first type color-converted by the first image processing circuit, the color image data of the second type color-converted by the second image processing circuit, and outputting the superposed data.
As the output device is provided, it is possible to superpose, on the color image data of the first type that has been color-converted by the first image processing circuit, the color image data of the second type that has been color-converted by the second image processing circuit. As a result, an image processing apparatus handling combined data including color image data of the first type and the color image data of the second type, capable of performing appropriate color conversion on the color image data of both the first and second types, and superposing and outputting the results can be provided.
More preferably, the first image processing circuit includes a first profile designating unit designating, in response to the instruction, a first color conversion profile prepared in advance for the color image data of the first type, and a first color-conversion circuit executing, in response to the instruction, the first color conversion process on the color image data of the first type based on the first color conversion profile designated by the first profile designating unit.
More preferably, the second image processing circuit includes a second profile designating unit designating, in response to the instruction, a second color conversion profile, different from the first color conversion profile, prepared in advance for the color image data of the second type, and a second color conversion circuit executing, in response to the instruction, the second color conversion process on the color image data of the second type based on the second color conversion profile designated by the second profile designating unit.
As described above, the first image processing circuit designates the first color conversion profile among profiles prepared in advance, for the color image data of the first type, and executes the first color conversion process based on the designated color conversion profile. Further, the second image processing circuit designates the second color conversion profile among the profiles prepared in advance, and executes the second color conversion process based on the designated color conversion profile on the color image data of the second type. As a result, an image processing apparatus handling combined data including color image data of the first type and the color image data of the second type, capable of performing more appropriate color conversion on each of the color image data of the first type and the color image data of the second type can be provided.
More preferably, the image processing apparatus further includes a controller enabling or disabling the second image processing circuit. The first image processing circuit includes an image processing executing unit executing, when the second image processing circuit is disabled by the controller, the first color conversion process both on the color image data of the first type and the second type, and executing, when the second image processing circuit is enabled, the first color conversion process on the color image data of the first type.
Accordingly, if the second image processing circuit is enabled, it is possible to execute appropriate image processing both on the color image data of the first type and the second type, as described above. If there is not much color distribution difference between the color image data of the first type and the color image data of the second type, or if the user does not wish to have separate image processing, the second image processing circuit is disabled, and the first color conversion process is executed on the color image data of the first type and the color image data of the second type.
More preferably, the first and second color conversion profiles include first and second color conversion tables for converting values of RGB color system of the color image data of the first and second types to values of CMYK color system, respectively.
As a result, in connection with combined data including the color image data of the first type and the color image data of the second type, more appropriate color conversion becomes possible for outputting image data of both the color image data of the first type and the color image data of the second type.
More preferably, in the first color conversion table, a range of RGB values that can be converted to the CMYK values is selected to be narrower than a range of RGB values that can be converted to the CMYK values in the second color conversion table.
Consequently, more appropriate color conversion becomes possible for outputting image data of both the color image data of the first type and the color image data of the second type having different ranges of RGB color system values.
More preferably, the image processing apparatus further includes a reading device reading image information of a document and outputting the read image information as the color image data of the first type; a display device displaying an image based on the read data; and a receiving unit receiving image information written to the image displayed on the display device, and outputting the image information as the color image data of the second type.
As described above, when the color image data of the first type is the image information output by the reading device and the color image data of the second type is the image information output by a receiving unit, it is often the case that the color image data of the first type and the color image data of the second type have distinctively different color characteristics. Therefore, by adapting the image processing apparatus to include the above-described components, an image processing apparatus handling combined data including the color image data of the first type and the color image data of the second type, capable of performing more appropriate color conversion both on the color image data of the first type and the color image data of the second type can be provided.
More preferably, the first image processing circuit includes a first profile designating unit designating, in response to the instruction, a first color conversion profile prepared in advance for the color image data of the first type; and the second image processing circuit includes a second profile designating unit designating, in response to the instruction, a second color conversion profile, different from the first color conversion profile, prepared in advance for the color image data of the second type. The image processing apparatus further includes a transmitting unit transmitting to the outside, a combination of the color image data of the first type and the first color conversion profile, and a combination of the color image data of the second type and the second color conversion profile.
As described above, the combination of the color image data of the first type and the first color conversion profile, and the combination of color image data of the second type and the second color conversion profile are transmitted and, therefore, the external device such as the printer receiving these combinations can perform color conversion processes using the first color conversion profile for the color image data of the first type and using the second color conversion profile for the color image data of the second type. As a result, an image processing apparatus handling combined data including the color image data of the first type and the color image data of the second type, enabling an external device such as a printer to perform appropriate color conversion both on the color image data of the first type and the color image data of the second type can be provided.
More preferably, the image processing apparatus further includes a determination circuit determining, in response to the instruction, whether or not color image data as an object of processing includes the color image data of the second type, and outputting a determination signal; and a suspending circuit suspending, when it is indicated by the determination signal that the color image data as the object of processing does not include the color image data of the second type, operation of the second image processing circuit.
As a result, meaningless execution of the second color conversion process on the color image data not including the color image data of the second type can be prevented, and hence, load on the image processing apparatus can be alleviated.
According to another aspect, the present invention provides an image processing method, including the steps of: storing color image data including color image data of a first type and color image data of a second type; executing, in response to a predetermined instruction of image processing, a first color conversion process on the color image data of the first type; and executing, in response to the instruction, a second color conversion process, different from the first color conversion process, on the color image data of the second type.
Preferably, the image processing method further includes the step of superposing, on the color image data of the first type color-converted at the step of executing the first color conversion process, the color image data of the second type color-converted at the step of executing the second color conversion process, and outputting the superposed data.
According to a further aspect, the present invention provides a computer program causing, when executed by a computer, the computer to operate as a storage unit storing color image data including color image data of a first type and color image data of a second type; a first image processing circuit executing a first color conversion process on the color image data of the first type, in response to a predetermined instruction of image processing; and a second image processing circuit executing, in response to the instruction, a second color conversion process different from the first color conversion process, on the color image data of the second type.
As described above, according to the present invention, the first color conversion process is executed on the color image data of the first type by the first image processing circuit, and the second color conversion process different from the first color conversion process is performed on the color image data of the second type by the second image processing circuit. This arrangement enables appropriate color conversions of both. Therefore, an image processing apparatus handling combined data including the color image data of the first type and the color image data of the second type, capable of performing appropriate color conversion both on the color image data of the first type and the color image data of the second type can be provided.
Further, by superposing, on the color image data of the first type color-converted by the first image processing circuit, the color image data of the second type color-converted by the second image processing circuit and by outputting the result, it becomes possible, in connection with the combined data including the color image data of the first type and the color image data of the second type, to perform appropriate color conversion both on the color image data of the first type and the color image data of the second type, and to superpose the data on each other and output the results.
The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
In the following description and in the drawings, the same components are denoted by the same reference characters and same names. Their functions are also the same. Therefore, detailed description thereof will not be repeated.
In the following, examples of display and printing of combined data including the read data and the written data, in accordance with the prior art will be described.
Referring to
When the combined data is to be printed, values of RGB color system used for display are converted to values of CMYK color system used for printing, by image processing. At the time of this conversion, it is necessary to convert each value of RGB color system to the value of CMYK color system, and data, referred to as a color conversion profile, determines the manner of conversion. The problem encountered when the combined data is printed described with reference to the prior art is considered to come from the fact that read data and written data exist mixed in the combined data and they have different ranges of possible RGB values, while image processing is executed using a single color conversion profile. The color conversion profile for printing is optimized such that the color tone displayed on the screen in RGB color system matches as well as possible with the color tone printed in CMYK color system.
Typically, when the combined data described above is printed, a color conversion profile optimized for the characteristics of read data is used. Therefore, when image processing is done using the same color conversion profile, the written data color becomes dull. Specifically, the written data is subjected to image processing using an inappropriate color conversion profile and, therefore, it comes to be printed in a color different from that when displayed.
Specifically, in a printed image 5 after printing shown in
In order to solve this problem, in the embodiment described in the following, the read data and the written data are held in separate layers and stored distinguished from each other in a storage. At the time of printing, color conversion profiles optimized separately for the read data and the written data, respectively, are used to solve the problem.
Referring to
When there is an instruction to print the combined data, the image processing system in accordance with the first embodiment executes a first image processing 38 for the read data on the read data 32, and executes a second image processing 40 for the written data, different from the first image processing 38, on the written data 34. Specifically, in the first image processing 38, the read data is subjected to CMYK conversion using a first color conversion profile optimized for the read data. In the second image processing 40, the written data is subjected to CMYK conversion using a second color conversion profile optimized for the written data. The first color conversion profile is the same as that used in the prior art. The second color conversion profile is created such that each color of the written data to be printed can be visually recognized to be similar to the color of written data as displayed before image processing. These color conversion profiles are created in advance in accordance with combinations of characteristics of the display device and the printer.
The second image processing 40 further includes a process of converting thickness of written data, using a table related to thickness conversion, to meet user's demand to make the written data sharper and more emphasized, or make it less noticeable. The thickness conversion table used here is created in advance for the written data such that the thickness of a line forming the written data before image processing is converted at the time of printing. By way of example, using the thickness conversion table, a line in the written data is converted to a thicker line, so that a written image easier to view is formed in the printed image, as compared with the thickness as visually recognized in the displayed image.
In the present embodiment, as shown in
As described above, in the present embodiment, appropriate image processing can be done on each of the read data and written data. As a result, conventionally experienced problems that only the written data becomes less sharp or comes to have duller color at the time of printing, can be prevented.
—Structure—
<Appearance>
Referring to
Information display apparatus 52 includes: a stand 58; a large LCD (Liquid Crystal Display) 60 having a rectangular shape long in the widthwise direction placed on an upper surface of stand 58; a transparent touch panel 62 having a shape similar to LCD 60 and provided integrally and overlapped on a front surface of LCD 60; a color scanner 64 arranged below LCD 60 and touch panel 62 and having a pair of openings 64A and 64B arranged one above the other on the front surface; and a PC 66 placed on stand 58.
Stand 58 includes a base 68 having a flat upper surface, and a pair of left and right legs 70 coupling base 68 to LCD 60. At the bottom of base 68, four casters 68A are rotatably attached for moving the information display apparatus 52. Each leg 70 is a wide, thin plate member, and the legs are erected spaced apart from each other by a prescribed distance on the upper surface of base 68. On the tip end surfaces of legs 70, LCD 60 is mounted. Between legs 70, PC 66 is placed.
LCD 60 has a display area for displaying image information, formed on the front surface. The display area of LCD 60 has a shape similar to the contour of LCD 60, and occupies most part of the front surface of LCD 60.
Scanner 64 is for reading a document for presentation and the like. The document is fed through upper opening 64A and discharged from lower opening 64B, of scanner 64. PC 66 is for controlling information display apparatus 52. This will be described later.
When a position on LCD 60 is designated by touch pen 54, touch panel 62 detects the position, and outputs it as coordinate information. Receiving the information, PC 66 can form written data input by the user, by an appropriate image processing program. Specifically, PC 66 forms the image input by the user.
<Hardware Configuration>
Referring to
Information display apparatus 52 includes a display/input unit 59 including LCD 60 and touch panel 62, scanner 64 and PC 66, as described above. Image forming apparatus 90 is connected to PC 66, and has a function of forming and printing an image in accordance with print data applied from PC 66. The print data output from PC 66 includes print object data represented in RGB color system and a color conversion table used for color conversion of the print object data, as will be described later. In the present embodiment, combinations of the print object data and color conversion table are created both for the read data and written data, and applied from PC 66 to image forming apparatus 90.
Referring to
Referring to
The image processing program for printing, which will be described later, is transmitted from another device through the communication unit to PC 66, and stored in HDD 130. As will be readily understood by a person skilled in the art, a program stored in an external storage medium can be introduced to PC 66 by providing, in place of the communication unit, a device that is capable of reading tapes such as a magnetic tape and a cassette tape, disks such as a magnetic disk including flexible disk (FD) and hard disk, or optical disc including a CD-ROM (Compact Disc-Read Only Memory), MO (Magento-Optical Disk), MD (Mini Disk) and DVD (Digital Versatile Disk), or semiconductor memories such as a mask ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory) and a flash memory.
In the following, the second color conversion profile used in the second image processing 40 shown in
In the following, the thickness conversion table used in the second image processing 40 shown in
Referring to
Document image reader 186 includes a document tray 200, an automatic document feeder 202 for feeding a document placed on document tray 200 to an image information reading unit 192, which will be described later, and a document discharge tray 203 for receiving the discharged document after completion of the image reading process.
Document image reader 186 includes an image information reading unit 192 for reading image information of a document fed to a document reading position by automatic document feeder 202 arranged on the upper surface. Image information reading unit 192 includes, though not shown, a document scanning unit, an optical lens and a CCD (Charge Coupled Device) line sensor as a photoelectric conversion element, which reciprocate parallel to the upper surface of image information reading unit 192. Image information reading unit 192 reads black-and-white image and color image of a document, and outputs image information of the image.
Image forming unit 188 includes: an image processing unit, which will be described later, connected to receive output signals from image information reading unit 192 and from an external device such as PC 66, not shown in
Image forming unit 188 further includes: a fixing unit 195 for fixing the image formed by image forming device 193 and transferred to the sheet of recording paper, on the sheet of recording paper; a paper discharge unit 196 for receiving discharged sheet of recording paper on which the image has been fixed; and a control unit 197 for controlling overall operations of image forming apparatus 90. In the present embodiment, control unit 197 also serves as the image processing unit.
Paper feed unit 190 includes a recording paper feeding unit 194 for feeding a sheet of recording paper to image forming device 193, and an LCC (Large Capacity Cabinet) 204 for containing and feeding a large amount of recording paper.
Referring to
Control unit 197 includes; an I/F 150 connected to I/F 128 of PC 66 for mediating communication with PC 66, a CPU 152 connected to I/F 150 and bus 162 for executing a prescribed image processing program for processing and printing the read data and written data received from PC 66 in accordance with color conversion profiles attached respectively, and for executing a program for realizing general functions of image forming apparatus 90, an engine I/F 158 connected to bus 162 and printer engine 174 for mediating communication between CPU 152 and printer engine 174, and an ROM 154, an RAM 156 and an HDD 160, all connected to bus 162.
<Program Configuration>
In the following, the program for executing different processes on the read data and the written data, respectively, and for outputting the results with separate color conversion profiles to image forming apparatus 90 will be described. The program is activated in response to a print instruction through input unit 120 of PC 66 shown in
Referring to
At step 238, if the print object data includes read data only, the read data and the first color conversion profile are output to image forming apparatus 90. If the print object data is the combined data including the read data and the written data, the read data, the first color conversion profile, the written data, the second color conversion profile, and the thickness conversion table are output to image forming apparatus 90.
In the following, a program for performing different image processing on each of the read data and the written data and printing the result, will be described. The program is activated, in image forming apparatus 90, when CPU 152 shown in
Referring to
—Operation—
Image processing system 50 having the above-described configuration operates in the following manner. In the following description, for convenience, it is assumed that main powers of all components related to image processing system 50 are all always kept on.
Referring to
In response to the print instruction mentioned above, the program, of which control structure is shown in
At steps 232 to 236 shown in
At step 238 shown in
If the print object data does not include written data, only the read data 302a and the first color conversion profile 304a are output.
In response, image forming apparatus 90 operates in the following manner. Referring to
At step 258, CPU 152 combines read data 312a and written data 312b to form data 314, and prints the same.
If the input print object data includes read data only, only the read data 312a is printed.
In the following, as a more specific example, an exemplary conversion of color values when the read data and written data are converted from RGB representation to CMYK representation using the first and second color conversion profiles 304a and 304b will be described.
Referring to
Referring to
The difference in conversion results from use of color conversion profiles that are optimal for the read data and the written data, respectively.
From the foregoing, it can be understood that by performing different color conversions on the read data and the written data and printing the result, difference in color tone in each of the read data and written data before and after processing is avoided as much as possible. Therefore, in the present embodiment, change in color tone at the time of printing can be reduced both in the read data and the written data.
As described above, by the image processing system 50 in accordance with the present embodiment, when combined data including read data and written data is to be printed, both the read data and the written data can be subjected to optimal image processing, respectively, before printing. Further, it is possible to reproduce both the read data and the written data in the color and manner of printing similar to those at the time of display. By the image processing system 50, it is possible, when printing the combined data, to reflect the brilliant display color of the written data on the printed image.
In the first embodiment, image processing of raw data is performed in the image forming apparatus. The present invention, however, is not limited to such an embodiment. Any manner of processing may be adopted, provided that optimal image processing is done on the read data and written data, respectively, and the displayed color can be reflected on printing. For instance, the information display apparatus may perform image processing based on optimal color conversion profiles on the raw read data and raw written data, and may output combined data including the read data and written data as a result of image processing, to the image forming apparatus. In that case, if the print object data includes read data only, only the read data after image processing is output to the image forming apparatus.
In the embodiment described above, when written data is included, the second image processing 40 is always enabled, and printing is done by applying separate color conversion profiles to the read data and the written data. The present invention, however, is not limited to such an embodiment. For instance, the second image processing 40 may be disabled by a certain set value, so that the operation can be switched to a mode in which, as in the prior art, a single, first color conversion profile is equally applied both to the read data and the written data.
The embodiment described above solves the problem encountered at the time of printing, which problem comes from the difference in RGB value ranges of the image read by a color scanner and the written data. The data handled by the present system, however, is not limited to the image read by a color scanner. By way of example, if a device such as a camera that forms an image with RGB range specific to the device is used, a special color conversion profile may be prepared as in the case of a color scanner, and the data obtained by the device may be subjected to image processing separate from the written data.
The embodiments as have been described here are mere examples and should not be interpreted as restrictive. The scope of the present invention is determined by each of the claims with appropriate consideration of the written description of the embodiments and embraces modifications within the meaning of, and equivalent to, the languages in the claims.
Number | Date | Country | Kind |
---|---|---|---|
2007-300762 | Nov 2007 | JP | national |