The present invention relates to a print data generating process for printing that has a characteristic feature in surface scattering.
In recent years, techniques for controlling the surface scattering of printed images have been developed, and there has been a trend of using digital techniques to reproduce a print object with an elaborate design by matching colors and reflective properties with those of the inputted original. PTL 1 describes the following. Specifically, a method is described in which: from a subject placed and illuminated on a planar base, diffuse reflection image signals and gloss signals, which indicate the degree of gloss, are obtained desirably in two directions, namely, a main-scanning direction and a sub-scanning direction; and after the diffuse reflection image signals are outputted with color inks, a shape is formed with a transparent ink to reproduce the gloss of the gloss signals in the two directions.
Also, according to a technique described in NPL 1, it is possible to reproduce anisotropic reflection in which, like satin or the like, the intensity of gloss and the shading change with changes in the incident direction of light and the viewing direction. Note that, in the print reproduction in NPL 1, a three-dimensional printer is used, and concavities and convexities are provided on the surface to allow surface scattering to change depending on the incident angle and the viewing angle.
In the technique described in PTL 1, the process is divided into reproduction of the diffused colors via control of the color inks and reproduction of the gloss via control of the transparent ink. In addition, the gloss is reproduced based only on the intensities in the two directions. Such a technique cannot sufficiently reproduce the object's actual appearance. On the other hand, in the technique described in NPL 1, the object's bidirectional reflectance distribution function (BRDF) is obtained and changes in surface scattering depending on the viewing angle are expressed with a print object having a three-dimensional structure. This three-dimensional structure can be obtained from the bidirectional reflectance distribution function (BRDF). Meanwhile, the bidirectional reflectance distribution function (BRDF) is the distribution of reflected light of light incident from a given direction. The surface reflection property (refractive index) and shape of the reproduction target material must be reproduced on the object to be reproduced with high fidelity in order that the properties of reflected light are matched on the object to be reproduced. However, this high-fidelity reproduction is actually impossible in a case of using a printer with a limited number of color materials. In NPL 1, optimization is used in an attempt to match the surface scattering in any light source direction and any viewing direction between the reproduction target material and the print object. Doing so, however, involves a great number of dimensions to be calculated and is in fact trying to solve a problem that is actually impossible to solve.
A print data generating apparatus according to the present invention includes: an obtaining unit configured to obtain a BRDF model group for each of a plurality of colors and an angle of incident light in an environment where a n object to be reproduced is to be viewed; a calculating unit configured to calculate a reflection distribution of the object to be reproduced for which the angle of the incident light is limited by applying the angle of the incident light, obtained by the obtaining unit, to each of models in the BRDF model group; a color data outputting unit configured to output color data for each of the models in the BRDF model group based on the reflection distribution calculated by the calculating unit, the color data indicating a color to be formed on a surface of the object to be reproduced; and a form data outputting unit configured to output form data for each of the models in the BRDF model group based on the reflection distribution calculated by the calculating unit, the form data indicating a form of the object to be reproduced.
The present invention greatly reduces the number of dimensions to be calculated for reproducing an object's surface scattering such as anisotropic reflection and is therefore capable of highly accurate reproduction in a simpler manner.
Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).
Embodiments of the present invention will be described hereunder with reference to the drawings. Note that the following embodiments are not intended to limit the present invention and that not all the combinations of the features described in these embodiments are necessarily essential for the solving means of the present invention. Also, identical constituent components will be described with the same reference numeral given thereto.
<Configuration of Print Data Generating Apparatus and Generating Steps>
The surface scattering obtaining unit 101 is configured to obtain, from outside, a bidirectional reflectance distribution function (BRDF) model group representing BRDF models of the pixels of print data, for example, for each of red (R), green (G), and blue (B) signals. Each BRDF model here includes various known models such as the Lambertian model, Cook and Torrance model, and Ward model. In this embodiment, an example where the Ward model is used will be described later for the sake of explanation, but this embodiment is not intended to limit the BRDF model to be used and any of those BRDF models may be used.
The incident light angle obtaining unit 102 is configured to obtain the incident angle of lighting in the environment where the print object using the print data to be generated is to be viewed. Assume a situation where the print object is exhibited in a gallery or a museum, for example. In this case, the exhibitor side can set the incident angle of the lighting on the print object. With the incident angle of the lighting on the print object being already known as above, the number of dimensions to be calculated based on the BRDF model is reduced.
The reflection distribution calculating unit 103 is configured to calculate a reflection distribution for each of the R, G, and B signals at the incident angle of the light obtained by the incident light angle obtaining unit 102, by using data corresponding to the BRDF model of each of the R, G, and B signals obtained by the surface scattering obtaining unit 101, for example.
The ink color separating unit 104 is configured to perform color separation into the combination of the ink colors which the printer is equipped with, from the R, G, and B reflectance distributions calculated by the reflection distribution calculating unit 103. The ink color separating unit 104 performs a process in which R, G, and B signals are derived from the R, G, and B reflectance distributions and the derived R, G, and B signals are converted into C, M, Y, K, and W signals, for example.
The surface normal distribution determining unit 105 is configured to calculate a surface normal distribution of the print object from the reflection distributions of the R, G, and B signals calculated by the reflection distribution calculating unit 103 and reflectance distributions based on the result of the ink color separation by the ink color separating unit 104.
(BRDF Model)
One example of a BRDF model corresponding to each single pixel of surface scattering data (BRDF model group) obtained by the surface scattering obtaining unit 101 will now be described. As mentioned earlier, in this embodiment, the anisotropic Ward model shown by the following formulas is used as the BRDF model for the sake of explanation.
Here, {right arrow over (l)} is a light source vector representing the direction of a light source, and {right arrow over (v)} is an observing vector representing the direction of eyes. {right arrow over (h)} is a half vector of the light source vector {right arrow over (l)} and the observing vector {right arrow over (v)}.
θl is the angle between a normal vector to the pixel and the light source vector, θv is the angle between the normal vector to the pixel and the observing vector, and θh is the angle between the normal vector to the pixel and the half vector. Moreover, φh is the angle between the half vector and a tangent vector (x axis) to the pixel. ρd is a diffuse component meaning the intensity of the diffuse reflection, ρs is a specular intensity component meaning the intensity of the specular reflection, αx is a specular spread component representing the spread of the specular reflection in the tangent vector direction, and αy is a specular spread component representing the spread of the specular reflection in the vertical normal vector direction. The optical anisotropy is expressed by describing the specular spread component in two dimensions with the tangent vector direction (x axis) and the vertical normal vector direction (y axis).
In this embodiment, the four parameters mentioned above are given for each of three pieces of color information R, G, and B. Note that in this embodiment, the pieces of color information will be described as three, R, G, and B pieces of information, but the method is not limited to such a case. For example, by using the spectral reflectance, color reproduction independent of the spectral luminance of the incident light and the like are possible. In addition, the tangent vector (x axis) can be defined in such that the direction differs from one pixel to another, and a rotation angle φ between the tangent vector to the pixel and the horizontal axis of the plane of the two-dimensional image is given for each pixel. As mentioned above, in this embodiment, a BRDF model based on an anisotropic Ward model is used. In so doing, 13 pieces of information in total (4 parameters (ρd, ρs, αx, αy)×3 colors (R, G, B)+1 (rotation angle)) are given for the pixel of each BRDF model. Note that these pieces of information are inputted into the print data generating apparatus as surface scattering data in the form of two-dimensional image information in which the above 13 dimensions in floating point are synchronized. The surface scattering obtaining unit 101 obtains the surface scattering data thus inputted (the above 13 pieces of information) for each BRDF model in the BRDF model group. Note that it suffices that the positional information on the pixel and the above 13 pieces of information are associated with each other, and the 13 pieces of information may not be obtained in the form of two-dimensional image information.
As shown in Formula (2) above, the bidirectional reflectance distribution function (BRDF) is a function dependent on the incident angle of light (light source vector) and the viewing direction (observing vector). This means that the reflection distribution calculating unit 103 is capable of calculating the reflection distribution required for the print object by using the BRDF models (surface scattering data) obtained by the surface scattering obtaining unit 101 and the light source vector obtained by the incident light angle obtaining unit 102.
In other words, the reflection distribution calculating unit 103 calculates the distribution of light reflected in each eye direction upon incidence of light from one light source vector. In Formula (2) above, the light source vector is already known, and the 13 pieces of information in total (4 parameters (ρd, ρs, αx, αy)×3 colors (R, G, B)+1 (rotation angle)) have been inputted and are thus already known. Therefore, the reflection distribution calculating unit 103 calculates the reflection intensity for all the observing vectors and outputs it as a reflection distribution. Note that the reflection distribution includes the diffuse component ρd, the specular intensity component ρs, and the specular spread components αx and αy.
(Division of BRDF Model into Pixels for Printing)
(Ink Color Separating Unit)
The process by the ink color separating unit 104 will now be described in detail. For each pixel, the ink color separating unit 104 derives color data (color material control amounts) from the parameter ρd representing the diffuse component and the parameter ρs representing the specular intensity component, which are inputted thereto. The ink color separating unit 104 then derives ink amount data from the derived color material control amounts. The parameter ρd representing the diffuse component and the parameter ρs representing the specular intensity component, which are inputted into the ink color separating unit 104, are the values calculated by the reflection distribution calculating unit 103 in accordance with the incident light angle. Moreover, the ink color separating unit 104 derives specular spread components corresponding to the color material control amounts and outputs them into the surface normal distribution determining unit 105.
In this embodiment, the ink color separation process is performed by referring to a color material look-up table (color table) in which ρd representing the diffuse component and the specular intensity component ρs are stored for each of R, G, and B.
Here, k is a constant, ρd_r, ρd_g, and ρd_b are the information of the inputted diffuse components ρd of the colors (R, G, and B), and ρs_r, ρs_g, and ρs_b are the information of the inputted specular intensity components ρs of the colors (R, G, and B). Also, ρdLUT_r[m], ρdLUT_g[m], and ρdLUT_b[m] represent the values of r, g, and b in the column 402 at the m-th row and ρsLUT_r[m], ρsLUT_g[m], and ρsLUT_b[m] represent the values of r, g, and b in the column 403 at the m-th row.
Then in Step S502, the ink color separating unit 104 determines whether or not the evaluation value V is the smallest. If so, the ink color separating unit 104 records the values of R, G, and B in the column 401 at the m-th row and the values of αx and αy in the columns 404 and 405 at the m-th row. The processes in Steps S501 and S502 are performed for all the points in the color material look-up table (all the columns in
The color material control amounts thus derived are converted by means of a publicly-known color matching process into a plurality of pieces of ink amount data for C, M, Y, K, and W, which indicate ink amounts, and then outputted. Note that the method of determining the ink amounts is not limited to the above method, and various other known color matching algorisms are applicable.
(Determination of Surface Normal Distribution)
The surface normal distribution determining unit 105 processes the pixels of the BRDF models one by one. The surface normal distribution determining unit 105 obtains ax and αy which are the specular spread components calculated by the reflection distribution calculating unit 103 and the rotation angle φ of the processing-target BRDF model, as well as the specular spread components α′x and α′y of the color materials on the surface inputted from the ink color separating unit 104. As the rotation angle φ, the value contained in the surface scattering data obtained by the surface scattering obtaining unit 101 can be used. The surface normal distribution determining unit 105 may obtain the rotation angle φ through the reflection distribution calculating unit 103 or from the surface scattering obtaining unit 101. Based on these pieces of information thus obtained, the surface normal distribution determining unit 105 outputs form data which is 6×6 height information. That is, the surface normal distribution determining unit 105 outputs form data representing 6×6 height information for the pixel of one BRDF model. With this 6×6 height information, a 5×5 inclined surface can be formed in reproduction of the pixel of one BRDF model.
First in Step S601, the surface normal distribution determining unit 105 calculates specular spread components with respect to luminance. Specifically, various methods are available such as calculating a weighted average of the R, G, and B specular spread components for each parameter. In the following, the weighted average values will be described as αlx, αly, αl′x, and αl′y, respectively. αlx and αly represent specular spread components with respect to luminance calculated by respectively obtaining the weighted averages of the specular spread components in the x direction and the y direction inputted from the reflection distribution-calculating unit 103. αl′x and αl′y represent specular spread components with respect to luminance calculated by respectively obtaining the weight averages of the specular spread components in the x direction and the y direction inputted from the ink color separating unit 104.
Then in Step S602, using Formula (6) below, the surface normal distribution determining unit 105 calculates the ratio between the two specular spread components in the x direction with respect to luminance which are calculated in Step S601 from the inputs from the reflection distribution calculating unit 103 and the ink color separating unit 104. Also, using Formula (7) below, the surface normal distribution determining unit 105 calculates the ratio between the two specular spread components in the y direction with respect to luminance which are calculated in Step S601 from the inputs from the reflection distribution calculating unit 103 and the ink color separating unit 104.
Xratio=αlx/αl′x Formula (6)
Yratio=αly/αl′y Formula (7)
In Step S603, the surface normal distribution determining unit 105 determines a base form by referring to a form look-up table (form table) with the specular spread ratios Xratio and Yratio calculated in Step S602. In the calculation of the surface normal distribution, it is desirable to reproduce the inputted BRDF model with as high fidelity as possible. Generally, in a state where color materials are placed on the upper surface, the intensity of specular reflection on a single surface (⅕×5) may be reduced in some cases. For this reason, in this embodiment, a process is performed in which the specular spread ratio utilizing the reflection properties in the state where the color materials are placed, i.e. after the color separation, is obtained, and a form corresponding to this ratio is determined.
Each piece of base form information is recorded in the form look-up table shown in
In Step S604, the surface normal distribution determining unit 105 rotates the form determined in Step S603 by the rotation angle φ and calculates 6×6 height information to be outputted. In Step S604, first, x and y of the 12×12 height information, which is the form determined in Step S603, are rotated by the rotation angle φ about the center coordinates ((x, y)=(10.5, 10.5) in
As described above, by using the form look-up table, the optical anisotropy of the input information can be easily reproduced. Note that while the lattice points of the base form are described as a square lattice as shown in
Alternatively, the form of one pixel, which is the unit region for reproducing a BRDF, may be the regular hexagon shown by reference numeral 801 in
(Overall Process Flow in Print Data Generating Apparatus)
First in Step S901, the surface scattering obtaining unit 101 obtains surface scattering data representing a BRDF model group as data indicating a print object to be reproduced. The data indicating a print object to be reproduced here is data in which pixels of BRDF models are arranged side by side in the x and y directions like the one shown in
Then in Step S902, the incident light angle obtaining unit 102 obtains a light source vector (incident angle) for viewing the print object which is to be printed using data to be generated by the print data generating apparatus 11.
In Step S903, the print data generating apparatus 11 selects the pixel of one model among the BRDF model group obtained in Step S901. Subsequent Steps S904 to S908 are processes for the pixel of this one selected BRDF model.
In Step S904, the reflection distribution calculating unit 103 calculates a target reflectance distribution for the print object by applying the light source vector obtained in Step S902 to the BRDF model of the pixel selected in Step S903.
In Step S905, the ink color separating unit 104 performs ink color separation. Details of the process are done as described earlier by following the flow shown in
In Step S906, the surface normal distribution determining unit 105 calculates a surface normal distribution in conformity with the target reflectance distribution calculated in Step S904. Details of the process are done as described earlier by following the flow shown in
In Step S907, the ink color separating unit 104 performs a color data outputting process for outputting data outputted in Step S905 and indicating, for example, C, M, Y, K, and W ink amounts.
In Step S908, the surface normal distribution determining unit 105 performs a form data outputting process for outputting form data corresponding to the surface normal distribution calculated in Step S906.
In Step S909, the print data generating apparatus 11 determines whether or not the pixels of all the BRDF models in the BRDF model group obtained in Step S901 have been processed. The print data generating apparatus 11 returns to Step S903 if determining that not all the BRDF models have been processed. The print data generating apparatus 11 ends the series of processes if determining that all the BRDF models have been processed.
As has been described above, in the print data generating apparatus in this embodiment, BRDF models which are dependent on the light vector and the observing vector are inputted and print data for reproducing the object to be reproduced is generated. In so doing, the data of the light source vector is obtained and used in the process for generating a simulated form. Thus, accurate print reproduction is possible. The accurate print reproduction means that it is possible to accurately reproduce how light is emitted outward in various directions upon incidence of light onto a given point on the print surface. Thus, in this embodiment, by obtaining in particular the direction of incident light in the print viewing environment as described above, it is possible to accurately reproduce the distribution of reflected light on the object while greatly reducing the number of dimensions to be calculated.
In the calculation of the surface normal distribution in Step S906 in Embodiment 1, the surface normal distribution of the print object is determined in conformity with the target reflectance distribution of the object to be reproduced. However, this embodiment is not limited to such a case. In the case of generating concavities and convexities on the surface as described in Embodiment 1, a shadow (a surface which the light from the light source cannot reach) may possibly be formed by the concavo-concave form which is dependent on the angle of the light source vector. In Embodiment 1, the light source is fixed, which in some cases leads to a situation where the reflection distribution is absent in the region where the shadow is formed and neither the color data nor the form data can therefore be obtained therefrom.
Description will be given below using
With this taken into consideration, in this embodiment, it is determined whether or not there is a shadow region like the one formed in
The shadow information calculating unit 1101 is configured to calculate a section where a shadow region as shown in
The normal angle adjusting unit 1102 corrects the form (surface normal distribution) data on the region determined as a shadow region by the shadow information calculating unit 1101 such that the angles of the normals thereto will be low, with the assumption that an angle perpendicular to the horizontal plane is 0°. Alternatively, the form data on the region that causes the formation of the shadow region may be corrected.
Note that a shadow is likely to be formed by a concavity and a convexity on the surface particularly in a case where the normal vector has a large angle of near 90°. Such a case leads to a situation where the target reflectance distribution cannot be achieved via the surface normal control, that is, the angles of the normals cannot be adjusted in such a way as to prevent the formation of a shadow region even with the form data correction. In such a situation, the user is notified that the inputted data cannot be reproduced, for example, by displaying such information on a display not shown in particular. In this case, the user may be prompted to reduce the angle of the light source vector.
In the correction of the surface normal distribution data performed here, the adjustment only needs to be such that the normal vector will not be at 90° or larger with respect to the light source vector. In so doing, a calculation similar to that by the surface normal distribution determining unit only needs to be performed while satisfying the above constraint.
Meanwhile, in a shadow region, the light is not incident, and no reflection component is thus present therefor in the reflection distribution data outputted from the reflection distribution calculating unit 103, and no ink color separation is thus performed therefor by the ink color separating unit 104. In the case where the form data is corrected to thereby prevent the formation of the shadow region, the ink amount data is derived for the region which was the shadow region. The BRDF model corresponding to the region with the corrected form can be obtained using the surface scattering data obtained by the surface scattering obtaining unit 101. Since the light source vector has been obtained by the incident light angle obtaining unit 102, the reflection component in the state where the light source vector on the region which was the shadow region is known can be calculated. As described in Embodiment 1, the ink color separating unit 104 derives and outputs the ink amount data corresponding to this reflection component. Thus, the ink amount data can be derived also for the region which was the shadow region.
As has been described above, according to this embodiment, it is possible to accurately reproduce how light is emitted outward in various directions even for a shadow region formed in the case where the light source vector is fixed.
Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2014-256080, filed Dec. 18, 2014, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2014-256080 | Dec 2014 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2015/005976 | 12/1/2015 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2016/098297 | 6/23/2016 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20090006051 | Zhou | Jan 2009 | A1 |
20090213120 | Nisper | Aug 2009 | A1 |
20100134811 | Fukasawa et al. | Jun 2010 | A1 |
20120032973 | Sano | Feb 2012 | A1 |
20140340707 | Hirabayashi | Nov 2014 | A1 |
20150016711 | Tin | Jan 2015 | A1 |
20150172636 | Gordon | Jun 2015 | A1 |
20150379162 | MohammadBagher | Dec 2015 | A1 |
20160371880 | Ide | Dec 2016 | A1 |
20170011496 | Lu | Jan 2017 | A1 |
20170104894 | Nishikawa | Apr 2017 | A1 |
Number | Date | Country |
---|---|---|
2003-145733 | May 2003 | JP |
2012-044421 | Mar 2012 | JP |
Entry |
---|
Yanxiang Lan, et al., “Bi-Scale Appearance Fabrication”, ACM Transactions on Graphics (TOG)—SIGGRAPH 2013 Conference Proceedings TOG Homepage archive, vol. 32, No. 4, Issue 4, Jul. 2013, pp. 1-11. |
Notification of Transmittal of the International Search Report and the Written Opinion of the International Search Authority, or the Declaration issued in corresponding application No. PCT/JP2015/005976 on Feb. 16, 2016. |
Number | Date | Country | |
---|---|---|---|
20170339318 A1 | Nov 2017 | US |