The present invention relates to computer-implemented methods and systems for utilizing technological improvements to aid in displaying desired materials.
Modern coatings provide various functions in industry and society. For example, different objects and structures, including vehicles and buildings, may be coated using paints or various other coatings in order to protect components from the elements (e.g., to protect against rust formation) or to provide aesthetic visual effects. Whenever a coated object is viewed, the aesthetic visual effects perceived are the result of complex relationships between the properties of a coating and viewing conditions, such that it is challenging to achieve an accurate color match or pleasing color harmony between two or more coated objects.
In some cases, a coating mixed, used, or even viewed under different conditions may exhibit varied appearances. Visual properties of a coating (e.g., color, visual effects, texture, etc.) may be determined, in part, based on a chemical composition of the coating and may vary according to time of manufacture, geographic location where the coating was applied (e.g., due to changes in altitude, climate, air quality, weather, etc.), solvent, coating orientation, substrate composition, or other environmental factors. Visual perception of color harmony between two coatings or coated objects may vary based on viewing conditions such as lighting (e.g., intensity, clarity, orientation, etc.), distance (e.g., between coatings/objects, from observer), relative orientation, surrounding colors or objects, or other environmental conditions. Even when two different coated objects have coatings with the same chemical composition, the objects may have different visual perceptions based upon differences in climate conditions when the objects were coated.
Accordingly, there are several challenges within the art that can be benefited by technical advancements. The subject matter claimed herein is not limited to cases that solve any disadvantages or that operate only in environments such as those described above. Rather, this background is only provided to illustrate one exemplary technology area where some computer-implemented methods and systems described herein may be practiced.
A method is provided to facilitate a comparison process in which a color harmony between a first object and a second object is evaluated. For example, a system performing the method may be configured to receive first color data and first spatial orientation data of a first physical object for generating a first visualization for the first visual object, and to receive second color data and second spatial orientation data of a second physical object for generating a second visualization for the second visual object. The color data may be provided or selected from a coating database and may include attributes of a respective coating. Spatial orientation data of an object may comprise data defining a size, shape, and position of the object in a coordinate plane and may be provided or selected from an object database. Further, in generating the first visualization and the second visualization, the system may determine light source data for use with the respective color data and spatial orientation data.
Within a user interface, the system may display (i) the first visualization or rendering for the first visual object and (ii) the second visualization or rendering for the second visual object as part of a digital harmony visualization, for example with respect to a predetermined observer position relative to the objects and the determined light source data. The system allows a digital harmony evaluation of the first object and the second object under standardized conditions, allowing a user to determine whether a combined appearance of the first object and the second object is acceptable. An input may be received at the user interface defining the digital harmony visualization as acceptable or unacceptable, for defining a tolerance range of color harmony between the first object and the second object.
A computer system is configured to compare multiple objects in a digital harmony visualization for determining a color harmony between the objects, where color data for available coatings, light source data, and orientation data are provided to the system. The system may be configured to define color properties of a printing device or a display device, and to process the first visualization and the second visualization based on the defined color properties, for adjusting a printed or displayed appearance of the first visualization and the second visualization provided by the printing device or the display device.
Additional features and advantages of exemplary implementations of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of such exemplary implementations. The features and advantages of such implementations may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features will become more fully apparent from the following description and appended claims or may be learned by the practice of such exemplary implementations as set forth hereinafter.
In order to describe the manner in which the above recited and other advantages and features of the invention can be obtained, a more particular description of the invention briefly described above will be rendered by reference to specific examples thereof, which are illustrated in the appended drawings. Understanding that these drawings depict only typical examples of the invention and are not therefore to be considered to be limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings, which are described below.
Accurately rendering colors is challenging on a digital display. Significant research and work have been done using various color-calibration techniques in order to bring a display's colors in closer alignment to colors within the physical world. In many cases, these technical tools are expensive, cumbersome, and/or limited.
Disclosed computer systems and methods provide unique solutions to challenges within this technical space. In particular, disclosed computer systems and methods are able to display objects having various coatings, and in particular coatings with effect pigments, in ways that accurately reflect their appearance in standardized, real-world conditions. In some configurations, a computer system may utilize display or printer calibration tools in order to create an accurate representation of color; however, the disclosed technology does not necessarily require unique color calibration tools or other expensive and cumbersome calibration steps.
The methods and systems of the instant disclosure provide significant advantages in addressing the complex variations that occur in visual properties of coatings, such as may occur in the automotive industry where ensuring color harmony between components painted in different locations presents a particular challenge. In the automotive industry example, a front fender panel of a vehicle may be painted at a manufacturing plant in a first state while a bumper for the same vehicle may be painted at a manufacturing plant in a second state. Even if the same coating formulation is used in both manufacturing plants, variations in altitude, climate, air quality, weather, etc. between the states or even the manufacturing plants can reduce confidence in the parts “matching” each other. Increasing the difficulty of ensuring color harmony between the bumper and the fender is the fact that even a direct visual comparison between the resulting painted parts in a single location is dependent on the viewing conditions at the time of the comparison (e.g., lighting, relative orientation and position, surrounding colors or objects, etc.). Even when parts are able to be identified as not matching, whether painted with the same coating formulation or not, manufacturers are left with the problem of where to find another bumper or fender that is an acceptable match. Similar challenges are presented in ensuring color harmony for after-market parts and in painting repaired parts. The methods and systems of the current application overcome these challenges by providing a unique digital harmony visualization.
The present disclosure extends to computerized systems and methods for providing a digital harmony visualization designed to have a particular visual layout. This layout is designed to enable the display of multiple different objects including color coatings thereon and is further designed to facilitate comparison between those objects at selected positions, orientations, and conditions. For instance, the system may be used in a design setting where potential coatings (applied or used at external coating systems) are being compared for color harmony when used on multiple objects having particular shapes, positions, and orientations, to determine whether selected coatings are acceptable for real world use together. Notably, the coatings are selected with respect to color data representing physical measurements of exemplary coatings (e.g., spectral measurements of color) and the objects having the coatings may be rendered with respect to the color data, an orientation and position of the objects, an orientation and position of an observer, and predetermined light conditions. That is, a digital harmony evaluation of the objects may be accurately performed. Optional peripheral devices may be provided with the system, such as a spectrophotometer, colorimeter, 3D scanner or the like.
As used herein, a “module” comprises computer executable code and/or computer hardware that performs a particular function. One of skill in the art will appreciate that the distinction between different modules is at least in part arbitrary and that modules may be otherwise combined and divided and still remain within the scope of the present disclosure. As such, the description of a component as being a “module” is provided only for the sake of clarity and explanation and should not be interpreted to indicate that any particular structure of computer executable code and/or computer hardware is required, unless expressly stated otherwise. In this description, the terms “component”, “agent”, “manager”, “service”, “engine”, “virtual machine” or the like may also similarly be used.
The computer system 100 may be configured to display a digital harmony visualization of objects having coatings thereon, the digital harmony visualization comprising a rendering of the objects based on color data of the respective coatings, an orientation of the objects, and light source data, for evaluating a color harmony of the objects. As used herein, “color data” may comprise a digital representation of a particular coating applied to a surface (e.g., including color, visual effects, texture, anisotropy, metamerism index, etc.). The color data for a particular coating may be distinguished by spray orientation, weathering, substrate material (e.g., of the object), etc. The color data may include spectrophotometric measurement data or similar measurement data. The objects may have the same relative shape as a given conventional object that may be known to those having skill in the art and, as used herein, “spatial orientation data” for a given object may comprise a digital representation of the object in a three-dimensional coordinate system. For example, the objects may be displayed as a rendering of their actual form (e.g., a fender and a bumper) and/or as virtual panels, such as based upon user input or selection (e.g., by measurement with a 3D scanner or use of object data such as CAD models). Accordingly, the objects may comprise a plurality of three-dimensional flat and/or curved surfaces with certain relative positions in space, morphologies, etc. Either of the color data and/or the spatial orientation data may further comprise a digital representation of material properties of the surface (e.g., plastic, metal, reflective properties, etc.)
“Light source data” may comprise a digital representation of light sources in a three-dimensional space (e.g., intensity, clarity, position, orientation, etc.). Multiple light sources may include sunlight of varying intensity and clarity, point light, diffuse light, incandescent light, fluorescent light, LED light, etc. The light source data may be used to modify the color data in a given rendering (e.g., with respect to anisotropy, metamerism, brightness, color, etc.), and may include a digital representation of shadows and reflected light influenced by the color data and the orientation of the objects. The light source data may include color brightness and/or color temperature, such as a range of color brightness and/or a range of color temperatures.
As part of a digital harmony visualization, the computer system 100 may display a digital rendering of a first coating applied to a first object and a second coating applied to a second object for a set of conditions defined by first color data, first spatial orientation data, second color data, second spatial orientation data, and light source data. For example,
In the depicted example, the first object 220 and the second object 230 comprise different coating materials, one being a water-borne coating and the other a solvent-borne coating. In another example, not shown, the first object 220 and the second object 230 may be formed of different materials, for example a fender may be made of a metal while a bumper may be made of a plastic material. The digital renderings described according to the current disclosure may thereby account for actual differences in coating material and/or in the material of the objects themselves. Additionally, a particular light source 240 is depicted, the light source applying lighting attributes to both the first object 220 and the second object 230 based on the position and respective properties of the light source. For example, both the first object 220 and the second object 230 may be rendered with the exact same virtual lighting conditions applied to both renderings or with different virtual lighting conditions.
In some cases, a viewer may be able to individually select components that affect a coating. For example, the viewer may select between a water-borne coating and a solvent-borne coating, a stack of coatings (e.g., e-coat, primer, basecoat, clearcoat, monocoat, etc.), additives (e.g., aluminum flakes for sparkle, etc.), texture from different material substrates (e.g., plastic vs metal substrate), spray directionality, etc. to create a particular object that demonstrates a potential coating. In response, the rendering engine 122 renders the object having the selected coating.
A person having skill in the art will appreciate that coatings may have complex associated visual appearances. For example, an appearance of a coating may change based upon the angle at which a viewer sees the coating and/or the angle of a light source on the coating. Rendering the first object 220 and the second object 230 next to each other allows a viewer to appreciate the impact of distance, light, and orientation in unique and novel ways. For example, a color of the first object 220 may in some cases appear to be in harmony, or visually compatible, with a color of the second object 230 simply based upon a viewing distance.
A typical view of the viewer may be from a “far away” distance, as shown in
In another aspect, the digital harmony visualization provided by a user interface 300 may allow a viewer to evaluate an effect of morphology on color harmony between a first object 320 and a second object 330. As illustrated in
This may be particularly advantageous where a first object 320 and a second object 330 are manufactured separately and later joined together. While it may be assumed that applying the same coating to both the first object 320 and the second object 330 would result in the objects 320, 330 being perceived as the same color when fixed together, that is not always the case due to color flop and similar effects that can change the perception of a same coating in dependence on their respective object's relative orientation. By providing a digital harmony visualization according to the current disclosure, such disadvantages can be avoided without the need for in-person, trial and error comparisons of objects, such as in harmony reviews subject to sunlight conditions or requiring diffuse light booths.
Additionally, in some cases, a viewer may be able to individually manipulate an orientation or shape of an object of the digital harmony visualization. For example, the user interface 300 may allow a viewer to rotate or otherwise move the objects relative to one another, to select whether the objects are displayed as a rendering of their actual form (e.g., a fender and a bumper) and/or as virtual panels, or to change the morphology of one or more of the objects by introducing a curve or similar variation in the given object. For instance, the viewer may be able to increase or decrease a curve of the first object 320. In response, the rendering engine 122 renders the object in the new configuration. The resulting digital harmony visualization may provide the viewer with increased information on the impact of shape and position on a color harmony.
In another aspect, a digital harmony visualization may be provided by a user interface 400 displaying a comparison of a first object 420 and a second object 430 under different light sources, as depicted in
A viewer may be able to manipulate and/or create custom light sources. For example, a user interface 400 may include light source selection elements allowing a viewer to select the number of light sources, the type of light sources (e.g., LED, neon, sunlight, diffuse, dusk, collimated, ambient, etc.), the location of the light sources with respect to each of the objects, an angle of incidence of the light sources with respect to each of the objects, and various other variables related to the lighting. When a viewer makes a customization to the light source using the user interface 400, the rendering engine 122 may re-render all of the objects 420, 430 so that the same lighting variables are applied to each of the objects 420, 430. In this way, each of the objects 420, 430 is independently rendered to include the same environmental attributes of each of the other objects 420, 430. Alternatively, when a viewer makes a customization to the light source using the user interface 400, the rendering engine 122 may re-render only a selection of the objects 420, 430 so that different lighting variables are applied to the objects 420, 430. In this way, each of the objects 420, 430 is independently rendered side-by-side to include different environmental attributes. As such, a viewer is able to appreciate the impact that changes in lighting have on each individual object in comparison to other objects.
A viewer may be able to customize surrounding conditions for performing a simulation or a digital harmony visualization according to the present disclosure. In this manner, a user may select one or more light sources from the type of light sources and specify a relative position of the light source or light sources, each of the objects, a viewpoint position, and surrounding environmental characteristics. Each of the components in the visualization may be independently adjustable, such that the light source or each of the light sources, each of the objects, and the viewpoint or observer position may be freely rotated or repositioned through the user interface. In this way, each of the components is independently rendered and re-rendered to reflect changes for each of the other components. This independent and dynamic control allows a user to simulate a variety of conditions in the digital harmony visualization, as well as adjust surrounding conditions in the visualization. For example, the surrounding conditions may be selected to simulate a diffuse light booth, to simulate a point light source, to simulate a mixture of lighting conditions or light sources, to simulate reflective effects of a surrounding environment, or the like. In like manner, a light source may be positioned behind a viewpoint or observer position, on an opposite side of the object relative to the viewpoint position, etc., to further simulate possible lighting conditions.
The independent rotation and/or positioning of each of the objects, the viewpoint position, and the light source provides numerous advantages and benefits in evaluating harmony between objects and/or coatings. This may be particularly evident where coatings include differing spray orientations, such that the viewpoint position and the light source position combine to result in possibly dramatic differences in appearance. In the described digital harmony visualization, each pixel may be adjusted for the particular conditions at that point, enabling an observer to clearly and completely evaluate color harmony for objects and coatings as they would or could appear in real world conditions.
As shown in
In one aspect, the gap 550 may be determined by an actual, real-world gap between parts of a car) e.g. a ¼″ gap between a hood and a fender. Accordingly, a viewer may accept a color harmony between different coatings for a first object 520 and a second object 530 that are separated by a predetermined distance at predetermined orientations and angles, such as by a trim component between a bumper and a fender.
A digital harmony evaluation may be performed to show the impact of varying application means on visual appearance of a coating.
A first object 620 and a second object 630 may be compared as still images or as an animation. For example, while shown as a comparison of multiple still images,
A viewer may be able to visualize and gain insightful information on an expected appearance of a coated object after predicted weathering effects, such as when selecting a coating for use with an object. Similarly, a viewer may be informed by a digital harmony evaluation including simulated weathering when selecting a coating for a new object to be added with an older part. For example, the second object 730 may comprise an existing part of a vehicle, such as a bumper or body, which has undergone weathering effects while the first object 720 may comprise a newly ordered part for addition to the vehicle. In this case, a viewer may review possible coatings for the new part, second object 730, with insightful information on color harmony with an existing weathered part.
In step 830 light source data may be received or selected for use with the color data and the spatial orientation data of the objects. The light source data may be used to modify the color data in a given rendering (e.g., with respect to anisotropy, metamerism, brightness, color, etc.) and may comprise a digital representation of light sources in a three-dimensional space (e.g., intensity, clarity, position, orientation, etc.). For example, color data may include spectral information captured under specific illumination conditions at a pixel level and selected light source data may be applied to modify each pixel of a given rendering. Multiple light sources may be selected, for example from sunlight of varying intensity and clarity, point light, diffuse light, incandescent light, fluorescent light, LED light, etc.
It should be noted that, while described as discrete steps, varying examples may include iteratively receiving or selecting color data and/or spatial orientation data and/or light source data. In like manner, a viewer may not be restricted to a single selection and may, for example, be able to rotate, manipulate, or otherwise modify a selected color or object in the rendering as has been described previously.
Step 840 may comprise generating a first visualization for the first physical object based on the first color data, the first spatial orientation data and the light source data, and generating a second visualization for the second physical object based on the second color data, the second spatial orientation data and the light source data. The first visualization and the second visualization may be generated in a common virtual space or in separate virtual spaces. In like manner, the light source data for the first visualization and the second visualization may be the same light source data or different light source data, according to an intended use.
A digital harmony visualization comprising the first visualization and the second visualization may be rendered or displayed on a graphical user interface at step 850. The digital harmony visualization may comprise an overlay of the first visualization and the second visualization, a side-by-side presentation of the first visualization and the second visualization, or the first visualization and the second visualization may be rendered together in a common virtual space.
Furthermore,
Step 940 may comprise generating a first visualization for the first physical object based on the first color data, the first spatial orientation data and the light source data, and generating a second visualization for the second physical object based on the second color data, the second spatial orientation data and the light source data. A digital harmony visualization comprising the first visualization and the second visualization may be rendered or displayed on a graphical user interface at step 950. In step 960 input may be received at the user interface defining the digital harmony visualization as acceptable or unacceptable. For example, a viewer may review the digital harmony visualization and accept or reject the compatibility of the coated objects shown based on their colors or combined general appearance.
At step 970 the digital harmony visualization and the input may be stored in a memory to form a tolerance range, such as a harmony tolerance range for given colors and/or for given light sources and/or relative positions and/or relative orientations of the described components in the visualization. In this manner, the method may facilitate the creation of a tolerance range defining acceptable combinations of coatings or colors, for example a standardized tolerance range for harmony, based on a response from viewers over time. The tolerance range may be dynamically updated or may be established from a standardized set of digital harmony visualizations. The tolerance range may be employed to provide suggested coatings, colors, spray orientations, or other features following the selection of initial color data and orientation of a first object. In this manner, the tolerance range may provide suggested coatings or colors for harmony with another coating or color, for objects of a given position, orientation, or light source conditions.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the described features or acts described above, or the order of the acts described above. Rather, the described features and acts are disclosed as example forms of implementing the claims.
The present invention may comprise or utilize a special-purpose or general-purpose computer system that includes computer hardware, such as, for example, one or more processors and system memory, as discussed in greater detail below. Within the scope of the present invention are also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. Such computer-readable media can be any available media that can be accessed by a general-purpose or special-purpose computer system. Computer-readable media that store computer-executable instructions and/or data structures are computer storage media. Computer-readable media that carry computer-executable instructions and/or data structures are transmission media. Thus, by way of example, and not limitation, within the practice of the invention at least two distinctly different kinds of computer-readable media can be used: computer storage media and transmission media.
Computer storage media are physical storage media that store computer-executable instructions and/or data structures. Physical storage media include computer hardware, such as RAM, ROM, EEPROM, solid state drives (“SSDs”), flash memory, phase-change memory (“PCM”), optical disk storage, magnetic disk storage or other magnetic storage devices, or any other hardware storage device(s) which can be used to store program code in the form of computer-executable instructions or data structures, which can be accessed and executed by a general-purpose or special-purpose computer system to implement the disclosed functionality of the invention.
Transmission media can include a network and/or data links which can be used to carry program code in the form of computer-executable instructions or data structures, and which can be accessed by a general-purpose or special-purpose computer system. A “network” is defined as one or more data links that enable the transport of electronic data between computer systems and/or modules and/or other electronic devices. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer system, the computer system may view the connection as transmission media. Combinations of the above should also be included within the scope of computer-readable media.
Further, upon reaching various computer system components, program code in the form of computer-executable instructions or data structures can be transferred automatically from transmission media to computer storage media (or vice versa). For example, computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a network interface module (e.g., a “NIC”), and then eventually transferred to computer system RAM and/or to less volatile computer storage media at a computer system. Thus, it should be understood that computer storage media can be included in computer system components that also (or even primarily) utilize transmission media.
Computer-executable instructions comprise, for example, instructions and data which, when executed at one or more processors, cause a general-purpose computer system, special-purpose computer system, or special-purpose processing device to perform a certain function or group of functions. Computer-executable instructions may be, for example, binaries, intermediate format instructions such as assembly language, or even source code.
Those skilled in the art will appreciate that the invention may be practiced in network computing environments with many types of computer system configurations, including, personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, tablets, pagers, routers, switches, and the like. The invention may also be practiced in distributed system environments where local and remote computer systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks. As such, in a distributed system environment, a computer system may include a plurality of constituent computer systems. In a distributed system environment, program modules may be located in both local and remote memory storage devices.
Those skilled in the art will also appreciate that the invention may be practiced in a cloud-computing environment. Cloud computing environments may be distributed, although this is not required. When distributed, cloud computing environments may be distributed internationally within an organization and/or have components possessed across multiple organizations. In this description and the following claims, “cloud computing” is defined as a model for enabling on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services). The definition of “cloud computing” is not limited to any of the other numerous advantages that can be obtained from such a model when properly deployed.
A cloud-computing model can be composed of various characteristics, such as on-demand self-service, broad network access, resource pooling, rapid elasticity, measured service, and so forth. A cloud-computing model may also come in the form of various service models such as, for example, Software as a Service (“SaaS”), Platform as a Service (“PaaS”), and Infrastructure as a Service (“IaaS”). The cloud-computing model may also be deployed using different deployment models such as private cloud, community cloud, public cloud, hybrid cloud, and so forth.
Some examples, such as a cloud-computing environment, may comprise a system that includes one or more hosts that are each capable of running one or more virtual machines. During operation, virtual machines emulate an operational computing system, supporting an operating system and perhaps one or more other applications as well. In some examples, each host includes a hypervisor that emulates virtual resources for the virtual machines using physical resources that are abstracted from view of the virtual machines. The hypervisor also provides proper isolation between the virtual machines. Thus, from the perspective of any given virtual machine, the hypervisor provides the illusion that the virtual machine is interfacing with a physical resource, even though the virtual machine only interfaces with the appearance (e.g., a virtual resource) of a physical resource. Examples of physical resources including processing capacity, memory, disk space, network bandwidth, media drives, and so forth.
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
This application claims the benefit of and priority to U.S. Provisional Patent Application Ser. No. 63/267,455 filed on 2 Feb. 2022 and entitled “DIGITAL HARMONY VISUALIZATION OF COLOR PROPERTIES BETWEEN OBJECTS,” which application is expressly incorporated herein by reference in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2023/061731 | 2/1/2023 | WO |
Number | Date | Country | |
---|---|---|---|
63267455 | Feb 2022 | US |