The present disclosure generally relates to modeling in computer graphics applications, and more particularly to efficient methods of computation used for simulating combustion reactions, some of which might be nonphysical, for use in generating computer-generated images depicting combustion reactions.
Combustion involves so many topics from both chemistry and physics that it is difficult to imagine anything more interdisciplinary. Obviously, chemical kinetics plays a central role, but so do several disciplines of physics, like thermodynamics, statistical mechanics, quantum mechanics, and fluid dynamics to mention just a few.
Combustion is surprisingly challenging from the perspectives of both understanding the fundamental chemical and physical processes, and modeling these processes on a computer. For example, simulating combustion requires an understanding of many advanced topics, such as discrete numerical analysis and multi-variable calculus. Further, accurate physical and chemical models of combustion model complex dynamic processes that occur within extremely short timeframes and at small length scales. For example, chemical reactions typically happen in femtosecond time scales, which produce local shock waves that propagate in the materials at the speed of sound. Regarding length scales, turbulent mixing of fuel and oxidizer plays an important role in non-premixed combustion, which is most common in nature, and occurs at Kolmogorov microscales (which can be as small a few molecules). Additionally, transport of heat, due to phenomena like convection, conduction, and radiation, is notoriously difficult to capture numerically.
Generally speaking, accurately modeling combustion events is not needed for computer graphics applications, which merely attempt to create realistic visual representations, if more efficient processes can used and do not materially affect visual results.
A computer graphics system can generate computer-generated imagery, such as images or frames of a video sequence, that in part might include a visualization of combustion, such as a movie action scene wherein something combusts without there necessarily being a real-world combustion being recorded. It is often desirable that such visualization match well to what would appear in an actual combustion reaction or contrived combustion reaction.
A computer-implemented method of simulating combustion processes might comprise steps under control of one or more computer systems configured with executable instructions, wherein the instructions provide for receiving a first set of data representing a fluid flow including a plurality of combustion precursors, physically realizable or otherwise, simulating a chemical reaction representing simulated combustion of at least some of the plurality of these precursors generating combustion byproducts, determining a change in temperature of the combustion byproducts due to the chemical reaction, determining a change in molar mass of the combustion byproducts due to the chemical reaction, determining a divergence of the combustion byproducts based on a combination of the change in the temperature and the change in molar mass, generating one or more data structures of the simulated combustion based on values of at least a first portion of the fluid flow, and generating a visual representation of the simulated combustion based on the one or more data structures.
The combustion precursors might comprise at least two combustible components and/or at least one non-combustible component. Divergence can be determined based on the change in temperature over time, possibly based on the change in molar mass over time.
The method might further comprise simulating the combustion byproducts as a second portion of the fluid flow having a variable density, wherein the variable density of the fluid flow varies in response to the divergence of a velocity field pertaining to the fluid flow.
At least a second portion of a fluid flow might be treated as incompressible or as compressible.
The method might further comprise generating the one or more data structures of the simulated combustion based on a reduced number of the combustion byproducts.
The method might further comprise configuring the one or more data structures for use by an animation process when generating one or more visual representations of a combustion event, and might further comprise using a convolution kernel to simulate heat diffusion by blurring at least a portion of the one or more visual representations of the combustion event. The convolution kernel might be derived from a heat equation.
The combustion precursors might comprise a linear alkane. The combustion precursors might comprise one or more of methane, ethane, propane, butane, pentane, hexane, heptane, and/or octane.
A computer system for simulating combustion processes might comprise at least one processor and a computer-readable medium might store instructions, which when executed by the at least one processor, causes the system to carry out one or more of the methods described herein. A non-transitory computer-readable storage medium might store instructions, which when such instructions are executed by at least one processor of some computer system or process, causes the computer system or process to carry out one or more of the methods described herein.
Various embodiments in accordance with the present disclosure will be described with reference to the drawings, in which:
In the following description, various embodiments will be described. For purposes of explanation, specific configurations and details are set forth in order to provide a thorough understanding of the embodiments. However, it will also be apparent to one skilled in the art that the embodiments may be practiced without the specific details. Furthermore, well-known features may be omitted or simplified in order not to obscure the embodiment being described.
In the physical world, combustion combines combustion reactants and produces combustion products and heat (and optionally light in the form of photons). The combustion reactants may include oxygen and fuel molecules (e.g., hydrocarbons), which are broken down by the combustion into the combustion products. The combustion products may be molecules (e.g., water and carbon dioxide). Depending upon the type of combustion, both the combustion reactants and the combustion products may be gases.
In some applications, such as computer animation and others, the combustion reactants or combustion precursors may include one or more materials that do not exist in the real or physical world and/or one or more materials that have an unknown chemical composition. Such materials will be referred to as “arbitrary combustion precursors.” Arbitrary combustion precursors may be characterized as being artist-specified components and non-arbitrary combustion precursors may be characterized as being real components. By way of non-limiting examples, arbitrary combustion precursors may include dragon saliva, magic potions, alien materials, fabled materials, mythical materials, fictitious materials, historic materials having unknown chemical compositions (e.g., Greek fire), materials that fuel supernatural flames (e.g., flames emitted by superheroes, gods, the underworld, mythical creatures, etc.), and the like. The arbitrary combustion precursors may be a liquid or a gas. Thus, arbitrary combustion precursors may be included in a fluid flow of combustion precursors. In some instances, a set of parameters defining an initial state might be specified by the artist for the arbitrary combustion precursors, and might not relate to non-arbitrary combustion precursors, i.e., real precursors.
Because combustion is a process, combustion is typically simulated over a combustion duration and its parameter values are calculated periodically (e.g., at discrete times). Thus, at least some of the values of combustion properties 110 may include series of values, with a value corresponding to a different timestamp occurring during the combustion duration. An amount of time between a pair of successive timestamps will be referred to as a time step. While the time steps may be uniform in some examples, that might not necessarily be the case for all embodiments.
Components (e.g., liquids, solids, and/or gases) of a combustion simulation may be divided into a plurality of simulated objects (e.g., particles) and the properties of the simulated objects may be determined for each timestamp during the combustion duration. The simulated objects may be three-dimensional (“3D”) and/or positioned within a 3D space. For example, the simulated objects may correspond to voxels within a 3D visualization. The values of combustion properties 110 may include the values of the properties of the simulated objects. By way of non-limiting examples, the properties of the simulated objects may include divergence (described below), temperature, location, and composition (e.g., fuel, oxygen, nitrogen, soot, carbon dioxide, water, and the like).
As illustrated in
Combustion has been studied and simulated for engineering and scientific purposes, such as for the purposes of propelling vehicles (e.g., space craft and rockets). Generally, such studies and simulations are concerned with changes occurring over short periods of time (e.g., on the order of a few microseconds). On the other hand, some computer graphics applications are concerned only with the appearance of combustion. Therefore, for such computer graphics applications, the combustion simulation system 120 is configured to generate a simplified combustion simulation that includes enough scientific calculations to generate a realistic looking combustion simulation but may employ models of various levels of accuracy of the physical and/or chemical reactions. The combustion simulation system 120 may also be configured to simulate combustion using a larger time step size than is typically used in engineering and scientific applications.
In some computer graphics applications, the combustion simulation system 120 can be configured to optimize computing efficiency by minimizing computational cycles to obtain the appearance of the combustion without including enough scientific calculations that would otherwise require for real world physical and/or chemical reactions, such as, for example, during simulation of a combustion reaction for a rocket thrustor. In other words, the combustion simulation system 120 is capable of reducing the number of parameters or variables, including for example, the number of byproducts, in the simulation to obtain an appearance of a combustion to produce a graphical representation of the combustion, rather than formulating detail calculations required, for example, for finite element simulation of the physical, chemical, thermodynamics and/or kinetics between the reactants and products of a combustion. In a non-limiting example, the combustion simulation system 120 can be configured so that the simulation produces the desired color of a flame (i.e., the appearance of the combustion), rather than determining the temperature that the combustion has to reach in order to produce the desired temperature color, and the various calculations of thermochemical reaction phenomena between reactants and products that would need to be detailed in order to produce the desired flame color.
In some computer graphics applications, the combustion simulation system 120 can be configured to include arbitrary combustion precursors, that may be characterized as being artist-specified components and non-arbitrary combustion precursors may be characterized as being real components. In some computer graphics applications, the combustion simulation system 120 can be configured to include arbitrary combustion precursors in place of non-arbitrary combustion precursors. In some instances, the arbitrary combustion precursors, as well as non-arbitrary combustion precursors may be included in a fluid flow of combustion precursors for the combustion simulation system 120.
The combustion simulation system 120 is configured to receive combustion data 150 and user-defined parameter values 154 as input, and is configured to output the values of the combustion properties 110. The combustion data 150 and/or the user-defined parameter values 154 may be stored by the combustion simulation system 120 and/or another device (e.g., a data storage) connected to the combustion simulation system 120. It should be understood that various elements being operated on, such as the values of the combustion properties 110, are stored as data that can be written to computer memory, read from computer memory, and transmitted between computer processes and/or components.
The combustion simulation system 120 may be characterized as implementing a plurality of solvers that interact with one another. For example, some of the solvers may each calculate a series of parameter values wherein each value in the series corresponds to a different discrete time value (or timestamp). In this manner, the series of parameter values represents how the parameter value changes over time during a combustion event. The solvers may be strongly or loosely coupled together so that different simulations may feed values to one another. In other words, different simulations may be executed simultaneously and, as the simulations step through time, the simulations may exchange parameter values (e.g., force values). The simulations may be configured to perform operator splitting, which means a solution for an original equation is obtained by splitting the original equation into multiple parts, solving each part separately, and combining the solutions.
The plurality of solvers implemented by the combustion simulation system 120 may be characterized as including a physics module 160, a thermodynamics module 162, and a chemistry module 164. However, this functionality need not be divided into multiple modules. Together, the physics module 160, the thermodynamics module 162, and the chemistry module 164 may be characterized as being a combustion model 170. The physics module 160 determines how parts (e.g., gases, fuel, soot, etc.) move during the simulated combustion. Thus, the physics module 160 may implement fluid mechanics. The thermodynamics module 162 determines how heat is transferred during the simulated combustion, which helps determine changes in temperature over time. The chemistry module 164 may implement an adiabatic flame model that helps determine the temperature obtained by the simulated combustion event. Temperature is generally used by the visual content generation system 600 (see
The combustion parameter values 154 may include any parameters that will affect the appearance of a combustion event. By way of non-limiting examples, the combustion parameter values 154 may include an identifier of one or more combustion fuels, an amount of fuel, an atmospheric composition, an initial temperature, a constant thermodynamic pressure, and the like. The combustion parameter values 154 may include parameter values that define one or more arbitrary combustion precursors.
As described below, the visual content generation system 600 (see
As mentioned above, the client computing device 140 is configured to communicate with the combustion simulation system 120. The artist 142 may use the client computing device 140 to specify the combustion parameter values 154 to the combustion simulation system 120. Referring to
Optionally, the graphical user interface may be used enter and/or change the values of any parameters associated with non-arbitrary combustion precursors, such as methane (CH4), ethane (C2H6) propane (C3H8), butane (C4H10), pentane (C5H12), hexane (C6H14), heptane (C7H16), octane (C8H18), and the like. Depending upon the changes made, the parameter values of a non-arbitrary combustion precursor may be changed such that the non-arbitrary combustion precursor is converted into an arbitrary combustion precursor. In such cases, the combustion simulation system 120 will treat the non-arbitrary combustion precursor as an arbitrary combustion precursor. Similarly, if the parameter values of an arbitrary combustion precursor match those of a non-arbitrary combustion precursor, the client computing device 140 may treat the arbitrary combustion precursor as the matching non-arbitrary combustion precursor.
Optionally, the combustion simulation system 120 may be configured to display the values of the combustion properties 110 and/or a simulation based at least in part on the values of the combustion properties 110 to the artist 142 on the client computing device 140 so that the artist 142 may adjust the combustion parameter values 154 as desired before the values of the combustion properties 110 are input into the visual content generation system. As mentioned above, the client computing device 140 is configured to receive the static image(s) and/or the animated video(s) and display the static image(s) and/or the animated video(s) to the artist 142 so that the artist 142 may adjust the combustion parameter values 154. The client computing device 140 may be implemented using the computer system 700 illustrated in
The combustion model 170 may be characterized as being an alternative computational model for combustion that is faithful to the processes of combustion and configured to satisfy the turnaround times required for computer graphics applications. The particular values for the combustion parameter values 154 might be based on actual physically realizable combustion components, such as physical gases. However, an artist might select and input values that do not necessarily correspond to physically realizable combustion but nonetheless result in a desirable simulation and possible visual appearance in rendered imagery that the artist is targeting.
Fluid mechanics is the study of fluid behavior (e.g., liquids and gases) at rest and in motion. The physics module 160 uses fluid mechanics equations to determine how each of the components of the combustion simulation (e.g., represented as simulated objects) moves during the simulated combustion event. The physics module 160 may determine a position for each simulated object for each discrete time period (e.g., timestamp) during the simulated combustion event.
Fluid mechanics is governed by Navier-Stokes equations that are derived from three fundamental laws, namely, conservation of linear momentum, conservation of mass, and conservation of energy. Traditionally, the field of computer graphics assumes that a fluid flow is incompressible. This assumption decouples the energy equation from the other two equations and more importantly leads to a time-independent boundary-value problem (elliptic partial differential equation (“PDE”)) for pressure, in lieu of a time-dependent initial value problem that propagates pressure at the speed of sound in a compressible fluid.
While no fluid is truly incompressible, it is a common assumption for most fluid applications in computer graphics, like modeling water, smoke, and the like. However, combustion is a notable exception because, the significant temperature changes caused by the chemical reactions result in very pronounced local pressure and density changes. Additionally, most combustion events break fuel molecules (e.g., hydrocarbons) into many product molecules (e.g., water and carbon dioxide) which can also cause the fluid to expand, contradicting the notion of an incompressible fluid. Thus, an accurate way to model combustion is through general compressible Navier-Stokes equations that allow for sharp changes in density and pressure (shocks) that propagate at an acoustic speed of the fluid.
As mentioned above, the Navier-Stokes equations are derived from the conservation of linear momentum, conservation of mass, and conservation of energy.
Equation 1 below is the Navier-Stokes equation for a Newtonian fluid, which is derived from conservation of linear momentum (or Newton's second law applied to fluids), also known as the Navier-Stokes Momentum Equation.
In Equation 1 above, a variable “” represents a velocity vector of a moving fluid (e.g., measured in meters per second “/s”), a variable “t” represents time (e.g., measured in seconds “s”), a variable “p” represents density (e.g., measured in kilograms per meter cubed “kg/m3”), a variable “Pmech” represents mechanical pressure (e.g., measured in Newtons per meter squared “N/m2”), a variable “i” represents a gravity vector (e.g., measured in Newtons N), and a variable “μ” represents dynamic viscosity (e.g., measured in kilograms per meter second “kg/(s)”).
A computer graphics system used to generate realistic imagery, such as images and video frames, might be programmed to compute values using the Navier-Stokes Momentum Equation with artist-selected input values and use those computed values to simulate combustion and determine pixel values, such as pixel color values, for imagery created to depict such combustion. In some embodiments, computer resources, such as computational cycles, are at a premium and therefore efficient computational processes for computing results of the Navier-Stokes Momentum Equation and other equations described herein might be important.
In the Navier-Stokes Momentum Equation, the variable “Pmech” represents mechanical pressure and is defined as total force acting on a unit area. The mechanical pressure is normally indistinguishable from thermodynamic pressure, represented by a variable “Ptherm.” below. However, compressible fluids are notable exceptions. In Equation 1, an expression
denotes local acceleration of the fluid, an expression “·∇” describes self-advection (e.g., hyperbolic transport by itself), an expression “∇Pmech” represents force caused by mechanical pressure differences (e.g., internal force), an expression “p{right arrow over (g)}” represents force caused by gravitational pull on mass (e.g., external force), and an expression “μ∇2” represents drag due to viscosity, (e.g., parabolic diffusion of velocity). This set of three (Cartesian axis) coupled PDEs is shared with traditional incompressible fluid models in computer graphics and there are several well-established techniques to solve Equation 1 (e.g., stable fluids or FLIP).
This section explains how a derivation that leads to an approximation of incompressible flows, and explains where and why assuming incompressibility fails for combustion simulations, and this can be used to optimize a computer process that is simulating combustion for visualization purposes.
A modified elliptic PDE is provided that more correctly accounts for rapid and local release of chemical energy, which is arguably a fundamental characteristic of combustion. Equation 2 calculates a mass flow rate (represented by an expression
through a small closed regular surface represented by a variable “∂Ω.” Referring to Equation 2 below, the surface represented by the variable “∂Ω” encloses a volume represented by a variable “Ω” (e.g., a voxel and its six faces). A material with a local density represented by the variable “ρ” is transported (e.g., moves) with a local velocity vector represented by the variable “” A variable “{right arrow over (n)}” represents an outward facing surface normal of the surface represented by the variable “∂Ω.” Equation 2 calculates a total amount of mass passing though the surface per unit time caused by local flux of mass represented by an expression “{right arrow over (J)}m” which equals the local density multiplied by the local velocity vector (which is represented in Equation 2 by an expression “ρ”).
Referring to Equation 3 below, according to the (classical) law of conservation of mass, the mass flow rate represented by the expression
is equal to a total change of material per unit time in the enclosing volume (represented by the variable “Ω”), because the enclosing volume (represented by the variable “Ω”) and volume element (represented by an expression “dV”) are independent of time.
Subtracting Equation 2 from Equation 3 leads to a fundamental relation represented by Equation 4 below.
Applying the divergence theorem to the second term of Equation 4 yields Equation 5 below.
Because Equation 5 is true for any enclosing volume (represented by the variable “Ω”), applying the product rule to a term “∇·(ρ)” of Equation 5, yields Equation 6. Equation 6 may be characterized as being a fundamental equation referred to as a continuity equation that holds true for both compressible fluid flows and incompressible fluid flows.
Equation 7 and Equation 8 involve an infinitesimal fluid particle with density (represented by the variable “ρ”) at time (represented by the variable “t”), traveling along a trajectory (or streamline of the flow) represented by an expression “{right arrow over (x)}(t).” The expression “{right arrow over (x)}(t)” is obtained from a definition
Mathematically, this implies that density (represented by the variable “ρ”) can be represented by a function “ρ({right arrow over (x)}(t),t)” with bold explicit and implicit time-dependencies. Using the chain rule, the function “ρ({right arrow over (x)}(t),t)” can be used to derive a material (or total) derivative with respect to time, which is shown in Equation 8.
Equation 8 can be substituted onto Equation 6 above to create Equation 9, which is an alternative formulation of the continuity equation.
By definition, a flow is incompressible when the total derivative (with respect to time) of the density is zero, which can be expressed as
Thus, for an incompressible flow, ρ∇·=0. Equation 10 below may be derived when ρ>0. Equation 10 applies if and only if a flow is incompressible, meaning the flow has a flow field that is divergence free.
∇·
=0 (Eqn. 10)
If this constraint is applied to the velocity of Equation 6 (the continuity equation), Equation 11 may be obtained. Equation 11 may be characterized as being a transport equation for density in an incompressible flow, which is consistent with setting Equation 8 equal to zero. Thus, Equation 11 may be characterized as expressing the evolution of the density in an incompressible flow.
As an even stricter assumption, the fluid itself (in addition to its flow) may be assumed to be incompressible, which by definition implies that the density of the fluid is constant both with respect to time and space. In other words,
and ∇ρ=0. Inserting this assumption into Equation 6 leads to the same condition for the flow field, namely Equation 10. A flow can be incompressible,
while the fluid is compressible. But, an incompressible fluid always implies that the flow is also incompressible. This is an important yet subtle and often overlooked detail in computer graphics literature on fluid animation, where the terms incompressible flow and incompressible fluid are typically used interchangeably. The justification is that, in computer graphics, the density is often assumed to be constant, which implies that both the fluid and the flow are incompressible. But, in the case of combustion simulation, the density varies due to the chemical reaction, so it is important to consider that the fluid being compressible alone does not necessarily imply that the flow is also compressible. That is, variable density fluids can still be governed by incompressible flows, which is exactly the reason why most existing combustion models in computer graphics assume flows are incompressible.
However, the fluid mechanics of combustion is inherently compressible, not merely because the density varies, but due to the way that it varies
For example, Equation 12 is an equation of state of ideal gases and establishes a simple relationship between the following state variables: thermodynamic pressure (represented by the variable “Ptherm”), volume (represented by the variable “V”), and the absolute temperature (represented by the variable “T” and measured in Kelvin). Additionally, in Equation 12, a variable “n” represents a number of moles and a variable “R” represents an ideal gas constant (8.314 joules per mole Kelvin (“J/molK”)).
P
therm
V=nRT (Eqn. 12)
As mentioned above, the thermodynamic pressure (represented by the variable “Ptherm”) is generally different from the mechanical pressure (represented by the variable “Pmech”), which appears in Equation 1 (the Navier-Stokes Momentum Equation). Formally, the relationship between the thermodynamic pressure and the mechanical pressure is expressed in Equation 13 below. In Equation 13, a variable “γ” represents a material property of the fluid called an expansion (or bulk) viscosity and has a value that is greater than or equal to zero.
P
mech
=P
therm−γ∇· (Eqn. 13)
In most cases, the value of the variable “γ” is small enough that the thermodynamic and mechanical pressures are identical. Obviously, for incompressible flows, the thermodynamic and mechanical pressures are exactly equal because ∇·=0. But, as mentioned earlier, combustion is a notable exception. However, this will not complicate the combustion model 170 if combustion is limited to occurring in open air, which implies that the thermodynamic pressure is fixed to atmospheric pressure (or approximately 1 atmosphere (“atm”)). Unless indicated otherwise, the remainder of this description assumes that combustion takes place at a constant thermodynamic pressure, which is a very common assumption in chemistry, fundamentally satisfied by most laboratory experiments performed in open air. Equation 14 below, is a rewritten version of the ideal gas law. In Equation 14 below, a variable “m” represents mass and a variable “M” represents molar mass. The density (represented by the variable “ρ”) is defined by an expression “m/V” and the number of moles (represented by the variable “n”) is defined by an expression m/M.
Note that Equation 14 assumes that the absolute temperature (represented by the variable “T” and measured in Kelvin) is greater than zero. The ideal gas law is most accurate for (monatomic) gases at high temperatures and low pressures. The ideal gas law states that the density of a gas at constant thermodynamic pressure is inversely proportional to the absolute temperature. Calculating the total derivative with respect to time yields Equation 15.
Combining Equation 15 with Equation 8 yields Equation 16.
In Equation 16, a first term “−∇ρ·” accounts for advection, which is the transport of the density (represented by the variable “p”) by the velocity field (represented by the variable “”). A second term
in Equation 16 accounts for the fact that, under constant thermodynamic pressure, the density increases when the molar mass of the moving fluid increases and the density decreases when the temperature of the moving fluid increases. Note, however, that the rate of change of the density decreases with rising temperature. More precisely, the proportionality factor for the rate of the density change caused by a change of molar mass depends on an expression “T−1” whereas the proportionality factor varies as an expression “T−2” caused by absolute temperature changes. In other words, the effect of temperature changes diminishes faster than the effect of changes in molar mass (e.g., changing mass of molecules as the molecules transition from reactants to products). As illustrated by contrasting Equation 16 with the transport equation represented by Equation 11 for incompressible flows, the combustion model 170 accounts for the combined effects of changing temperatures and changing molecular masses. Equation 9 and Equation 15 may be combined into Equation 17 below, which is an elliptic PDE for the flow field.
As mentioned above, an expression “∇·” is the divergence. In Equation 17, an expression
represents the temperatures of the moving fluids and an expression
represents the molar mass of the moving fluids. Thus, in regions with increasing temperatures of moving fluids (where the expression
is greater than zero), or decreasing molar mass (where the expression
is less than zero), the divergence of the velocity field is positive (or ∇·>0), corresponding to an expansion. Conversely, regions with decreasing temperatures (e.g., due to cooling of products) or increasing molar mass (e.g., due to the formation of heavier molecules), the divergence is negative (or ∇·<0), corresponding to local compression or contraction. Finally, in regions with no temperature and molar mass changes (e.g., ambient air or fuel far from regions of combustion), the flow is incompressible (or ∇·=0). In other words, if the material derivative of the temperature and molar mass is equal to zero
the material derivative of the density is also equal to zero. Thus, the flow is by definition incompressible and divergence free. In other words, if the cause of temperature or molar mass changes is only material transport (or hyperbolic advection), the cause of the change of density is also only material transport (or hyperbolic advection) and the flow remains incompressible. However, during combustion, both temperature and molar mass change due to several different processes other than just simple material transport. Before deriving expressions for
a description of some fundamentals of thermodynamics as well as the chemistry of combustion is provided, as might be used in a computer system that simulates combustion and related processes. In some aspects, ideal simulations for modeling materials, designing equipment, determining safety, and/or other processes might require a certain level of detail, and for computer graphics purposes, simplified (or more complex) operations might be used instead, where such operations provide acceptable graphics outputs.
As mentioned above, the thermodynamics module 162 determines how heat is transferred during the simulated combustion, which helps determine changes in temperature over time. The thermodynamics module 162 uses thermodynamics equations to help determine the temperature of the components of the combustion simulation (e.g., represented as simulated objects) during the simulated combustion event. The thermodynamics module 162 may help determine the temperature of each simulated object for each discrete time period (e.g., timestamp) during the simulated combustion event.
Combustion might be simulated as being governed both by chemical kinetics and thermochemistry of an underlying reaction that converts fuel and oxidizer into combustion products. Accurately modeling chemical kinetics of combustion reactions may be too complex for many computer graphics applications (e.g., involving numerous chemical reactions and sub-species). Instead, these reactions may be simplified (e.g., as explained in a Chemistry of Combustion section below) and it may be assumed that the reactions continue to completion. The effects of chemical equilibrium may be ignored.
According to the first law of thermodynamics, a change of internal energy (represented by an expression “ΔU”) in a closed system is a sum of heat (represented by a variable “Ω”) added to the closed system and an amount of work performed on the closed system. Traditionally this is expressed as Equation 18.
ΔU=Q−W (Eqn. 18)
In Equation 18, a variable “W” represents work performed by the closed system on its surroundings. In other words, the variable “W” represents energy used by the closed system to perform mechanical work, such as compressing or expanding its volume. Heat (represented by the variable “Ω”) is energy added to the closed system, which is not mechanical. In other words, the variable “Ω” represents thermal energy caused by temperature differences between the closed system and its surroundings. While neither the work nor the heat are state functions because they depend on the path versus final and initial states taken by the closed system, the internal energy is a state function.
A variable “H” represents enthalpy, which is defined by Equation 19 below. In Equation 19, a variable “U” represents the internal energy, the variable “Ptherm” represents the thermodynamic pressure, and a variable “V” represents a volume of the closed system.
H≡U+P
therm
V (Eqn. 19)
Given Equation 18 above, which is the first law of thermodynamics, a change of enthalpy (represented by an expression “ΔH”) may be expressed by Equation 20.
ΔH=ΔU+Δ(PthermV)=Q−W+Δ(PthermV) (Eqn. 20)
As mentioned above, the thermodynamic pressure (represented by the variable “Ptherm”) is assumed to be constant, which implies that the work (represented by the variable “W”) is limited to volume change. In other words, W=PthermΔV. Thus, Equation 20 above may be simplified to Equation 21 below. The work described by an expression “PthermΔV” is referred to herein as “PV-work.”
ΔH=Q (Eqn. 21)
In other words, for a closed system, at constant thermodynamic pressure, the enthalpy change equals energy transferred from the environment through heat transfer (or work other than PV-work).
An adiabatic process is defined as a process in which a closed system does not exchange any heat with its surroundings. In other words, the value of the variable “Ω” equals zero for an adiabatic process. Therefore, Equation 21 above reduces to Equation 22 below for an adiabatic process under constant pressure (isobaric).
ΔH=0 (Eqn. 22)
Thus, enthalpy is preserved (or equals zero) for any thermodynamic process of a close system, which is both adiabatic and isobaric. As mentioned above, the combustion model 170 models combustion events in open air, which has a constant atmospheric thermodynamic pressure. The combustion model 170 models reactions assumed to be so fast that no heat is exchanged with the surroundings. Thus, only work is volume change(s) performed at constant thermo-dynamic pressure. This assumption is not valid for combustion occurring inside a closed chamber, like most combustion engines. However, it is a reasonable assumption for deflagrations in open air, but not detonations that are accompanied by shock waves. Shock waves can require modeling of acoustic pressure propagation and in some embodiments, combustion model 170 can be used for combustion events simulated as occurring in open air and might exclude those combustion events that have significant acoustic pressure propagation components.
Combustion may be characterized as being driven by two processes, namely, the release of heat and transfer of heat. Both of these processes manifest in temperature changes throughout the fluid. In thermodynamics, the amount of heat, required to increase the temperature of one kilogram of a substance by one Kelvin is referred to as a specific heat capacity. In Equation 23 below, the specific heat capacity is represented by a variable “C.” As mentioned above, heat is represented by the variable “Q.” If a number of joules of heat is required to change the temperature of one kilogram of the substance by a particular amount (represented by the expression “ΔT”), the specific heat capacity is equal to an expression
Equation 21 states ΔH=Q. Thus, under the assumption of PV-work only, the specific heat capacity at constant thermodynamic pressure (represented by a variable “Cp”) may be expressed in terms of enthalpy by an expression
The expression
may be expressed in differential form as Equation 23.
Equation 23 may be particularly useful for combustion because combustion typically satisfies these assumptions and since enthalpy, unlike heat, is in fact a state variable. Equation 23 can be rewritten in differential form as an expression “dH=CP dT,” which may be written in integral form as Equation 24. In Equation 24, a variable “H1” represents an initial enthalpy and a variable “H2” represents a final enthalpy.
∫H
In Equation 24, an initial state has an initial temperature (represented by a variable “T1”) and a final state has a final temperature (represented by a variable “T2”). This leads to an important relation expressed in Equation 25 below.
H
2
=H
1+∫T
A term “∫T
The specific heat capacity at constant thermodynamic pressure (represented by the variable “Cr”) typically varies with temperature so Equation 26 is a common Taylor-series approximation of the specific heat capacity at constant thermodynamic pressure.
C
P(T)=α+βT+γT2 (Eqn. 26)
Equation 26 can be substituted into Equation 25 to create Equation 27 below.
The polynomial coefficients α, β, and γ may be obtained from tables (and/or included in the combustion data 150) for the chemical components. Further, the initial temperature (represented by a variable “T1”) is known for most combustion events. So, if the initial and final enthalpies (represented by the variables “H1” and “H2,” respectively) are also known, Equation 27 can be solved (numerically) for the final temperature (represented by the variable “T2”).
At this point, Equation 19 has introduced the enthalpy state variable (variable “H”), which has been shown to correspond to heat when the thermodynamic pressure is fixed (see Equation 21), and consequently that enthalpy is a conserved quantity for any adiabatic (no heat exchange) and isobaric process. This means enthalpy may be used to study the fast chemical reactions that occur during combustion when the thermodynamic pressure is constant. Finally, Equation 25 defines sensible (or thermal) enthalpy as the transfer of heat due to temperature differences (separate from the chemical reaction). However, there are other ways to introduce heat into a system and, for combustion, they are related to chemical reactions, which will be discussed in the next section.
As mentioned above, the chemistry module 164 may implement an adiabatic flame model. The chemistry module 164 uses the adiabatic flame model to determine the temperature obtained by the components of the combustion simulation (e.g., represented as simulated objects) during the simulated combustion event. The chemistry module 164 may determine a temperature for each simulated object for each discrete time period (e.g., timestamp) during the simulated combustion event. From these determinations, a computer system can simulate combustion in sufficient detail for use in generating computer-generated imagery.
In part, combustion can be modeled as fuel and an oxidizer (e.g., oxygen or oxygen-bearing molecules) reacting to form combustion outputs. Typically heat is also required, to initiate combustion to a state where the combustion provides enough output heat to continue the reaction until the fuel is consumed or the oxidizer is depleted. Combustion is a chemical reaction wherein the heat involved is a significant factor in how the reaction evolves. Combustion, once started, will end once the fuel is consumed, the oxidizer is depleted, or if sufficient heat is removed to stop the combustion reaction, but can continue until fuel is consumed and the oxidizer is depleted if the heat is not removed. In part, this is because combustion involves the release of heat (or enthalpy at constant pressure) due to the exothermic chemical reactions that turn cold fuel and oxidizer into hot products that heat up surrounding fuel and oxidizer resulting in a chain reaction. This enthalpy of reaction and the enthalpy required to turn the products into their constituent elements being lower than that of the reactants, should be taken into account when simulating combustion. When simulating combustion for the purposes of depicting the simulated combustion graphically, the fuel, oxidizer, and heat can be taken into account and aspects of those, or other details, can be ignored—thus potentially saving computational effort—if those details do not affect the visualization in graphical depictions involving that combustion.
The reaction in
CH4+2(O2+3.76N2)→CO2+2(H2O+3.76N2) (Eqn. 28)
Equation 28 includes a perfectly balanced ratio of methane and oxygen and produces what is referred to as complete combustion. If, instead, an excess of oxidizer is present, the reaction may be represented by Equation 29. In Equation 29, a coefficient “a” has a value greater than two. Equation 29 produces what is referred to as fuel-lean combustion.
CH4+α(O2+3.76N2)→CO2+2H2O+(α−2)O2+3.76αN2 (Eqn. 29)
If, instead, an excess of methane is present, the reaction may be represented by Equation 30 below. In Equation 30, the coefficient “a” has a value greater than zero and less than two. Equation 30 produces what is referred to as fuel-rich combustion.
The coefficient “a” is closely tied to this specific reaction so it is often convenient to introduce a different metric that is independent of the reaction. A fuel-to-oxidizer equivalence ratio (represented by a variable “λ”) is defined as an actual fuel-to-oxidizer ratio to the stoichiometric fuel-to-oxidizer ratio. When the value of the variable “λ” is greater than one, the reaction is fuel-rich or more fuel is present than required for complete combustion, regardless of the type of fuel and oxidizer. Conversely, when the value of the variable “λ” is less than one, the mixture includes excess oxidizer. Thus, the term “rich” means excess fuel is present (the value of the variable “λ” is greater than one), the term “stoichiometric” means a balanced ratio (the value of the variable “λ” equals one), and the term “lean” means excess oxidizer is present (the value of the variable “λ” is less than one).
While many different types of fuel exist, for the sake of brevity, the combustion model 170 will be described with respect to fossil fuels, including linear alkanes (acyclic saturated hydrocarbons) having a form “C2H2n+2.” Non-limiting examples of linear alkanes include natural gases like methane (CH4), ethane (C2H6) propane (C3H8), butane (C4H10), pentane (C5H12), hexane (C6H14), heptane (C7H16), and octane (C8H18). For example, stoichiometric combustion of CA in atmospheric air is described by Equation 31 below.
CnH2n+2αn(O23.76N2)→nCO2+(n+1)H2O+3.76α2N2 (Eqn. 31)
In Equation 31, a constant “αn” expresses a number of oxygen molecules required to completely combust one molecule of CnH2n+2. The constant “αn” is defined by Equation 32 below.
To further complicate matters, most combustion events in atmospheric air are not premixed. Instead pure fuel (e.g., CnH2n+2) interacts with atmospheric air and mixing takes place in a thin interface between fuel and the atmospheric air. Such mixing is caused by diffusion and is referred to as a diffusion flame. This can produce arbitrary fractions of the fuel and oxidizer, which, in general, has to be estimated before the reaction can be deduced. Thus, in general, concentrations of at least fuel (e.g., CnH2n+2), oxidizer (O2), nitrogen (N2), water (H2O), and carbon dioxide (CO2) must be tracked. If the ratio of available oxygen molecules to fuel molecules is larger than the value of the expression
the combustion is fuel-lean. On the other hand, if the ratio of available oxygen molecules to fuel molecules is smaller than the value of the expression
the combustion is fuel-rich. Additionally, if the ratio of available oxygen molecules to fuel molecules is equal to the value of the expression
the combustion is stoichiometric. Temporarily ignoring the nitrogen (N2), because it is neither consumed nor produce, these three cases are represented schematically in
The constant αn is defined by Equation 32 as
In Equation 33, the coefficient “α” represents the actual oxygen to fuel ratio. Thus, the fuel-to-oxidizer equivalence ratio (represented by the variable “λ”) for this reaction may be determined by Equation 33.
If the thermodynamic and chemical properties of carbon dioxide (CO2) and water vapor (H2O) are assumed to be the same (which is a reasonably good approximation), they can be combined into a single type of product, denoted “Prod.” This means one less chemical component needs to be tracked and leads to a simpler diagram illustrated in
A characteristic feature of non-premixed combustion of hydrocarbon fluid (e.g., diffusion flames) is the formation of soot, which is generally agreed to occur within a temperature range of 1300 K to 1600 K. While the chemistry and physics of soot formation in diffusion flames is exceedingly complex, it can be simplified. Equation 34 describes equilibrium. In Equation 34, an expression “Kn⊖(T)” represents an equilibrium constant defined as a ratio of a concentration of soot to fuel.
The equilibrium constant is assumed to be constant within the temperature range of 1300 K to 1600 K and zero otherwise. The value of the equilibrium constant depends at least in part on the type of fuel and may be available in a look-up-tables and/or included in the combustion data 150 (see
Soot is small particles (typically 10-100 nanometers) with 3000-10000 atomic mass units formed by a complex process of chemical reactions and coagulation. Though these particles are technically solids, the particles are small enough to be suspended and transported by the fluid flow. These hot soot particles are incandescent and emit a characteristic yellow glow, which gives rise to the term “luminous flames” for the diffuse (or non-premixed) flames that form soot. Conversely, flames that do not form soot are called non-luminous flames.
During the formation of soot, typically interior to the flame-front, no oxidizer is present, but as the hot soot is ejected by buoyancy forces (caused by local density differences), the hot soot will invariably cross into regions (primarily at the flame tip) with oxidizer where the hot soot will react with the oxidizer to form products. Equation 35 (crudely) models this reaction. In Equation 35, a parameter “a” scales with the size of the soot particles (or more precisely the number of carbon atoms per soot particle), and an expression “Ksoot⊖(T)” an represents a temperature dependent equilibrium constant that depends on the fuel source and size of the flame.
If all of the soot particles are oxidized, the flame is said to be non-sooting and otherwise the flame is referred to as sooting. In other words, even flames that are not accompanied by raising (or visible) soot might still be producing soot internally and hence be luminous flames. Non-luminous flames are always non-sooting, and sooting flames are always luminous flames.
When temperatures are high (typically around 2500K) products (e.g., H2O) start to undergo chemical reactions themselves, that is the products separate or split into smaller molecules or atoms, a process that is referred to as dissociation. For example, carbon dioxide may dissociate into carbon monoxide (CO) and oxygen (O). To help reduce the number of chemical species, the combustion model 170 may ignore dissociation.
The combustion model 170 may track the following five chemical species: CnH2n+2, oxygen (O2), nitrogen (N2), Prod, and Soot. But, if the combustion model 170 represents each species as molar fractions, the combustion model 170 only needs to track four quantities because the fifth quantity can be derived or calculated from the other four quantities because the sum of all of the molar fractions must be one. In other words, the reduction in the number of quantities from five to four can enable a more efficient way to simulate the combustion model approximately, for example, by 20 percent, while keeping the sum of all of the molar fractions to be one. This can be accomplished, for example, by reducing the number of combustion products, as described above with respect to
By reducing the number of combustion byproducts, simulations can be performed in few number of computing cycles compared to tracking all possible chemical species or byproducts.
Referring to
At this point, a model for the chemical reaction of combustion has been provided along with a measure of heat at constant thermodynamic pressure (enthalpy, cf. Equation 21). The chemistry module 164 may use this information to compute the temperature obtained by the simulated combustion event. As mentioned above, the combustion model 170 assumes constant thermodynamic pressure in open air. Additionally, the combustion model 170 assumes the chemical reaction of combustion happens very fast (e.g., virtually instantaneously), which means the release of chemical heat has no time to be exchanged (as thermal heat) with the surroundings, resulting in an adiabatic isobaric combustion process. As shown in Equation 22, this implies that the total enthalpy for the combustion is conserved (or is zero). This enthalpy originates from the chemical reaction and is manifested as reactants at the initial temperature transforming into products at the final temperature. Normally, the initial temperature of the reactants is known, so the challenge is to compute the higher unknown final temperature of the products based on the conservation of energy, which for adiabatic isobaric combustion equals enthalpy. The higher unknown final temperature of the products for adiabatic isobaric combustion is referred to as an adiabatic flame temperature.
Hess's law may be used to compute the adiabatic flame temperature. Hess's law states that a total change of enthalpy for a reaction is independent of a number of steps or stages of the reaction. In other words, the total enthalpy is the same whether the reaction is completed in one step or includes multiple steps. This is a consequence of enthalpy being a state variable, which means enthalpy is independent of the pathway from the reactants to the products of the chemical reaction. Combining Hess's law with the assumption of adiabatic isobaric combustion means that the total enthalpy change occurring in multiple sub-steps must remain zero. This is important because it allows changes of enthalpies for sub-steps to be measured and tabled at fixed conditions and later applied to reactions that take place under different conditions. For example, changes of enthalpies for sub-steps may be included in the combustion data 150 (see
By definition enthalpy is conserved for any adiabatic reaction at constant thermodynamic pressure. Equation 36 expresses the enthalpy of the reaction (represented by an expression “ΔHreaction ⊖combustion”) as a difference between the enthalpy of formation for the products (represented by an expression “ΔHformation⊖products”) and the enthalpy of formation for the reactants (represented by an expression “ΔHformation⊖reactions”).
ΔHreaction⊖combustion=ΔHformation⊖products−ΔHformation⊖reactants (Eqn. 36)
Equation 36 is represented by a cyclic connection of a lower triangle 500 in
ΔHadiabaticcombustion=∫T
Combining Equation 36 and Equation 37 leads to Equation 38 below.
ΔHadiabaticcombustion=∫T
Equation 38 is schematically represented as the cyclic connection of all five stages in
Enthalpy of formation for most chemicals is available in tables and may be included in the combustion data 150 (see
While the adiabatic flame temperature is fixed (when the initial temperature and the chemical reaction are known), surrounding gases that are not undergoing chemical combustion are subject to various processes that change the temperature locally. Simply stated, heat transfer can be defined as a passage of thermal energy from a first (hotter) material to a second (colder) material. This “passage” occurs typically via three distinct processes, namely, convection (or advection), conduction (or diffusion), and radiation. Physically, convection corresponds to heat (or thermal energy) transfer due to material transport, conduction corresponds to temperature differences of materials in contact, and radiation corresponds to electromagnetic emission and absorption.
Deriving the transport and diffusion equations are relatively straightforward for incompressible fluids, but the combustion model 170 explicitly allows for variable density (as well as temperature). Below, derivations of the heat transfer equation used by the combustion model 170 are provided.
As a gas is being advected by a fluid velocity field, the temperature, which is a material property of the molecules of the gas, undergoes the same transport. Equation 39 calculates a thermal energy (or heat) per unit volume (represented by a variable “Qden”) contained in a fluid as a function of the density (represented by the variable “ρ”), an absolute temperature (represented by the variable “T”), and the specific heat capacity at constant thermodynamic pressure (represented by the variable “Cp”). The thermal energy (or heat) per unit volume is sometimes referred to as a thermal energy density of the fluid.
Q
den
=ρC
P
T (Eqn. 39)
Next, consider a small volume of fluid (represented by a variable “Ω”) with a surface area (represented by an expression “∂Ω”). The rate of change of thermal heat in the volume of fluid (represented by the variable “Ω”) may be expressed by Equation 40 and Equation 41. In Equation 40 and Equation 41, it is assumed that the specific heat capacity (represented by the variable “Cp”) is time-independent within the volume of fluid (represented by the variable “Ω”), and the volume of fluid is fixed in time.
If the fluid is moving with a velocity (represented by a variable “”), the heat flux due to advection may be expressed as “{right arrow over (J)}adv=ρCpT” and the rate of change of thermal heat due to motion is given by Equation 42 and Equation 43 below.
If (for now) convection (or fluid motion) is assumed to be the only mechanism of heat transfer, conservation of energy implies that the sum of Equation 41 and Equation 43 is zero. This relationship is shown in Equation 44 below.
After some re-factoring this leads to Equation 45 below, which in turn implies (since the volume of fluid represented by the variable “Ω” is arbitrary) that the kernel of the volume integral must be zero.
As explained above, the continuity equation (Equation 6) may be expressed as
which when combined with ρ>0 and Cp>0 leads to Equation 46 below. Equation 46 is a transport equation for the absolute temperature, which is a prototypical hyperbolic transport equation.
Equation 46 resembles Equation 11, which is the transport equation for density in an incompressible flow. While Equation 46 models the physical phenomena of convection, the mathematical terminology is (hyperbolic) advection.
Conduction is the transport of heat caused by physical contact between (instead of motion by) molecules. Heat flux (represented by a variable “{right arrow over (J)}dif”) may be measured in energy per unit time and unit area (e.g., W/m2). Equation 47 is Fourier's law. According to Fourier's law, the heat flux through a surface is proportional to a negative gradient of the temperature (e.g., measured in K/m) across the surface (represented by an expression “∇T”). In Equation 47, a variable “k” represents the thermal conductivity (e.g., measured in W/mK). The thermal conductivity (represented by the variable “k”) may be 0.026 W/(mK) for air. The subscript “dif” in the variable “{right arrow over (J)}dif” refers to diffusion, which is the fundamental mechanism for this type of heat transfer.
{right arrow over (J)}
dif
=−k∇T (Eqn. 47)
Integrating the heat flux over the surface area (represented by the expression “∂Ω”) of a small fluid volume (represented by the variable “Ω”) yields Equation 48 and Equation 49.
Combining the effects of advection and diffusion implies Equation 50 and Equation 51 below.
When
ρ>0, and Cp>0, Equation 52, which is a PDE, may be obtained.
A first term “−·∇T” on the right-hand-side of Equation 52 accounts for transport (advection) and a second term
on me right-hand-side of Equation 52 models diffusion though the Laplacian differential operator. Physicists refer to this as convection-diffusion whereas mathematicians tend to call it advection-diffusion. Equation 52 reduces to Equation 53 below if the fluid is assumed to be stationary, ={right arrow over (O)}.
In Equation 53,
is known as the thermal diffusivity of the medium. Equation 53 is a prototypical parabolic PDE, which is simply dubbed “the heat equation.” But, it is important to note that Equation 53 accounts for only one of three fundamental mechanisms of heat transfer, namely conduction. Equation 52, which was derived for heat advection-diffusion for a compressible fluid model, is actually identical to its incompressible counterpart, typically employed in computer graphics. This implies that a computer process computing values using Equation 52 would not have to deal with additional complications in its numerical implementation.
Solving the heat equation may be computationally expensive. But, a well-known mathematical technique exists for obtaining a general or fundamental solution to many PDEs, like the heat equation. Thus, a fundamental solution may be generated for the heat equation (and included in the combustion data 150). Then, concrete solutions can be generated from the fundamental solution using convolution. In computer graphics, convolution causes or is depicted as blurring. Such blurring may be applied to a visual representation using a convolution kernel (e.g., a Gaussian kernel). Thus, solving the heat equation may be reduced to blurring with a convolution kernel, which can be done efficiently. The convolution kernel may be derived from the heat equation. The size of the convolution kernel may be based at least in part on the timestamp (or time step), and the viscosity or the diffusion coefficient. For example, smaller timestamps (or time steps) may yield smaller convolution kernels.
Heat transfer caused by electromagnetic radiation is notoriously difficult to model since such heat transfer is based on complex interactions over long distances (much like global illumination). As such, the combustion model 170 aims at capturing the essence of heat transfer caused by electromagnetic radiation and model it with an additional term to the convection-diffusion PDE (Equation 52) that approximates its behavior.
A simple classical model for thermal radiation is the blackbody model and radiation from an idealized blackbody model can be expressed by Planck's law, which is Equation 54 below.
Planck's law describes an amount of heat (or energy) emitted per unit time, wavelength, and surface area from an idealized blackbody model as a function of its absolute temperature (represented by a variable “T”) when the absolute temperature is greater than zero. When integrated over all wavelengths (represented by a variable “λ”), Planck's law reduces to Equation 55, which is known as the Stefan-Boltzmann law.
Equation 55 includes the Stefan-Boltzmann constant
in which the variable “k” represents the Boltzmann constant, a variable “c” represents the speed of light in vacuum, and a variable “h” represents Planck's constant. To allow for this simple power law to be applied to more general materials (sometimes called graybody materials), Equation 56 below introduces a unit-less parameter “E.” In Equation 56, a variable “
{right arrow over (J)}
rad
=∈σT
4
{right arrow over (n)} (Eqn. 56)
Several problems arise when a model of thermal radiation for combustion is based on the Stefan-Boltzmann law. First, the model would apply only to solids and not gases. So, soot is actually the only material in the combustion model 170 that can be reasonably modeled by the Stefan-Boltzmann law. In fact, this is a fairly good model for the incandescence of luminous flames, but not for the light emission from the hot gases. Second, solving heat transfer due to blackbody radiation in a fluid, despite the deceivingly simple power relation, is exceedingly complicated. In fact, so much so that many scientific simulation techniques approximate and even ignore this effect. The reason is for this is that this resembles global illumination in complexity where all materials are simultaneously emitting and absorbing photons. The combustion model 170 attempts to model this phenomena with a term that at least captures the essence of this mechanism under severe assumptions. As such, the following may be considered an approximation.
If a graybody with a temperature (represented by the variable “T”) is embedded in an ambient space with a constant temperature (represented by the variable “Tamb”), the normal flux of radiation per surface area away from this body may be determined by Equation 57. In Equation 57, the variable “{right arrow over (n)}” represents the local surface normal of the graybody. Both the material temperature and ambient temperature (represented by the variables “T” and “Tamb,” respectively) are measured in kelvin.
{right arrow over (J)}
rad=∈σ(T4−Tamb4){right arrow over (n)} (Eqn. 57)
For a volume (represented by the variable “Ω”) with a surface area (represented by the expression “∂Ω”), Equation 58 may be used to determine a total rate of change of energy due to heat flux.
Equation 59 may be obtained when the volume (represented by the variable “Ω”) is a very small sphere, because both the temperature and the ambient temperature (represented by the variables “T” and “Tamb,” respectively) can be assumed to be constant and
with a variable “r” representing the radius of the sphere. The radius may be conceptualized as being a characteristic length scale of the radiation model (such as the voxel size).
The total energy balance from heat exchange due to the combined effects of convection, conduction and radiation may be expressed as Equation 60 below.
Equation 60 implies Equation 61 below, which is an integral equation.
Finally, since Equation 61 must hold for any small spherical volume, Equation 62 below, which is a PDE, may be obtained for the absolute temperature. Equation 62 is an equation of evolution for temperature.
The model of radiation may be considered to be a gross oversimplification because the ambient temperature (represented by the variable “Tamb”) is far from constant in time or space, but the ambient temperature captures the spirit of radiative cooling. As such, the ambient temperature (represented by the variable “Tamb”) is defined as an average temperature of the surroundings that exchange heat through radiation with the fluid.
For example,
Still images that are output by visual content generation system 600 might be represented in computer memory as pixel arrays, such as a two-dimensional array of pixel color values, each associated with a pixel having a position in a two-dimensional image array. Pixel color values might be represented by three or more (or fewer) color values per pixel, such as a red value, a green value, and a blue value (e.g., in RGB format). Dimensions of such a two-dimensional array of pixel color values might correspond to a preferred and/or standard display scheme, such as 1920-pixel columns by 1280-pixel rows or 4096-pixel columns by 2160-pixel rows, or some other resolution. Images might or might not be stored in a compressed format, but either way, a desired image may be represented as a two-dimensional array of pixel color values. In another variation, images are represented by a pair of stereo images for three-dimensional presentations and in other variations, an image output, or a portion thereof, might represent three-dimensional imagery instead of just two-dimensional views. In yet other embodiments, pixel values are data structures and a pixel value is associated with a pixel and can be a scalar value, a vector, or another data structure associated with a corresponding pixel. That pixel value might include color values, or not, and might include depth values, alpha values, weight values, object identifiers or other pixel value components.
A stored video sequence might include a plurality of images such as the still images described above, but where each image of the plurality of images has a place in a timing sequence and the stored video sequence is arranged so that when each image is displayed in order, at a time indicated by the timing sequence, the display presents what appears to be moving and/or changing imagery. In one representation, each image of the plurality of images is a video frame having a specified frame number that corresponds to an amount of time that would elapse from when a video sequence begins playing until that specified frame is displayed. A frame rate might be used to describe how many frames of the stored video sequence are displayed per unit time. Example video sequences might include 24 frames per second (24 FPS), 50 FPS, 140 FPS, or other frame rates. In some embodiments, frames are interlaced or otherwise presented for display, but for clarity of description, in some examples, it is assumed that a video frame has one specified display time, but other variations might be contemplated.
One method of creating a video sequence is to simply use a video camera to record a live action scene, i.e., events that physically occur and can be recorded by a video camera. The events being recorded can be events to be interpreted as viewed (such as seeing two human actors talk to each other) and/or can include events to be interpreted differently due to clever camera operations (such as moving actors about a stage to make one appear larger than the other despite the actors actually being of similar build, or using miniature objects with other miniature objects so as to be interpreted as a scene containing life-sized objects).
Creating video sequences for story-telling or other purposes often calls for scenes that cannot be created with live actors, such as a talking tree, an anthropomorphic object, space battles, and the like. Such video sequences might be generated computationally rather than capturing light from live scenes. In some instances, an entirety of a video sequence might be generated computationally, as in the case of a computer-animated feature film. In some video sequences, it is desirable to have some computer-generated imagery and some live action, perhaps with some careful merging of the two.
While computer-generated imagery might be creatable by manually specifying each color value for each pixel in each frame, this is likely too tedious to be practical. As a result, a creator uses various tools to specify the imagery at a higher level. As an example, an artist (e.g., artist 142 illustrated in
In a specific example, a rendering engine performs ray tracing wherein a pixel color value is determined by computing which objects lie along a ray traced in the scene space from the camera viewpoint through a point or portion of the camera view plane that corresponds to that pixel. For example, a camera view plane might be represented as a rectangle having a position in the scene space that is divided into a grid corresponding to the pixels of the ultimate image to be generated, and if a ray defined by the camera viewpoint in the scene space and a given pixel in that grid first intersects a solid, opaque, blue object, that given pixel is assigned the color blue. Of course, for modem computer-generated imagery, determining pixel colors—and thereby generating imagery—can be more complicated, as there are lighting issues, reflections, interpolations, and other considerations.
As illustrated in
In a specific live action capture system, cameras 606(1) and 606(2) capture the scene, while in some systems, there might be other sensor(s) 608 that capture information from the live scene (e.g., infrared cameras, infrared sensors, motion capture (“mo-cap”) detectors, etc.). On stage 604, there might be human actors, animal actors, inanimate objects, background objects, and possibly an object such as a green screen 610 that is designed to be captured in a live scene recording in such a way that it is easily overlaid with computer-generated imagery. Stage 604 might also contain objects that serve as fiducials, such as fiducials 612(1)-(3), that might be used post-capture to determine where an object was during capture. A live action scene might be illuminated by one or more lights, such as an overhead light 614.
During or following the capture of a live action scene, live action capture system 602 might output live action footage to a live action footage storage 620. A live action processing system 622 might process live action footage to generate data about that live action footage and store that data into a live action metadata storage 624. Live action processing system 622 might include computer processing capabilities, image processing capabilities, one or more processors, program code storage for storing program instructions executable by the one or more processors, as well as user input devices and user output devices, not all of which are shown. Live action processing system 622 might process live action footage to determine boundaries of objects in a frame or multiple frames, determine locations of objects in a live action scene, where a camera was relative to some action, distances between moving objects and fiducials, etc. Where elements have sensors attached to them or are detected, the metadata might include location, color, and intensity of overhead light 614, as that might be useful in post-processing to match computer-generated lighting on objects that are computer-generated and overlaid on the live action footage. Live action processing system 622 might operate autonomously, perhaps based on predetermined program instructions, to generate and output the live action metadata upon receiving and inputting the live action footage. The live action footage can be camera-captured data as well as data from other sensors.
An animation creation system 630 is another part of visual content generation system 600. Animation creation system 630 might include computer processing capabilities, image processing capabilities, one or more processors, program code storage for storing program instructions executable by the one or more processors, as well as user input devices and user output devices, not all of which are shown. Animation creation system 630 might be used by animation artists, managers, and others to specify details, perhaps programmatically and/or interactively, of imagery to be generated. From user input and data from a database or other data source, indicated as a data store 632, animation creation system 630 might generate and output data representing objects (e.g., a horse, a human, a ball, a teapot, a cloud, a light source, a texture, etc.) to an object storage 634, generate and output data representing a scene into a scene description storage 636, and/or generate and output data representing animation sequences to an animation sequence storage 638.
Scene data might indicate locations of objects and other visual elements, values of their parameters, lighting, camera location, camera view plane, and other details that a rendering engine 650 might use to render CGI imagery. For example, scene data might include the locations of several articulated characters, background objects, lighting, etc. specified in a two-dimensional space, three-dimensional space, or other dimensional space (such as a 2.5-dimensional space, three-quarter dimensions, pseudo-3D spaces, etc.) along with locations of a camera viewpoint and view place from which to render imagery. For example, scene data might indicate that there is to be a red, fuzzy, talking dog in the right half of a video and a stationary tree in the left half of the video, all illuminated by a bright point light source that is above and behind the camera viewpoint. In some cases, the camera viewpoint is not explicit, but can be determined from a viewing frustum. In the case of imagery that is to be rendered to a rectangular view, the frustum would be a truncated pyramid. Other shapes for a rendered view are possible and the camera view plane could be different for different shapes.
Animation creation system 630 might be interactive, allowing a user to read in animation sequences, scene descriptions, object details, etc. and edit those, possibly returning them to storage to update or replace existing data. As an example, an operator might read in objects from object storage into a baking processor 642 that would transform those objects into simpler forms and return those to object storage 634 as new or different objects. For example, an operator might read in an object that has dozens of specified parameters (movable joints, color options, textures, etc.), select some values for those parameters and then save a baked object that is a simplified object with now fixed values for those parameters.
Rather than requiring user specification of each detail of a scene, data from data store 632 might be used to drive object presentation. For example, if an artist is creating an animation of a spaceship passing over the surface of the Earth, instead of manually drawing or specifying a coastline, the artist might specify that animation creation system 630 is to read data from data store 632 in a file containing coordinates of Earth coastlines and generate background elements of a scene using that coastline data.
Animation sequence data might be in the form of time series of data for control points of an object that has attributes that are controllable. For example, an object might be a humanoid character with limbs and joints that are movable in manners similar to typical human movements. An artist can specify an animation sequence at a high level, such as “the left hand moves from location (X1, Y1, Z1) to (X2, Y2, Z2) over time T1 to T2”, at a lower level (e.g., “move the elbow joint 2.5 degrees per frame”) or even at a very high level (e.g., “character A should move, consistent with the laws of physics that are given for this scene, from point P1 to point P2 along a specified path”).
Animation sequences in an animated scene might be specified by what happens in a live action scene. An animation driver generator 644 might read in live action metadata, such as data representing movements and positions of body parts of a live actor during a live action scene. Animation driver generator 644 might generate corresponding animation parameters to be stored in animation sequence storage 638 for use in animating a CGI object. This can be useful where a live action scene of a human actor is captured while wearing mo-cap fiducials (e.g., high-contrast markers outside actor clothing, high-visibility paint on actor skin, face, etc.) and the movement of those fiducials is determined by live action processing system 622. Animation driver generator 644 might convert that movement data into specifications of how joints of an articulated CGI character are to move over time.
A rendering engine 650 can read in animation sequences, scene descriptions, and object details, as well as rendering engine control inputs, such as a resolution selection and a set of rendering parameters. Resolution selection might be useful for an operator to control a trade-off between speed of rendering and clarity of detail, as speed might be more important than clarity for a movie maker to test some interaction or direction, while clarity might be more important than speed for a movie maker to generate data that will be used for final prints of feature films to be distributed. Rendering engine 650 might include computer processing capabilities, image processing capabilities, one or more processors, program code storage for storing program instructions executable by the one or more processors, as well as user input devices and user output devices, not all of which are shown.
Visual content generation system 600 can also include a merging system 660 that merges live footage with animated content. The live footage might be obtained and input by reading from live action footage storage 620 to obtain live action footage, by reading from live action metadata storage 624 to obtain details such as presumed segmentation in captured images segmenting objects in a live action scene from their background (perhaps aided by the fact that green screen 610 was part of the live action scene), and by obtaining CGI imagery from rendering engine 650.
A merging system 660 might also read data from rulesets for merging/combining storage 662. A very simple example of a rule in a ruleset might be “obtain a full image including a two-dimensional pixel array from live footage, obtain a full image including a two-dimensional pixel array from rendering engine 650, and output an image where each pixel is a corresponding pixel from rendering engine 650 when the corresponding pixel in the live footage is a specific color of green, otherwise output a pixel value from the corresponding pixel in the live footage.”
Merging system 660 might include computer processing capabilities, image processing capabilities, one or more processors, program code storage for storing program instructions executable by the one or more processors, as well as user input devices and user output devices, not all of which are shown. Merging system 660 might operate autonomously, following programming instructions, or might have a user interface or programmatic interface over which an operator can control a merging process. In some embodiments, an operator can specify parameter values to use in a merging process and/or might specify specific tweaks to be made to an output of merging system 660, such as modifying boundaries of segmented objects, inserting blurs to smooth out imperfections, or adding other effects. Based on its inputs, merging system 660 can output an image to be stored in a static image storage 670 and/or a sequence of images in the form of video to be stored in an animated/combined video storage 672.
Thus, as described, visual content generation system 600 can be used to generate video that combines live action with computer-generated animation using various components and tools, some of which are described in more detail herein. While visual content generation system 600 might be useful for such combinations, with suitable settings, it can be used for outputting entirely live action footage or entirely CGI sequences. The code may also be provided and/or carried by a transitory computer readable medium, e.g., a transmission medium such as in the form of a signal transmitted over a network.
According to one embodiment, the techniques described herein are implemented by one or more generalized computing systems programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. Special-purpose computing devices may be used, such as desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
For example,
Computer system 700 also includes a main memory 706, such as a random-access memory (RAM) or other dynamic storage device, coupled to bus 702 for storing information and instructions to be executed by processor 704. Main memory 706 may also be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 704. Such instructions, when stored in non-transitory storage media accessible to processor 704, render computer system 700 into a special-purpose machine that is customized to perform the operations specified in the instructions.
Computer system 700 further includes a read only memory (ROM) 708 or other static storage device coupled to bus 702 for storing static information and instructions for processor 704. A storage device 710, such as a magnetic disk or optical disk, is provided and coupled to bus 702 for storing information and instructions.
Computer system 700 may be coupled via bus 702 to a display 712, such as a computer monitor, for displaying information to a computer user. An input device 714, including alphanumeric and other keys, is coupled to bus 702 for communicating information and command selections to processor 704. Another type of user input device is a cursor control 716, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 704 and for controlling cursor movement on display 712. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
Computer system 700 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system 700 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by computer system 700 in response to processor 704 executing one or more sequences of one or more instructions contained in main memory 706. Such instructions may be read into main memory 706 from another storage medium, such as storage device 710. Execution of the sequences of instructions contained in main memory 706 causes processor 704 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
The term “storage media” as used herein refers to any non-transitory media that store data and/or instructions that cause a machine to operation in a specific fashion. Such storage media may include non-volatile media and/or volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device 710. Volatile media includes dynamic memory, such as main memory 706. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media includes coaxial cables, copper wire, and fiber optics, including the wires that include bus 702. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 704 for execution. For example, the instructions may initially be carried on a magnetic disk or solid-state drive of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a network connection. A modem or network interface local to computer system 700 can receive the data. Bus 702 carries the data to main memory 706, from which processor 704 retrieves and executes the instructions. The instructions received by main memory 706 may optionally be stored on storage device 710 either before or after execution by processor 704.
Computer system 700 also includes a communication interface 718 coupled to bus 702. Communication interface 718 provides a two-way data communication coupling to a network link 720 that is connected to a local network 722. For example, communication interface 718 may be a network card, a modem, a cable modem, or a satellite modem to provide a data communication connection to a corresponding type of telephone line or communications line. Wireless links may also be implemented. In any such implementation, communication interface 718 sends and receives electrical, electromagnetic, or optical signals that carry digital data streams representing various types of information.
Network link 720 typically provides data communication through one or more networks to other data devices. For example, network link 720 may provide a connection through local network 722 to a host computer 724 or to data equipment operated by an Internet Service Provider (ISP) 726. ISP 726 in turn provides data communication services through the world-wide packet data communication network now commonly referred to as the “Internet” 728. Local network 722 and Internet 728 both use electrical, electromagnetic, or optical signals that carry digital data streams. The signals through the various networks and the signals on network link 720 and through communication interface 718, which carry the digital data to and from computer system 700, are example forms of transmission media.
Computer system 700 can send messages and receive data, including program code, through the network(s), network link 720, and communication interface 718. In the Internet example, a server 730 might transmit a requested code for an application program through the Internet 728, ISP 726, local network 722, and communication interface 718. The received code may be executed by processor 704 as it is received, and/or stored in storage device 710, or other non-volatile storage for later execution.
Operations of processes described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. Processes described herein (or variations and/or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions and may be implemented as code (e.g., executable instructions, one or more computer programs or one or more applications) executing collectively on one or more processors, by hardware or combinations thereof. The code may be stored on a computer-readable storage medium, for example, in the form of a computer program comprising a plurality of instructions executable by one or more processors. The computer-readable storage medium may be non-transitory. The code may also be provided carried by a transitory computer readable medium e.g., a transmission medium such as in the form of a signal transmitted over a network.
Conjunctive language, such as phrases of the form “at least one of A, B, and C,” or “at least one of A, B and C,” unless specifically stated otherwise or otherwise clearly contradicted by context, is otherwise understood with the context as used in general to present that an item, term, etc., may be either A or B or C, or any nonempty subset of the set of A and B and C. For instance, in the illustrative example of a set having three members, the conjunctive phrases “at least one of A, B, and C” and “at least one of A, B and C” refer to any of the following sets: {A}, {B}, {C}, {A, B}, {A, C}, {B, C}, {A, B, C}. Thus, such conjunctive language is not generally intended to imply that certain embodiments require at least one of A, at least one of B and at least one of C each to be present.
The use of examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the invention.
In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The sole and exclusive indicator of the scope of the invention, and what is intended by the applicants to be the scope of the invention, is the literal and equivalent scope of the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction.
Further embodiments can be envisioned to one of ordinary skill in the art after reading this disclosure. In other embodiments, combinations or sub-combinations of the above-disclosed invention can be advantageously made. The example arrangements of components are shown for purposes of illustration and combinations, additions, re-arrangements, and the like are contemplated in alternative embodiments of the present invention. Thus, while the invention has been described with respect to exemplary embodiments, one skilled in the art will recognize that numerous modifications are possible.
For example, the processes described herein may be implemented using hardware components, software components, and/or any combination thereof. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. It will, however, be evident that various modifications and changes may be made thereunto without departing from the broader spirit and scope of the invention as set forth in the claims and that the invention is intended to cover all modifications and equivalents within the scope of the following claims.
All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and were set forth in its entirety herein.
This application claims the benefit of U.S. Provisional application No. 63/003,081, filed on Mar. 31, 2020, which is incorporated by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
63003081 | Mar 2020 | US |