Patent Application
20210012512
Implementations of the disclosure describe systems and methods for training and using a model to accurately track the jaw of a subject during facial performance capture based on the facial skin motion of the subject.
In one embodiment, a method comprises: capturing facial training data for one or more subjects, the captured facial training data including each of the one or more subject's facial skin geometry tracked over a plurality of times and the subject's corresponding jaw poses for each of those plurality of times; and using the captured facial training data to create a model that provides a mapping from skin motion to jaw motion. The mapping may be from a set of skin features that define the skin motion to a set of jaw features that define the jaw motion. In particular implementations, the jaw features are displacements of jaw points.
In some implementations, the facial training data is captured for a plurality of subjects over a plurality of facial expressions. In some implementations, using the captured facial training data to create a model that provides a mapping from the set of skin features that define the skin motion to the set of jaw features that define the jaw motion, comprises: for a first of the plurality of subjects, using the first subject's facial skin geometry captured over a plurality of times and the first subject's corresponding jaw poses for each of those plurality of times to learn a first mapping from a set of skin features to a set of jaw features; using the first mapping to align facial skin geometry of the other plurality of subjects with facial skin geometry of the first subject; and learning a second mapping from a set of skin features to a set of jaw features, using the first subject's facial skin geometry, the other subject's aligned facial skin geometry, and the each of the plurality of subject's corresponding jaw poses.
In some implementations, using the captured facial training data to create the model, comprises for at least one of the one or more subjects: selecting points on the subject's jaw while the subject is in a rest pose; for each of the selected points, finding a corresponding point on the face to determine skin feature points in the rest pose; and for each of a plurality of frames: tracking a position of the skin feature points to derive skin features; and tracking a displacement between a current position of the selected points on the subject's jaw and a position of the selected points on the subject's jaw in the rest pose to derive target displacements of the jaw.
In some implementations, using the captured facial training data to create the model, comprises training a regression from the set of skin features to the set of jaw features. In some implementations, training the regression comprises training a regressor for each of the selected points on the subject's jaw to independently predict a displacement of each of the selected points of the jaw.
In some implementations, the method further comprises: using the created model to predict a jaw pose of a subject for a time using as an input the subject's corresponding facial skin geometry for the time. The subject for which the jaw pose is predicted may be one of the one or more subjects for which the facial training data is captured. Alternatively, the subject for which the jaw pose is predicted may be a new subject different from the one or more subjects for which the facial training data is captured.
In some implementations, the method further comprises: capturing a plurality of calibration poses for the new subject; extracting calibration skin features and corresponding calibration bone features from each of the plurality of captured calibration poses; and sing at least the extracted calibration skin features and corresponding calibration bone features, determining a transformation of skin features of the new subject to align with a feature space the mapping.
In some implementations, using the created model to predict a jaw pose of a subject for a time using as an input the subject's corresponding facial skin geometry for the time, comprises: determining skin motion relative to a skull of the subject; using the created model to predict jaw motion of the subject; and predicting the jaw pose from the predicted jaw motion.
In one embodiment, a method comprises: determining a facial skin geometry of a subject; using a model that provides a mapping from skin motion to jaw motion to predict a motion of the subject's jaw from a rest pose given the facial skin geometry; and determining a jaw pose of the subject using the predicted motion of the subject's jaw.
In some implementations, the mapping is from a set of skin features that define the skin motion to a set of jaw features that define the jaw motion. In some implementations, the method further comprises: extracting skin features from the determined facial skin geometry of the subject; and prior to predicting the motion of the subject's jaw, transforming the extracted skin features of the subject to align with a feature space of the mapping, wherein the mapping is created using facial skin features of another subject.
In some implementations, the set of jaw features are displacements of jaw points, wherein using the model to predict the jaw motion comprises: predicting displacements between current positions of points on the subject's jaw and a position of points of the subject's jaw in the rest pose given a position of facial skin features determined from the facial skin geometry; and wherein determining the jaw pose of the subject comprises fitting the subject's jaw using the predicted displacements.
Other features and aspects of the disclosed method will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the features in accordance with embodiments of the disclosure. The summary is not intended to limit the scope of the claimed disclosure, which is defined solely by the claims attached hereto.
The present disclosure, in accordance with one or more various embodiments, is described in detail with reference to the following figures. The figures are provided for purposes of illustration only and merely depict typical or example embodiments of the disclosure.
The figures are not exhaustive and do not limit the disclosure to the precise form disclosed.
Generating realistic facial animation may be an important aspect in the creation of digital characters for computer games, visual effects for film, and other virtual experiences. The underlying jaw may be an important aspect of the face, as the jaw's motion may be used to control the deformation of the face surface using methods like skinning. For this reason, many facial animation rigs contain an explicit jaw rig.
A significant amount of character facial animation is created through performance capture, in a process where a real actor is recorded and the facial surface is reconstructed and tracked to provide a digital performance that exactly matches the real one. The digital performance may then be provided to the animator as a starting point for further manipulation, which may involve a retargeting step to a fantasy creature or another human for final display. During this process, it may be important to know the jaw motion that corresponds to the captured facial performance of the actor.
Accurate jaw tracking has been studied in fields such as dentistry and speech analysis, however typically at the cost of complicated setups and invasive instruments such as electromagnetic sensors or fiducial markers attached to the teeth. In the computer graphics and visual effect communities, artists typically perform jaw tracking either fully manually (e.g., using markers attached to the teeth/jaw of the actor) or inaccurately by naively assuming skin motion around jaw line is equal to the jaw motion. The latter method neglects skin sliding, and produces inadequate results. Accordingly, there is a need for accurately tracking the jaw during facial performance capture or during facial motion capture without attaching markers or tracking teeth.
To this end, various implementations of the disclosure are directed to accurately tracking the jaw of a subject during facial performance capture without the need for attaching markers or tracking teeth. In accordance with implementations described herein, accurate jaw tracking for facial performances may be achieved using only the tracked facial surface as input. In such implementations, a non-linear mapping from skin motion to underlying jaw motion may be learned for one or more subjects for which a ground-truth jaw poses are obtained. As further described below, this mapping may be utilized for the same subjects for which the ground-truth jaw motion is obtained, or it may be transferred onto new subjects, for which ground truth jaw motion (e.g., marker based jaw tracking) is not available, rendering the techniques described herein applicable to traditional facial performance acquisition.
As noted above, in production, jaw tracking may be a very manual and labor intensive step, where artists leverage the teeth wherever visible and/or estimate the jaw pose from the perceived surface. Aside from the required effort, which may be very substantial, manual tracking offers a lot of potential for human error, which may manifest itself in the final character. As such, by virtue of implementing the techniques described herein, jaw tracking may be automated at a high accuracy while removing human error. Further, by virtue of implementing the techniques described herein, jaw tracking may achieve at a high accuracy without imposing any additional requirements onto the actor or the setup during acquisition. Moreover, the techniques described herein may be readily integrated with off-the-shelf facial performance capture systems.
These and other advantages that may be realized from implementing the systems and methods described may be further appreciated from the disclosure.
During operation 310, data acquisition and model generation system 100 is configured to capture facial training data 101 for one or more subjects, the captured facial training data for each subject including the subject's facial skin geometry over a plurality of times (e.g., frames) and the subject's corresponding jaw poses for each of those plurality of times (e.g., for each frame). Particular implementations of operation 310 are further described below with reference to
At operation 320, using the captured facial training data, system 100 is configured to train a prediction model 102 that provides a mapping from skin motion to jaw motion. Relevant features may be extracted from the facial training data 101 in preparation for training and learning the model. For example, set of skin features that define the skin motion and a set of jaw features that define the jaw motion may be extracted.
It should be appreciated that any suitable representation of skin motion and jaw motion may be used for the mapping. Skin motion may be encoded as absolute point locations, a displacement from a neutral position, blendshape weights, or some other suitable representation of skin motion. The jaw motion that the skin motion is mapped to may be encoded as absolute point locations, a displacement from a neutral position, distances to a skin surface, a transformation matrix, or some other suitable representation of jaw motion. As such, while some implementations of the disclosure will be described in the context of mapping skin vertex features to a set of displacements of jaw bone features, it should be appreciated that any suitable representations of skin motion and jaw motion may be used for the mapping. Particular implementations of operation 320 are further described below with reference to
In some implementations, depending on the accuracy of the prediction model (e.g., as determined from testing a subset of data 101), operations 310-320 may be iterated. For example, training data may be captured for additional subjects having a range of facial features and/or training data may be captured for the same subject over a greater range of facial expressions.
During operation 330, jaw motion prediction system 200 is configured to use the created model 102 to predict jaw poses for a subject over a plurality of times (e.g., frames) using an input the subject's corresponding facial skin geometry for those plurality of times (e.g., frames). The subject for which jaw poses are predicted using the learned model and input facial skin geometry may be one of the one or more subjects for which training data was acquired at operation 310. Alternatively, the subject may be a new subject in which case the mapping learned for the captured training subjects may be retargeted to the new target subject. Particular implementations of operation 330 are further described below with reference to
Data acquisition and model generation system 100 may include computer readable medium(s) 110, a processing device 120, facial capture devices 130, and connection interface 140. Facial capture devices 130 may be used at operation 310 to capture facial training data 101, including a subject's facial skin geometry over a plurality of times (e.g., frames) and a subject's corresponding jaw poses for each of those plurality of times (e.g., for each frame). One or more cameras, lights, facial markers, and/or teeth markers may be used to capture facial training data 101.
The computer readable medium(s) 110 may store facial training data 101 and a prediction model 102. Computer readable medium(s) 110 may additionally store instructions 103 that are executable by processing device 120 to obtain training data 101 (e.g., by performing operation 310 discussed above). Computer readable medium(s) 110 may additionally store instructions 104 that are executable by processing device 120 to generate prediction model 102 (e.g., by performing operation 320 discussed above).
Connection interface 140 may be to communicatively couple data acquisition and model generation system 100 to a connection interface 240 of jaw motion prediction system 200. For example, connection interface 140 may be to transmit a file including learned model 102 to jaw motion prediction system 200. In some implementations, connection interface 140 may be implemented as a wired interface (e.g., an HDMI interface, a USB interface such as a USB Type-C interface, a THUNDERBOLT interface, an Ethernet interface, etc.) In some implementations, connection interface 140 may be implemented as a wireless interface (e.g., a WiFi communications interface, a cellular communications interface, a satellite communications interface, etc.). In some implementations, connection interface 140 may comprise a combination of both wired and wireless interfaces.
Jaw motion prediction system 200 may include computer readable medium(s) 210, a processing device 210, facial capture devices 230, and connection interface 240. Facial capture devices 230 may be used at operation 330 to capture a subject's facial skin geometry over a plurality of times. For example, facial capture devices 230 may include one or more cameras and lights. Capture may occur during facial performance capture for media content creation. In some instances, facial capture devices 230 may also include facial markers, and/or teeth markers for capturing calibration poses to improve subject retargeting as further described below with reference to
The computer readable medium(s) 210 may store a prediction model 102. Computer readable medium(s) 210 may additionally store instructions 201 that are executable by processing device 220 to predict a jaw pose of the subject for a given time (e.g., frame) or expression given the prediction model 201 and the subject's facial skin geometry at that time/expression (e.g., by performing operation 330 discussed above).
Connection interface 240 may be to communicatively couple jaw motion prediction system 200 to data acquisition and model generation system 100. For example, connection interface 240 may be to receive one or more files including learned model 102 from system 100.
Although the foregoing examples depict systems 100 and 200 as separate systems performing operations 310-330, in other implementations, systems 100 and 200 may be integrated into a single system that performs all of operations 310-330.
With particular reference now to capturing facial training data 101 for one or more subjects (e.g., operation 310), in order to learn a mapping from the skin surface to a jaw pose, ground truth data including both the skin surface and jaw pose may need to be captured at the same time. Training data 101 may be captured for a plurality of different subjects undergoing a large range of jaw motion. In this manner, a thoroughly captured dataset that spans a significant range of jaw and skin motion may be subsequently used to robustly train one or more predictors. In some implementations, the ground-truth data may be obtained as part of a one-time database creation step. In this manner, any system may subsequently use the data to learn mappings from skin motion to jaw motion and/or apply learned mappings. It should be appreciated that the number of subjects for which data is captured, along with the range of jaw motion of those subjects for which data is captured, may be tuned depending on the desired accuracy of the created model, further described below, and the diminishing returns in improved accuracy from capturing additional data.
For a given subject, skin geometry may be captured for each frame using facial capture devices 130 including a rig of one or more cameras and lights with software that may reconstruct a subject's face in full motion, without using motion-capture dots. Fiducial markers may be used to capture accurate jaw pose data per frame at the same time that the subject's skin geometry is captured. The fiducial markers may include a set of markers that are glued or otherwise attached to the subject's teeth, which may enable accurate estimation of the six degrees of freedom (DoF) pose of both the skull and jaw. This implementation is depicted by
Although the above describes an example set of techniques for capturing facial training data 101, it should be appreciated that any suitable technique may be utilized to capture the facial skin geometry and corresponding jaw motion over time. For example, in some implementations an artist may manually label the subject's teeth as they appear in images. In another implementation, sensors (e.g., electromagnetic sensors) may be attached to a subject's teeth to precisely capture jaw motion. In yet further implementations, jaw motion may be recovered by detecting, using computer vision, some reflective material attached to the subject's teeth. In some implementations, motion-capture dots may be used to capture the subject's facial skin geometry over a plurality of times.
Following capture of the training data 101, including skin geometry and jaw pose, a relation between skin and jaw motion may be learned. To this end, relevant features may be extracted from the facial training data 101 in preparation for training and learning a prediction model that provides a mapping from skin motion to jaw motion. In accordance with implementations further discussed below, multiple skin points may be considered at the same time to predict each of several jaw points. By virtue of this implementation, a relationship between skin and jaw motion may be determined.
At operation 420, for each selected point or vertex, a corresponding point on the face, is found and determines the corresponding skin feature vertex in the rest pose. In particular implementations, the corresponding point on the face is the closest point on the face along the normal of the jaw. For example, the selected vertices on the surface of the jaw may be projected in the direction of the jaw's normal to determine skin feature vertices in a neutral position.
At operation 430, points on the jaw are selected in the rest pose. A set of points distributed over the jaw may be selected as jaw bone features. The selected jaw points may correspond to jaw bone features that are used to define the jaw pose as a rigid transformation. In implementations, a minimum of three non-collinear bone samples are used.
At operation 440, for each training frame, the position of the skin feature vertices may be tracked to determine skin features 460 for all frames. The skin features vertices may be tracked relative to the subject's skull. For example, a displacement of the set of sample skin feature vertices from a reference neutral expression (i.e., rest pose) to another expression (i.e., in current training frame), relative to a coordinate frame of the skull, may be determined.
At operation 450, for each training frame, a displacement between a current position of the selected jaw points in the training frame's expression and the position of the selected jaw points in the rest pose may be tracked to determine target displacements 470 of the jaw.
Following method 400, the determined set of skin features 460 and corresponding target displacements 470 of the jaw for each frame/expression may be used to train a model that provides a mapping for predicting a relative (e.g., from neutral) displacement of a set of points on the jaw given the skin surface features of the subject's face. This is depicted by
The trained model 102 may be used to predict new jaw poses for a subject where ground-truth jaw poses have been acquired for a sufficient number of expressions. However, in some implementations, the ground truth poses may not be available. Although it may be assumed that the relation between skin and jaw motion generalizes across people given human anatomy, and that a mapping learned from one or more training subjects may be applied to new subjects, it may be advantageous to retarget a mapping learned from/on one or more training subjects to a new target subject. In accordance with such implementations, the retargeting method may be used to refine the mapping learned on one or more source subjects with respect to a new target subject. In particular, the retargeting method may be used to transform the motion space of each skin feature (e.g., each feature vertex) of the target subject to best align with the input space or feature space of the mapping that was computed from a source subject.
To this end,
At operation 720, for each of the captured calibration poses, calibration skin features and corresponding calibration jaw features may be extracted. In implementations, calibration skin features and corresponding calibration bone features may be extracted from the new subject in a manner similar to how skin features and jaw features were extracted from training data as described above with reference to
At operation 730, using at least the extracted calibration skin features and corresponding calibration jaw features, a transformation of skin features of the new subject may be determined to align with the feature space of a mapping of skin motion to jaw motion that was computed from one or more source subjects. For example, the skin features of a target actor may be aligned with the ones from a source actor. In implementations, a transformation may be found for each of the skin features such that feature spaces of source and target subjects are optimally aligned, allowing use of the source mapping on unseen target input shapes after applying the transformations to the skin features.
In some cases, the retargeting method may be applied to align feature spaces of a single source subject with a target subject. In such cases, the retargeting method may produce good results in cases where the facial anatomy of the source and target subjects are similar. In some implementations, however, instead of retargeting the mapping from a single subject, it may be advantageous to combine the features of several subjects to learn a multi-subject mapping. In such cases, a number of different subject subjects having different facial structures and jaw motions may be captured (e.g., during the aforementioned steps for capturing facial training data 101).
To learn the multi-subject mapping, one of the source subjects may be selected as a primary subject, and a mapping may be learned for that subject as discussed above with reference to
At operation 910, facial skin features are determined for the subject. For example, the position of the skin feature vertices relative to the skull may be determined from the facial skin geometry of the subject. If the subject is a new subject for which prior training data is not available (optional decision 920), at optional operation 930 the determined skin features may be transformed to align with a feature space of a mapping that was computed from one or more other source subjects. For example, skin feature vertices may be transformed as discussed above with reference to
At operation 940, a prediction model 935 may be used to predict a displacement between a position of jaw points in the rest pose and a current position of jaw points of the subject given the skin features determined at 910 or transformed skin features determined at operation 930. The prediction model 935 may be obtained as discussed above with references to
At operation 950, the jaw of the target subject may be fitted using the predicted displacements, thereby determining a jaw pose.
It should be noted that although method 900 illustrates one particular example method of predicting a jaw pose for a subject given the subject's skin features and a model that provides a mapping from skin features to jaw feature displacements, the techniques described herein may more generally be applied to predict jaw poses using any model that provides a mapping from skin motion to jaw motion. For example, given the facial skin geometry of the subject as an input, a model that provides a mapping from skin motion to jaw motion may be used to predict the jaw motion of the subject. The predicted jaw motion of the subject may then be used to determine a jaw pose of the subject.
In particular implementations, a method for predicted jaw motion from observed skin motion may be mathematically formulated as follows. A mapping Φ()→
that predicts jaw features
from observed skin features
may be found, and then the final jaw pose may be computed from the estimated jaw features.
Skin features . In order to render a feature space invariant to translation and global rotation of the head, a skin feature
j ∈
|V|×3 may be defined to be the displacements {dv}j of a set of sample vertices v ∈ V from reference neutral to expression j, relative to the coordinate frame of the skull. The feature vertices V on the face may be computed by randomly sampling jaw vertices and finding the closest point on the face along the normal of the jaw. Only jaw points within a manually defined mask may be sampled, which excludes vertices on the inside of the jaw. For example, as depicted by
j ∈
242×3.
Bone features . Target bone features
j ∈
|W|×3 that are invariant to translation and global rotation may be found and expressed as displacements {bw}j of a set of sample vertices w ∈
from the reference bone pose to the pose in expression j, relative to the coordinate frame of the skull. Since these features may be used to define the jaw pose as a rigid transformation, a minimum of three non-collinear bone samples may be required, and more samples can increase robustness to noise. It was found empirically that five samples, selected manually as shown in
j ∈
5×3.
For every bone sample w a support vector machine (SVR) regressor ϕw({dv})→bw may be trained that predicts the displacement bw for the bone sample w from the skin displacements {dv} of all skin sample vertices v ∈ V, trained over all captured expressions j in the training data. In some implementations, three different regressors per bone target, one for each dimension, may be trained. In such implementations, the final mapping Φ()→
may be given by aggregating the regressors ϕw for the individual jaw bone samples w.
For any new expression k of the face, the skin feature k may be computed and the regression may be evaluated to obtain a corresponding bone feature
k. From these predicted displacements {bw}k for the jaw bone samples w, absolute locations {xw}k may be computed, and we may solve for the rigid transformation Tk that optimally fits the jaw bone to these locations in a least-squares sense, by minimizing Equation (1):
E
fit(T)=Σw∈W∥T{circumflex over (x)}w−xw∥22 (1)
Where {circumflex over (x)}w denotes the location of bone feature w in the reference pose, and note that the pose subscript k was removed for simplicity. Efit may be minimized using the ceres solver.
In particular implementations, a method for retargeting from source subject(s) to a new subject may be formulated as follows. A small set of calibration poses may be captured for which lower teeth are visible. This set may include five poses: mouth wide open, jaw to the left, to the right, forward, and backward. Thereafter, the skull may be aligned to these poses and used to recover the rigid transformation of the jaw with respect to the skull for each frame by triangulating teeth outlines on images. For each calibration pose p ∈
, calibration skin features
p and corresponding calibration bone features
p may be extracted. The retargeting method may assume consistent vertex topology such that the skin features
p are consistent across actors.
The motion space of each feature vertex v on the target subject may be transformed to best align with the mapping Φ that was computed from a source subject. To this end, the following may be formulated in accordance with Equation (2): an energy term for solving the optimal rigid transformations Rv for every skin feature v, defined over all poses p of the calibration set
E
ret({Rv})=∥Φ({Rv}⊗
p)−
p∥22 (2)
Define {Rv}⊗p as the operator applying each transformation Rv to the corresponding displacement dv ∈
p. Additionally add regularization terms for both the translational (tv) and rotational (qv) components of each transformation Rv=T(qv, tv). The optimal rigid transformations may then be computed by solving
With q0 being the identity quaternion. Equation (3) may be minimized using ceres, with λ1=1e−5, and λ2=2.5e-5. This may optimally align the feature spaces of source and target subjects, allowing to use the source mapping on unseen target input shapes after applying the transformations {Rv} to the skin features.
It should be noted that although implementations of the disclosure have been described primarily in the context of jaw tracking for the purpose of facial performance capture to create media content (e.g., films, episodes, video games, augmented reality or virtual reality content, etc.), the technology described herein may be applicable to other fields (e.g., dentistry and speech analysis) where accurate facial movement capture is desirable, particularly without the need for complicated or invasive methods.
Experimental Results
Implementations of the jaw tracking method described herein were evaluated, including validating the case of training and testing on the same subject, validating retargeting a trained model from a corpus of subjects to an unseen subject, and demonstrating additional examples of unseen subjects qualitatively. During validation, comparisons were made to baseline result. As a baseline, a computation was made of the rigid transformation from the neutral pose to the input expression using Procrustes analysis on the skin feature vertices, and this transformation was applied to the jaw bone. Although this baseline algorithm may typically predict the general direction of jaw motion correction, it may fail to achieve high accuracy because it does not capture the effects of skin sliding over the bone, as further demonstrated below.
Implementations of the jaw tracking method described herein were tested by validating the application of training on one subject, and testing on new expressions of the same subject.
Implementations of the method described herein were tested by validating the retargeting of a trained predictor from several subjects to a new unseen subject. Four main subjects (S1, S2, S3, S4) for which significant ground truth data was available were considered, and a leave-on-out cross validation was performed. For example, a predictor was trained on three of the subjects (e.g., S1, S2, S3) and then tested on one subject (e.g., S4), comparing again to the aforementioned baseline approach. The results of all combinations are shown in the first four columns of Table 1 below, which shows the average prediction error in mm of both the proposed and the baseline method.
As depicted, implementations of the method described herein outperformed the baseline for every subject (subject S5 was not used for training and is predicted using S1-S4). Thereafter, a single multi-subject predictor was creating using all frames of the four subjects, and tested on an additional subject S5, shown in column 5 of Table 1. As shown, in all cases, implementations of the retargeting method described herein quantitatively outperformed the baseline method by a wide margin.
In this document, the terms “machine readable medium,” “computer readable medium,” and similar terms are used to generally refer to non-transitory mediums, volatile or non-volatile, that store data and/or instructions that cause a machine to operate in a specific fashion. Common forms of machine readable media include, for example, a hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, an optical disc or any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge, and networked versions of the same.
These and other various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processing device for execution. Such instructions embodied on the medium, are generally referred to as “instructions” or “code.” Instructions may be grouped in the form of computer programs or other groupings. When executed, such instructions may enable a processing device to perform features or functions of the present application as discussed herein.
In this document, a “processing device” may be implemented as a single processor that performs processing operations or a combination of specialized and/or general-purpose processors that perform processing operations. A processing device may include a CPU, GPU, APU, DSP, FPGA, ASIC, SOC, and/or other processing circuitry.
The various embodiments set forth herein are described in terms of exemplary block diagrams, flow charts and other illustrations. As will become apparent to one of ordinary skill in the art after reading this document, the illustrated embodiments and their various alternatives can be implemented without confinement to the illustrated examples. For example, block diagrams and their accompanying description should not be construed as mandating a particular architecture or configuration.
Each of the processes, methods, and algorithms described in the preceding sections may be embodied in, and fully or partially automated by, code components executed by one or more computer systems or computer processors comprising computer hardware. The one or more computer systems or computer processors may also operate to support performance of the relevant operations in a “cloud computing” environment or as a “software as a service” (SaaS). The processes and algorithms may be implemented partially or wholly in application-specific circuitry. The various features and processes described above may be used independently of one another, or may be combined in various ways. Different combinations and sub-combinations are intended to fall within the scope of this disclosure, and certain method or process blocks may be omitted in some implementations. Additionally, unless the context dictates otherwise, the methods and processes described herein are also not limited to any particular sequence, and the blocks or states relating thereto can be performed in other sequences that are appropriate, or may be performed in parallel, or in some other manner. Blocks or states may be added to or removed from the disclosed example embodiments. The performance of certain of the operations or processes may be distributed among computer systems or computers processors, not only residing within a single machine, but deployed across a number of machines.
As used herein, the term “or” may be construed in either an inclusive or exclusive sense. Moreover, the description of resources, operations, or structures in the singular shall not be read to exclude the plural. Conditional language, such as, among others, “can,” “could,” “might,” or “may,” unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps.
Terms and phrases used in this document, and variations thereof, unless otherwise expressly stated, should be construed as open ended as opposed to limiting. Adjectives such as “conventional,” “traditional,” “normal,” “standard,” “known,” and terms of similar meaning should not be construed as limiting the item described to a given time period or to an item available as of a given time, but instead should be read to encompass conventional, traditional, normal, or standard technologies that may be available or known now or at any time in the future. The presence of broadening words and phrases such as “one or more,” “at least,” “but not limited to” or other like phrases in some instances shall not be read to mean that the narrower case is intended or required in instances where such broadening phrases may be absent.
