Patent Application
20190182450
Computer animation has progressed substantially in the past two decades, but live recordings—including puppetry—still offer much higher resolution and a more realistic visceral feel. Live action recording of puppets has limitations though, especially with multiple puppeteer actuated puppets. Puppetry provides a means for storytelling that has not had the expanse of use in major motion pictures as has live action human or animation because of perceived technical limitations, complexity, and articulation quality issues. There exists a need for providing technical solutions to puppetry limitations to allow the expanded use of puppetry medium in video productions.
Wherefore, it is an object of the present invention to overcome the above mentioned shortcomings and drawbacks associated with the current technology.
The present invention also relates to filmed performances of puppetry, with puppeteers moving portions of their puppeted character in real time. Multi Track puppetry allows a puppeteer or group of puppeteers to perform different components/portions (body parts or “pieces”) of a character/creature separately and at a different time. The computer then puts the various recorded pieces together to create a seamless and unified performance. As just one example, a scene in which a character walks across the street and waves could be performed as a composite of partial scenes as follows: a first puppeteer is recorded performing a scene puppeting only the body and legs of the character; then the same or a second puppeteer is recorded performing the scene puppeting only the left arm of the character; then the same first or second or a third puppeteer is recorded performing the scene puppeting only the right arm of the character; then the same first. Second, or third or a fourth puppeteer is recorded performing the scene puppeting only the head of the character. The recordings of the scenes of the various body parts are then compiled via a computer to create one scene with the whole body of the character. This allows for asynchronous recordings of various portions (including of different scales) of a single bodied character to be combined to form an illusion of a single live recorded character.
The present invention is directed to apparatuses and methods of creating a video of a puppet character comprising filming a scene including a first portion of a puppet character on a first recorded track, filming the same scene including a second portion of the puppet character on a second recorded track, and combining the first portion of the puppet character from the first recorded track and the second portion of the puppet character from the second recorded track together onto a single video recording of the scene with an assembled puppet character. According to a further embodiment, multiple single video recordings are combined to create a combined video recording lasting longer than 20 minutes. According to a further embodiment, the filming of the first portion of the puppet character and the second portion of the puppet character are conducted one of in separate time, in separate space, with separate cameras, and some combination thereof. According to a further embodiment, the first portion of the puppet character and the second portion of the puppet character are of different scales. According to a further embodiment, a first puppeteer puppets the first portion of the puppet character and a second puppeteer puppets the second portion of the puppet character. According to a further embodiment, a first puppeteer puppets both the first portion of the puppet character and the second portion of the puppet character. According to a further embodiment, the same scene is filmed including a third portion of the puppet character on a third recording track and the third portion of the puppet character from the third recorded track is combined together with first portion of the puppet character from the first recorded track and the second portion of the puppet character from the second recorded track onto the single video recording of the scene with the assembled puppet character. According to a further embodiment, two of the three portions of the puppet character are of the same scale and one of the three portions of the puppet character is of a different scale. According to a further embodiment, each of the three portions of the puppet character are of different scales. According to a further embodiment, the first portion of the puppet character has a first tracking marker and the second portion of the puppet character has a second tracking marker. According to a further embodiment, the first tracking marker is located adjacent to a location where the second portion of the puppet character will connect with the first portion of the puppet character after the combining step, and the second tracking marker is located adjacent to a location where the first portion of the puppet character will connect with the second portion of the puppet character after the assembling step. According to a further embodiment, the same scene is filmed including a third portion of the puppet character on a third recording track and the third portion of the puppet character from the third recorded track is combined together with first portion of the puppet character from the first recorded track and the second portion of the puppet character from the second recorded track onto the single video recording of the scene with the assembled puppet character, and the portion of the puppet character has a third tracking marker. According to a further embodiment, the third tracking marker is located adjacent to a location where one of the first and the second portions of the puppet character will connect with the third portion of the puppet character after the assembling step. According to a further embodiment, the tracking marker is mounted on an extension that extends away from the first or the second portion of the puppet character. According to a further embodiment, the tracking marker is one of a three dimensional regular polygon, a sphere, and a two dimensional shape, and the tracking marker is substantially monochromatic. According to a further embodiment, the tracking marker one of reflects and emits a non-visual electromagnetic signal that is detected by a detector. According to a further embodiment, the tracking marker detects its own three dimensional location. According to a further embodiment, the tracking marker one of records and transmits its three dimensional location during filming of the scene.
The disclosed invention further relates to methods and puppet character kits comprising a first portion of the puppet character, a second portion of the puppet character disconnected from the first portion, and a tracking marker on one of the first portion of the puppet character and the second portion of the puppet character adjacent to a connection location between the first portion and the second portion. According to a further embodiment, the first portion of the puppet character is of a different scale than the second portion of the puppet character. The recording tracks maybe analog or digital and may be made on exposure film, flash memory, hard drive, for example, including other electronic manners of capturing video.
Various objects, features, aspects, and advantages of the present invention will become more apparent from the following detailed description of preferred embodiments of the invention, along with the accompanying drawings in which like numerals represent like components. The present invention may address one or more of the problems and deficiencies of the current technology discussed above. However, it is contemplated that the invention may prove useful in addressing other problems and deficiencies in a number of technical areas. Therefore the claimed invention should not necessarily be construed as limited to addressing any of the particular problems or deficiencies discussed herein.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate various embodiments of the invention and together with the general description of the invention given above and the detailed description of the drawings given below, serve to explain the principles of the invention. It is to be appreciated that the accompanying drawings are not necessarily to scale since the emphasis is instead placed on illustrating the principles of the invention. The invention will now be described, by way of example, with reference to the accompanying drawings in which:
The present invention will be understood by reference to the following detailed description, which should be read in conjunction with the appended drawings. It is to be appreciated that the following detailed description of various embodiments is by way of example only and is not meant to limit, in any way, the scope of the present invention. In the summary above, in the following detailed description, in the claims below, and in the accompanying drawings, reference is made to particular features (including method steps) of the present invention. It is to be understood that the disclosure of the invention in this specification includes all possible combinations of such particular features, not just those explicitly described. For example, where a particular feature is disclosed in the context of a particular aspect or embodiment of the invention or a particular claim, that feature can also be used, to the extent possible, in combination with and/or in the context of other particular aspects and embodiments of the invention, and in the invention generally. The term “comprises” and grammatical equivalents thereof are used herein to mean that other components, ingredients, steps, etc. are optionally present. For example, an article “comprising” (or “which comprises”) components A, B, and C can consist of (i.e., contain only) components A, B, and C, or can contain not only components A, B, and C but also one or more other components. Where reference is made herein to a method comprising two or more defined steps, the defined steps can be carried out in any order or simultaneously (except where the context excludes that possibility), and the method can include one or more other steps which are carried out before any of the defined steps, between two of the defined steps, or after all the defined steps (except where the context excludes that possibility).
The term “at least” followed by a number is used herein to denote the start of a range beginning with that number (which may be a range having an upper limit or no upper limit, depending on the variable being defined). For example “at least 1” means 1 or more than 1. The term “at most” followed by a number is used herein to denote the end of a range ending with that number (which may be a range having 1 or 0 as its lower limit, or a range having no lower limit, depending upon the variable being defined). For example, “at most 4” means 4 or less than 4, and “at most 40%” means 40% or less than 40%. When, in this specification, a range is given as “(a first number) to (a second number)” or “(a first number)-(a second number),” this means a range whose lower limit is the first number and whose upper limit is the second number. For example, 25 to 100 mm means a range whose lower limit is 25 mm, and whose upper limit is 100 mm. The embodiments set forth the below represent the necessary information to enable those skilled in the art to practice the invention and illustrate the best mode of practicing the invention. In addition, the invention does not require that all the advantageous features and all the advantages need to be incorporated into every embodiment of the invention.
Turning now to
Turning to
In this embodiment, the three portions 8, 12, 16 are of different scales. The first portion 8 is about 1:4 scale, or about one fourth the scale of the size the puppet character 4 is depicted as being in the final video 2. The second portion 12 is about 2:1 scale. The third portion 16 is about 3:2 scale. In an alternative embodiment, the different portions 8, 12, 16 of the puppet character 4 may all be of the same scale. In a further alternative embodiment, two, three, four or more of the portions 8, 12, 16 may be of the same scale while one, two, three, four, or more other portion(s) 8, 12, 16 may be of different scale(s).
Each portion 8, 12, 16 preferably has a tracking marker 20 adjacent to a connection location 22. The connection locations 22 are a physical location on a given portion 8, 12, 16 where an other portion 8, 12, 16 would connect to the given portion 8, 12, 16 when the puppet character 4 is assembled. The tracking markers 20 may be three dimensional shapes, such as spheres (as shown), cubes, or pyramids, for example. They may also be two dimensional shapes like circles, regular polygons, crosses or unique shapes. Though each portion 8, 12, 16 preferably has a tracking marker 20 adjacent to a connection location 22, the invention may also function with a tracking marker 20 on only one connection location for two complementary connection location 22 or mating portions of puppet characters—such as a hand and a wrist or a head and neck for example.
The tracking markers 20 may be mounted tracking markers 24 as shown or surface tracking markers 26, for example. Mounted tracking markers 24 may be two or three dimensional, and are mounted on extensions 28 that preferably extend away from the puppet portion 8, 12, 16. The extensions 28 may be rods or dowels that are preferably mounted internally in the puppet portion 8, 12, 16 and preferably extend through a central area of the connection location 22. Alternatively or additionally, surface tracking markers 26 may be used, which may be applied on the surface of the puppet character portion 8, 12, 16, especially those portions 8, 12, 16 like the gloves in
The various portions of the puppet character's body parts are puppeted, preferably having appropriate tracking markers. The tracking marker is any marker the computer can easily identify for the purpose of marking the connection point of the various components. Examples of tracking markers include small colored sticker, ping pall ball painted certain color, colored plastic pyramids and a wooden stick with a colored dot on it. Some examples of the color are green and hot pink, though other colors could be used, including markers painted with non-visible light wave reflective coverings, such as UV reflective, infrared reflective, microwave reflective, and radio wave reflective coverings. The shape and or the color of the tracking marker should stand out in most or all lighting and be a color and or shape that is easily trackable.
Turning to
The scene is preferably filmed in front of a chroma key green screen and the first and the second puppeteers 30, 32 are preferably dressed in a green screen suit or other clothing to allow the background and the two puppeteers 30, 32 to be easily removed or edited out the final video in the combining step. It is understood that various colored or types of chroma key type backgrounds and suit may be used as is appropriate. Additionally or alternatively, the scene 6 may be filmed in front of a background to be used in the video, or for example, a filmed background may be combined in the combining step S4.
As shown, the puppeteers 30, 32, while filming the scene 6, preferably remain cognizant of the first portion 8 of the puppet character's 4 location with respect to a central recording axis 48 of the filming camera 50, and of the locations of the primary and secondary first connection locations 40, 46 with respect to the central recording axis 48. The central recording axis 48 is an imaginary line formed by a straight ahead axial view from a center of the lens for the filming camera 50. Also shown is a connection location vector 52 formed by an imaginary line extending from a connection location 22 to the center of the lens for the filming camera 50. The connection location vector 52 shown in
Turning to
Turning to
Turning to
In this step S4, in each video recording track 10, 14, 18 the background and puppeteers 30, 32 are extracted or cropped out of the video recording tracks 10, 14, 18 to leave the respective portions 8, 1216 on the respective video recording tracks 10, 14, 18. The computer 70 then creates a 4D track 72 with frame nodes 74 that correspond to the location of a given tracking marker 20 on each frame of video for a given time period. The thirty-one frame nodes shown in
The tracking marker 20 may have additional shape or size features that help the artist (or computer 70) plot or confirm the 4D track 72 of the portion 8, 12, 16. As shown in the embodiment of
Then separate portions 8, 12, 16 are layer or joined together to create a whole puppet character 4 at complementary connection locations 22 by aligning the tracking markers 20 for each portion to the tracking nodes 74 on respective 4D tracks 72. A complementary connection location 22 is where two connection locations 22 join, such as the primary first connection location 40 and the second connection location 62 in the embodiment shown. There is preferably a single 4D track for each complementary connection location 22. Alternatively, separate 4D tracks may be created for each tracking marker 20, and then the artist can separately match the frame nodes 74 for the 4D tracks 72 for complementary connection locations 22. Additionally, the computer can automatically match the frame nodes 74 for the 4D tracks 72 for complementary connection locations, and the artist 68 can preferably confirm the computer's 70 matching, and edit as needed.
When a tracking marker 20 physically extends beyond the connection location 20, a connection gap may be factored into the combination step S4, whereby a frame node 74 aligning with a tracking marker will align with a frame node 74 for a complementary tracking marker 20, but will offset the second frame node 74 by a set amount in a set direction—for example the scaled distance the first tracking marker 36 extends beyond the primary first connection location 40 plus the scaled distance the third tracking marker 58 extends beyond second connection location 62, with such gap amount and direction being adjusted by the angle of the two portions 8, 12, 16 to one another.
As stated above, a tracking marker 20 is not necessary for all of the separate portions 8, 12, 16, but greatly expedites the combination step S4 if present. Preferably, at least one of two connecting portions 8, 12, 16 will have a tracking marker 20. Items like gloves, which are worn by puppeteers 30, 32, may not have tracking markers 20. In such circumstances, as described above, the artist 68 will preferably composite the portion 8, 12, 16 manually, that is, for example, will “eyeball” a center of the wrist for the glove when attaching the glove to a frame node 74 or to the wrist of the torso portion 8.
Preferably, a tracking marker 20 on is on the negative not the positive. In one embodiment, the tracking marker 20 is only put on the asset or portion 8, 12, 16 the body is being attached to. So if two body parts are being connected, one tracking marker 20 could suffice. A tracking marker 20 for each is preferable though.
As mentioned briefly above, other types of tracking markers 20 may include different type of laser or ultraviolet tracking markers 20, which are preferably visible through a puppeteer's 30, 32 skin or body, such that the camera 50 computer can “see” the tracking marker 20 no matter where the puppeteer's hand or arm is, even if the puppeteer's 30, 32 hand or arm is between the tracking marker 20 and the camera 50. In such embodiments, the tracking marker 20 may be used inside the glove or other worn portions 8, 12, 16. This will allow the camera to track the portion 8, 12, 16 so that the camera can pick up the tracking marker 20 no matter where puppeteer's 30, 32 hand is.
In further embodiments, the tracking marker 20 may reflect or emit a preferably non-visual electromagnetic signal to a detector(s), either through the camera lens, mounted on the camera, or mounted elsewhere in filming area. In one embodiment there can be three or four detectors spaced in the in or near the filming area to triangulate the location of each non-visual electromagnetic signal emitting/reflecting tracking marker 20. In this way, the separate tracking markers 20 may be tracked in three dimensions over time without impeding visually on the take. The tracking data from the separate tracking markers 20 could be compiled in the computer 70 to compute a 4D track 72 for the separate tracking markers 20.
In still further embodiments, the separate tracking markers 20 could contain preferably miniaturized microprocessors, memory, and sensors, including accelerometers and/or 3 dimensional location sensors, for example. In this embodiment, each tracking marker 20 could track and record in memory its own movement through three dimensional space and time. After the puppeteers 30, 32 record the scene 6, and the tracking marker 20 records in memory its location data, the tracking marker's 20 data could be uploaded to the computer 70 and the 4D track 72 for the separate tracking markers 20 could be computed. Additionally or alternatively to having onboard memory, the tracking markers 20 of this embodiment could have wireless transmitting functionality, such as wi-fi or blue-tooth, just for example, and as the scene 6 is being filmed, these tracking markers 20 could just transmit their respective three dimensional locations in real time to sensors or receivers of the camera 50 or additional sensors or receivers, as the scene 6 was progressing. The data would then be loaded into the computer 70 and 4D tracks 72 for the separate tracking markers 20 could be computed, and the portions 8, 12, 16 of the puppet character 4 then combined for final video 2.
The portions 8, 12, 16 may be separately adjusted in size in the computer, with magnifications greater than or less than 1.0, to attain a uniform scale for the whole puppet character 4. This is shown in
In embodiments when the background is filmed with the portion 8, 12, 16, the puppeteers will be cropped or chroma keyed out and the respective portion and background remain 8, 12, 16,
ADVANTAGES: The previously described embodiments and variations of the present invention have many advantages. Some of the advantages of some embodiments include the ability to create a single unitary scaled puppet character of multiple varied scaled portions. This is advantageous if, for example, the puppet character is built to be a 1:6 scale and interact on a 1:6 scale background set, but it is desired to file the puppet character's hands moving and articulating as naturally as someone moving a hand inside of gloves. By separately filming the gloved puppet hands worn and puppeted by a puppeteer, such as in
Additionally, by breaking the puppet character into multiple portions, very complex sequences, like a puppet character jumping of a ledge, rolling on the ground, and bouncing up to a walk, for example, become significantly easier by both allowing puppeteers to focus on only a single portion at a time and not requiring that all elements of the puppet character be correct in a single shot. Instead, the hands can be filmed until the hands puppeteer gets the shot correctly puppeted, with the hand puppeteer focusing just on the hands. Then the head can be filmed until the head puppeteer gets the shot correctly puppeted, with the head puppeteer focusing just on the head. As opposed to having 4 to 5 puppeteers manipulating a puppet character for each take, and needing to select a take which is perfect all around. This greatly enhances the separate puppeteers' ability to control the nuance of a performance, and selecting the best take of each portion of the puppet character.
Also, by splitting the puppeting into multiple separately filmed portions, it allows for a reduced number of very talented puppeteers to puppet the entire puppet character. This can be especially advantageous where there are limited numbers of highly talented puppeteers.
Compared with animation, the disclosed invention offers clear advantages in video quality and time requirements. Puppetry is live filmed video that allows high definition and high texture and granularity in appearance. Even though puppetry is a moving inanimate object, the live action film recording offers a visual realism that surpasses animation. Further, even with the embodiments of the disclosed invention using 4D track and combining multiple portions of a puppet character on multiple video recording tracks into a final whole puppet character on a single video, the process can offer significant time advantages over animation, including up to 40 times faster production. The rendering time required to make animated figure approach real life is substantial. With the filmed puppet character though, the texture, lighting, and shadow is instantaneous as soon as the scene is recorded on the camera.
Though various advantages and advantageous features have been described, the present invention does not require all of the advantageous features or all of the advantages to be included into every embodiment.
The invention illustratively disclosed herein suitably may explicitly be practiced in the absence of any element which is not specifically disclosed herein. While various embodiments of the present invention have been described in detail, it is apparent that various modifications and alterations of those embodiments will occur to and be readily apparent those skilled in the art. However, it is to be expressly understood that such modifications and alterations are within the scope and spirit of the present invention, as set forth in the appended claims. Further, the invention(s) described herein is capable of other embodiments and of being practiced or of being carried out in various other related ways. In addition, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items while only the terms “consisting of” and “consisting only of” are to be construed in the limitative sense.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15614645 | Jun 2017 | US |
| Child | 16178658 | US |
