1. Field of the Invention
The present invention relates, generally, to imaging and, more particularly, to media simulation and generating images therefor.
2. Description of the Related Art
As digital imaging replaces much of the filmed image origination of the past, aesthetic and artistic issues arise for many in the industry. The change from photo chemical to electronic media capture and the change in equipment, from film cameras to video cameras, have contributed largely to these issues. U.S. Pat. No. 5,687,011 (the “'011 patent”) to Mowry discloses an approach to digital film simulation.
In particular, the '011 patent discloses a hybrid camera that bridges the “gap” between electronic (e.g., digital) capture and film capture. The camera presents both capture techniques interdependently, thereby allowing for a new range of creative and artistic options, including filmic image results, while simultaneously maintaining the efficiency and cost effectiveness, well-known to those skilled in the art of digitally originated productions.
So-called “media simulation” refers herein, generally, to a process of manipulating images captured with one medium to mimic images associated with another capture medium. For example, images that are in digital format may not appear as images that are captured on film. The digital images are modified to simulate the film images, for example, by adjusting color, resolution, sharpness, or the like. In an alternative example, filmed images are modified to simulate digital images. As known to those skilled in the art, media simulation is an important aspect of consumer and entertainment imaging. In a media simulation, visuals are, typically, manipulated or at least passed through a digital realm at some point before provided in a final form.
Imaging in the entertainment industry continues to focus on maintaining the aesthetics of film origination in an ever growing number of productions that are shot digitally. These productions are typically based on data transforms from media sampling, unlike the discreet method disclosed in the '011 patent wherein the actual film media to be simulated is involved at capture to inform the modification process of digital images using film that was actually exposed at capture. This is distinct from a software program suggesting how film might have rendered the lens image under certain conditions at capture.
As further disclosed in the '011 patent, film and video originate in tandem for the specific purpose of aesthetically modifying the video-originated visuals. The benefit of cross-referencing the media at initial capture and/or store, is allowing for proper image reference of images originated of a selected scene on one medium with images originated on another medium of the same visual scene, whether through a single or multiple lenses. Unfortunately, no technique or system is available in the prior art that provides a user with an automated way to cross-reference the media easily in relation to a multi-media capture, media simulation system.
The present invention includes a media simulation system that provides at least one lens operable to optically relay a single visual scene, and a first visual medium and a second visual medium. The first imaging medium and the second imaging medium are each operable to capture and store respective images of the single visual scene. Further, the respective images stored on the first imaging medium are correlated with the respective images stored on the second imaging medium. Also provide is a data management program operable on a computing device to selectively apply aspects of the respective images stored on the first imaging medium to modify corresponding aspects of the respective images stored on the second imaging medium.
In an alternative embodiment, the present invention includes a media simulation software application operable on a computing device. The application includes an image receiving module operable to receive respective images captured by a plurality of media, and an image modification module operable to modify image data derived from at least some of the respective images in relation to non-image data provided by at least one of the plurality of media. At least some images originating from a first of the plurality of media are selectively modified based on data from corresponding aspects of images captured on a second of the plurality of media. The respective images are captured by the plurality of media through a single lens.
Yet another embodiment includes a film simulation system that includes photographic film that is exposed through a lens to capture visuals. The photographic film has a data storage aspect for additional information other than imaging information. Also included is an electronic capturing means to capture the visuals through the lens, and means for cross-referencing the visuals captured on the electronic capturing means with selected portions of the visuals captured on the photographic film.
A still further embodiment regards a media simulation system that includes a lens for relaying visuals, and a visual data recording medium used for recording the visuals relayed through the lens and for recording cross-referencing data. Moreover, an electronic capture medium is provided that is operable to electronically capture the visuals relayed through the lens. The visuals that are electronically captured by the electronic capture medium are cross-referenced during post production processes with selected aspects of the visuals recorded by the visual data recording medium in relation to cross-referencing data.
These and other features and advantages of the present invention will become apparent from the following description of the invention that refers to the accompanying drawings.
For the purpose of illustrating the invention, there is shown in the drawings a form which is presently preferred, it being understood, however, that the invention is not limited to the precise arrangements and instrumentalities shown. The features and advantages of the present invention will become apparent from the following description of the invention that refers to the accompanying drawings, in which:
Preferably, a system and method is disclosed that provides non-visual data that are preferably stored on a media while a camera captures a visual scene, referred to herein, generally as a “visual,” to a plurality of media. As used herein, “non-visual data” refer, generally, to any data that are not the digital image data included in an image. The term, “non-visual data” is not meant to exclude data that cannot be seen; instead, non-visual data are data that are not included in an image.
A first of the plurality of media may be, for example, film, and a second of the plurality of media may be, for example, a digital storage device. The non-visual data may be stored in either media, and are preferably used during a process to modify digital images of the visual by cross-referencing the images stored on one medium (e.g., film) with the images stored on the other medium (e.g., digital storage device). Using the non-visual data, digital images can be cross-referenced with respective non-digital images, and the digital images can be modified without a need for user input or instructions to identify respective. Any user input, for example, for aesthetic adjustments, are not necessarily eliminated.
As known in the art, several approaches are relied upon for cross-referencing media, for example, in double system sound and non-linear editing systems, in order to assign and cross-reference visuals based on data recorded, typically, on various media that are utilized. Preferably, cross-referencing media is used in a hybrid camera configuration for the purpose of media simulation, and of film origination for eventual modification of visuals that are also electronically captured. Preferably, images recorded on a plurality of media are delivered though a single lens, separately recorded, and cross-referenced in relation to data stored in the cross-referencing media.
The following description refers to the accompanying drawings, in which like reference numerals refer to like elements. Below is list of some reference numerals and corresponding elements illustrated in
101—visual scene
102—beam splitter/image diverter
103—film stock
104—hybrid multi-media camera
105—videotape or other electronic storage or drive
106—digital visual data recorder
108—lens
109—digital image capture device (such as ccd)
110—film exposing gate and shutter
112—time code generator providing data to both media for recording
201—magnetic, visual or other recording media for non-visual data
203—film image and corresponding selected number of digital images to be modified by data from the single filmed image
205—magnetic media or other option for storing digitally originated images
206—digital visual recording head or other (to tape or other)
208—time code/non visual data recording means
209—non-visual digitally captured image reference data (transferred from original media)
210—non-visual filmed image reference data (transferred from original media)
301—monitor display of digitally originated image
302—film simulating modified digitally originated image, replacing image aspects based on image and on image data corresponding to digitized film originated images (as displayed on a display monitor)
303—digital image modifying computer
304—film originated image referencing, digital image modification program
305—high definition dvd or other storage option
306—user input device, such as keyboard, for optional aesthetic and functional instructions
401—digitally originated visual data
402—film originated image data
In a preferred embodiment, a simple and cost effective configuration of the film simulating, hybrid digital camera disclosed in the '011 patent, such as shown in specifically in
In a preferred embodiment, a familiar cartridge-based product involving the known super 8 mm film stock, commonly referred to as the super 8 sound cartridge, is an example of a useful application of the film aspect of an embodiment. Typically, consumer film cameras utilize this product or similar products, which allow for sound to be recorded live onto magnetic stripe 201 (
With the aesthetic advantage of any selected emulsion type film stock being provided selectively in the super 8 sound cartridge containment, in a preferred embodiment, a double media system is provided for recording for eventual digital modification of high definition digitally originated images. Of course, one skilled in the art will recognize that any other electronically captured visual format can be used. The digitally oriented images are cross-referenced with images in a non-digital media during post production processes. Accordingly, an electronic time code or related data generated by the electronic capture aspect of camera 104 (
Film capture unit 111, preferably configured to accommodate the super 8 sound cartridge, also includes magnetic recording head 107, familiar to those skilled in the art, and used in super 8 sound recordings. Magnetic recording head 107 preferably provides electronic stimulus for the magnetic sound stripe 201 added to the film stock to receive and store data, for example, related to microphone recorded sound. These data are preferably recorded several frames offset from the portion of the film emulsion being recorded at the same moment, thereby allowing proper space for the components of the camera.
Preferably, the time code data 210 are provided by magnetic recording head 107 to magnetic sound stripe 201 by camera time code generator 112, which provides data for recording on both the reference media (such as film) and digital media (such as compact flash memory) containing the images to be later modified. Whether 24 frames per second (“FPS”), 1 FPS or slower, there is ample magnetic media to store all necessary time code data, or equivalent types of data, regardless of the frame rate at which the digitally originated images are captured. Once the film stock is processed in the selected digitizing process, the sound stripe data are read and provided to electronic recording media used to store the digitized film visuals, such as a high definition DVD, or computer drive.
One benefit provided by the teachings herein is that filmed images may be captured at a vastly different frame rate than images captured by video. This is unlike typical prior art 24 fps film productions that include video assist footage captured at the same frame rate and used for cross-referencing purposes. Preferably, a software program 304, included in an embodiment and operable on a computing device, addresses frame rate variation options, and applies data stored on magnetic stripe 201 that represent a series of electronically captured visuals 203, selectively, to address the special application of one filmed key frame providing the subsequent digital data to modify any selected number of digitally (electronically) captured and stored images.
In other embodiments, magnetic components and recording material may be replaced by other data recording options that allow for acceptable recorded image cross-referencing during post production processes. One example of another option is visual recording onto the film emulsion, and further using a bar code or other selected data encoding visual record. Selectively, each and every filmed visual may selectively (though not necessarily) have an emulsion stored visual data aspect imprinted (exposed) onto the emulsion by a visual stimulus component of hybrid, multi-media camera 104. Selectively close to the filmed frame that the visual data aspect relates to, this bit of emulsion stored data may also be offset from the frame(s) to which they correspond, reciprocally when read by a subsequent data aspect reading means, (such as laser or other visual scanning device). This optional offset is compensated and corrected to allow the proper recorded data aspect to reference the correct filmed image, once the filmed material is photo-chemically processed and selectively digitized or otherwise scanned and stored as an electronic media facsimile of the filmed images. Alternatively, existing image reference data markers present in the utilized film stock may be read during exposure of the film stock, thereby enabling recording relative to the electronically captured images. This provides a reliable data link between the media for subsequent identification of system-relevant corresponding images between media.
Prior art approaches to such emulsion based data aspects include KODAK datacode as well as the sound synching emulsion recording data of AATON film camera systems. These allow for visual data within material filmed with cameras to provide data tracked visuals for cross referencing for double system sound recording, and editing. In contrast, software is preferably used to provide a visual-to-visual(s) reference, link selected visuals of different media recorded at the same or varying frame rates for the purpose of infusing aspects of one media appropriately into aspects of another. This linking enables an automatic media reference in post production for selected modification of data within the images captured and stored on one of the various media embodied within the hybrid camera capture device 104 (or devices should the “camera” take the form of multiple units, of differing media, working in tandem as one cooperative, multimedia capturing system).
Further, the option of prerecorded filmed frame reference data within film stock yet to be exposed to image data, may be provided for reading and recording by the hybrid camera unit or system 104. Prerecorded filmed frame reference information can be used for recording data within the electronic recording means of the electronic capture aspect of the system, or for electronic recording of data separately, such as with a secondary data referencing means to electronically captured images.
An alternative embodiment includes a system to cross reference filmed and electronically captured material that includes a configuration including variously selected media, which may be electronic or otherwise, and including individual visual capture or motion imaging. This alternative embodiment enables discreet media simulation by referencing data that are specific to image modification for such simulation, regardless of the various media involved.
Preferably, computer executed instructions (e.g., included in software) are employed by a computing device. The computing device may be any device that is capable of sending and receiving data across a communication network, e.g., a mainframe computer, mini computer, personal computer, laptop computer, a personal digital assistant (PDA) and an internet access device such as Web TV. The software preferably includes a data management application that employs selective image zone modification transforms, thereby allowing filmed visuals to provide a discreet basis for modification of digitally originated images. Corresponding image zones and/or aspects may be identified by one of a selective combination variety of existing digital means, based on the desired aesthetic and degree of detail and modification detail desired in a given configuration of the application. This program relies herein on the data link provided between the media, to distinguish those images relevant in modifying others, between media. This data will provide the framework for the selective, media simulating modification process. (This non visual data is not limited to time code data, or the like, and potentially includes user input data at capture, automatically gathered data related to camera settings and lighting conditions, or other data useful in the digital modification stage).
Continuing with reference to
The digital capture is recorded by digital recorder 106 by way of recording component, including options such as magnetic recording means 206 and recorded within storage 105 which may be magnetic tape, (and 204, a detail of such tape), computer drive or other recording media, as known in the art. In accordance with the teachings herein, captured visual reference data is selectively generated by data generator 112, recorded, (or read in another optional configuration) by data providing component 107 which exposes film stock 103, magnetic material 201 or other media by way of data providing/recording component 107 to specific data relevant stimuli to create readable data record, of selective size (to not interfere with image recording), and recorded selectively with a selected frame offset, such as that typical to that of the super 8 sound recording sound/visual frame offset. Again, this data stimuli for exposing non image data onto the film is selectively created from data selectively generated by hybrid camera time code generator 112 as image correlating (or other image reference) data, which is also recorded in relation to selected image data with, or in relation to, digital capture image data stored. Such data recorded relative to the digital capture material is delivered by recording component 208 to the selected digital data store option, such as magnetic tape.
A post production aspect includes, though is not limited to, film 103 being chemically processed and digitized, with data recorded by component 107 being recorded as an aspect of, or in relation to, these stored, digitized film originated images. In case the media involved are both electronically originated, such processing and digitizing is preferably bypassed. Computer(s) 303 preferably receives image and non-image data from all relevant media, 103 and 204, and maintains them within a selected memory, and employs the non-image data to correctly match corresponding film originated image(s) with selected digitally originated image(s). A single filmed image, or filmed “key frame,” may provide data for modification of data related to many digitally originated images, 203. This may selectively occur in the process of actual modification of digitally originated images based on the filmed images, 201 or in an intermediary stage of creating a subsequent data store, (such as a DVD 305 or other media) which embodies all image 401, 402 and non-image data 209, 210 from all media used at capture, synched/correlated prior to delivery to further computing means for use in image data, media simulation modifications, or other selected image modifications.
Thus, the creation of a distinct data store 305 (whether as one piece of media or more than one slaved to work in tandem) embodying all image and non image data as an aspect of a modification program, where selectively automatically image aspects and/or zones of data from one medium is correlated with and modified in accordance with image data from another medium and wherein data from a single image of one medium, such as film, may be applied to a series or sequence of images originated on another medium, such as digital. Distinct software 304 capable of employing such a unique data store may be provided, employable by the data modifying computer 303, wherein the computer system user may load media into a memory and by virtue of the unique synching and selective modification process, see all digitally originated images, (or just selected images determined to be the “final edit” of a project), as modified, film simulating images; borrowing on image aspects of one medium selectively to simulate that medium, from another medium display 301 displays the images related to unmodified media with monitor 302 displaying final visuals, modified by and for the purposes described herein. Final aesthetic visual adjustments, subjective to the system user, by way of data inputting component 306, (or other means,) may be employed at this point, based on visuals viewed on monitor 302.
Although the present invention has been described in relation to particular embodiments thereof, many other variations and modifications and other uses will become apparent to those skilled in the art. It is preferred, therefore, that the present invention not be limited by the specific disclosure herein.
This application claims priority from U.S. Provisional Patent Application Ser. No. 60/672,965, filed Apr. 20, 2005, entitled SYSTEM AND METHOD TO FACILITATE TIME CODE CROSS REFERENCING BETWEEN FILM AND DIGITALLY ORIGINATED IMAGES, WHICH WERE CAPTURED SIMULTANEOUSLY THROUGH THE SAME LENS, the entire disclosure of which is hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
60672965 | Apr 2005 | US |