Patent Grant
8854539
NOT APPLICABLE
NOT APPLICABLE
The present invention is directed to processing video and audio information. More particularly, the invention provides a method and system for converting video information in an incoming format into an outgoing format, which is one of a plurality of formats using computer software and then writing the video information on a disk medium. But it would be recognized that the invention has a much broader range of applicability. For example, the invention can be applied to a variety of formats and information including audio information for a variety of applications such as fixed files, streaming video, captured streaming video and/or audio, any combination of these, and the like.
From a long time ago, people have been capturing visual images of moving or animated objects for storage and playback. Images were first captured as still on photographic papers, which were organized in stacks and flipped back to illustrate animation. Although somewhat successful, such images could not imitate a continuous and fluid motion of a moving picture. Later on, images were captured on photosensitive films, which were formed on thin plastic rolls. Such rolls were developed, and then played back using a projector, which included a light source that projected images from such roll through a lens onto a display screen. The projector mechanically scrolled through the roll to output images from the roll of film onto the screen to create a moving picture. The roll of film could be stored and later played back at anytime.
Other ways of distributing moving pictures include television. Television broadcasts moving pictures through one of a plurality of channels, which can be selected. Television has been broadcast through wireless ways, as well as hard cables. Moving pictures can also be broadcast or uni-cast from one location to another through a world wide network of computers, commonly called the Internet. Here, the Internet is a world wide “super-network” which connects together millions of individual computer networks and computers. The Internet is generally not a single entity. It is an extremely diffuse and complex system over where no single entity has complete authority or control. Although the Internet is widely know for one of its ways of presenting information through the World Wide Web (herein “Web”), there are many other services currently available based upon the general Internet protocols and infrastructure.
Video can also be transferred and output through the Internet. A company called RealNetworks, Inc. is a provider of media delivery and digital distribution solutions designed for the Internet. RealNetworks, Inc. has provided a way for video streaming media that enable the delivery and playback of multimedia content using a media player. Unfortunately, such media player is often large in size and difficult to download effectively. It often takes minutes to download such media player over a conventional modem device. Complex instructions also accompany the download and later installation of such media player, which makes the media player difficult to use for most Internet users. Accordingly, streaming media has had some success but still lacks wide spread utilization on the Internet. Other video players have also been used. Such video players include, among others, one manufactured and distributed by Microsoft Corporation of Redmond Wash. Others include Quicktime™ by Apple Computers, Inc. Such video players can often output certain video in a proprietary format. Alternative ways of distributing moving pictures includes the use of video tapes, disks (e.g., DVD, CD-ROM), and the like.
Unfortunately, many different types of sources for video now exist. Such sources include video files, captured video, analog video, streaming video, and others. Many different types of video outputs also exist. Such video output types include DVD, VCD, SuperVCD, and others. Accordingly, compatibility problems have plagued conventional video and video/audio technologies. Additionally, difficulties arise in editing video in a first format to a second format since tools have been limited and often require a great deal of technical skill to use such tools, which are cumbersome.
Specifically, conventional techniques have used more than one application to edit and convert video information. Here, multiple software applications are often needed to perform the editing and conversion process. Such applications are often complex and cannot be easily performed without a high degree of skill. Additionally, many of these applications are incompatible with each other further causing difficulty in the editing and converting process. Conventional techniques also take up a large amount of memory (e.g., disk space) and are extremely time consuming. Many other limitations with regard to conventional techniques can be found throughout the present specification and more particularly below.
From the above, it is seen that an improved technique for processing video information is desired.
According to the present invention, techniques for processing video and audio information are included. More particularly, the invention provides a method and system for converting video information in an incoming format into an outgoing format, which is one of a plurality of formats using computer software and then writing the video information on a disk medium. But it would be recognized that the invention has a much broader range of applicability. For example, the invention can be applied to a variety of formats and information including audio information for a variety of applications such as fixed files, streaming video, captured streaming video and/or audio, any combination of these, and the like.
In a specific embodiment, the invention provides a method for converting video information (e.g., captured, streaming, file) from an incoming format to an outgoing format using a single pass conversion process (e.g. continuous) free from one or more intermediary files. The method includes inputting video information in a first format, e.g., captured, streaming, multimedia files. The method directly converts the video information in the first format to raw video information in an uncompressed format, e.g., RGB, YUV. The method inputs a desired output media format based upon a first input and inputs a desired TV standard (check on this) based upon a second input. Preferably, the first and second inputs are user inputs from a user interface. The method directly resizes the raw video information in the uncompressed format into a size associated with the desired output media format and the desired TV standard and also adjusts the uncompressed format in the size associated with the desired output media format and the desired TV standard to a frame rate associated with the desired TV standard. A step of directly processing the uncompressed format in the size and the frame rate into an elementary video stream is included. The method processes (e.g., multiplexes) the elementary video stream with audio information in the desired output media format and the desired TV standard to form video and audio information in a presentation format based upon the desired output media format and the desired TV standard.
In an alternative specific embodiment, the invention provides a system for converting video information from an incoming format to an outgoing format using an integrated computer software application. The integrated computer software application is provided on one or more memories, e.g., hard disk, Read Only Memory, Random Access Memory. A code is directed to receiving video information in a first format. A code is directed to receiving a desired output media format based upon a first input. A code is directed to receiving a desired TV standard based upon a second input. The software application also has a code directed to converting the video information in the first format to raw video information an uncompressed format using a decoding process and a code directed to resizing the raw video information in the uncompressed format into a size associated with the desired output media format and the desired TV standard. The application has a code directed to adjusting the uncompressed format in the size associated with the desired output media format and the desired TV standard to a frame rate associated with the desired TV standard and a code directed to processing the uncompressed format in the size and the frame rate into an elementary video stream. A code is also directed to processing the elementary video stream with audio information in the desired output media format and the desired TV standard to form video and audio information in a presentation format based upon the desired output media format and the desired TV standard. Depending upon the embodiment, there can also be one or more other computer codes for carrying out the functionality described at least throughout the present specification.
In a further alternative embodiment, the invention provides a method for converting video information from an incoming format to an outgoing format using a process free from one or more intermediary files. The method includes receiving video information in a first format and receiving a desired output media format based upon a first input and a desired TV standard based upon a second input. The method decodes the video information in the first format to raw video information in an uncompressed format and directly resizes the raw video information in the uncompressed format into a size associated with the desired output media format and the desired TV standard. The method adjusts the uncompressed format in the size associated with the desired output media format and the desired TV standard to a frame rate associated with the desired TV standard and encodes the uncompressed format in the size and the frame rate into an elementary video stream. A step of multiplexing the elementary video stream with audio information in the desired output media format and the desired TV standard to form video and audio information in a presentation format based upon the desired output media format and the desired TV standard is included.
Many benefits are achieved by way of the present invention over conventional techniques. For example, the present technique provides an easy to use process that relies upon conventional technology. The invention provides an integrated software application, which can be installed on a conventional personal computer or the like. In other embodiments, the invention allows a user to take any video information in any format and convert such video information into an outgoing format for writing onto a disk media, e.g., CD, DVD. Additionally, the invention is easy to use and efficiently processes video and/or audio information in a faster and more efficient way as compared to conventional video/audio editing and conversion applications. Depending upon the embodiment, one or more of these benefits may be achieved. These and other benefits will be described in more throughout the present specification and more particularly below.
Various additional objects, features and advantages of the present invention can be more fully appreciated with reference to the detailed description and accompanying drawings that follow.
According to the present invention, techniques for processing video and audio information are included. More particularly, the invention provides a method and system for converting video information in an incoming format into an outgoing format, which is one of a plurality of formats using computer software and then writing the video information on a disk medium. But it would be recognized that the invention has a much broader range of applicability. For example, the invention can be applied to a variety of formats and information including audio information for a variety of applications such as fixed files, streaming video, captured streaming video and/or audio, any combination of these, and the like.
Next, the convention method performs an encoding process, step 107. The encoding process often includes use of conventional tools such as software or hardware encoder and others. The encoding process converts the file with desired size and frame rate to a selected output format, such as MPEG or others. After encoding, the method outputs an elementary video stream 109, which is also in an intermediary file. Such file is often stored.
The conventional method then adds audio information to the elementary video stream in a multiplexing process, step 111. The audio information is in a format such as PCM, MPEG-1, or Dolby Digital formats. Often times, the method uses conventional tools such as disc authoring software to perform the multiplexing process. The conventional method outputs a video/audio file 113 having a desired format. Such file is often stored. The method ends at stop, step 115. As show, the conventional method has many limitations. Depending upon the particular embodiment of the present invention, one or more of these limitations has been overcome by way of the present method and system described throughout the present specification and more particularly below.
A method according to an embodiment of the present invention is provided as follows:
As shown, the method performs a sequence of steps to convert video information into a desired format without any intermediary files of conventional techniques. Preferably, the video information can be in almost any format or any format. The output video information can also be in any desired format, depending upon the embodiment. These and other features of the present method can be found throughout the specification and more particularly according to the figures below.
A method according to an alternative embodiment of the present invention is provided as follows:
As shown, the method performs a sequence of steps to convert video information into a desired format without any intermediary files of conventional techniques. Preferably, the video information can be in almost any format or any format. The output video information can also be in any desired format, depending upon the embodiment. More preferably, the user selects the desired output format and TV standard using a user interface, e.g., graphical user interface. These and other features of the present method can be found throughout the specification and more particularly according to the figures below.
The method transfers the raw video raw video without any intermediary files to a resizing and framing process or processes, step 205. Here, the method directly resizes the raw video information in the uncompressed format into a size associated with the desired output media format and the desired TV standard. The method also directly adjusts the uncompressed format in the size associated with the desired output media format and the desired TV standard to a frame rate associated with the desired TV standard. The method processes the uncompressed format in the size and the frame rate into an elementary video stream. The method also processes the audio information (step 207) into a desired output format. Preferably, the method uses one or more encoding processes. The encoding process can form a desired output such as DVD, VCD, and others.
Next, the method transfers the video and audio information in desired formats without any intermediary files in preferred embodiments. The method forms the desired audio/video output (step 209) using at least a multiplexing process, which combines audio and video information together. The method stops at step 211. Preferably, the method inputs (step 215) video format information based upon a plurality of different formats into the processing step 205 to form the desired output video. Such video format information is preferably provided by way of user interface but can also be others. Additionally, the method inputs (step 213) audio format information based upon a plurality of different formats into the processing step 207 to form the desired output audio. Such audio format information is preferably provided by way of user interface but can also be others. Of course, one of ordinary skill in the art would recognize many other ways of inputting the format information for audio and video.
Although the above has been described in terms of a specific sequence of steps in one or more processes, it would be recognized that there could be many alternatives, variations, and modifications. For example, any of the above elements can be further separated or combined with each other or other elements. Preferably, the functionality of the above elements is carried out using computer software. Alternatively, some of the elements can be implemented in software or implemented in computer code in a combination of hardware and software. Alternatively, the above elements can be further integrated in computer code in hardware or software or implemented in computer code in hardware and software or the like. Depending upon the embodiment, further details of these steps are provided below according to the figures.
In an alternative embodiment, the method includes providing captured video 321 and captured audio information 323. The captured video can be captured from any video capturing device. The video capturing device can include, among others, a video capture card connected to the bus of the computer, a USB video capture device. The video capturing device receives the video information from any analog video source, for example, a camcorder, a VCR, TV antenna, or others. The video capturing device digitizes the analog video information in a uncompressed raw video format. The audio capturing is provided using an audio capture device. The audio capture device can include, among others, a audio capture card connected to the bus of the computer, a USB audio capture device. The audio capturing device receives audio information from any audio source, for example, a camcorder, a VCR, TV antenna, microphone, or others. The audio capturing device digitizes the analog audio information in a uncompressed audio format. As merely an example, the captured video can be from a camera such as those manufactured by Sony, Panasonic, and others, as illustrated by reference numerals 322 and 324, respectively, for video and audio.
The method processes (step 325) the captured video information and also processes (step 327) the captured audio information. Preferably, the captured video information is processed by way of decoding to an elementary or raw video form 329 (e.g., uncompressed). The raw video form can include RGB, YUV, and others. The captured audio information is also processed by way of decoding to an elementary and/or uncompressed audio format, which includes PCM 331 (e.g., Pulse Code Modulation). The raw video and audio are outputted respectively to the next process steps without any intermediary files in preferred embodiments.
Alternatively, the method captures video information 341 using a digital video (“DV”) capturing device, such as a high speed serial bus commonly called IEEE 1394. The high speed bus can be used to capture both audio and video information. The captured video and audio information processed 343 using the capturing device. The processed information is then processed through a decoding process 345, which yields an uncompressed or elementary or raw video 347 information and audio 349 information. Of course, one of ordinary skill in the art would recognize many other alternatives, variations, and modifications.
As can be seen, the media format can be DVD, VCD, or Super VCD, among others. Depending upon the embodiment, DVD can include sizes of those noted above, and may also include others for NTSC and PAL. In alternative embodiments, VCD can include sizes as noted above for NTSC and PAL. Still further, Super VCD can include sizes as noted above for NTSC and PAL. Preferably, the media format and TV standard are provided by way of user input (step 402). Of course, there may also be other variations, modifications, and alternatives, depending upon the embodiment. Additionally, other types of display sizes can also be used depending upon the embodiment.
The method also adjusts (step 405) a frame rate of the video information. Depending upon the embodiment, NTSC includes a frame rate of 29.97 Vertical Frame Frequency and PAL includes a Vertical Frame Frequency of 25. The frame rate is adjusted in a separate process from the sizing step, which has been described. Alternatively, the frame rate can be adjusted in other ways, depending upon the specific embodiment. Outgoing video information, which has been sized and framed, exits the process, as provided by reference numeral 407.
The method also processes 500 audio information as illustrated in the simplified diagram of
As can be seen, the media format can be DVD, VCD, or Super VCD, among others. Depending upon the embodiment, the DVD format often uses a 48 kHz frequency rate. Alternatively, the VCD format often uses a 44.1 kHz frequency rate. As can be seen, the DVD and VCD uses MPEG 1 layer 2 Audio. Regardless of the final audio format, the audio is first converted to the desired frequency in this step. The adjusted audio is outputted to the next process, step 505. Preferably, the media format is provided by way of user input (step 502). Of course, there may also be other variations, modifications, and alternatives, depending upon the embodiment.
Although the above has been described in terms of a specific sequence of steps in one or more processes, it would be recognized that there could be many alternatives, variations, and modifications. For example, any of the above elements can be further separated or combined with each other or other elements. Preferably, the functionality of the above elements is carried out using computer software. Alternatively, some of the elements can be implemented in software or implemented in computer code in a combination of hardware and software. Alternatively, the above elements can be further integrated in computer code in hardware or software or implemented in computer code in hardware and software or the like. Of course, the particular method will depend highly upon the application.
In an alternative embodiment, a method for adding video editing elements to the present invention can be outlined as follows:
As shown, the method performs a sequence of steps to convert video information into a desired format without any intermediary files of conventional techniques. Preferably, the video information can be in almost any format or any format. The output video information can also be in any desired format, depending upon the embodiment. Preferably, editing features are also included. These and other features of the present method can be found throughout the specification and more particularly according to the figures below.
The method transfers the raw video raw video without any intermediary files to a resizing and framing process or processes, step 703. Here, the method directly resizes the raw video information in the uncompressed format into a size associated with the desired output media format and the desired TV standard. The method also directly adjusts the uncompressed format in the size associated with the desired output media format and the desired TV standard to a frame rate associated with the desired TV standard. The method processes the uncompressed format in the size and the frame rate into an elementary video stream. The method also processes the audio information (step 705) into a desired output format. Preferably, the method uses one or more encoding processes. The encoding process can form a desired output such as DVD, VCD, and others.
Next, the method transfers the video and audio information in desired formats with any intermediary files in preferred embodiments. Preferably, the method includes a video editing process (step 707) to the video information. The editing process can be selected from fade, wipe, scroll, and others. Preferably, the method also includes a audio editing process (step 709) to the audio information. As merely an example, the audio editing process can include mixing with additional audio, fade, and others. The editing process is often input (step 704) by way of user input. The user input is provided through a graphical user interface. One of ordinary skill in the art would recognize many other limitations, variations, and modifications. The method forms the desired audio/video output (step 711) using at least a multiplexing process, which combines audio and video information together. The method stops at step 713. Although the above has been described in terms of a specific sequence of steps in one or more processes, it would be recognized that there could be many alternatives, variations, and modifications. For example, any of the above elements can be further separated or combined with each other or other elements. Preferably, the functionality of the above elements is carried out using computer software. Alternatively, some of the elements can be implemented in software or implemented in computer code in a combination of hardware and software. Alternatively, the above elements can be further integrated in computer code in hardware or software or implemented in computer code in hardware and software or the like. As merely an example, hardware used according to the present invention is provided in more detail below.
Random access memory 870 and fixed disk drive 880 are mere examples of tangible media for storage of computer programs, e-mail messages, audio and/or video data, e-mail client programs, and code implementing embodiments of the present invention. Other types of tangible media include SRAM, floppy disks, optical storage media such as CD-ROMs and bar codes, semiconductor memories such as flash memories, read-only-memories (ROMs), ASICs, battery-backed volatile memories, and the like.
Network interface 840 may be any type of interface to a computer network. For example network interface 840 may be a modem, an Ethernet or fast Ethernet interface, a LocalTalk connection, a satellite or other wireless connection, or the like. As disclosed above, the computer network may be any type of network such as the Internet, an Intranet, an IPX network, private tunnel, local area network (LAN), WAN, and the like.
In a preferred embodiment, computing system 820 includes a '586 class microprocessor running Windows2000™. operating system from Microsoft Corporation of Redmond, Wash. Many other computer systems, such as MacOS™ from Apple Corporation, running upon G3 based microprocessors, or Solaris™ from Sun Microsystems or UNIX running upon a SPARCstation, and the like can also be used. The system above discloses examples of configurations that embody the present invention. It will be readily apparent to one of ordinary skill in the art that many system types, configurations, and combinations of the above devices are suitable for use in light of the present disclosure. Of course, the types of system elements used depend highly upon the application.
Computer software codes to carry out the functionality herein are provided in one or more memories.
It is also understood that the examples and embodiments described herein are for illustrative purposes only and that various modifications or changes in light thereof will be suggested to persons skilled in the art and are to be included within the spirit and purview of this application and scope of the appended claims.
The present application is a continuation of U.S. application Ser. No. 12/907,939, filed on Oct. 19, 2010, which is a continuation of U.S. application Ser. No. 11/342,280, filed on Jan. 27, 2006, which is a continuation of U.S. application Ser. No. 10/202,999, filed on Jul. 23, 2002, the content of which is incorporated herein by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6297851 | Taubman et al. | Oct 2001 | B1 |
| 6370198 | Washino | Apr 2002 | B1 |
| 6781596 | Falk | Aug 2004 | B2 |
| 7009655 | Huang | Mar 2006 | B2 |
| 7062714 | Mo et al. | Jun 2006 | B1 |
| 7283172 | Huang | Oct 2007 | B2 |
| 7362946 | Kowald | Apr 2008 | B1 |
| 7688384 | Davis et al. | Mar 2010 | B2 |
| 7843508 | Huang | Nov 2010 | B2 |
| 20040001159 | Shen et al. | Jan 2004 | A1 |
| 20040257434 | Davis et al. | Dec 2004 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20140043529 A1 | Feb 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12907939 | Oct 2010 | US |
| Child | 14054734 | US | |
| Parent | 11847190 | Aug 2007 | US |
| Child | 12907939 | US | |
| Parent | 11342280 | Jan 2006 | US |
| Child | 11847190 | US | |
| Parent | 10202999 | Jul 2002 | US |
| Child | 11342280 | US |
