Patent Application
20170127138
This invention is related to the field of broadcast television in all its forms. This includes but is not limited to over-the-air broadcast, cable TV, and satellite TV. The primary focus is the broadcast paradigm, whereby programs are scheduled by the broadcaster and broadcast in real-time whereupon viewers may tune in to the program. This invention relates in particular to a device which allows users much greater flexibility in their reception and use of this programming.
VCRs are one example of an earlier technology that relates to the use of broadcast programs. Using VCRs, viewers were able to record a program and play it back at their leisure, perhaps at another time. Additionally, for the first time viewers were offered limited control over the viewing. The user could pause, rewind, fast-forward and stop and re-start viewing at any time after the initial recording was complete. The broadcast program was essentially captured in an analog medium for later use.
Some of the limitations of a VCR which the present invention addresses are: simultaneous record and playback from the same medium are not available; the device records only one, or at the most two, channels at a time; and a removable medium, namely magnetic tape, is required.
This invention relates in a similar fashion to the broadcast television industry but offers new and unique features not found in VCRs or any other video/audio-programming-based device,
The objects of the present invention include, but are not limited to the following.
It is one object of the invention to facilitate recording of a program and allow viewing of the already-recorded material to take place while the program recording continues.
It is another object of the invention to allow this simultaneous record/playback to take place on one or more channels simultaneously.
It is another object of the invention to record using digital storage in many forms, using either internal or external mediums.
It is another object of this invention to provide a ‘save’ function which incorporates semi-permanent digital storage of the recorded program as a function distinct from the simultaneous recording and playback of the program.
It is another object of the invention to allow complete VCR-like control during playback.
It is another object of this invention to allow the ‘save’ function to save edited versions of the program as defined by the playback commands used during viewing.
With the advent of digital video components, it is now possible to digitize, compress and store entire video programs using a variety of digital storage devices such as disk, digital tape, RAM, CD-ROM, DVD (Digital Versatile Disk or Digital Video Disk) and others.
In the present invention, the system may be connected to a conventional video source such as broadcast TV, cable TV, satellite TV, VCR and so forth. In most cases, the video signal is in a standard RF-modulated analog format such as NTSC, PAL or SECAM. In the case of a modulated video source such as broadcast TV or cable TV, the signal is first demodulated to tune to a specific channel. This is performed by a conventional tuner such as those found in VCRs and TVs. The tuner may be used to tune into one or more channels simultaneously and more than one tuner may be included in the system. Digital inputs are also provided and will be described shortly.
In the case of an incoming analog video signal, the signal is then digitized and optionally compressed using a conventional video capture board or video capture chip sets integrated into the system. This capture hardware accepts a video input, digitizes the video/audio program, optionally compresses the quantity of digital data and outputs a digital data stream which can be stored using any digital storage media.
In variations of the preferred embodiment, the incoming video signal may already be in a digital format and thus not require digitization (such as a High-Definition Television (HDTV), Direct Broadcast Satellite (DBS) signal, or Internet-based broadcasts). Further, the source digital signal or the digitized analog signal may or may not be compressed. The compression method used may vary and is of little consequence to the present invention, which can use uncompressed digital data or compressed data. However, the current common compressed digital formats include MPEG and AVI formats. For the present invention, the selection of the video capture board or chip sets (and the compressed digital format it uses) is relevant only to the quality of the video playback and the corresponding amount of digital storage required.
It is envisioned that the embodiments will vary depending on the desired quality and cost constraints for the storage media. In a relatively inexpensive consumer device, for example, a cost-efficient MEPG-1 and inexpensive four-Gigabyte hard drive might currently be used. On the other hand, a professional application might currently use MPEG-2 and RAM for very high quality along with very fast access.
An important consideration regarding the selection of the video capture board and the storage media is that the data rate for writing to the digital storage must exceed the output rate of the video capture hardware. For example, if MPEG-1 is the selected compression method and the output rate of the capture/compression hardware is therefore 15 Mbits/second, then the sustained data rate for writing to digital storage must be greater than 15 Mbits/second or else data will be lost. Also, compression/decompression may take place via software algorithms implemented by the system's main CPU or in dedicated compression/decompression processors. Cable converter boxes, commonly known as “set-top” boxes provide decoding of compressed digital video streams. In such a case one embodiment of the present invention includes a provision for using the set-top box for providing the compression/decompression for the system.
A key aspect of the present invention is its use of FIFO dual-port storage. Digital storage systems are most commonly used in an off-line mode, that is, data is written and the data is read at some later time. For example, in a video compression and playback system, the compressed digital data would likely be written to disk during recording and, after the recording process has been completed, the data could be read for playback. In this sense, storage is used as an archive—even if the archive will be used moments later, the process of storing all the data must be completed before the data is used.
In contrast, the present invention is designed to be dual-ported, that is, to be accessed for writing and reading simultaneously on the same media. In this manner, at any time after the process of capturing, optionally compressing and storage has begun, the program is also accessible for reading, decompression, playback and other functions. This can also occur while the recording process is continuing to store data using a separate and distinct section of the same storage medium.
Additionally, the storage medium in the system is designed as a FIFO, which is a commonly understood acronym in the art which stands for First In First Out. FIFO storage is essentially used as a circular buffer. The first data written into this circular buffer is the first data which is overwritten. For brevity, the terms ‘buffer storage’ or ‘buffer’ may be used herein, but the term always refers to this dual-port circular buffer storage unless otherwise noted.
In an example of the preferred embodiment, the use of this buffer storage is also taken a step further. In this embodiment, once the storage medium has been filled, the oldest data, which is the first data to have entered the FIFO, is pushed out—it is overwritten with the new data. In this manner, the buffer storage is constantly filled with the latest recorded material. The total amount of storage in the buffer determines the extents of VCR-like control for rewind and fast-forward. Alternatively, only a designated amount of the total storage may be used for recording, leaving storage available for other features of the system. In any case, this FIFO dual-port storage will be referred to herein as buffer storage. Buffer storage is always the storage used to provide direct access for the viewer to control playback of the recorded material.
In the example of the preferred embodiment, consider the scenario for 30 minutes of buffer storage and the viewer wishing to begin viewing of a two-hour program fifteen minutes after the scheduled broadcast start time of 8:00 p.m. At 8:00 p.m. the system begins recording the broadcast program. This may occur due to a timer previously set by the user or it may occur because the system is set to continuously record. Furthermore, the system may have been recording continuously for some time. However, in order to illustrate the nature of the dual-port circular buffer, in the present example we consider the case where the present invention has just been turned on and the buffer has been initially empty.
Recording of the broadcast program begins at 8:00 p.m. At 8:15 p.m. the user begins viewing the 8:00 p.m. material. Simultaneously, the present invention continues to record the currently-broadcast 8:15 material. At 8:30 the buffer storage is completely filled. Consequently, the oldest material, namely 8:00, is overwritten with the current 8:30 material. This process continues indefinitely, and effectively, the viewer has time-shifted their viewing by 15 minutes in the present example. The user may time-shift up to the maximum buffer storage size configured in the system, which in the present example would be 30 minutes.
Because of the aforementioned 15-minute time-shift the viewer may now exercise VCR-like control features on the already-recorded material. So in the present example, the viewer could fast-forward past commercials or any objectionable material. Pause, stop and rewind features are also available, enabling the viewer to re-watch a segment or to pause the playback for a phone call or other interruption.
If the viewer were to fast-forward through the full buffer of recorded material, they would be caught up to the live broadcast. When this occurs, the present invention may switch directly to the live feed without processing the input video through the usual capture and compression. In a further embodiment, even the input video stream (which is the ‘live’ feed) may be processed through capture and compression if so desired. Note that in such a scenario only pause and rewind features would be available because no material is available in the buffer for fast-forwarding.
In one use of the present invention, the user may be watching video playback at the same rate at which new data is being recorded. Assuming that in the time between initiating recording and playback, the buffer storage has not already been filled up, it will in fact never get filled up because data is being removed at the same rate at which it is being added.
However, in another scenario, the user may not watch video playback at all during the recording process. In one embodiment of the present invention, the buffer storage is simply allowed to fill up and the recording process stops. In such an embodiment, it is the user's responsibility to recognize the limited amount of buffer storage in the system and use the system accordingly.
Consider the embodiment Whereby the system is designed to store two hours of video from one or more channels and is not set to overwrite any recorded data. In such a case, the recording process acts much like a conventional VCR—two hours of programming are recorded and when the storage media is filled, recording stops. However, the present invention, even in this particular embodiment has several unique advantages over a VCR. Programming viewing and control, by virtue of the digital data, is entirely random-access. The user may almost instantaneously skip to any desired portion of the program. Furthermore, even though the recording process stopped when storage was filled, once playback begins, the user may record new material while viewing the two hours of previously recorded material.
The aforementioned features in essence return control of viewing to the viewer, who is no longer forced to view objectionable broadcast material or to adhere strictly to the broadcast schedules. Complete control is returned to the viewer, especially for real-time broadcasts. To achieve this control, the viewer need only slightly delay their viewing from the normally-scheduled broadcast start time. Once the present invention's FIFO dual-port storage has recorded some portion of the programming, the viewer has complete VCR-like control over the slightly-delayed but real-time broadcast, without having to wait for the entire program to be recorded.
To complete the paradigm shift into viewer-controlled broadcast television viewing, one embodiment of the present invention performs all of the aforementioned functions simultaneously on many channels In this manner, the viewer may literally scan through, watch, or store one or more of the channels, with all of the aforementioned features. In such an embodiment, multiple video capture compression/decompression cards would be required, or cards that are designed to accommodate more than one video input stream.
Multiple input streams may be realized through multiple tuners with multiple output streams to one or more storage devices or through a single tuner with multiple output streams to one or more storage devices. The total aggregate bandwidth of data to be stored might also require faster storage media. Certainly RAM-based systems could handle such bandwidths and write speeds.
In a disk-based embodiment, high-speed disk drives such as RAID drives can accommodate the higher bandwidths. The total required bandwidth in any embodiment is determined by the output data rate of each video capture/compression card, chipset or software data stream. By varying the quality of the video, the compression method or the video resolution, the bandwidth may be adjusted to suit the application.
In some cases, these and other parameters of the video capture/compression hardware or software are adjustable, thus allowing the output data rate to be adjusted. In other cases, this adjustment is made merely by the selection of the desired compression/decompression hardware or software versus another. En one embodiment this configurability is tied directly to the content provider. For example, certain movies may include a command which is recognized by the present invention and is used to set (at the user's discretion) the compression/decompression quality to a higher-than-usual level.
Another feature of the present invention is its ability to off-load the buffer storage onto other more permanent media for either internal or external archival. For example, a RAM-only embodiment may also be configured with one or more other digital storage devices, such as hard-disk or recordable DVD. At any time, even automatically during recording and/or playback, the contents of the buffer storage may be selectively or continuously transferred or duplicated to these archive storage devices in order to retain a copy of the program.
In some embodiments, the viewer will transfer the program to removable media such as DVD disc in order for it to be used in another device, including another of the present invention. In this manner, viewers can build a ‘library’ of recorded material much like is currently accomplished with conventional VCRs. Such archival may occur at any time, including before, during or after the viewing of the stored material. In one embodiment, archival occurs as a user-selected transfer from the main storage to archival storage. In another embodiment programming is continuously recorded on the larger archival storage in addition to the main storage.
The present invention, however, offers several additional advantages over the traditional analog-tape VCR library. First, due to the digital nature of the data, many different embodiments are envisioned utilizing different types of digital storage media. In some embodiments, multiple types of storage media may be used, offering different levels of off-line or on-line storage and allowing the user to account for the various cost and physical considerations of the stored media type. Archival storage may be implemented as distinct devices separate from the buffer storage or as an allocation of one large storage device, with one portion designated and used as buffer storage and another as archival storage.
Another unique feature of the storage characteristics of the present invention is that the aforementioned archival functions may be initiated at any time including after the program has been viewed in its entirety from the buffer storage. For example, in a RAM-based embodiment, the user may elect to transfer the entire contents of the program from RAM to hard disk, while playback and recording continue, or the user may also elect to transfer after viewing from RAM is complete. The only caveat in this process is that the user must consider the overwriting, circular buffer nature of the buffer storage and that the oldest material is overwritten when the allocated amount of storage becomes full. For this reason, this overwriting feature as well as all features of the system may be user-configurable. Other examples of archival storage mediums, both internal and external, include but are not limited to: hard disk, removable hard disk, tape, optical disk, DVD or any other digital storage medium.
Another unique feature of the storage characteristics of the present invention is that the aforementioned archival functions may include interpretation of the playback control as edit events, thus modifying the copy of the program which is to be archived. For example, a user may record a TV movie, fast-forwarding past each commercial. Upon storing the viewed program, the user may elect to interpret the fast-forwarding or similar control in several ways.
First, it may be taken literally, with the archived program including a control code for ‘fast-forward.’ Upon playback, this control could be interpreted and executed by the playback control software, thereby resulting in the playback of the program exactly as the viewer watched it, fast-forwards and all. A second manner of interpreting the fast-forward could be as an edit point, the implication being that since the user fast-forwarded past a portion of the program they did not want to view it and therefore that portion of the program need not be archived at all. In such a mode, upon playback the video would seamlessly skip past the fast-forwarded portion of the program since it was not recorded in the archive at all. And in a third manner of interpreting the fast-forward or other playback controls, these controls may not be recorded in archive at all, i.e. they may be ignored, implying that the user desires to have brand-new control over the video at playback time.
A further feature of the present invention is that all of the aforementioned VCR-like control features may be stored as data representing the viewer control. In other words, all of the viewer control such as fast-forward, play and pause are captured as data. This viewer control data may be used in a number of ways, including storage along with the archived program as described previously.
In another embodiment of the present invention, a modem is provided for communication to other similar devices or to computers via network communication channels, such as phone lines, cable modems, and satellite. In such an embodiment, at the election of the viewer, the viewer control data may be provided to a central computer for storage. The data may later be analyzed by advertisers, broadcasters, ratings companies and so forth to receive indirect feedback from viewers regarding viewing preferences. This same communication channel may be used to transmit software upgrades to the invention, remote diagnostics, billing data or pay-per-view locking/unlocking by the content provider. In another embodiment, the modem may be replaced by a faster communications device such as a satellite receiver, Internet connection or so forth.
The aforementioned network communication channels are also used in another unique way. Since these channels provide a link to other computers, possibly on the Internet, this connection may be used to automatically set the configuration of the system from these computers. For example, in an embodiment connected to the Internet, the system also includes basic computer components sufficient to interact with the World-Wide Web.
Besides the network communications channel the system also includes a video graphics card and one or more user-interface devices which may include but are not limited to: a mouse, touchpad, keyboard, trackball, remote control or voice control. With this Web-based connection, content providers or third parties may link Web pages to interact with the present invention. For example, a third party may offer pay-per-view programs, wherein the program may be ordered via the Web, and data provided via the Web so the present invention can set parameters such as record timers, video quality settings, channel tuning and so forth. The Web site may provide additional data about the offered program to aid the users in selecting programs, such as plot summaries, ratings, casts and so forth.
Many of the aforementioned features may be implemented in various modes and in some cases selectable by the user to be automatic. For example, “continuous recording” may be a mode, whereby the preferred embodiment continuously records on one or more programming channels, overwriting the oldest data as previously described. But this mode is selectable for there might be situations where this is not desirable, such as setting a timer on the present invention to record a program at a specific time. Should the user arrive home much later than expected, the recorded program is still available, instead of being recorded over by the latest program.
And as another example, the aforementioned editing capabilities are configurable by the user, such as the “archive as edited” mode, in which control functions dictate an edited form of the program for archival. These functions and configurable options are all controlled through anyone of several user-interface methods. In one embodiment, a remote control and on-screen menus are used. In another embodiment, buttons on the device are used, also in conjunction with on-screen menus. These and other user-interfaces are implemented alone or in combination, thus providing access to all of the unique features described herein.
In the example of
As depicted for buffer storage 110, within this buffer the user has complete VCR-like control such as rewind and fast-forward. So the viewer may begin playback of the 8:00 material and immediately has the capability to fast-forward up to the contents of the current buffer which in the illustrative example is 8:15. Archive storage 120 maintains an archived copy of all the recorded material.
For playback, storage output connection 350 transfers data from storage device 380 to decompression/playback hardware 360. During playback, via video out connection 310, the program is transferred to a standard video device (not shown) such as a TV, monitor or VCR. Recording direction arrow 370 is included to conceptually illustrate the use of storage 380 as a circular buffer as explained previously.
Content provider 420 comprises, without limitation, over-the-air television broadcasters, cable TV operators, satellite-feed providers and direct broadcast satellite (DBS), broadcasters. In some cases, the program material as made accessible to the user via set-top box 410 instead of directly from content provider 420. Set-top box 410 may be a common cable converter box or a digital video and user-interface box as used in upcoming cable and satellite services. The video format provided by both set-top box 410 and content provider 420 is most often a standard analog video signal and is routed to capture/display hardware 500.
However, in some cases a digital video signals is provided and therefore the capture (analog-to-digital conversion) ordinarily provided by capture/display hardware 500 is not needed. Capture input switch 560 is provided for such a circumstance and the input digital video is routed directly to compressor/decompressor 480. This switching may be automatic by the system, automatically controlled by the content provider or set-top box or it may be user-selectable.
In the case of an analog video input signal, the program must first be converted to a digital format. Capture/display hardware 500 is a video capture and playback card. Alternatively, this may be implemented in a chipset form and integrated onto the main circuit board of the system. Capture/display boards are well-known in tile art. Current examples include hardware MPEG capture/compression boards commonly used in computer systems. Such boards often integrate the compression element of the present invention, compressor/decompressor 480, into the same board for a full capture, compression, decompression and playback functionality. Such components may be used in the present invention to implement both capture/display hardware 500 and compressor/decompressor 480. Alternatively, separate boards may be used. However, any of the capture, compression, decompression and display elements may be incorporated directly onto the main circuit board of the invention.
The capture and compression of the incoming video program, or the automatic or user-selectable switching out of the capture element, are all managed under control of CPU 530 which is a conventional microprocessor. Software running on CPU 530 manages the capture, compression and storage of the program. In doing so, it controls system bus 510, to which all major components are connected. In this manner, CPU 530 controls the 110 controller, which in turn is used to operate storage 580 and removable storage 590.
Storage 580 may be implemented by one or more digital storage devices for buffer storage and/or archive storage as discussed previously. System RAM 560 is used as needed by the system for software execution and temporary data storage. The software controlling capture/display 500 and compressor/decompressor 480 may use this as buffer memory. In another embodiment, compressor/decompressor 480 may be eliminated entirely, with CPU 530 performing the compression/decompression operations in software, in which case compressor/decompressor 480 uses system RAM 560 as buffer memory for such operations. In a similar embodiment, compressor/decompressor 480 may be eliminated with set-top box 410 performing compression/decompression. In yet another embodiment, compressor/decompressor 480 and capture/display 500 may both be eliminated, with all of these functions being performed by set-top box 410.
Storage 580 is implemented as any type of digital storage media. This includes, without limitation, internal or external versions of hard disk, optical disk, DVD, magnetic tape and semi-conductor storage. Similar storage solutions may be implemented for removable media 590. Although only one storage device is depicted, more than one may be used.
Network interface 550 connects the device through network connection 520 to telecommunications cloud 490. Telecommunications “cloud” is a term commonly used to denote myriad inter-connected telecommunications connection types and interfaces. It is essentially a superset of the Internet and may include networked computers, telephone lines, and other telephone company equipment such as satellite, microwave and so forth. The portion of telecommunications cloud 490 to which the present invention is connected determines the type of network connection 520 and network interface 550.
For example, in a home-based embodiment, network interface 550 is likely to be a modem and telecommunications connection would be a telephone line. Other examples include, without limitation, cable modems and cable networks, computer networks such as Ethernet and their associated interfaces, and satellite modems. The present invention is operatively connected through telecommunications cloud 490 to workstation 595.
Workstation 595 is any type of computer used by advertisers, broadcasters, ratings companies and so forth to receive indirect feedback from viewers regarding viewing preferences. Data about the user's viewing habits and use of the invention may, at the user's option, be transmitted via network interface 550 through the aforementioned operative link to workstation 595.
Many options are available for implementing the simultaneous read and write of storage 580. Commonly-available hard disks may be used, depending on the data rate of the compressed data stream of the capture/compression hardware. For example, if MPEG-1 video is used, one stream requires a data rate of 1.5 Mbits/sec. Therefore, to simultaneously read and write, storage 580 must be capable of sufficient throughput for one write stream and one read stream, totaling 3.0 Mbits/sec. Such input/output speeds are well within the realm of current hard drives, which can sustain data rates of over 10 Mbits/sec.
Other embodiments can use other solutions for storage 580. For example, some embodiments will record many channels simultaneously and may even play back more than one channel simultaneously to provide a ‘picture-in-picture’ feature similar to current televisions. The total required bandwidth may exceed the sustained data rates for conventional disk drives. In such a case RAID (Redundant Array of Inexpensive Disks) systems may be used. These systems are disk array subsystems which use several disk drives in parallel to achieve faster overall throughput. Similarly, the present invention may simply incorporate individual drives for each tuned channel RAM and other high-bandwidth storage solutions may be also be used.
The ultimate use of the recorded data is in the playback. As the user views programming through all the aforementioned features, the data is read from storage 580 or from removable media 590. This compressed data is routed to compressor/decompressor 480 for decompression under control of CPU 530.
In some embodiments, the data may be in an uncompressed form and compressor/decompressor 480 may be bypassed. Once the data is uncompressed, it may be muted directly to monitor 440 for viewing on a digital monitor such as those used by computer systems. Set-top box 410 and/or television. 430 may also be capable of accepting digital data in either a compressed or uncompressed form and consequently data may be routed there directly.
In the preferred embodiment, the uncompressed digital data is routed to capture/display 500 for conversion to an NTSC, PAL, SECAM or other standard video signal for viewing on one or more of the display devices, TV 430, monitor 440 or VCR. 450.
This application is a continuation of U.S. patent application Ser. No. 15/083,280, filed Mar. 28, 2016, which is a continuation of U.S. patent application Ser. No. 13/766,388, filed Feb. 13, 2013, which is a continuation of U.S. patent application Ser. No. 11/833,891, filed Aug. 3, 2007, which is a divisional of U.S. patent application Ser. No. 09/073,452, filed May 6, 1998, the entire contents of the foregoing are hereby incorporated by reference as if fully set forth herein, under 35 U.S.C. §119(e). The applicant(s) hereby rescind any disclaimer of claim scope in the parent application(s) or the prosecution history thereof and advise the USPTO that the claims in this application may be broader than any claim in the parent application(s).
| Number | Date | Country | |
|---|---|---|---|
| Parent | 09073452 | May 1998 | US |
| Child | 11833891 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15083280 | Mar 2016 | US |
| Child | 15291057 | US | |
| Parent | 13766388 | Feb 2013 | US |
| Child | 15083280 | US | |
| Parent | 11833891 | Aug 2007 | US |
| Child | 13766388 | US |
